Update 'pages/topics/question/README.md'

This commit is contained in:
dano 2021-01-21 15:55:16 +00:00
parent 9c44b6d3b8
commit ff7fa4aeb7

View File

@ -58,33 +58,28 @@ An annotation recipe for Prodigy
Input: A set of paragraphs
Output: A question for each paragraph
Output: 5 questions for each paragraph
Done:
- a data preparation script (Daniel Hládek)
- annotation recipe (Daniel Hládek)
- annotation recipe for Prodigy (Daniel Hládek)
- deployment at [question.tukekemt.xyz](http://question.tukekemt.xyz) (only from tuke) (Daniel Hládek)
- answer annotation together with question (Daniel Hládek)
- prepare final input paragraphs (dataset)
In progress:
- More annotations (volunteers and workers).
- Select the largest articles (to be compatible with squad).
To be done:
- Prepare development set
### Answer Annotation
Input: A set of paragraphs and questions
Output: An answer for each paragraph and question
Done:
- a data preparation script (Daniel Hládek)
- annotation recipe (Daniel Hládek)
- deployment at [answer.tukekemt.xyz](http://answer.tukekemt.xyz) (only from tuke) (Daniel Hládek)
- extract annotations from question annotation in squad format
### Annotation Summary
### Annotation Web Application
Annotation work summary, web applicatiobn
@ -96,8 +91,14 @@ Done:
- application template (Tomáš Kuchárik)
- Dockerfile (Daniel Hládek)
- web application for annotation analysis (Tomáš Kuchárik, Daniel Hládek)
- web application for annotation analysis in Flask (Tomáš Kuchárik, Daniel Hládek)
- application deployment (Daniel Hládek)
- extract annotations from question annotation in squad format (Daniel Hladek)
To be done:
- review of validations
### Annotation Validation
@ -105,14 +106,14 @@ Input: annnotated questions and paragraph
Output: good annotated questions
Done:
In Progress:
- Recipe for validations (binary annotation for paragraphs, question and answers, text fields for correction of question and answer). (Daniel Hládek)
- Deployment
- Design validation recipe (Tomáš Kuchárik)
To be done:
To do:
- Implement and deploy validation recipe (Tomáš Kuchárik)
- Prepare for production
### Annotation Manual
@ -124,6 +125,10 @@ Done:
- Modivation video (Daniel Hládek)
- Video with instructions (Daniel Hládek)
In progress:
- Should be instructions a part of the annotation webn application?
### Question Answering Model
Training the model with annotated data
@ -143,13 +148,7 @@ In progress:
- Preliminary model (Ján Staš and Matej Čarňanský)
### Supporting activities
Output: More annotations
Organizing voluntary student challenges to support the annotation process
TBD
## Existing implementations