KEMT/zpwiki
31
1
Fork 9
Code Issues Pull Requests Releases Wiki Activity

Update 'pages/topics/question/README.md'

Browse Source
This commit is contained in:
dano 2021-01-21 15:55:16 +00:00
parent 9c44b6d3b8
commit ff7fa4aeb7
1 changed files with 27 additions and 28 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

55
pages/topics/question/README.md
View File

@ -58,33 +58,28 @@ An annotation recipe for Prodigy
Input: A set of paragraphs Input: A set of paragraphs
Output: A question for each paragraph Output: 5 questions for each paragraph
Done: Done:
- a data preparation script (Daniel Hládek) - a data preparation script (Daniel Hládek)
- annotation recipe (Daniel Hládek) - annotation recipe for Prodigy (Daniel Hládek)
- deployment at [question.tukekemt.xyz](http://question.tukekemt.xyz) (only from tuke) (Daniel Hládek) - deployment at [question.tukekemt.xyz](http://question.tukekemt.xyz) (only from tuke) (Daniel Hládek)
- answer annotation together with question (Daniel Hládek) - answer annotation together with question (Daniel Hládek)
- prepare final input paragraphs (dataset) - prepare final input paragraphs (dataset)
In progress:
- More annotations (volunteers and workers).
- Select the largest articles (to be compatible with squad).
To be done:
- Prepare development set
### Answer Annotation
Input: A set of paragraphs and questions ### Annotation Web Application
Output: An answer for each paragraph and question
Done:
- a data preparation script (Daniel Hládek)
- annotation recipe (Daniel Hládek)
- deployment at [answer.tukekemt.xyz](http://answer.tukekemt.xyz) (only from tuke) (Daniel Hládek)
- extract annotations from question annotation in squad format
### Annotation Summary
Annotation work summary, web applicatiobn Annotation work summary, web applicatiobn
@ -96,8 +91,14 @@ Done:
- application template (Tomáš Kuchárik) - application template (Tomáš Kuchárik)
- Dockerfile (Daniel Hládek) - Dockerfile (Daniel Hládek)
- web application for annotation analysis (Tomáš Kuchárik, Daniel Hládek) - web application for annotation analysis in Flask (Tomáš Kuchárik, Daniel Hládek)
- application deployment (Daniel Hládek) - application deployment (Daniel Hládek)
- extract annotations from question annotation in squad format (Daniel Hladek)
To be done:
- review of validations
### Annotation Validation ### Annotation Validation
@ -105,14 +106,14 @@ Input: annnotated questions and paragraph
Output: good annotated questions Output: good annotated questions
Done:
In Progress: - Recipe for validations (binary annotation for paragraphs, question and answers, text fields for correction of question and answer). (Daniel Hládek)
- Deployment
- Design validation recipe (Tomáš Kuchárik) To be done:
To do: - Prepare for production
- Implement and deploy validation recipe (Tomáš Kuchárik)
### Annotation Manual ### Annotation Manual
@ -124,6 +125,10 @@ Done:
- Modivation video (Daniel Hládek) - Modivation video (Daniel Hládek)
- Video with instructions (Daniel Hládek) - Video with instructions (Daniel Hládek)
In progress:
- Should be instructions a part of the annotation webn application?
### Question Answering Model ### Question Answering Model
Training the model with annotated data Training the model with annotated data
@ -143,13 +148,7 @@ In progress:
- Preliminary model (Ján Staš and Matej Čarňanský) - Preliminary model (Ján Staš and Matej Čarňanský)
### Supporting activities
Output: More annotations
Organizing voluntary student challenges to support the annotation process
TBD
## Existing implementations ## Existing implementations