forked from KEMT/zpwiki
Update 'pages/topics/question/README.md'
This commit is contained in:
parent
9c44b6d3b8
commit
ff7fa4aeb7
@ -58,33 +58,28 @@ An annotation recipe for Prodigy
|
|||||||
|
|
||||||
Input: A set of paragraphs
|
Input: A set of paragraphs
|
||||||
|
|
||||||
Output: A question for each paragraph
|
Output: 5 questions for each paragraph
|
||||||
|
|
||||||
Done:
|
Done:
|
||||||
|
|
||||||
- a data preparation script (Daniel Hládek)
|
- a data preparation script (Daniel Hládek)
|
||||||
- annotation recipe (Daniel Hládek)
|
- annotation recipe for Prodigy (Daniel Hládek)
|
||||||
- deployment at [question.tukekemt.xyz](http://question.tukekemt.xyz) (only from tuke) (Daniel Hládek)
|
- deployment at [question.tukekemt.xyz](http://question.tukekemt.xyz) (only from tuke) (Daniel Hládek)
|
||||||
- answer annotation together with question (Daniel Hládek)
|
- answer annotation together with question (Daniel Hládek)
|
||||||
- prepare final input paragraphs (dataset)
|
- prepare final input paragraphs (dataset)
|
||||||
|
|
||||||
|
In progress:
|
||||||
|
|
||||||
|
- More annotations (volunteers and workers).
|
||||||
|
- Select the largest articles (to be compatible with squad).
|
||||||
|
|
||||||
|
To be done:
|
||||||
|
|
||||||
|
- Prepare development set
|
||||||
|
|
||||||
|
|
||||||
### Answer Annotation
|
|
||||||
|
|
||||||
Input: A set of paragraphs and questions
|
### Annotation Web Application
|
||||||
|
|
||||||
Output: An answer for each paragraph and question
|
|
||||||
|
|
||||||
Done:
|
|
||||||
|
|
||||||
- a data preparation script (Daniel Hládek)
|
|
||||||
- annotation recipe (Daniel Hládek)
|
|
||||||
- deployment at [answer.tukekemt.xyz](http://answer.tukekemt.xyz) (only from tuke) (Daniel Hládek)
|
|
||||||
- extract annotations from question annotation in squad format
|
|
||||||
|
|
||||||
|
|
||||||
### Annotation Summary
|
|
||||||
|
|
||||||
Annotation work summary, web applicatiobn
|
Annotation work summary, web applicatiobn
|
||||||
|
|
||||||
@ -96,8 +91,14 @@ Done:
|
|||||||
|
|
||||||
- application template (Tomáš Kuchárik)
|
- application template (Tomáš Kuchárik)
|
||||||
- Dockerfile (Daniel Hládek)
|
- Dockerfile (Daniel Hládek)
|
||||||
- web application for annotation analysis (Tomáš Kuchárik, Daniel Hládek)
|
- web application for annotation analysis in Flask (Tomáš Kuchárik, Daniel Hládek)
|
||||||
- application deployment (Daniel Hládek)
|
- application deployment (Daniel Hládek)
|
||||||
|
- extract annotations from question annotation in squad format (Daniel Hladek)
|
||||||
|
|
||||||
|
|
||||||
|
To be done:
|
||||||
|
|
||||||
|
- review of validations
|
||||||
|
|
||||||
### Annotation Validation
|
### Annotation Validation
|
||||||
|
|
||||||
@ -105,14 +106,14 @@ Input: annnotated questions and paragraph
|
|||||||
|
|
||||||
Output: good annotated questions
|
Output: good annotated questions
|
||||||
|
|
||||||
|
Done:
|
||||||
|
|
||||||
In Progress:
|
- Recipe for validations (binary annotation for paragraphs, question and answers, text fields for correction of question and answer). (Daniel Hládek)
|
||||||
|
- Deployment
|
||||||
|
|
||||||
- Design validation recipe (Tomáš Kuchárik)
|
To be done:
|
||||||
|
|
||||||
To do:
|
- Prepare for production
|
||||||
|
|
||||||
- Implement and deploy validation recipe (Tomáš Kuchárik)
|
|
||||||
|
|
||||||
### Annotation Manual
|
### Annotation Manual
|
||||||
|
|
||||||
@ -124,6 +125,10 @@ Done:
|
|||||||
- Modivation video (Daniel Hládek)
|
- Modivation video (Daniel Hládek)
|
||||||
- Video with instructions (Daniel Hládek)
|
- Video with instructions (Daniel Hládek)
|
||||||
|
|
||||||
|
In progress:
|
||||||
|
|
||||||
|
- Should be instructions a part of the annotation webn application?
|
||||||
|
|
||||||
### Question Answering Model
|
### Question Answering Model
|
||||||
|
|
||||||
Training the model with annotated data
|
Training the model with annotated data
|
||||||
@ -143,13 +148,7 @@ In progress:
|
|||||||
|
|
||||||
- Preliminary model (Ján Staš and Matej Čarňanský)
|
- Preliminary model (Ján Staš and Matej Čarňanský)
|
||||||
|
|
||||||
### Supporting activities
|
|
||||||
|
|
||||||
Output: More annotations
|
|
||||||
|
|
||||||
Organizing voluntary student challenges to support the annotation process
|
|
||||||
|
|
||||||
TBD
|
|
||||||
|
|
||||||
## Existing implementations
|
## Existing implementations
|
||||||
|
|
||||||
|
Loading…
Reference in New Issue
Block a user