diff --git a/pages/topics/question/README.md b/pages/topics/question/README.md index ab5005df43..80c5b516cc 100644 --- a/pages/topics/question/README.md +++ b/pages/topics/question/README.md @@ -58,33 +58,28 @@ An annotation recipe for Prodigy Input: A set of paragraphs -Output: A question for each paragraph +Output: 5 questions for each paragraph Done: - a data preparation script (Daniel Hládek) -- annotation recipe (Daniel Hládek) +- annotation recipe for Prodigy (Daniel Hládek) - deployment at [question.tukekemt.xyz](http://question.tukekemt.xyz) (only from tuke) (Daniel Hládek) - answer annotation together with question (Daniel Hládek) - prepare final input paragraphs (dataset) +In progress: + +- More annotations (volunteers and workers). +- Select the largest articles (to be compatible with squad). + +To be done: + +- Prepare development set -### Answer Annotation -Input: A set of paragraphs and questions - -Output: An answer for each paragraph and question - -Done: - -- a data preparation script (Daniel Hládek) -- annotation recipe (Daniel Hládek) -- deployment at [answer.tukekemt.xyz](http://answer.tukekemt.xyz) (only from tuke) (Daniel Hládek) -- extract annotations from question annotation in squad format - - -### Annotation Summary +### Annotation Web Application Annotation work summary, web applicatiobn @@ -96,8 +91,14 @@ Done: - application template (Tomáš Kuchárik) - Dockerfile (Daniel Hládek) -- web application for annotation analysis (Tomáš Kuchárik, Daniel Hládek) +- web application for annotation analysis in Flask (Tomáš Kuchárik, Daniel Hládek) - application deployment (Daniel Hládek) +- extract annotations from question annotation in squad format (Daniel Hladek) + + +To be done: + +- review of validations ### Annotation Validation @@ -105,14 +106,14 @@ Input: annnotated questions and paragraph Output: good annotated questions +Done: -In Progress: +- Recipe for validations (binary annotation for paragraphs, question and answers, text fields for correction of question and answer). (Daniel Hládek) +- Deployment -- Design validation recipe (Tomáš Kuchárik) +To be done: -To do: - -- Implement and deploy validation recipe (Tomáš Kuchárik) +- Prepare for production ### Annotation Manual @@ -124,6 +125,10 @@ Done: - Modivation video (Daniel Hládek) - Video with instructions (Daniel Hládek) +In progress: + +- Should be instructions a part of the annotation webn application? + ### Question Answering Model Training the model with annotated data @@ -143,13 +148,7 @@ In progress: - Preliminary model (Ján Staš and Matej Čarňanský) -### Supporting activities -Output: More annotations - -Organizing voluntary student challenges to support the annotation process - -TBD ## Existing implementations