From e27ca6931e948267321bcddf7c72152f603ebb9e Mon Sep 17 00:00:00 2001 From: Jakub Maruniak Date: Tue, 21 Apr 2020 20:07:16 +0000 Subject: [PATCH] =?UTF-8?q?P=C5=99idat=20=E2=80=9Epages/students/2016/jaku?= =?UTF-8?q?b=5Fmaruniak/dp2021/annotation/README.md=E2=80=9C?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit --- .../jakub_maruniak/dp2021/annotation/README.md | 15 +++++++++++++++ 1 file changed, 15 insertions(+) create mode 100644 pages/students/2016/jakub_maruniak/dp2021/annotation/README.md diff --git a/pages/students/2016/jakub_maruniak/dp2021/annotation/README.md b/pages/students/2016/jakub_maruniak/dp2021/annotation/README.md new file mode 100644 index 000000000..a04fead9a --- /dev/null +++ b/pages/students/2016/jakub_maruniak/dp2021/annotation/README.md @@ -0,0 +1,15 @@ +## Diplomový projekt 1 2020 + +-príprava dát + stiahnutie článkov z wiki pomocou nástroja dataminer, uložené v súbore dataminer.csv + vytvorenie skriptu text_to_sent.py, ktorý rozdelí text na vety a zapíše ich do súboru textfile.csv + +-vytvorenie a spustenie docker kontajneru + > docker build . -t prodigy + > winpty docker run --name prodigy -it -p 8080:8080 -v C://Users/jakub/Desktop/annotation/work prodigy bash + +-spustenie anotačného procesu s návrhmi od modelu + > prodigy ner.correct wikiart sk_sk1 ./textfile.csv --label OSOBA,MIESTO,ORGANIZACIA,PRODUKT + +-anotované dáta možno exportovať vo formáte jsonl potrebnom pre spracovanie vo spacy + > prodigy db-out wikiart > ./annotations.jsonl \ No newline at end of file