From 138250b5c0180531b49deab5188acd210a458203 Mon Sep 17 00:00:00 2001 From: dano Date: Tue, 3 Sep 2024 09:09:25 +0000 Subject: [PATCH] Update pages/interns/oliver_pejic/README.md --- pages/interns/oliver_pejic/README.md | 14 ++++++++++++++ 1 file changed, 14 insertions(+) diff --git a/pages/interns/oliver_pejic/README.md b/pages/interns/oliver_pejic/README.md index 9c7b7040..21685192 100644 --- a/pages/interns/oliver_pejic/README.md +++ b/pages/interns/oliver_pejic/README.md @@ -23,6 +23,20 @@ Final Tasks: - [Machine translate](https://huggingface.co/google/madlad400-3b-mt) an SBERT evaluation set for multiple slavic languages. - Write a short scientific paper with results. +Meeting 3.9: + +State: Studied BEIR framework and transformers. + +Tasks: + +- Prepare and try BEIR evaluation tasks for the database. For evaluation you can try me5-base model. +- Make a fork of BEIR and do necessary modification, including the documentation references for the task. +- Prepare 2 GITHUB pull requests for the databases, preliminary BEIR script given. + +Future tasks: + +- Prepare a machine translation system to create another slovak/multilingual evaluation task from English task. + Preparation (7.8.2024): - Get familiar with [SentenceTransformer](https://sbert.net/) framework, study fundamental papers and write down notes.