KEMT/zpwiki
32
1
Fork 9
Code Issues Pull Requests Releases Wiki Activity

zz

Browse Source
This commit is contained in:
Daniel Hládek 2025-07-17 10:36:38 +02:00
parent a1b4a3d2f8
commit c065ab523d
1 changed files with 25 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

25
pages/interns/yussef_ressaissi/README.md
View File

@ -30,4 +30,29 @@ Tasks:
- Prepare a final report with analysis, experiments and conclusions. - Prepare a final report with analysis, experiments and conclusions.
- Publish the fine-tuned models in HF HUB. Publish the paper from the project. - Publish the fine-tuned models in HF HUB. Publish the paper from the project.
Meeting 17.7.2025:
State:
- Studying of the task, metrics (ROUGE,BLEU)
- Loaded a model. preprocessed a dataset, evaluated a model
- loaded more models, used SlovakSum, generated summarization with four model and comapre them with ROUGE and BLEU (TUKE-KEMT/slovak-t5-base, google/mt5-small, google/mt5-base, facebook/mbart-large-50)
- the comparisin is without fine tuning (zero shot), for far, the best is MBART-large
- working on legal dataset "dennlinger/eur-lex-sum",
- notebooks are on the kemt git
Tasks:
- Prepare "mango.kemt.fei.tuke.sk" workflow
- Finetune an existing models and evaluate it. Use News and Legal datasets
- Try mbart-large, flan-t5-large, slovak-t5-base, google/t5-v1_1-large
- Describe the experimental setup, prepare tables with results.
Future tasks:
- Try prompting LLM and evaluation of the results. We need to pick LLM with SLovak Support
- Finetune an LLM to summarize
- Use medical data (after they are ready).
- Prepare a detailed report (to be converted into a paper).