Heat-map:
low → high within each metric column
| Model (2) | ⌀ AVG | lang AVG | arc | belebele | chiby | driving_tests | financial_exams | ifeval_sk | globalmmlu_lite | mmlu | movie_reviews | multi_wiki_qa | senti_sk:sentiment_3_class | senti_sk:sentiment_binary | sklep:hate-speech | sklep:nli | sklep:question-answering | sklep:rte | sklep:sentiment-analysis | skj1 | slovakcopa | slovak_trivia | toxic_sk | truthfulqa | analogies_sk | slohry | scio | e_tests_mqa | e_tests_qa | slovak_tests_mqa | slovak_tests_qa |
| ALL|0 | SK_AVERAGE|0 | SK|0 | SK|0 | SK|0 | SK|0 | SK|0 | SK|0 | SK|0 | SK|0 | SK|0 | SK|0 | SK|0 | SK|0 | SK|0 | SK|0 | SK|0 | SK|0 | SK|0 | SK|0 | SK|0 | SK|0 | SK|0 | SK|0 | SK|0 | SK|0 | SK|0 | SK|0 | SK|0 | SK|0 | SK|0 |
| acc | inst_level_loose_acc | inst_level_strict_acc | prompt_level_loose_acc | prompt_level_strict_acc | qem | qf1 | rouge1 | rouge2 | rougeL | acc | inst_level_loose_acc | inst_level_strict_acc | prompt_level_loose_acc | prompt_level_strict_acc | qem | qf1 | rouge1 | rouge2 | rougeL | acc | acc | acc | acc | acc | inst_level_loose_acc | inst_level_strict_acc | prompt_level_loose_acc | prompt_level_strict_acc | acc | acc | acc | qem | qf1 | acc | acc | acc | acc | qem | qf1 | acc | acc | acc | acc | acc | acc | acc | acc | acc | acc | acc | qem | qf1 | rouge1 | rouge2 | rougeL | acc | qem | qf1 | rouge1 | rouge2 | rougeL |
| models/ministral-base | 0.0003 | 0.1731 | 0.1731 | 0.0782 | 0.0782 | 0.0039 | 0.0045 | 0.0007 | 0.0000 | 0.0007 | 0.0002 | 0.1731 | 0.1731 | 0.0782 | 0.0782 | 0.0039 | 0.0045 | 0.0007 | 0.0000 | 0.0007 | 0.2449 | 0.2537 | 0.0000 | 0.1374 | 0.0887 | 0.1731 | 0.1731 | 0.0782 | 0.0782 | 0.2108 | 0.2225 | 0.0000 | 0.0005 | 0.0053 | 0.0000 | 0.0000 | 0.0000 | 0.0000 | 0.0003 | 0.0070 | 0.0000 | 0.0000 | 0.5967 | 0.0533 | 0.1992 | 0.0000 | 0.0647 | 0.0000 | 0.0023 | 0.2385 | 0.1501 | 0.0023 | 0.0026 | 0.0003 | 0.0000 | 0.0003 | 0.1739 | 0.0126 | 0.0030 | 0.0012 | 0.0000 | 0.0011 |
| models/ministral-last-109064 | 0.2603 | 0.2131 | 0.2131 | 0.1024 | 0.1024 | 0.0382 | 0.0708 | 0.0149 | 0.0032 | 0.0149 | 0.2405 | 0.2131 | 0.2131 | 0.1024 | 0.1024 | 0.0382 | 0.0708 | 0.0149 | 0.0032 | 0.0149 | 0.2447 | 0.2667 | 0.1424 | 0.2710 | 0.1862 | 0.2131 | 0.2131 | 0.1024 | 0.1024 | 0.2758 | 0.2415 | 0.1489 | 0.0788 | 0.1235 | 0.3862 | 0.4936 | 0.2143 | 0.0240 | 0.0520 | 0.1428 | 0.3151 | 0.1139 | 0.0000 | 0.2700 | 0.2786 | 0.1998 | 0.3188 | 0.0006 | 0.0170 | 0.2500 | 0.1815 | 0.0120 | 0.0079 | 0.0148 | 0.0032 | 0.0148 | 0.2601 | 0.0098 | 0.0089 | 0.0149 | 0.0031 | 0.0149 |