Compare commits
19 Commits
master
...
graphrag-v
| Author | SHA1 | Date | |
|---|---|---|---|
| 427bbc3222 | |||
| 9389a54dcd | |||
| d0ab5fdddf | |||
| 90fc7f2df0 | |||
| fee6ffc70f | |||
| 86a155691d | |||
| 90abe1558b | |||
| 348be522bd | |||
| b5153fd79b | |||
| a3e43eac9c | |||
| 4ff72bb74b | |||
| 9f3483d290 | |||
| 921642a16a | |||
| 043db73ee6 | |||
| f38ebf65f7 | |||
| 9b59994d2c | |||
| 40dc2ba38e | |||
| 4d64ad2b83 | |||
| 78e952dcfb |
@ -25,7 +25,7 @@ RUN python -m pip install --no-cache-dir \
|
||||
-r requirements.txt
|
||||
|
||||
COPY app ./app
|
||||
COPY scripts ./scripts
|
||||
COPY tools ./tools
|
||||
|
||||
RUN mkdir -p data
|
||||
|
||||
|
||||
482
README.md
482
README.md
@ -10,10 +10,14 @@ vytvorená RAG vrstva, ktorá pripravuje kontext, zdroje a pravidlá pre
|
||||
odpoveď jazykového modelu. API je integrované so školským OpenWebUI ako
|
||||
OpenAPI Tool Server.
|
||||
|
||||
Súčasná hlavná retrieval vetva používa klasický hybridný RAG:
|
||||
FTS5/BM25 + embeddingy + RRF. GraphRAG zatiaľ nie je implementovaný;
|
||||
je preň pripravený samostatný evaluačný dataset a bude sa dopĺňať ako
|
||||
ďalšia experimentálna vetva.
|
||||
Stabilná baseline retrieval vetva používa klasický hybridný RAG:
|
||||
FTS5/BM25 + embeddingy + RRF. Nad týmto baseline sa vo vetve GraphRAG
|
||||
dopĺňa knowledge graph uložený v Neo4j. Aktuálne je implementovaná
|
||||
grafová infraštruktúra, deterministický builder, vizualizácia grafu a
|
||||
samostatné grafové vyhľadávanie. Grafová vrstva má zdrojovo overený benchmark a zmrazenú opravenú
|
||||
verziu v7 s novým TESTom 80 kombinácií a regresiou 320 historických otázok, kontrolou všetkých vrátených
|
||||
typovaných faktov a samostatným overením generovania odpovedí cez OpenWebUI API. Ďalším krokom je natívne zapojenie grafového
|
||||
nástroja a hlavného agenta do OpenWebUI.
|
||||
|
||||
## Implementované
|
||||
|
||||
@ -60,6 +64,15 @@ je preň pripravený samostatný evaluačný dataset a bude sa dopĺňať ako
|
||||
- atomická výmena databázy po úspešnom reindexovaní,
|
||||
- persistentná Hugging Face cache v Docker volume,
|
||||
- warm-up embeddingového modelu,
|
||||
- Neo4j databáza spúšťaná ako samostatná Docker služba,
|
||||
- deterministická tvorba knowledge graphu z `documents.json` a
|
||||
`chunks.json`,
|
||||
- grafové entity `Person`, `Document`, `DocumentAuthor`, `Thesis`,
|
||||
`Work`, `Keyword`, `Topic` a `Category`,
|
||||
- grafové vzťahy pre dokumenty, práce, témy, kategórie a autorstvo,
|
||||
- uniqueness constraints a opakovateľný rebuild GraphRAG grafu,
|
||||
- Neo4j Browser na vizualizáciu a kontrolu vytvoreného grafu,
|
||||
- samostatné grafové vyhľadávanie nad Neo4j s rozpoznaním entít, vzťahov, prác, tém a rokov,
|
||||
- retrieval evaluácia pre FTS, embeddings a hybridný retrieval,
|
||||
- answer-level RAG evaluácia cez OpenWebUI model a RAG tool,
|
||||
- oddelené answer-level overrides bez úpravy frozen retrieval
|
||||
@ -113,6 +126,38 @@ jazykový model
|
||||
odpoveď + source_url
|
||||
```
|
||||
|
||||
GraphRAG vývojová vetva:
|
||||
|
||||
```text
|
||||
documents.json + chunks.json
|
||||
↓
|
||||
graphrag.py
|
||||
↓
|
||||
build_graphrag.py
|
||||
↓
|
||||
Neo4j
|
||||
├── Person
|
||||
├── Document
|
||||
├── Thesis
|
||||
├── Work
|
||||
├── Keyword
|
||||
├── Topic
|
||||
├── Category
|
||||
└── DocumentAuthor
|
||||
↓
|
||||
grafové vzťahy + vizualizácia
|
||||
↓
|
||||
graph_search.py
|
||||
↓
|
||||
grafové entity + cesty + zdrojové dokumenty
|
||||
↓
|
||||
spojenie s klasickým RAG
|
||||
```
|
||||
|
||||
V aktuálnom stave je implementované vytvorenie a uloženie knowledge
|
||||
graphu aj samostatné grafové vyhľadávanie. Jeho zapojenie do `/rag` a
|
||||
OpenWebUI sa ešte dopĺňa.
|
||||
|
||||
Synchronizačná vetva:
|
||||
|
||||
```text
|
||||
@ -134,7 +179,7 @@ atomická výmena databázy
|
||||
Evaluačná vetva:
|
||||
|
||||
```text
|
||||
evaluation/json_files/*.json
|
||||
tools/rag/evaluation/json_files/*.json
|
||||
↓
|
||||
retrieval evaluator / RAG answer evaluator
|
||||
↓
|
||||
@ -142,11 +187,11 @@ runner
|
||||
↓
|
||||
metriky
|
||||
↓
|
||||
evaluation/results/
|
||||
tools/rag/evaluation/results/
|
||||
```
|
||||
|
||||
`evaluation/results/` nie je v nižšie uvedenom stromčeku, pretože
|
||||
obsahuje generované výstupy experimentov.
|
||||
`tools/rag/evaluation/results/` nie je v nižšie uvedenom stromčeku,
|
||||
pretože obsahuje generované výstupy experimentov.
|
||||
|
||||
## Štruktúra projektu
|
||||
|
||||
@ -161,34 +206,47 @@ zp-agent/
|
||||
│ ├── routes.py
|
||||
│ └── security.py
|
||||
│
|
||||
├── scripts/
|
||||
│ ├── common.py
|
||||
│ ├── scan_zpwiki.py
|
||||
│ ├── build_chunks.py
|
||||
│ ├── build_sqlite_index.py
|
||||
│ ├── embedding_utils.py
|
||||
│ ├── rag_utils.py
|
||||
│ ├── rebuild_index.py
|
||||
│ ├── search_db.py
|
||||
│ ├── search_core.py
|
||||
│ └── search_utils.py
|
||||
├── tools/
|
||||
│ ├── rag/
|
||||
│ │ ├── common.py
|
||||
│ │ ├── scan_zpwiki.py
|
||||
│ │ ├── build_chunks.py
|
||||
│ │ ├── build_sqlite_index.py
|
||||
│ │ ├── embedding_utils.py
|
||||
│ │ ├── rebuild_index.py
|
||||
│ │ ├── search_core.py
|
||||
│ │ ├── search_utils.py
|
||||
│ │ ├── search_db.py
|
||||
│ │ ├── rag_utils.py
|
||||
│ │ ├── rag_document_expansion.py
|
||||
│ │ ├── rag_query_evidence.py
|
||||
│ │ ├── rag_supplemental_expansion.py
|
||||
│ │ ├── run_e5_regression.sh
|
||||
│ │ ├── run_e5_1_regression.sh
|
||||
│ │ ├── evaluation/
|
||||
│ │ │ ├── evaluate_retrieval.py
|
||||
│ │ │ ├── evaluate_rag_answers.py
|
||||
│ │ │ ├── retrieval_runner.py
|
||||
│ │ │ ├── rag_runner.py
|
||||
│ │ │ ├── metrics.py
|
||||
│ │ │ ├── rag_metrics.py
|
||||
│ │ │ └── json_files/
|
||||
│ │ └── tests/
|
||||
│ │
|
||||
│ └── graphrag/
|
||||
│ ├── graph_db.py
|
||||
│ ├── graphrag.py
|
||||
│ ├── build_graphrag.py
|
||||
│ ├── graph_search.py
|
||||
│ ├── neo4j_smoke.py
|
||||
│ ├── evaluation/
|
||||
│ │ └── graphrag_questions.json
|
||||
│ └── tests/
|
||||
│
|
||||
├── evaluation/
|
||||
│ ├── evaluate_retrieval.py
|
||||
│ ├── retrieval_runner.py
|
||||
│ ├── metrics.py
|
||||
│ ├── evaluate_rag_answers.py
|
||||
│ ├── rag_runner.py
|
||||
│ ├── rag_metrics.py
|
||||
│ └── json_files/
|
||||
│ ├── questions.json
|
||||
│ ├── questions_before_ambiguity_cleanup.json
|
||||
│ ├── questions_before_validation.json
|
||||
│ ├── rag_answer_overrides.json
|
||||
│ ├── questions_extended_2000.json
|
||||
│ ├── graphrag_questions.json
|
||||
│ ├── robustness_questions.json
|
||||
│ └── performance_queries.json
|
||||
├── test/
|
||||
│ ├── test_api.py
|
||||
│ ├── test_configuration.py
|
||||
│ └── test_security.py
|
||||
│
|
||||
├── data/
|
||||
│ ├── documents.json
|
||||
@ -240,7 +298,7 @@ vypnuté. Pre integráciu OpenWebUI je dôležitý endpoint:
|
||||
- používa bezpečné porovnávanie autentifikačných hodnôt,
|
||||
- validuje očakávaný Gitea repozitár a súvisiacu konfiguráciu.
|
||||
|
||||
### `scripts/`
|
||||
### `tools/rag/`
|
||||
|
||||
`common.py`
|
||||
|
||||
@ -277,6 +335,42 @@ vyhľadávacou vrstvou.
|
||||
- normalizuje vektory,
|
||||
- poskytuje utility pre vektorové vyhľadávanie.
|
||||
|
||||
### `tools/graphrag/`
|
||||
|
||||
`graph_db.py`
|
||||
|
||||
- načítava konfiguráciu Neo4j,
|
||||
- vytvára Neo4j driver,
|
||||
- poskytuje kontrolu spojenia s grafovou databázou.
|
||||
|
||||
`graphrag.py`
|
||||
|
||||
- pripravuje dátový model knowledge graphu,
|
||||
- normalizuje grafové identifikátory,
|
||||
- extrahuje osoby, práce, roky, témy, kategórie a súvisiace metadata,
|
||||
- pripravuje uzly a vzťahy pre zápis do Neo4j.
|
||||
|
||||
`build_graphrag.py`
|
||||
|
||||
- načíta `documents.json` a `chunks.json`,
|
||||
- vytvorí GraphRAG payload,
|
||||
- vytvorí Neo4j uniqueness constraints,
|
||||
- zapíše uzly a vzťahy,
|
||||
- podporuje opakovateľný rebuild spravovanej časti grafu,
|
||||
- vypíše základné počty uzlov, vzťahov a kvalitu extrakcie názvov prác.
|
||||
|
||||
`graph_search.py`
|
||||
|
||||
- rozpoznáva relevantné osoby a obmedzenia v otázke,
|
||||
- vyhľadáva práce, témy, roky a spoločné vzťahy v Neo4j,
|
||||
- vracia grafové cesty, fakty a zdrojové dokumenty,
|
||||
- slúži ako základ budúceho GraphRAG nástroja pre OpenWebUI.
|
||||
|
||||
`neo4j_smoke.py`
|
||||
|
||||
Jednoduchý smoke test pripojenia k Neo4j používaný pri kontrole Docker
|
||||
prostredia.
|
||||
|
||||
`search_core.py`
|
||||
|
||||
Nízkoúrovňové jadro vyhľadávania:
|
||||
@ -322,7 +416,7 @@ scan
|
||||
→ atomická výmena DB
|
||||
```
|
||||
|
||||
### `evaluation/`
|
||||
### `tools/rag/evaluation/`
|
||||
|
||||
`evaluate_retrieval.py`
|
||||
|
||||
@ -376,7 +470,7 @@ Počíta answer-level metriky, napríklad:
|
||||
- strict pass,
|
||||
- latency a tokenové údaje.
|
||||
|
||||
### `evaluation/json_files/`
|
||||
### `tools/rag/evaluation/json_files/`
|
||||
|
||||
`questions.json`
|
||||
|
||||
@ -397,7 +491,7 @@ Historická záloha datasetu pred úpravami nejednoznačností.
|
||||
|
||||
Historická záloha datasetu pred validačnými úpravami.
|
||||
|
||||
`questions_extended_2000.json`
|
||||
`questions_extended.json`
|
||||
|
||||
Rozšírený benchmark s presne 2000 otázkami. Je pripravený pre neskoršie
|
||||
rozsiahlejšie experimenty nad klasickým retrievalom a RAG.
|
||||
@ -418,35 +512,13 @@ Obsahuje kombináciu:
|
||||
Tento dataset je zatiaľ pripravený, ale nemá sa používať na priebežné
|
||||
ladenie frozen benchmarku.
|
||||
|
||||
`graphrag_questions.json`
|
||||
|
||||
Samostatný benchmark pripravený pre budúcu GraphRAG vetvu.
|
||||
|
||||
Obsahuje 500 otázok zameraných na:
|
||||
|
||||
- multi-hop vzťahy,
|
||||
- spoločné témy,
|
||||
- spoločné roky,
|
||||
- person → title → year,
|
||||
- person → topic → title,
|
||||
- person → category → author,
|
||||
- agregácie,
|
||||
- konjunktívnu disambiguáciu,
|
||||
- multi-document reasoning.
|
||||
|
||||
Dataset obsahuje aj GraphRAG metadata ako:
|
||||
GraphRAG benchmark je po oddelení nástrojov uložený samostatne v:
|
||||
|
||||
```text
|
||||
graph.task
|
||||
graph.hop_count
|
||||
graph.start_entities
|
||||
graph.expected_entities
|
||||
graph.expected_relations
|
||||
graph.expected_paths
|
||||
tools/graphrag/evaluation/graphrag_questions.json
|
||||
```
|
||||
|
||||
Dôležité: existencia tohto datasetu neznamená, že je GraphRAG už
|
||||
implementovaný. Dataset je pripravený na neskorší vývoj a porovnanie.
|
||||
Obsahuje 500 otázok zameraných na grafové a viacvzťahové dopyty.
|
||||
|
||||
`robustness_questions.json`
|
||||
|
||||
@ -517,6 +589,12 @@ WEBHOOK_PULL_GIT=false
|
||||
# Voliteľné
|
||||
EMBEDDING_MODEL=intfloat/multilingual-e5-small
|
||||
EMBEDDING_BATCH_SIZE=32
|
||||
|
||||
# GraphRAG / Neo4j
|
||||
NEO4J_URI=bolt://localhost:7687
|
||||
NEO4J_USER=neo4j
|
||||
NEO4J_PASSWORD=<silné lokálne heslo>
|
||||
NEO4J_DATABASE=neo4j
|
||||
```
|
||||
|
||||
Tajomstvá je možné vygenerovať príkazom:
|
||||
@ -569,13 +647,34 @@ docker compose down
|
||||
Hugging Face cache je uložená v persistentnom Docker volume, takže sa
|
||||
embeddingový model pri bežnom reštarte kontajnera nemusí znova sťahovať.
|
||||
|
||||
## Reindexovanie
|
||||
|
||||
Celý proces načíta dokumenty, vytvorí chunky, obnoví FTS5 index a
|
||||
vytvorí embedding pre každý chunk:
|
||||
Neo4j je spustené ako samostatná služba v rovnakom Docker Compose
|
||||
prostredí. Stav služieb je možné skontrolovať:
|
||||
|
||||
```bash
|
||||
docker compose run --rm zp-agent-api python scripts/rebuild_index.py
|
||||
docker compose ps
|
||||
```
|
||||
|
||||
Neo4j Browser je lokálne dostupný na:
|
||||
|
||||
```text
|
||||
http://127.0.0.1:7474/browser/
|
||||
```
|
||||
|
||||
Kontrola spojenia z API kontajnera:
|
||||
|
||||
```bash
|
||||
docker compose exec zp-agent-api \
|
||||
python -m tools.graphrag.neo4j_smoke
|
||||
```
|
||||
|
||||
## Reindexovanie
|
||||
|
||||
Spoločná synchronizácia pripraví dokumenty, chunky, SQLite/FTS5, embeddingy
|
||||
a Neo4j graf z jedného snapshotu wiki. Nová generácia sa aktivuje až po
|
||||
úspešnej príprave oboch indexov:
|
||||
|
||||
```bash
|
||||
docker compose run --rm zp-agent-api python -m tools.rag.rebuild_index
|
||||
```
|
||||
|
||||
Vzniknú súbory:
|
||||
@ -584,15 +683,38 @@ Vzniknú súbory:
|
||||
data/documents.json
|
||||
data/chunks.json
|
||||
data/zp_index.sqlite
|
||||
data/index_version.json
|
||||
```
|
||||
|
||||
Databáza obsahuje dokumenty, chunky, FTS5 index, metadata a embeddingy.
|
||||
|
||||
Pri automatickom reindexovaní sa používa zámok proti súbežnému spusteniu
|
||||
a atomická výmena databázy po úspešnom vytvorení nového indexu.
|
||||
Manuálny `/sync`, push webhook a uvedený CLI príkaz používajú rovnakú pipeline.
|
||||
SQLite, Neo4j a odpovede nástrojov evidujú spoločnú verziu dát a Git revíziu.
|
||||
Pri krátkom prepnutí sa nové vyhľadávanie dočasne odmietne; chyba grafu
|
||||
vyvolá rollback. Pri nedokončenom prepnutí po páde zostane vyhľadávanie
|
||||
nedostupné do úspešného opakovania synchronizácie. Podrobnosti a zotavenie:
|
||||
[Spoločná synchronizácia indexov](docs/synchronizacia_indexov.md).
|
||||
|
||||
## Publikovanie a dostupnosť nástrojov
|
||||
|
||||
Oba nástroje predvolene vylučujú iba explicitné `published=false`.
|
||||
Chýbajúca hodnota sa považuje za publikovanú. Parameter
|
||||
`published_only=false` výslovne zahrnie aj nepublikované dokumenty pri
|
||||
autorizovanom volaní; CLI používa `--include-unpublished`.
|
||||
|
||||
`/health` uvádza samostatne `tools.rag`, `tools.neo4j` a `tools.graphrag`.
|
||||
Globálne `ready` vyžaduje oba vyhľadávacie nástroje; pri výpadku Neo4j
|
||||
môže klient ďalej používať RAG podľa `tools.rag.ready`.
|
||||
[Politika, migrácia a príklady](docs/publikovanie_a_dostupnost.md).
|
||||
|
||||
## Hybridné vyhľadávanie
|
||||
|
||||
RAG aj GraphRAG používajú spoločné polia `status`, `reason`, `sources`,
|
||||
`index_version`, `complete`, `truncated` a `truncation_reasons`. Pôvodný
|
||||
RAG kontext aj grafové fakty a cesty zostávajú dostupné. Úplnosť vyhľadania
|
||||
sa odlišuje od pravdivosti odpovede; pri RAG môže byť nezaručená (`null`).
|
||||
[Výstupný kontrakt a spracovanie chýb](docs/vystupny_kontrakt.md).
|
||||
|
||||
Vyhľadávanie kombinuje:
|
||||
|
||||
```text
|
||||
@ -623,7 +745,7 @@ Test z terminálu:
|
||||
|
||||
```bash
|
||||
docker compose run --rm zp-agent-api \
|
||||
python scripts/search_db.py "rag agent" --limit 5
|
||||
python -m tools.rag.search_db "rag agent" --limit 5
|
||||
```
|
||||
|
||||
Pred volaním API načítaj premenné z `.env`:
|
||||
@ -643,7 +765,7 @@ curl -X POST http://127.0.0.1:8000/search \
|
||||
-d '{
|
||||
"query": "strojový preklad",
|
||||
"limit": 3,
|
||||
"published_only": false,
|
||||
"published_only": true,
|
||||
"max_per_document": 1
|
||||
}'
|
||||
```
|
||||
@ -661,7 +783,7 @@ dokumentu.
|
||||
## RAG
|
||||
|
||||
Nad hybridným retrievalom je implementovaná RAG vrstva v
|
||||
`scripts/rag_utils.py`.
|
||||
`tools/rag/rag_utils.py`.
|
||||
|
||||
Endpoint `/rag` vyhľadá relevantné dokumenty a pripraví:
|
||||
|
||||
@ -694,11 +816,82 @@ curl -X POST http://127.0.0.1:8000/rag \
|
||||
-d '{
|
||||
"query": "V akom roku robil Ján Holp diplomovú prácu?",
|
||||
"limit": 5,
|
||||
"published_only": false,
|
||||
"published_only": true,
|
||||
"max_per_document": 1
|
||||
}'
|
||||
```
|
||||
|
||||
## GraphRAG
|
||||
|
||||
GraphRAG vetva rozširuje existujúci klasický RAG o knowledge graph.
|
||||
Graf sa vytvára deterministicky z už pripravených dokumentov a chunkov
|
||||
a ukladá sa do Neo4j.
|
||||
|
||||
Aktuálne používané hlavné typy uzlov:
|
||||
|
||||
```text
|
||||
Person
|
||||
Document
|
||||
DocumentAuthor
|
||||
Thesis
|
||||
Work
|
||||
Keyword
|
||||
Topic
|
||||
Category
|
||||
```
|
||||
|
||||
Hlavné vzťahy zahŕňajú napríklad:
|
||||
|
||||
```text
|
||||
Person -[:HAS_DOCUMENT]-> Document
|
||||
Person -[:AUTHORED]-> Thesis
|
||||
Person -[:HAS_WORK]-> Work
|
||||
Thesis/Work -[:EVIDENCED_BY]-> Document
|
||||
Document -[:HAS_KEYWORD]-> Keyword
|
||||
Document -[:IN_CATEGORY]-> Category
|
||||
DocumentAuthor -[:AUTHORED_DOCUMENT]-> Document
|
||||
Document -[:DESCRIBES]-> Topic
|
||||
```
|
||||
|
||||
Knowledge graph sa vytvorí príkazom:
|
||||
|
||||
```bash
|
||||
docker compose exec zp-agent-api \
|
||||
python -m tools.graphrag.build_graphrag
|
||||
```
|
||||
|
||||
Builder vytvára constraints, zapisuje uzly a vzťahy a pri štandardnom
|
||||
spustení obnoví iba časť grafu spravovanú ZP Agentom. Zmazanie aj zápis
|
||||
prebiehajú v jednej transakcii s kontrolou počtov, takže chyba zachová
|
||||
pôvodný graf. Opakované spustenie nevytvára duplicitné uzly.
|
||||
|
||||
Graf je možné vizuálne kontrolovať v Neo4j Browseri. Samostatné
|
||||
grafové vyhľadávanie je implementované v `tools/graphrag/graph_search.py`.
|
||||
GraphRAG zatiaľ nezasahuje do stabilného klasického `/rag` toku; ďalšia
|
||||
etapa spojí grafové výsledky s klasickým RAG a OpenWebUI nástrojom.
|
||||
|
||||
Aktuálna evaluácia GraphRAG **v7** má DEV **1 046/1 046** a nový TEST
|
||||
**80/80** pre grafové vyhľadávanie aj finálne odpovede. Modelový DEV má
|
||||
**46/46**; pri novom TESTe prešlo na prvý pokus **77/80 (96,25 %)**,
|
||||
po jednej povolenej oprave **80/80 (100 %)**. Prirodzený text sa skladá
|
||||
z overených štruktúrovaných tvrdení. Sú to nové kombinácie nad známym
|
||||
korpusom a šablónami, nie neznáme osoby ani ľudsky anotovaný benchmark.
|
||||
Samostatná historická regresia má **319/320 (99,69 %)**; nepodložená
|
||||
odpoveď v zostávajúcom prípade bola odmietnutá pred doručením.
|
||||
|
||||
Všetkých **591 testov** vrátane živých prešlo. V7 opravuje ignorovanie rokov
|
||||
mimo 20xx, kontrolu rozporných tvrdení o úplnosti, počtov, povinných tvrdení
|
||||
a citácií vrátane referenčného Markdownu a HTML. Začiatok štúdia vyžaduje
|
||||
explicitný zdroj, neodvodzuje sa z adresára; opravilo sa 10 očakávaní.
|
||||
Všetky v1–v6 merania ostávajú zachované.
|
||||
[Finálna správa v7](tools/graphrag/evaluation/results/final_v7_2026-10-26/REPORT.md)
|
||||
uvádza presný protokol, opravy, regresiu aj obmedzenia.
|
||||
|
||||
Historická v4 mala grafový strict TEST 320/320, doplnkovú kontrolu kontextových
|
||||
faktov 319/320 a LLM TEST 281/300 (93,67 %). Pôvodné otázky aj výsledky
|
||||
v1–v4 zostávajú zachované. Aktuálne skóre nie je zárukou všeobecnej pravdivosti.
|
||||
[Protokol a reprodukcia](tools/graphrag/evaluation/README.md).
|
||||
|
||||
## OpenWebUI
|
||||
|
||||
ZP Agent je pripojený do OpenWebUI ako OpenAPI Tool Server.
|
||||
@ -734,7 +927,7 @@ Výsledná odpoveď má byť grounded v ZP Wiki a má používať relevantný
|
||||
Frozen retrieval benchmark sa spúšťa napríklad:
|
||||
|
||||
```bash
|
||||
python evaluation/evaluate_retrieval.py \
|
||||
python -m tools.rag.evaluation.evaluate_retrieval \
|
||||
--split dev \
|
||||
--strict-dataset
|
||||
```
|
||||
@ -772,7 +965,7 @@ TEST split sa nemá používať na priebežné ladenie retrieval konfigurácie.
|
||||
Answer-level evaluácia používa:
|
||||
|
||||
```bash
|
||||
python evaluation/evaluate_rag_answers.py --split dev
|
||||
python -m tools.rag.evaluation.evaluate_rag_answers --split dev
|
||||
```
|
||||
|
||||
Evaluuje kompletný model/tool/RAG tok a od retrieval benchmarku je
|
||||
@ -782,7 +975,7 @@ Ak je pôvodná otázka vhodná pre retrieval, ale nejednoznačná pre
|
||||
generatívnu odpoveď, jej answer-level formulácia sa upraví iba cez:
|
||||
|
||||
```text
|
||||
evaluation/json_files/rag_answer_overrides.json
|
||||
tools/rag/evaluation/json_files/rag_answer_overrides.json
|
||||
```
|
||||
|
||||
Pôvodný frozen `questions.json` tým ostáva nezmenený.
|
||||
@ -874,10 +1067,10 @@ Kontrola syntaxe najdôležitejších upravovaných modulov:
|
||||
|
||||
```bash
|
||||
python -m py_compile \
|
||||
scripts/rag_utils.py \
|
||||
evaluation/evaluate_rag_answers.py \
|
||||
evaluation/rag_runner.py \
|
||||
evaluation/rag_metrics.py
|
||||
tools/rag/rag_utils.py \
|
||||
tools/rag/evaluation/evaluate_rag_answers.py \
|
||||
tools/rag/evaluation/rag_runner.py \
|
||||
tools/rag/evaluation/rag_metrics.py
|
||||
```
|
||||
|
||||
Pred checkpointom je vhodné použiť aj:
|
||||
@ -891,116 +1084,65 @@ Pevný počet `pytest` výsledkov nie je v README uvádzaný, pretože sa
|
||||
s vývojom mení. Aktuálny stav sa má vždy potvrdiť novým spustením testov
|
||||
na konkrétnom commite.
|
||||
|
||||
## Pripravené, ale zatiaľ neaktívne experimenty
|
||||
## Experimentálne datasety
|
||||
|
||||
Nasledujúce datasety sú pripravené, ale nemajú sa teraz používať na
|
||||
priebežné ladenie aktuálneho frozen benchmarku:
|
||||
Pre ďalšie experimenty sú pripravené:
|
||||
|
||||
```text
|
||||
questions_extended_2000.json
|
||||
questions_extended.json
|
||||
graphrag_questions.json
|
||||
robustness_questions.json
|
||||
performance_queries.json
|
||||
```
|
||||
|
||||
Odporúčané poradie ich neskoršieho použitia:
|
||||
|
||||
```text
|
||||
stabilný klasický RAG
|
||||
↓
|
||||
extended benchmark
|
||||
↓
|
||||
robustness benchmark
|
||||
↓
|
||||
GraphRAG implementácia
|
||||
↓
|
||||
GraphRAG benchmark
|
||||
↓
|
||||
performance benchmark
|
||||
↓
|
||||
stress test
|
||||
↓
|
||||
finálne experimenty
|
||||
```
|
||||
`graphrag_questions.json` je aktuálne určený pre vývoj GraphRAG vetvy.
|
||||
Ostatné datasety zostávajú oddelené od priebežného ladenia frozen
|
||||
klasického baseline.
|
||||
|
||||
## Najbližší postup
|
||||
|
||||
Najbližšia vývojová etapa je zámerne menšia a má uzavrieť existujúci
|
||||
klasický RAG pred otvorením ďalších experimentov.
|
||||
Klasický RAG a GraphRAG sú oddelené do samostatných komponentov v
|
||||
`tools/rag/` a `tools/graphrag/`. Stabilný klasický RAG zostáva
|
||||
referenčným bodom.
|
||||
|
||||
### 1. Uzavretie retrieval/regresie
|
||||
### 1. GraphRAG dátový model
|
||||
|
||||
Najprv sa má potvrdiť, že aktuálne zmeny neovplyvnili frozen retrieval
|
||||
baseline.
|
||||
Model je implementovaný. Rozlišuje autora dokumentu, študenta, záverečnú
|
||||
prácu, projekt, tému a kľúčové slovo. Študijný program sa nedopĺňa bez
|
||||
spoľahlivého zdroja.
|
||||
|
||||
Postup:
|
||||
### 2. GraphRAG evaluácia
|
||||
|
||||
```text
|
||||
py_compile
|
||||
↓
|
||||
pytest
|
||||
↓
|
||||
frozen retrieval DEV strict
|
||||
↓
|
||||
porovnanie s uloženým baseline
|
||||
↓
|
||||
git diff --check
|
||||
↓
|
||||
retrieval lock
|
||||
```
|
||||
V7 má zmrazený graf, DEV **1 046/1 046** a nový TEST **80/80**.
|
||||
[Finálna správa](tools/graphrag/evaluation/results/final_v7_2026-10-26/REPORT.md)
|
||||
oddeľuje nový TEST od historickej regresie a vyhľadávanie od modelu
|
||||
s kontrolami a rendererom; pôvodné v1–v6 sa nemenia.
|
||||
Pred formálnym porovnaním s klasickým RAG potrebujeme spoločnú metodiku
|
||||
a ideálne otázky anotované nezávislým človekom. Nový nezávislý TEST vyžaduje
|
||||
nové otázky; opakované meranie odhalených otázok je regresia.
|
||||
|
||||
Do retrieval scoringu sa potom nemá zasahovať bez nového
|
||||
experimentálneho dôvodu.
|
||||
### 3. OpenWebUI nástroje
|
||||
|
||||
### 2. Regresia section-lead RAG kontextu
|
||||
Pripraviť samostatne inštalovateľný RAG nástroj a GraphRAG nástroj.
|
||||
Každý komponent bude mať vlastný adresár, rozhranie a testy.
|
||||
|
||||
Treba potvrdiť, že section-lead expanzia:
|
||||
### 4. Hlavný agent
|
||||
|
||||
- opravuje prípady, kde primárny chunk chýba o názov/tému/rok,
|
||||
- nepridáva duplicitný chunk,
|
||||
- zostáva v rovnakom dokumente a sekcii,
|
||||
- nemení retrieval `max_per_document=1`,
|
||||
- nevytvára zbytočne veľký kontext.
|
||||
Pridať hlavný prompt/agenta, ktorý podľa otázky vyberie vhodný nástroj a
|
||||
bude vedieť kombinovať ich výsledky.
|
||||
|
||||
### 3. `retry + backoff + resume` pre answer evaluator
|
||||
### 5. Git MCP server
|
||||
|
||||
Pred spustením veľkého DEV answer benchmarku sa má evaluator doplniť
|
||||
tak, aby dlhý beh nebol znehodnotený jedným timeoutom alebo dočasnou
|
||||
chybou API.
|
||||
Pridať samostatný MCP server pre prácu s Git repozitárom a spúšťať ho v
|
||||
Dockeri. Následne ho sprístupniť hlavnému agentovi ako ďalší nástroj.
|
||||
|
||||
Plánované správanie:
|
||||
### 6. Spojenie GraphRAG s klasickým RAG
|
||||
|
||||
```text
|
||||
request
|
||||
↓
|
||||
úspech ───────────────→ uložiť výsledok
|
||||
│
|
||||
└─ timeout / 429 / 5xx
|
||||
↓
|
||||
retry
|
||||
↓
|
||||
exponential backoff
|
||||
↓
|
||||
retry limit
|
||||
```
|
||||
Po stabilizovaní grafového vyhľadávania spojiť výsledky grafu s
|
||||
existujúcim FTS5 + embedding vyhľadávaním a porovnať klasický RAG s
|
||||
GraphRAG variantom.
|
||||
|
||||
Resume mechanizmus má:
|
||||
### 7. Finálne experimenty
|
||||
|
||||
- priebežne ukladať `.partial.json`,
|
||||
- pri novom spustení načítať existujúci partial výsledok,
|
||||
- overiť kompatibilitu modelu/datasetu/splitu,
|
||||
- preskočiť už úspešne dokončené otázky,
|
||||
- pokračovať od ďalšej otázky,
|
||||
- neprepisovať hotové výsledky bez explicitnej voľby,
|
||||
- po úspešnom dokončení vytvoriť finálny JSON/CSV výstup.
|
||||
|
||||
Zároveň je vhodné:
|
||||
|
||||
- rozlišovať retryable a permanentné chyby,
|
||||
- logovať číslo pokusu a dôvod retry,
|
||||
- mať konfigurovateľný maximálny počet pokusov,
|
||||
- mať konfigurovateľný počiatočný backoff,
|
||||
- používať mierny delay medzi otázkami,
|
||||
- validovať typy answer-level datasetových polí,
|
||||
- nenačítavať osobný OpenWebUI API kľúč z fallback súboru, ak má byť
|
||||
podľa bezpečnostnej politiky dostupný iba cez environment.
|
||||
Až po stabilizovaní celého systému vykonať širšie porovnanie embedding
|
||||
modelov, robustnosti, výkonu a ostatných finálnych experimentov.
|
||||
|
||||
46
app/main.py
46
app/main.py
@ -13,6 +13,11 @@ from fastapi import (
|
||||
from fastapi.middleware.cors import (
|
||||
CORSMiddleware,
|
||||
)
|
||||
from fastapi.exceptions import RequestValidationError
|
||||
from fastapi.encoders import jsonable_encoder
|
||||
from fastapi.exception_handlers import http_exception_handler, request_validation_exception_handler
|
||||
from starlette.exceptions import HTTPException as StarletteHTTPException
|
||||
from starlette.responses import JSONResponse
|
||||
|
||||
|
||||
PROJECT_ROOT = Path(__file__).resolve().parents[1]
|
||||
@ -28,7 +33,8 @@ from app.routes import router
|
||||
from app.security import (
|
||||
validate_security_configuration,
|
||||
)
|
||||
from scripts.embedding_utils import embed_query
|
||||
from tools.rag.embedding_utils import embed_query
|
||||
from tools.retrieval_contract import error_result
|
||||
|
||||
|
||||
logger = logging.getLogger(__name__)
|
||||
@ -41,15 +47,17 @@ OPENWEBUI_ORIGIN = (
|
||||
|
||||
@asynccontextmanager
|
||||
async def lifespan(
|
||||
_: FastAPI,
|
||||
application: FastAPI,
|
||||
):
|
||||
validate_security_configuration()
|
||||
application.state.embedding_ready = False
|
||||
|
||||
try:
|
||||
await asyncio.to_thread(
|
||||
embed_query,
|
||||
"warmup",
|
||||
)
|
||||
application.state.embedding_ready = True
|
||||
|
||||
except Exception:
|
||||
logger.exception(
|
||||
@ -76,6 +84,27 @@ app = FastAPI(
|
||||
)
|
||||
|
||||
|
||||
@app.exception_handler(StarletteHTTPException)
|
||||
async def retrieval_http_error(request: Request, error: StarletteHTTPException):
|
||||
if request.url.path not in {'/rag', '/search'}:
|
||||
return await http_exception_handler(request, error)
|
||||
reason = {400: 'invalid_query', 401: 'unauthorized', 403: 'forbidden',
|
||||
404: 'not_found', 405: 'method_not_allowed', 422: 'invalid_request',
|
||||
503: 'retrieval_unavailable'}.get(error.status_code, 'internal_error')
|
||||
return JSONResponse(status_code=error.status_code, headers=error.headers,
|
||||
content={**error_result(reason=reason), 'detail': error.detail})
|
||||
|
||||
|
||||
@app.exception_handler(RequestValidationError)
|
||||
async def retrieval_validation_error(request: Request, error: RequestValidationError):
|
||||
if request.url.path not in {'/rag', '/search'}:
|
||||
return await request_validation_exception_handler(request, error)
|
||||
# Retain useful validation locations/types without echoing submitted secrets.
|
||||
details = [{'loc': row['loc'], 'type': row['type'], 'msg': row['msg']} for row in error.errors()]
|
||||
return JSONResponse(status_code=422, content=jsonable_encoder({
|
||||
**error_result(reason='invalid_request'), 'detail': details}))
|
||||
|
||||
|
||||
app.add_middleware(
|
||||
CORSMiddleware,
|
||||
allow_origins=[
|
||||
@ -114,9 +143,16 @@ async def add_security_headers(
|
||||
request: Request,
|
||||
call_next,
|
||||
):
|
||||
response = await call_next(
|
||||
request
|
||||
)
|
||||
try:
|
||||
response = await call_next(request)
|
||||
except Exception:
|
||||
if request.url.path not in {'/rag', '/search'}:
|
||||
raise
|
||||
# Serialization failures must obey the same contract as backend errors.
|
||||
logger.exception('Neočakávaná chyba výstupu retrieval API.')
|
||||
response = JSONResponse(status_code=500, content={
|
||||
**error_result(reason='internal_error'),
|
||||
'detail': 'Nastala interná chyba servera.'})
|
||||
|
||||
response.headers[
|
||||
"Cache-Control"
|
||||
|
||||
@ -36,16 +36,19 @@ from app.security import (
|
||||
verify_gitea_signature,
|
||||
webhook_should_pull_git,
|
||||
)
|
||||
from scripts.common import (
|
||||
from tools.rag.common import (
|
||||
DB_FILE,
|
||||
ZPWIKI_ROOT,
|
||||
)
|
||||
from scripts.rag_utils import build_rag_context
|
||||
from scripts.rebuild_index import (
|
||||
from tools.rag.rag_utils import build_rag_context
|
||||
from tools.rag.rebuild_index import (
|
||||
ReindexInProgressError,
|
||||
rebuild_index,
|
||||
)
|
||||
from scripts.search_utils import search_database
|
||||
from tools.rag.search_utils import search_database
|
||||
from tools.publication import DEFAULT_PUBLISHED_ONLY
|
||||
from tools.tool_health import tools_readiness
|
||||
from tools.retrieval_contract import RetrievalResponse, RetrievalSource, RetrievalErrorResponse
|
||||
|
||||
|
||||
logger = logging.getLogger(__name__)
|
||||
@ -103,7 +106,7 @@ class SearchRequest(
|
||||
le=50,
|
||||
)
|
||||
|
||||
published_only: bool = False
|
||||
published_only: bool = DEFAULT_PUBLISHED_ONLY
|
||||
|
||||
max_per_document: int = Field(
|
||||
default=1,
|
||||
@ -136,10 +139,10 @@ class RagRequest(
|
||||
)
|
||||
|
||||
published_only: bool = Field(
|
||||
default=False,
|
||||
default=DEFAULT_PUBLISHED_ONLY,
|
||||
description=(
|
||||
"Ak je true, použijú sa iba "
|
||||
"publikované dokumenty."
|
||||
"dokumenty okrem explicitného published=false; chýbajúca hodnota sa zahrnie."
|
||||
),
|
||||
)
|
||||
|
||||
@ -182,9 +185,11 @@ class HealthResponse(BaseModel):
|
||||
zpwiki_exists: bool
|
||||
|
||||
security_configured: bool
|
||||
index_version: dict[str, Any] | None = None
|
||||
tools: dict[str, Any]
|
||||
|
||||
|
||||
class RagSource(BaseModel):
|
||||
class RagSource(RetrievalSource):
|
||||
model_config = ConfigDict(
|
||||
extra="allow",
|
||||
)
|
||||
@ -205,7 +210,7 @@ class RagSource(BaseModel):
|
||||
] | None = None
|
||||
|
||||
|
||||
class RagResponse(BaseModel):
|
||||
class RagResponse(RetrievalResponse):
|
||||
model_config = ConfigDict(
|
||||
extra="forbid",
|
||||
)
|
||||
@ -231,9 +236,10 @@ class RagResponse(BaseModel):
|
||||
sources: list[
|
||||
RagSource
|
||||
]
|
||||
index_version: dict[str, Any] | None = None
|
||||
|
||||
|
||||
class SearchResponse(BaseModel):
|
||||
class SearchResponse(RetrievalResponse):
|
||||
query: str
|
||||
engine: str
|
||||
|
||||
@ -246,6 +252,7 @@ class SearchResponse(BaseModel):
|
||||
results: list[
|
||||
dict[str, Any]
|
||||
]
|
||||
index_version: dict[str, Any] | None = None
|
||||
|
||||
|
||||
class SyncResponse(BaseModel):
|
||||
@ -261,6 +268,8 @@ class SyncResponse(BaseModel):
|
||||
str,
|
||||
int,
|
||||
]
|
||||
index_version: dict[str, Any] | None = None
|
||||
graph_counts: dict[str, int] | None = None
|
||||
|
||||
|
||||
class WebhookSuccessResponse(
|
||||
@ -283,6 +292,8 @@ class WebhookSuccessResponse(
|
||||
str,
|
||||
int,
|
||||
]
|
||||
index_version: dict[str, Any] | None = None
|
||||
graph_counts: dict[str, int] | None = None
|
||||
|
||||
|
||||
class WebhookIgnoredResponse(
|
||||
@ -507,7 +518,7 @@ async def read_webhook_body(
|
||||
include_in_schema=False,
|
||||
response_model=HealthResponse,
|
||||
)
|
||||
def health() -> dict[str, Any]:
|
||||
def health(request: Request) -> dict[str, Any]:
|
||||
database_exists = (
|
||||
DB_FILE.exists()
|
||||
)
|
||||
@ -524,15 +535,15 @@ def health() -> dict[str, Any]:
|
||||
except RuntimeError:
|
||||
security_configured = False
|
||||
|
||||
ready = (
|
||||
database_exists
|
||||
and zpwiki_exists
|
||||
and security_configured
|
||||
)
|
||||
tools, version = tools_readiness(DB_FILE, security_configured=security_configured,
|
||||
embedding_ready=getattr(request.app.state, 'embedding_ready', False))
|
||||
ready = tools['rag']['ready'] and tools['graphrag']['ready']
|
||||
|
||||
return {
|
||||
"status": "ok",
|
||||
"ready": ready,
|
||||
"index_version": version,
|
||||
"tools": tools,
|
||||
"database_exists": (
|
||||
database_exists
|
||||
),
|
||||
@ -573,27 +584,32 @@ def health() -> dict[str, Any]:
|
||||
),
|
||||
responses={
|
||||
400: {
|
||||
"model": RetrievalErrorResponse,
|
||||
"description": (
|
||||
"Neplatný dotaz."
|
||||
),
|
||||
},
|
||||
401: {
|
||||
"model": RetrievalErrorResponse,
|
||||
"description": (
|
||||
"Chýbajúci alebo neplatný "
|
||||
"API kľúč."
|
||||
),
|
||||
},
|
||||
422: {
|
||||
"model": RetrievalErrorResponse,
|
||||
"description": (
|
||||
"Neplatná štruktúra requestu."
|
||||
),
|
||||
},
|
||||
500: {
|
||||
"model": RetrievalErrorResponse,
|
||||
"description": (
|
||||
"Interná chyba servera."
|
||||
),
|
||||
},
|
||||
503: {
|
||||
"model": RetrievalErrorResponse,
|
||||
"description": (
|
||||
"Retrieval nie je momentálne "
|
||||
"dostupný."
|
||||
@ -608,9 +624,10 @@ def health() -> dict[str, Any]:
|
||||
)
|
||||
def rag(
|
||||
request: RagRequest,
|
||||
http_request: Request,
|
||||
) -> dict[str, Any]:
|
||||
try:
|
||||
return build_rag_context(
|
||||
result = build_rag_context(
|
||||
DB_FILE,
|
||||
request.query,
|
||||
limit=request.limit,
|
||||
@ -621,6 +638,8 @@ def rag(
|
||||
request.max_per_document
|
||||
),
|
||||
)
|
||||
http_request.app.state.embedding_ready = True
|
||||
return result
|
||||
|
||||
except Exception as error:
|
||||
raise_retrieval_error(
|
||||
@ -640,6 +659,7 @@ def rag(
|
||||
)
|
||||
def search(
|
||||
request: SearchRequest,
|
||||
http_request: Request,
|
||||
) -> dict[str, Any]:
|
||||
try:
|
||||
response = search_database(
|
||||
@ -653,6 +673,7 @@ def search(
|
||||
request.max_per_document
|
||||
),
|
||||
)
|
||||
http_request.app.state.embedding_ready = True
|
||||
|
||||
except Exception as error:
|
||||
raise_retrieval_error(
|
||||
@ -664,6 +685,7 @@ def search(
|
||||
]
|
||||
|
||||
return {
|
||||
**{key: response[key] for key in RetrievalResponse.model_fields if key in response},
|
||||
"query": request.query,
|
||||
"engine": response[
|
||||
"engine"
|
||||
@ -675,6 +697,7 @@ def search(
|
||||
results
|
||||
),
|
||||
"results": results,
|
||||
**({'index_version': response['index_version']} if response.get('index_version') else {}),
|
||||
}
|
||||
|
||||
|
||||
@ -690,6 +713,7 @@ def search(
|
||||
)
|
||||
def sync(
|
||||
request: SyncRequest,
|
||||
http_request: Request,
|
||||
) -> dict[str, Any]:
|
||||
try:
|
||||
result = rebuild_index(
|
||||
@ -697,6 +721,7 @@ def sync(
|
||||
request.pull_git
|
||||
)
|
||||
)
|
||||
http_request.app.state.embedding_ready = True
|
||||
|
||||
except Exception as error:
|
||||
raise_reindex_error(
|
||||
@ -708,6 +733,8 @@ def sync(
|
||||
"pull_git": (
|
||||
request.pull_git
|
||||
),
|
||||
"index_version": result.get('index_version'),
|
||||
"graph_counts": result.get('graph_counts'),
|
||||
"duration_seconds": (
|
||||
result[
|
||||
"duration_seconds"
|
||||
@ -873,6 +900,7 @@ async def gitea_webhook(
|
||||
webhook_should_pull_git()
|
||||
),
|
||||
)
|
||||
request.app.state.embedding_ready = True
|
||||
|
||||
except Exception as error:
|
||||
raise_reindex_error(
|
||||
@ -890,6 +918,8 @@ async def gitea_webhook(
|
||||
"verified_by": (
|
||||
"hmac_sha256"
|
||||
),
|
||||
"index_version": result.get('index_version'),
|
||||
"graph_counts": result.get('graph_counts'),
|
||||
"duration_seconds": (
|
||||
result[
|
||||
"duration_seconds"
|
||||
|
||||
@ -15,6 +15,10 @@ services:
|
||||
CHUNK_MIN_TOKENS: "80"
|
||||
CHUNK_TOKEN_ENCODING: cl100k_base
|
||||
HF_HOME: /cache/huggingface
|
||||
NEO4J_URI: bolt://neo4j:7687
|
||||
NEO4J_USER: ${NEO4J_USER:-neo4j}
|
||||
NEO4J_PASSWORD: ${NEO4J_PASSWORD}
|
||||
NEO4J_DATABASE: ${NEO4J_DATABASE:-neo4j}
|
||||
|
||||
volumes:
|
||||
- ./data:/app/data
|
||||
@ -23,5 +27,35 @@ services:
|
||||
|
||||
restart: unless-stopped
|
||||
|
||||
neo4j:
|
||||
image: neo4j:2026.09.0
|
||||
container_name: zp-agent-neo4j
|
||||
|
||||
ports:
|
||||
- "127.0.0.1:7474:7474"
|
||||
- "127.0.0.1:7687:7687"
|
||||
|
||||
environment:
|
||||
NEO4J_AUTH: ${NEO4J_USER:-neo4j}/${NEO4J_PASSWORD}
|
||||
|
||||
volumes:
|
||||
- neo4j-data:/data
|
||||
- neo4j-logs:/logs
|
||||
|
||||
healthcheck:
|
||||
test:
|
||||
[
|
||||
"CMD-SHELL",
|
||||
"u=$${NEO4J_AUTH%%/*}; p=$${NEO4J_AUTH#*/}; cypher-shell -u \"$$u\" -p \"$$p\" 'RETURN 1' >/dev/null 2>&1"
|
||||
]
|
||||
interval: 10s
|
||||
timeout: 5s
|
||||
retries: 10
|
||||
start_period: 20s
|
||||
|
||||
restart: unless-stopped
|
||||
|
||||
volumes:
|
||||
hf-cache:
|
||||
neo4j-data:
|
||||
neo4j-logs:
|
||||
|
||||
153
docs/cleanup_2026-10-24.json
Normal file
153
docs/cleanup_2026-10-24.json
Normal file
@ -0,0 +1,153 @@
|
||||
{
|
||||
"date": "2026-10-24",
|
||||
"backup": "/tmp/zp-agent-graphrag-v2-backup-20261024T193749Z/project-before.tar.gz",
|
||||
"removed": [
|
||||
{
|
||||
"path": "tools/rag/evaluation/results/retrieval_results_test.json",
|
||||
"reason": "byte-identical duplicate",
|
||||
"kept": "tools/rag/evaluation/results/retrieval_results_test_final.json",
|
||||
"bytes": 1084326,
|
||||
"sha256": "96b953285f0b2f249edb1ca500adc926df8211c732643e953539863930aac89f"
|
||||
},
|
||||
{
|
||||
"path": "tools/rag/evaluation/results/retrieval_results_test.csv",
|
||||
"reason": "byte-identical duplicate",
|
||||
"kept": "tools/rag/evaluation/results/retrieval_results_test_final.csv",
|
||||
"bytes": 659640,
|
||||
"sha256": "61d718a664892784756666315f54c05b5bd80232508b2e22ba7b6c5e8fb7f282"
|
||||
},
|
||||
{
|
||||
"path": "tools/rag/evaluation/results/retrieval_results.json",
|
||||
"reason": "byte-identical duplicate",
|
||||
"kept": "tools/rag/evaluation/results/retrieval_results_baseline.json",
|
||||
"bytes": 88796,
|
||||
"sha256": "46d6314e47868bc308fa96d572d163a1a3c70ed13c98cab2f26fbdd3c7583ebb"
|
||||
},
|
||||
{
|
||||
"path": "tools/rag/evaluation/results/retrieval_results.csv",
|
||||
"reason": "byte-identical duplicate",
|
||||
"kept": "tools/rag/evaluation/results/retrieval_results_baseline.csv",
|
||||
"bytes": 52000,
|
||||
"sha256": "cc91e2daee386279f0bd4c3a85d3c6ff1dcdd0dec2e8d64e153f97e5e76ba74f"
|
||||
},
|
||||
{
|
||||
"path": "tools/rag/evaluation/results/retrieval_results_dev.csv",
|
||||
"reason": "byte-identical duplicate",
|
||||
"kept": "tools/rag/evaluation/results/retrieval_results_dev_final.csv",
|
||||
"bytes": 787621,
|
||||
"sha256": "2d9f53942d3df67f1190b14e04e241fe57e3cfebdc70b6d2d2efc12a6b2d62b1"
|
||||
},
|
||||
{
|
||||
"path": "graphrag_3_1_audit.txt",
|
||||
"reason": "obsolete terminal transcript; preserved in pre-cleanup backup",
|
||||
"bytes": 29495,
|
||||
"sha256": "f5d588f1a31e6a85f9b6a5e782cd31cd6566e07102bd4940c5fcdfa95a3941f8"
|
||||
},
|
||||
{
|
||||
"path": "graphrag_3_3_current_search.txt",
|
||||
"reason": "obsolete terminal transcript; preserved in pre-cleanup backup",
|
||||
"bytes": 85802,
|
||||
"sha256": "e0a58a9c2f7896ed3527f6ff4e82d658674dfd27f340a1afaf47ba4bf702e0d3"
|
||||
},
|
||||
{
|
||||
"path": "graphrag_3_3_dev.txt",
|
||||
"reason": "obsolete terminal transcript; preserved in pre-cleanup backup",
|
||||
"bytes": 52639,
|
||||
"sha256": "94cf8bdd18fa6582ab1d7192c5787672679345201de1edef01b981ce8ec2b058"
|
||||
},
|
||||
{
|
||||
"path": "tools/graphrag/evaluation/results/graphrag_dev_first10.json",
|
||||
"reason": "intermediate smoke/selected run; v1 full results retained",
|
||||
"bytes": 28564,
|
||||
"sha256": "507e814b155115b44ae191ce5ae5316ec50855dad4c2a03cd8417da31a9a8afc"
|
||||
},
|
||||
{
|
||||
"path": "tools/graphrag/evaluation/results/graphrag_dev_first10.csv",
|
||||
"reason": "intermediate smoke/selected run; v1 full results retained",
|
||||
"bytes": 7535,
|
||||
"sha256": "86d364650f8292cf87ecb20a21da8d744009ecdd04d8d900042e7899a83ea5db"
|
||||
},
|
||||
{
|
||||
"path": "tools/graphrag/evaluation/results/graphrag_dev_selected.json",
|
||||
"reason": "intermediate smoke/selected run; v1 full results retained",
|
||||
"bytes": 43599,
|
||||
"sha256": "40b506ebf1cf0a3ee3d5567ad4d0486a4e9790ea0b9bb98a32e177cfd163e570"
|
||||
},
|
||||
{
|
||||
"path": "tools/graphrag/evaluation/results/graphrag_dev_selected.csv",
|
||||
"reason": "intermediate smoke/selected run; v1 full results retained",
|
||||
"bytes": 9623,
|
||||
"sha256": "eb0285025f5124f0c598ac3f91eae24bc115b1b9531a02cb9be20d9ade0d4eae"
|
||||
},
|
||||
{
|
||||
"path": "scripts/",
|
||||
"reason": "orphan bytecode only; source moved to tools/"
|
||||
},
|
||||
{
|
||||
"path": "tools/graphrag/evaluation/graphrag_questions_before_schema_v2.json",
|
||||
"reason": "exact historical copy already preserved in Git",
|
||||
"kept_git_object": "9f3483d:tools/graphrag/evaluation/graphrag_questions.json",
|
||||
"bytes": 747071,
|
||||
"sha256": "0e9d4175b766c1af0e0af474bc56b260ba35d864f90fbd30339a9ffed03b6dab"
|
||||
}
|
||||
],
|
||||
"retained": "All nonduplicate research runs, RAG DEV/TEST freeze, retrieval final/baseline, GraphRAG v1 artifacts, source-history archives and historical benchmark versions.",
|
||||
"archived": [
|
||||
{
|
||||
"from": "tools/graphrag/evaluation/results/graphrag_dev.json",
|
||||
"to": "tools/graphrag/evaluation/results/archive_pre_v1/graphrag_dev.json",
|
||||
"reason": "retain historical full DEV run without confusing it with final results"
|
||||
},
|
||||
{
|
||||
"from": "tools/graphrag/evaluation/results/graphrag_dev.csv",
|
||||
"to": "tools/graphrag/evaluation/results/archive_pre_v1/graphrag_dev.csv",
|
||||
"reason": "retain historical full DEV run without confusing it with final results"
|
||||
}
|
||||
],
|
||||
"cache_cleanup": [
|
||||
{
|
||||
"path": ".pytest_cache",
|
||||
"files": 5
|
||||
},
|
||||
{
|
||||
"path": "test/__pycache__",
|
||||
"files": 38
|
||||
},
|
||||
{
|
||||
"path": "app/__pycache__",
|
||||
"files": 4
|
||||
},
|
||||
{
|
||||
"path": "app/.pytest_cache",
|
||||
"files": 4
|
||||
},
|
||||
{
|
||||
"path": "tools/__pycache__",
|
||||
"files": 1
|
||||
},
|
||||
{
|
||||
"path": "tools/rag/__pycache__",
|
||||
"files": 14
|
||||
},
|
||||
{
|
||||
"path": "tools/rag/evaluation/__pycache__",
|
||||
"files": 9
|
||||
},
|
||||
{
|
||||
"path": "tools/rag/tests/__pycache__",
|
||||
"files": 41
|
||||
},
|
||||
{
|
||||
"path": "tools/graphrag/__pycache__",
|
||||
"files": 6
|
||||
},
|
||||
{
|
||||
"path": "tools/graphrag/evaluation/__pycache__",
|
||||
"files": 10
|
||||
},
|
||||
{
|
||||
"path": "tools/graphrag/tests/__pycache__",
|
||||
"files": 17
|
||||
}
|
||||
]
|
||||
}
|
||||
58
docs/graphrag_2026-10-25_worklog.md
Normal file
58
docs/graphrag_2026-10-25_worklog.md
Normal file
@ -0,0 +1,58 @@
|
||||
# Úpravy GraphRAG a upratanie projektu — 25. 10. 2026
|
||||
|
||||
Výsledky: [finálna správa v3](../tools/graphrag/evaluation/results/final_v3_2026-10-25/REPORT.md).
|
||||
Upravené je grafové vyhľadávanie a jeho vyhodnotenie. Klasický RAG kód ani index sa funkčne nemenili.
|
||||
|
||||
## Zálohy a upratanie
|
||||
|
||||
Pred úpravami vznikla záloha `/tmp/zp-agent-graphrag-v2-backup-20261024T193749Z/project-before.tar.gz`, stav Gitu a neskôr export Neo4j `neo4j_before_v2.json`. Git tagy uchovávajú presné publikované implementácie.
|
||||
|
||||
[Cleanup manifest](cleanup_2026-10-24.json) zaznamenáva odstránené súbory a ponechané protikusy s SHA-256. Odstránených bolo päť presných kópií retrieval výsledkov, tri dočasné terminálové výpisy, štyri smoke/selected výstupy, historická kópia benchmarku už prítomná v Gite a osirelá cache pôvodného `scripts/`. Plný starý GraphRAG DEV sa presunul do označeného archívu. Final JSON/CSV, baseline, zmrazený RAG DEV/TEST a neidentické historické experimenty zostali zachované. CSV a JSON sa nepovažujú za duplicity rôznych formátov.
|
||||
|
||||
## Implementácia
|
||||
|
||||
- Celé mená, presná zhoda, kontrolované skloňovanie a bezpečné neznáme/nejednoznačné osoby; neznámy kandidát nezmení vyhľadávanie na globálne.
|
||||
- Autor dokumentu vs. opisovaná osoba; celá fráza požadovaného tagu a oddelenie následnej vety/osôb.
|
||||
- Typované prepojené dôkazy: osoba, konkrétna práca, jej názov/rok a správny dokument. Konfliktné údaje toho istého uzla sa odmietajú.
|
||||
- Rozlíšenie roku štúdia a práce, nulového počtu a no-answer, presného počtu/množiny, platných alternatív zdrojov a URL.
|
||||
- Nezávislý oracle pôvodných Markdown súborov; opravených 128 tagových predpokladov a 9 množín kategórií. Neskôr zdrojovo rozlíšený bakalársky projekt a záverečná práca.
|
||||
- Doplnené vedecké a bakalárske projekty, akademické rozsahy rokov a regresné/negatívne/integritné testy.
|
||||
- Freeze viaže kód, benchmark, raw Markdown, JSON vstupy, graf, audit, parametre a rozdelenie profilov; chráni pred prepísaním archívov.
|
||||
|
||||
## Podstatné vykonané príkazy
|
||||
|
||||
Použitý bol `.venv/bin/python`; pri pripojení sa načítala lokálna `.env` bez výpisu tajomstiev.
|
||||
|
||||
```bash
|
||||
python -m tools.graphrag.evaluation.benchmark_v2
|
||||
python -m tools.graphrag.evaluation.benchmark_v3
|
||||
python -m tools.graphrag.build_graphrag
|
||||
RUN_NEO4J_TESTS=1 HF_HUB_OFFLINE=1 TRANSFORMERS_OFFLINE=1 pytest -q -p no:cacheprovider
|
||||
|
||||
python -m tools.graphrag.evaluation.evaluate_graphrag \
|
||||
--split dev \
|
||||
--audit tools/graphrag/evaluation/results/v3_preparation/source_audit.json \
|
||||
--output-dir tools/graphrag/evaluation/results/final_v3_2026-10-25
|
||||
|
||||
python -m tools.graphrag.evaluation.freeze_graphrag \
|
||||
--dev-results tools/graphrag/evaluation/results/final_v3_2026-10-25/graphrag_dev.json \
|
||||
--audit tools/graphrag/evaluation/results/v3_preparation/source_audit.json \
|
||||
--output tools/graphrag/evaluation/frozen_v3.json
|
||||
|
||||
python -m tools.graphrag.evaluation.evaluate_graphrag \
|
||||
--split test \
|
||||
--audit tools/graphrag/evaluation/results/v3_preparation/source_audit.json \
|
||||
--freeze-manifest tools/graphrag/evaluation/frozen_v3.json \
|
||||
--output-dir tools/graphrag/evaluation/results/final_v3_2026-10-25
|
||||
|
||||
docker compose build zp-agent-api
|
||||
docker compose up -d --no-deps zp-agent-api
|
||||
```
|
||||
|
||||
Príkazy na tvorbu datasetu a freeze boli použité pred archivovaním; existujúce zmrazené súbory neregeneruj na rovnaké miesto. Reprodukcia používa nový výstupný adresár.
|
||||
|
||||
## Výsledok
|
||||
|
||||
430 automatizovaných testov prešlo, 4 boli preskočené. Finálny DEV v3 589/589 a posledný doplnkový TEST 13/13 majú 0 runtime chýb. V2 malo prvý širší nezávislý TEST 67/80; tieto výsledky ani neskôr odhalené anotačné nedostatky nie sú skryté. V3 už obsahuje vystavených 80 otázok ako DEV. Nový malý TEST je profilovo oddelený, ale nie je reprezentatívnym dôkazom všeobecnej 100 % presnosti. Kvalita finálnej LLM odpovede a kompletný OpenWebUI GraphRAG agent patria do ďalších blokov projektu.
|
||||
|
||||
Docker overenie po zostavení finálneho obrazu: obsahové odtlačky Python kódu a datasetu v kontajneri sa zhodujú s manifestom v3, grafový DEV dotaz prešiel a `/health` má `ready=true`. Po testoch sa odstránila regenerovateľná Python/pytest cache mimo `.venv`; zoznam je v cleanup manifeste.
|
||||
71
docs/graphrag_v4_2026-10-25_worklog.md
Normal file
71
docs/graphrag_v4_2026-10-25_worklog.md
Normal file
@ -0,0 +1,71 @@
|
||||
# Dokončenie širšej GraphRAG evaluácie v4
|
||||
|
||||
Zdrojové meranie a obmedzenia: [správa v4](../tools/graphrag/evaluation/results/final_v4_2026-10-25/REPORT.md).
|
||||
|
||||
## Rozsah a záloha
|
||||
|
||||
Pracovalo sa na grafovej vrstve a jej evaluácii. Stabilný klasický RAG, indexové JSON, baseline aj historické merania v1–v3 ostali zachované. Aktuálny default `jp170na/zpwiki:master` bol porovnaný s lokálnym checkoutom. Archív projektu a samostatný snapshot spravovaného Neo4j grafu sú v `/tmp/zp-agent-graphrag-v4-backup-20261025T013116Z/`. Konfiguračné kľúče sa do výsledkov ani Gitu nekopírujú.
|
||||
|
||||
## Zmeny
|
||||
|
||||
1. `benchmark_v4.py`: 320 nových zdrojových TEST otázok v 10 kategóriách; 722 DEV otázok zvlášť. Kvóty a seed sú určené bez výsledkov vyhľadávania. Žiadna otázka sa nevyraďuje podľa neúspechu.
|
||||
2. Normalizované logické skupiny bránia tomu, aby sa parafráza rovnakého zadania tvárila ako nezávislý TEST. Freeze deklaruje, že 72 známych profilov sa prekrýva; nezamieňa to za profilovo nezávislé v2/v3 meranie.
|
||||
3. Zdrojový oracle a grafový builder rozlišujú názvy, návrhy názvov, témy, organizačné poznámky, súvisiace práce a odkazy. Explicitný názov má prednosť. Linkovaný názov tímového projektu sa extrahuje ako názov, nie URL. Vyhľadávanie na názov nevracia bezmenný akademický záznam ako pozitívnu odpoveď.
|
||||
4. Explicitný akademický rozsah `2022/23` sa nesmie prepísať nesúvisiacou kategóriou `vp2021`. Graf bol bezpečne znovu zostavený z rovnakých JSON vstupov.
|
||||
5. Audit overuje všetky očakávania oproti raw Markdownu. Priama kontrola má 616 dôkazových záznamov, bez chyby. Doplnené sú zdrojové adjudikácie, mapovanie ID a vzorka kontroly pôvodných riadkov.
|
||||
6. Osobitný `tools/answer_evaluation/` hodnotí skutočné odpovede školského modelu cez OpenWebUI API po dodaní grafového kontextu. Nejde o prehliadač ani nainštalovaný nástroj. Prvých 20 externých otázok je DEV; zostávajúcich 300 je TEST generovania. Kód a prompt majú vlastné odtlačky a presné ID. Pôvodný slabší diagnostický výsledok zostal uložený.
|
||||
7. Nové regresné testy cielia neplatné zdrojové názvy, rok, únik logických skupín, chybné tvrdenia, null hodnoty a zámenu diplomovej/dizertačnej práce. Kompletná sada: 448 passed, 4 skipped.
|
||||
|
||||
## Použité príkazy
|
||||
|
||||
```bash
|
||||
# Kontrola stavu a aktuálneho zdroja:
|
||||
git status --short
|
||||
git -C ../zpwiki ls-remote --symref origin HEAD
|
||||
|
||||
# Benchmark sa vytvára len do nových ciest:
|
||||
.venv/bin/python -m tools.graphrag.evaluation.benchmark_v4
|
||||
|
||||
# Po načítaní .env, bez vypísania jeho hodnôt:
|
||||
.venv/bin/python -m tools.graphrag.build_graphrag
|
||||
RUN_NEO4J_TESTS=1 HF_HUB_OFFLINE=1 TRANSFORMERS_OFFLINE=1 \
|
||||
.venv/bin/python -m pytest -q -p no:cacheprovider
|
||||
|
||||
.venv/bin/python -m tools.graphrag.evaluation.evaluate_graphrag \
|
||||
--split dev --audit tools/graphrag/evaluation/results/v4_preparation/source_audit.json \
|
||||
--output-dir tools/graphrag/evaluation/results/final_v4_2026-10-25
|
||||
.venv/bin/python -m tools.graphrag.evaluation.freeze_graphrag \
|
||||
--dev-results tools/graphrag/evaluation/results/final_v4_2026-10-25/graphrag_dev.json \
|
||||
--audit tools/graphrag/evaluation/results/v4_preparation/source_audit.json \
|
||||
--output tools/graphrag/evaluation/frozen_v4.json
|
||||
.venv/bin/python -m tools.graphrag.evaluation.evaluate_graphrag \
|
||||
--split test --audit tools/graphrag/evaluation/results/v4_preparation/source_audit.json \
|
||||
--freeze-manifest tools/graphrag/evaluation/frozen_v4.json \
|
||||
--output-dir tools/graphrag/evaluation/results/final_v4_2026-10-25
|
||||
|
||||
# Pôvodná diagnostika, potom nový prompt na DEV a nový TEST generovania:
|
||||
.venv/bin/python -m tools.graphrag.evaluation.check_openwebui \
|
||||
--freeze-manifest tools/graphrag/evaluation/frozen_v4.json \
|
||||
--audit tools/graphrag/evaluation/results/v4_preparation/source_audit.json \
|
||||
--output tools/graphrag/evaluation/results/final_v4_2026-10-25/openwebui_sample.json
|
||||
.venv/bin/python -m tools.answer_evaluation.evaluate_graph_answers \
|
||||
--split dev --output-dir tools/graphrag/evaluation/results/answers_v4_dev_2026-10-25
|
||||
.venv/bin/python -m tools.answer_evaluation.evaluate_graph_answers \
|
||||
--split test --output-dir tools/graphrag/evaluation/results/answers_v4_test_2026-10-25
|
||||
```
|
||||
|
||||
Medzi DEV behmi sa opravovali zdrojové anotácie a kód. Po finálnom grafovom TESTe sa grafový kód ani dataset nemenili. Po spustení 300-otázkového LLM TESTu sa nemenil prompt, kontextový adaptér ani hodnotenie. Reprodukcia vyžaduje nové výstupné adresáre a pôvodné odtlačky; nie je novým nezávislým meraním.
|
||||
|
||||
## Finálny výsledok
|
||||
|
||||
Grafový strict TEST 320/320 (100 %); zdrojový audit všetkých kontextových faktov 319/320 (99,69 %). Externý TEST odpovedí 281/300 (93,67 %), vrátane 19 zlyhaní, z toho 7 chýb spracovania JSON. Cieľ ≥92 % splnený v prvom finálnom behu oboch experimentov. Úplné JSON/CSV, zdrojové audity, súhrn a rozpis chýb sú uložené. Natívny výber nástrojov hlavným agentom zostáva bodom 4.
|
||||
|
||||
Docker obraz bol znovu zostavený a existujúci API kontajner obnovený bez reštartu Neo4j. Obsahové odtlačky grafového kódu, otázok, JSON vstupov a raw wiki v kontajneri zodpovedajú frozen_v4. Overený bol grafový dotaz aj `/health`.
|
||||
|
||||
```bash
|
||||
docker compose build zp-agent-api
|
||||
docker compose up -d --no-deps zp-agent-api
|
||||
git diff --check
|
||||
git commit -m "Dokončenie GraphRAG evaluácie"
|
||||
git push --atomic origin graphrag-v1 graphrag-v4-frozen
|
||||
```
|
||||
100
docs/graphrag_v5_2026-10-25_worklog.md
Normal file
100
docs/graphrag_v5_2026-10-25_worklog.md
Normal file
@ -0,0 +1,100 @@
|
||||
# GraphRAG v5.1 — dokončenie bodu 3 a história iterácie v5
|
||||
|
||||
## Rozsah a protokol
|
||||
|
||||
Ide o nové meranie opravenej implementácie na historicky odhalených otázkach.
|
||||
Výsledky v1–v4, otázky ani pôvodné očakávania sa neprepisujú. Používa sa
|
||||
722 DEV otázok a 320 historických grafových TEST otázok. Druhý split je vo v5
|
||||
regresia, nie nový nezávislý holdout. Nezavádzajú sa nové otázky iba kvôli skóre.
|
||||
|
||||
Generovanie sa ladí na 39 vopred deklarovaných prípadoch: 20 pôvodných DEV
|
||||
výstupov a 19 zlyhaní historického LLM TESTu. Finálna regresia generovania má
|
||||
všetkých 320 historických otázok vrátane týchto 39 DEV; tento prekryv je
|
||||
výslovne uložený v protokole a vo výsledkoch. Žiadna otázka sa nevynecháva
|
||||
podľa úspechu vyhľadávania alebo modelu.
|
||||
|
||||
Záloha kódu, dát a spravovaného grafu je v
|
||||
`/tmp/zp-bod3-v5-backup-20261025T155423Z/`. Konfiguračné tajomstvá sa nearchivujú.
|
||||
|
||||
## Opravy
|
||||
|
||||
- Príprava na akademický projekt je organizačná poznámka. Sama nevytvára
|
||||
akademický záznam ani jeho rok. Tým sa rieši historický prípad `wide-080`.
|
||||
- Označenie „Návrh na zadanie BP“ samo nedokazuje názov práce. Pri doplnkovej
|
||||
kontrole DEV sa odhalili tri výstupy Martina Šarišského s takto odhadnutým
|
||||
názvom. Parser teraz používa explicitné názvy/témy alebo dovolený úvodný
|
||||
názvový odsek. Očakávania benchmarku sa kvôli predikciám nemenili.
|
||||
- Prvá zmrazená v5 mala regresiu 319/320. `wide-275` odhalil konzultačnú
|
||||
poznámku nesprávne použitú ako názov projektu na hranici chunku. V5.1
|
||||
vylučuje tieto organizačné vety; prvá iterácia a overený zdrojový patch ostávajú uložené.
|
||||
- Evaluator odmieta `complete=false` aj bez príznaku `truncated` a kontroluje
|
||||
všetky vrátené typované fakty proti nezávislému čítaniu raw Markdownov:
|
||||
osobu, dokument, URL, akademický názov/rok/typ, metadata na tom istom
|
||||
dokumente, zdieľané vlastnosti a porovnania rokov. Chybné nadbytočné fakty
|
||||
znižujú strict skóre. Nejde o všeobecný sémantický súd ľubovoľných viet.
|
||||
- Zmrazenie zahŕňa spoločné moduly, publikačnú politiku a pravidlo prípravy;
|
||||
finálna generácia kontroluje identitu kódu/promptu/dát voči dokončenému DEV.
|
||||
- Pokyny pre LLM vysvetľujú väzbu názvu a tagu pri tej istej osobe aj cez
|
||||
dcérsky dokument. Kategória a autor dokumentu musia mať spoločný dokument.
|
||||
- JSON sa kontroluje typovanou schémou. Jeden úplný JSON blok sa môže vybrať
|
||||
z Markdown ohraničenia bez prepisovania hodnôt. Skutočne neplatný JSON môže
|
||||
vyvolať najviac jeden opravný požiadavok s pôvodnou otázkou a kontextom.
|
||||
Gold odpovede sa neposielajú modelu; všetky pokusy aj prvotná úspešnosť sa ukladajú.
|
||||
|
||||
## Overenie a príkazy
|
||||
|
||||
Kompletná regresná sada finálnej v5.1: **525 passed, 4 skipped**. Prvý prísny
|
||||
DEV mal 719/722; tri nesúlady názvu viedli k oprave parsera uvedenej vyššie.
|
||||
V5 mala DEV 722/722, regresiu 319/320 a DEV generovania 38/39. V5.1 má
|
||||
DEV 722/722 a regresiu 320/320 vrátane všetkých typovaných faktov; DEV
|
||||
generovania zostal 38/39. Tieto priebežné výsledky sa nezatajujú.
|
||||
|
||||
Použité hlavné príkazy po načítaní lokálnej konfigurácie:
|
||||
|
||||
```bash
|
||||
RUN_NEO4J_TESTS=1 HF_HUB_OFFLINE=1 TRANSFORMERS_OFFLINE=1 .venv/bin/python -m pytest -q
|
||||
docker compose build zp-agent-api
|
||||
docker compose up -d --no-deps zp-agent-api
|
||||
```
|
||||
|
||||
Koordinovaná obnova indexov používa autentifikovaný `POST /sync` s
|
||||
`{"pull_git":false}`. Korpus zostáva 114 dokumentov/887 chunkov, aktualizovaný
|
||||
graf má 446 uzlov a 877 vzťahov. Presné indexové verzie a finálne výsledky
|
||||
sú identifikované vo finálnej správe v5.1 a v zázname overenia nasadenia.
|
||||
|
||||
Grafový protokol:
|
||||
|
||||
```bash
|
||||
python -m tools.graphrag.evaluation.evaluate_graphrag \
|
||||
--split dev --audit tools/graphrag/evaluation/results/v5_1_preparation/source_audit.json \
|
||||
--output-dir tools/graphrag/evaluation/results/final_v5_1_2026-10-25
|
||||
python -m tools.graphrag.evaluation.freeze_graphrag \
|
||||
--dev-results tools/graphrag/evaluation/results/final_v5_1_2026-10-25/graphrag_dev.json \
|
||||
--audit tools/graphrag/evaluation/results/v5_1_preparation/source_audit.json \
|
||||
--purpose historical_regression --output tools/graphrag/evaluation/frozen_v5_1.json
|
||||
python -m tools.graphrag.evaluation.evaluate_graphrag \
|
||||
--split test --audit tools/graphrag/evaluation/results/v5_1_preparation/source_audit.json \
|
||||
--freeze-manifest tools/graphrag/evaluation/frozen_v5_1.json \
|
||||
--output-dir tools/graphrag/evaluation/results/final_v5_1_2026-10-25
|
||||
```
|
||||
|
||||
Generovanie nad rovnakým zmrazeným grafom:
|
||||
|
||||
```bash
|
||||
python -m tools.answer_evaluation.evaluate_graph_answers \
|
||||
--split dev --dev-ids tools/graphrag/evaluation/results/v5_1_preparation/generation_dev_ids.json \
|
||||
--audit tools/graphrag/evaluation/results/v5_1_preparation/source_audit.json \
|
||||
--freeze-manifest tools/graphrag/evaluation/frozen_v5_1.json \
|
||||
--output-dir tools/graphrag/evaluation/results/answers_v5_1_dev_2026-10-25
|
||||
python -m tools.answer_evaluation.evaluate_graph_answers \
|
||||
--split regression --dev-ids tools/graphrag/evaluation/results/v5_1_preparation/generation_dev_ids.json \
|
||||
--dev-results tools/graphrag/evaluation/results/answers_v5_1_dev_2026-10-25/answers_dev.json \
|
||||
--audit tools/graphrag/evaluation/results/v5_1_preparation/source_audit.json \
|
||||
--freeze-manifest tools/graphrag/evaluation/frozen_v5_1.json \
|
||||
--output-dir tools/graphrag/evaluation/results/answers_v5_1_regression_2026-10-25
|
||||
```
|
||||
|
||||
Príkazy vyššie dokumentujú pôvodný beh. Pri reprodukcii použite nové výstupné
|
||||
adresáre a zachovajte zodpovedajúci zmrazený manifest. Nový manifest vytvárajte
|
||||
pre novú verziu; existujúce finálne súbory sú nemenné. Reprodukcia nie je nový
|
||||
nezávislý TEST. Aktuálny release označuje Git tag `graphrag-v5.1-frozen`.
|
||||
165
docs/graphrag_v6_2026-10-25_worklog.md
Normal file
165
docs/graphrag_v6_2026-10-25_worklog.md
Normal file
@ -0,0 +1,165 @@
|
||||
# GraphRAG v6 — kontext, citácie a kontrola zdrojov
|
||||
|
||||
Práce z 25. 10. 2026 nadväzujú na historickú v5.1. Výsledky a otázky v1–v5.1
|
||||
sa neprepisujú. Záloha vstupného projektu je v
|
||||
`/tmp/zp-v6-backup-20261025T170922Z/before.tar.gz`, dodatočný snapshot grafu
|
||||
v `/tmp/zp-v6-graph-before.json`. Sú to lokálne zálohy, nie verzované artefakty.
|
||||
|
||||
## Osem úloh
|
||||
|
||||
1. RAG vkladá `complete`, `truncated`, `truncation_reasons`, `index_version`
|
||||
aj do textového kontextu. Grafový adaptér tieto hodnoty prenáša bez
|
||||
domýšľania; starý výsledok bez verzie ostáva s `index_version=null`.
|
||||
2. Oba prompty rozlišujú úplné, neúplné a neznáme pokrytie. Kontrola generovania
|
||||
vyžaduje upozornenie na neúplnosť. Presný agregovaný počet môže byť úplný,
|
||||
aj keď sú orezané zobrazené dôkazy. Z neúplnej agregácie sa celkový počet
|
||||
nesmie odvodzovať.
|
||||
3. Spoločný modul `context_policy.py` kontroluje `source_urls` aj odkazy priamo
|
||||
v texte vrátane Markdownu, relatívnych cieľov a adries s `www.`. Povolené
|
||||
sú presné URL zdrojov konkrétneho dotazu, nie ľubovoľné známe wiki URL.
|
||||
Úvodzovky a bežná interpunkcia nie sú súčasťou citovanej URL.
|
||||
4. Nové testy obsahujú správnu povinnú citáciu s ďalším chybným odkazom,
|
||||
správnu URL iného dotazu, relatívny a ne-HTTP odkaz aj korektné citácie.
|
||||
Archivované odpovede sa znovu skontrolovali bez volania modelu a bez
|
||||
prepisovania ich pôvodných skóre. Nový prepočet je v
|
||||
`results/v6_preparation/citation_regrade.json`.
|
||||
Kontrola zahŕňa 56 archivovaných súborov a 6 044 odpovedí (opakované
|
||||
experimenty sa prekrývajú), s piatimi porušeniami prísneho kontraktu URL.
|
||||
5. Typ práce sa nesmie vydávať za `keyword`. `answer_candidates` spája
|
||||
doložený názov/rok a doslovný tag cez tú istú osobu aj cez jej dcérske
|
||||
dokumenty. Nespája ľudí navzájom; názov s rokom musí patriť jednému
|
||||
akademickému záznamu a kategória s autorom rovnakému dokumentu.
|
||||
6. Vzorka 34 otázok zahŕňa všetkých desať kategórií a známe rizikové prípady.
|
||||
Priame čítanie pôvodných Markdownov je oddelené od grafového retrievera;
|
||||
vykonala ho AI. Výber, výňatky, SHA-256, závery a hárok pre človeka sú
|
||||
v `results/v6_preparation/`. **Ľudské posúdenie neprebehlo.**
|
||||
7. Celý grafový DEV, regresia a generované odpovede sa merajú samostatne.
|
||||
Zmrazenie zahŕňa spoločné moduly, schému odpovede, kontroly kontextu,
|
||||
publikačnú politiku a kód RAG evaluátora; generovanie navyše fixuje prompt,
|
||||
model, jeho parametre a vybrané ID. Finálne opakovanie známych otázok je
|
||||
historická regresia, nie nový nezávislý TEST.
|
||||
8. Nasadený Docker sa overuje voči zmrazeniu, `/health`, reálnemu `/rag`,
|
||||
grafovým dotazom v kontajneri a spoločnej generácii JSON/SQLite/Neo4j.
|
||||
Synchronizácia sa vykonala cez `/sync` s `pull_git=false`, bez zmeny wiki.
|
||||
|
||||
## Kontroly a opravný pokus
|
||||
|
||||
`generate_checked_answer()` nedostáva benchmark, očakávanú odpoveď ani oracle.
|
||||
Používa iba otázku, skutočný kontext, prompt a klienta modelu. Najviac jeden
|
||||
spoločný opravný požiadavok rieši neplatný JSON alebo porušenie pravidiel
|
||||
kontextu. Gold sa používa až po ukončení generovania. Chybná odpoveď, prípadný
|
||||
opravný pokus aj konečné odmietnutie sú uložené; odmietnutá odpoveď sa počíta
|
||||
ako zlyhanie, nevynecháva sa z menovateľa.
|
||||
|
||||
`accepted_for_delivery=false` znamená, že konzument odpoveď nesmie zobraziť
|
||||
ako overenú. Nejde o záruku pravdivosti každého voľného súvetia. Kontroly
|
||||
overujú citácie, štruktúrované fakty a vybrané rozpory; formálna evaluácia
|
||||
navyše kontroluje požadované väzby, hodnoty v texte a zdrojové dôkazy.
|
||||
Budúci OpenWebUI agent musí tieto kontroly volať a rešpektovať ich výsledok;
|
||||
natívne rozhodovanie a smerovanie nástrojov ostáva bodom 4.
|
||||
|
||||
Klasický RAG má samostatnú prezentačnú funkciu `finalize_rag_answer()`.
|
||||
Ak model uviedol správne podložené údaje, ale vynechal povinné upozornenie,
|
||||
pridá iba vetu „Výpis je neúplný.“ a uchová presný pôvodný `model_answer`,
|
||||
pôvodné kontrolné dôvody aj príznak `display_notice_added`. Nepridáva fakty
|
||||
ani ďalší požiadavok na model. Neznáme citácie a nepodložené tvrdenie o úplnom
|
||||
zozname týmto spôsobom neobchádza. RAG evaluátor používa túto funkciu pred
|
||||
hodnotením a budúci nástroj ju musí použiť pred doručením odpovede.
|
||||
|
||||
Päť vopred vybraných živých RAG prípadov malo správne fakty a zdroje 5/5,
|
||||
ale chýbajúce upozornenie 5/5. Pôvodné výstupy ostávajú v `rag_live_smoke.json`.
|
||||
Prehratie tých istých odpovedí cez prezentačnú funkciu má 5/5 prijateľných
|
||||
výstupov v `rag_delivery_replay.json`. Nie je to nové meranie modelu ani
|
||||
odhad presnosti klasického RAG z piatich prípadov. Zmena tejto čisto RAG
|
||||
vrstvy nezasahuje do zmrazeného grafového generovania; celkový release
|
||||
navyše fixuje všetky runtime moduly v `frozen_release_v6.json`.
|
||||
|
||||
## Zistenia zo zdrojovej kontroly
|
||||
|
||||
Generický odkaz `Písomná práca: [rešerš](...)` nie je doložený názov projektu.
|
||||
V Dáriusovom profile je v sekcii TP 2019, zatiaľ čo cieľový dokument má vlastný
|
||||
názov a kategóriu `tp2020`. Názov ani rok dcérskeho dokumentu sa neprenášajú
|
||||
do nadradeného akademického záznamu. To isté pravidlo platí pre všetkých ľudí,
|
||||
nie iba pre dve známe zlyhania modelu. Konkrétny názov typu „Rešerš na tému
|
||||
prekladu“ ostáva platným kandidátom.
|
||||
|
||||
Nový benchmark v6 zachováva všetkých 1 042 ID, texty, kategórie a rozdelenie
|
||||
722 DEV / 320 regresia. Opravených je 15 očakávaní vrátane štyroch
|
||||
`wide-116`, `wide-142`, `wide-145`, `wide-165`; tieto štyri otázky ostávajú
|
||||
v pôvodných kategóriách a očakávajú `no_answer`. Regresia má preto 284
|
||||
kladných a 36 záporných očakávaní. Úplné pred/po je v
|
||||
`source_adjudications.json`. Vyššie skóre oproti v5.1 nemožno pripísať iba
|
||||
zlepšeniu modelu, keďže sa opravil aj gold a zmenili kontroly.
|
||||
|
||||
Zo vzorky: 31 očakávaní podporených, dve opravené a jedno podmienené zavedenou
|
||||
konvenciou. Pri `wide-112` Tomáš Kuchárik nemá výslovnú vetu o začiatku
|
||||
štúdia; rok 2016 sa odvodzuje z ročníka adresára `students/2016`. Tento
|
||||
fallback používa aj existujúci systém. Nie je nezávislým dôkazom skutočného
|
||||
dátumu nástupu a vyžaduje potvrdenie človekom pred interpretáciou ako
|
||||
administratívny fakt.
|
||||
|
||||
Pri prísnej politike „všetky URL len zo sources“ historický RAG prípad
|
||||
`q0892` neprejde, lebo v texte navyše uvádza `http://skner.tukekemt.xyz`.
|
||||
Táto adresa v súčasnom Markdowne reálne existuje; nie je to dôkaz halucinácie.
|
||||
Nie je však v archivovanom zozname nástrojových `source_url`. Nové skóre je
|
||||
skóre dodržania prísneho kontraktu, nie nový úsudok o pravdivosti tej adresy.
|
||||
|
||||
## Protokol generovania
|
||||
|
||||
DEV má vopred vybraných 42 známych otázok: predchádzajúcich 39, historickú
|
||||
chybu `wide-129` a opravené title otázky. Prvý DEV kandidát mal 41/42;
|
||||
`wide-283` nesprávne odmietol spojenie tagu a roku cez profil a dcérsky dokument.
|
||||
Nasledovala oprava všeobecného spojenia osoby a nový DEV pred finálnym behom.
|
||||
Pôvodný kandidátsky DEV je zachovaný v `answers_v6_dev_2026-10-25`.
|
||||
`frozen_candidate.json` a overený `candidate_to_final.patch` zachovávajú
|
||||
prvú kandidátsku implementáciu; spätné aplikovanie patchu ju obnoví.
|
||||
Kandidátske retrieval výpisy sú iba v lokálnej zálohe
|
||||
`/tmp/zp-v6-candidate-before-year-join/retrieval`; pre finálne grafové čísla
|
||||
sa používajú výhradne plné uložené v6 výsledky. Kandidát nie je release.
|
||||
Finálna regresia vždy obsahuje všetkých 320 otázok vrátane DEV prekryvu.
|
||||
|
||||
## Príkazy a reprodukcia
|
||||
|
||||
Prostredie načítavajte bez vypisovania `.env`. Existujúce výstupné adresáre
|
||||
ani zmrazené súbory neprepisujte; pri reprodukcii zvoľte nové cesty.
|
||||
|
||||
```bash
|
||||
python -m tools.graphrag.evaluation.benchmark_v6
|
||||
RUN_NEO4J_TESTS=1 HF_HUB_OFFLINE=1 TRANSFORMERS_OFFLINE=1 python -m pytest -q
|
||||
python -m tools.graphrag.evaluation.evaluate_graphrag \
|
||||
--questions tools/graphrag/evaluation/graphrag_questions_v6.json --split dev \
|
||||
--audit tools/graphrag/evaluation/results/v6_preparation/source_audit.json \
|
||||
--output-dir NOVY_RETRIEVAL_ADRESAR
|
||||
python -m tools.graphrag.evaluation.freeze_graphrag \
|
||||
--dev-results NOVY_RETRIEVAL_ADRESAR/graphrag_dev.json \
|
||||
--questions tools/graphrag/evaluation/graphrag_questions_v6.json \
|
||||
--audit tools/graphrag/evaluation/results/v6_preparation/source_audit.json \
|
||||
--purpose historical_regression --output NOVY_MANIFEST.json
|
||||
python -m tools.graphrag.evaluation.evaluate_graphrag \
|
||||
--questions tools/graphrag/evaluation/graphrag_questions_v6.json --split test \
|
||||
--audit tools/graphrag/evaluation/results/v6_preparation/source_audit.json \
|
||||
--freeze-manifest NOVY_MANIFEST.json --output-dir NOVY_RETRIEVAL_ADRESAR
|
||||
python -m tools.answer_evaluation.evaluate_graph_answers \
|
||||
--questions tools/graphrag/evaluation/graphrag_questions_v6.json \
|
||||
--audit tools/graphrag/evaluation/results/v6_preparation/source_audit.json \
|
||||
--freeze-manifest NOVY_MANIFEST.json \
|
||||
--dev-ids tools/graphrag/evaluation/results/v6_preparation/generation_dev_ids.json \
|
||||
--split dev --output-dir NOVY_LLM_DEV
|
||||
python -m tools.answer_evaluation.evaluate_graph_answers \
|
||||
--questions tools/graphrag/evaluation/graphrag_questions_v6.json \
|
||||
--audit tools/graphrag/evaluation/results/v6_preparation/source_audit.json \
|
||||
--freeze-manifest NOVY_MANIFEST.json \
|
||||
--dev-ids tools/graphrag/evaluation/results/v6_preparation/generation_dev_ids.json \
|
||||
--dev-results NOVY_LLM_DEV/answers_dev.json \
|
||||
--split regression --output-dir NOVY_LLM_REGRESSION
|
||||
docker compose build zp-agent-api
|
||||
docker compose up -d zp-agent-api
|
||||
```
|
||||
|
||||
`benchmark_v6` slúži na jednorazovú migráciu a odmietne prepísať hotový dataset.
|
||||
Pri obyčajnej reprodukcii používajte uložené v6 otázky. Živé syntetické
|
||||
funkčné scenáre sa spúšťajú cez `tools.answer_evaluation.check_context_scenarios`;
|
||||
nepripočítavajú sa k 320 otázkam ani k meraniu presnosti na wiki.
|
||||
|
||||
Finálne čísla, zlyhania a stav nasadenia:
|
||||
[správa v6](../tools/graphrag/evaluation/results/final_v6_2026-10-25/REPORT.md).
|
||||
133
docs/graphrag_v7_2026-10-26_worklog.md
Normal file
133
docs/graphrag_v7_2026-10-26_worklog.md
Normal file
@ -0,0 +1,133 @@
|
||||
# Uzavretie bodu 3 — GraphRAG v7, 26. 10. 2026
|
||||
|
||||
V7 opravuje konkrétne chyby z posledného auditu. Historické otázky,
|
||||
manifesty, tagy a výsledky v1–v6 zostávajú zachované. Záloha projektu,
|
||||
indexových súborov a grafu je v `/tmp/zp-v7-backup-20261026/`.
|
||||
|
||||
## Opravy
|
||||
|
||||
1. Dotaz rešpektuje ľubovoľný štvormiestny rok vrátane 1899, 1999, 2100
|
||||
a 9999. Nepodporovaný zápis po „roku“, napríklad 10000 alebo 20xx,
|
||||
sa odmieta cez `unsupported_year_constraint`. Podmienka sa nepremení
|
||||
na vyhľadávanie bez časového obmedzenia.
|
||||
2. Upozornenie na neúplnosť už nepovoľuje kladné tvrdenie o úplnom zozname
|
||||
v inej vete. Kontrola rozlišuje aj pravdivé popretie „Nie je to úplný
|
||||
zoznam“. Testy obsahujú obe možnosti aj skloňované „všetkých študentov“.
|
||||
3. Model vyberá štruktúrované `claims`, `source_urls`, `status`, `count`;
|
||||
`answer` ponecháva prázdne. Text pre používateľa zostaví
|
||||
`render_graph_answer()` z overených hodnôt, bez gold a bez nových faktov.
|
||||
Pôvodná HTTP odpoveď, parsované tvrdenia a vykreslená odpoveď ostávajú
|
||||
osobitne uložené. Voľná próza modelu sa nepoužíva ako doručený text.
|
||||
4. Pri kontrole starého alebo neočakávaného voľného textu sa odmietajú
|
||||
nepodložené číselné údaje. URL a doslovné hodnoty overených titulov sa
|
||||
pred týmto porovnaním odlíšia od nových tvrdení. Prípad s dopísaným
|
||||
rokom 2099 tak neprejde. Samotné porovnávanie čísel nie je úplný
|
||||
sémantický analyzátor slovenčiny; doručený grafový text je preto
|
||||
deterministický a obsahuje iba overené polia.
|
||||
5. `count` musí mať podklad v úplnej agregácii. Pozitívna faktová odpoveď
|
||||
musí obsahovať tvrdenia a citácie; kontrolujú sa zdroje jednotlivých
|
||||
uvedených atribútov. Prázdna úplná agregácia s počtom 0 je platná.
|
||||
6. Citácie sa kontrolujú v bežnom texte, inline a referenčnom Markdowne
|
||||
aj HTML `href`/`src`, vrátane relatívnych URL, HTML entít a vnorených
|
||||
zátvoriek v platnej URL. Povolené sú iba URL dodané pre konkrétny dotaz.
|
||||
7. Ročník adresára sa prestal používať ako začiatok štúdia. Builder aj
|
||||
nezávislý oracle vyžadujú explicitnú vetu v texte. Graf uvádza
|
||||
`start_year_basis=explicit_text|missing` a
|
||||
`start_year_confidence=documented|unknown`. Oracle vedie `cohort_year`
|
||||
oddelene; táto hodnota sa nevydáva za začiatok štúdia. Pri chýbajúcom
|
||||
údaji nástroj vráti `missing_documented_start_year`.
|
||||
8. Hodnotenie mena povoľuje obmedzené gramatické prípony v prirodzenom
|
||||
texte, ale štruktúrovanú identitu naďalej porovnáva presne. „Martina
|
||||
NaN1“ sa nezamieňa za iného Martina. Pri deterministickom texte sú
|
||||
mená aj tak v pôvodnom tvare. Parser JSON neprepisuje neplatné hodnoty;
|
||||
jeden spoločný opravný požiadavok pre formát/kontext ostáva limitom.
|
||||
9. Evaluačné CLI vyžadujú explicitný dataset, audit a manifest. Odpovedný
|
||||
runner vyžaduje aj zoznam DEV; historická regresia navyše vlastné ID.
|
||||
Už nevyberajú v4 ako tichý predvolený benchmark. Hashované cesty kódu
|
||||
generovania sú relatívne voči projektu, aby sa dali overiť aj inde.
|
||||
|
||||
## Benchmark a oddelenie meraní
|
||||
|
||||
Všetkých 1 042 odhalených v6 otázok prešlo do DEV. Pridali sa štyri
|
||||
potrebné regresné otázky na roky mimo 20xx. DEV má **1 046 otázok**.
|
||||
Odstránenie odhadu štúdia opravilo 10 očakávaní; údaje, ktoré dokument
|
||||
neuvádza, sa očakávajú ako nenájdené. ID ani text pôvodných otázok sa
|
||||
nevymazali. Zmeny sú v `v7_preparation/source_corrections.json`.
|
||||
|
||||
Nový **TEST má 80 otázok**, 72 kladných a 8 záporných, vo všetkých
|
||||
desiatich kategóriách. Seed, kvóty a výber boli uložené pred vyhľadávaním.
|
||||
Žiadna logická query skupina sa neprekrýva s odhalenými otázkami ani DEV.
|
||||
Ide o nové kombinácie nad známou wiki, osobami a šablónami. Nie je to
|
||||
experiment s neznámymi osobami, novým korpusom alebo ľudskou anotáciou.
|
||||
|
||||
Počet otázok v kategóriách je obmedzený dostupnými novými skupinami:
|
||||
spojenie autor–kategória má dve nové skupiny, výpis kategórií sedem.
|
||||
Kvóty sa neurčovali podľa úspechu retrievera. Reprezentatívnu vzorku
|
||||
20 otázok (dve z každej kategórie) skontrolovala AI priamo oproti
|
||||
Markdownom pred meraním. `source_review_packet.json` obsahuje pôvodné
|
||||
výňatky a dôkazy; `source_review.csv` závery. **Človek ju neanotoval.**
|
||||
Odstránenie odhadu z adresára teda rieši neistotu z auditu; nenahrádza
|
||||
nezávislú ľudskú anotáciu celého korpusu.
|
||||
|
||||
Graf sa zmrazí po kompletnom DEV. Generovanie má vopred deklarovaných
|
||||
46 DEV otázok: predchádzajúcich 42 a štyri nové rokové regresie.
|
||||
Finálny nový TEST sa spustí raz po úspešnom DEV. Výsledky sa nepoužijú
|
||||
na ladenie tejto verzie. Všetkých 320 pôvodných historických otázok sa
|
||||
meria oddelene ako regresia; jej prekryv s modelovým DEV je priznaný.
|
||||
|
||||
## Zmrazenie a nasadenie
|
||||
|
||||
`frozen_v7.json` viaže implementáciu, raw Markdown, dataset, JSON vstupy,
|
||||
graf, publikačnú politiku a parametre. Deklarácia `frozen_answers.json`
|
||||
navyše fixuje model, prompt, renderer a presné ID merania. Kompletný
|
||||
`frozen_release_v7.json` pokrýva všetky runtime moduly a merané artefakty.
|
||||
|
||||
Docker sa overuje cez `/health`, reálne `/rag`, grafové pozitívne aj
|
||||
negatívne dotazy, novú rokovú regresiu a chýbajúci začiatok štúdia.
|
||||
JSON, SQLite a Neo4j majú spoločnú generáciu po `/sync` s `pull_git=false`.
|
||||
Publikačná politika ostáva: iba explicitné `published=false` sa vylúči.
|
||||
|
||||
## Príkazy
|
||||
|
||||
Konfiguráciu načítajte z prostredia bez jej vypisovania. Pri reprodukcii
|
||||
vždy používajte nové výstupné cesty; existujúce otázky a merania neprepisujte.
|
||||
|
||||
```bash
|
||||
# Jednorazové vyhlásenie benchmarku; hotový dataset neregenerovať.
|
||||
python -m tools.graphrag.evaluation.benchmark_v7
|
||||
|
||||
RUN_NEO4J_TESTS=1 RUN_LIVE_TESTS=1 RUN_LIVE_RAG_E2E=1 \
|
||||
HF_HUB_OFFLINE=1 TRANSFORMERS_OFFLINE=1 python -m pytest -q
|
||||
|
||||
python -m tools.graphrag.evaluation.evaluate_graphrag \
|
||||
--questions tools/graphrag/evaluation/graphrag_questions_v7.json --split dev \
|
||||
--audit tools/graphrag/evaluation/results/v7_preparation/source_audit.json \
|
||||
--output-dir NOVY_GRAF_DEV
|
||||
python -m tools.graphrag.evaluation.freeze_graphrag \
|
||||
--questions tools/graphrag/evaluation/graphrag_questions_v7.json \
|
||||
--dev-results NOVY_GRAF_DEV/graphrag_dev.json \
|
||||
--audit tools/graphrag/evaluation/results/v7_preparation/source_audit.json \
|
||||
--purpose independent_holdout --output NOVY_MANIFEST.json
|
||||
python -m tools.graphrag.evaluation.evaluate_graphrag \
|
||||
--questions tools/graphrag/evaluation/graphrag_questions_v7.json --split test \
|
||||
--audit tools/graphrag/evaluation/results/v7_preparation/source_audit.json \
|
||||
--freeze-manifest NOVY_MANIFEST.json --output-dir NOVY_GRAF_DEV
|
||||
|
||||
python -m tools.answer_evaluation.evaluate_graph_answers \
|
||||
--questions tools/graphrag/evaluation/graphrag_questions_v7.json \
|
||||
--audit tools/graphrag/evaluation/results/v7_preparation/source_audit.json \
|
||||
--freeze-manifest NOVY_MANIFEST.json \
|
||||
--dev-ids tools/graphrag/evaluation/results/v7_preparation/generation_dev_ids.json \
|
||||
--split dev --output-dir NOVY_LLM_DEV
|
||||
```
|
||||
|
||||
Pre nový TEST použite tie isté parametre, `--split test`,
|
||||
`--dev-results NOVY_LLM_DEV/answers_dev.json` a nový výstupný adresár.
|
||||
Pri historickej regresii použite `--split regression` a navyše
|
||||
`--regression-ids tools/graphrag/evaluation/results/v7_preparation/regression_ids.json`.
|
||||
Opakovaný beh už odhaleného TESTu je reprodukcia/regresia, nie ďalší
|
||||
nezávislý experiment. Po ladení podľa TESTu treba nový vopred deklarovaný TEST.
|
||||
|
||||
Kompletné výsledky a zostávajúce metodické obmedzenia sú v
|
||||
[správe v7](../tools/graphrag/evaluation/results/final_v7_2026-10-26/REPORT.md).
|
||||
Ďalší blok je natívna integrácia nástrojov a hlavného agenta v OpenWebUI.
|
||||
102
docs/publikovanie_a_dostupnost.md
Normal file
102
docs/publikovanie_a_dostupnost.md
Normal file
@ -0,0 +1,102 @@
|
||||
# Publikovanie dokumentov a dostupnosť nástrojov
|
||||
|
||||
## Jednotná politika
|
||||
|
||||
Používateľ zvolil zahrnutie dokumentov bez `published`. RAG aj GraphRAG preto
|
||||
predvolene používajú `published_only=true` s týmto významom:
|
||||
|
||||
| Hodnota zdroja | Predvolené vyhľadávanie |
|
||||
|---|---|
|
||||
| `published: true` | Zahrnúť |
|
||||
| Chýbajúce `published` alebo normalizované `null` | Zahrnúť |
|
||||
| `published: false` | Vylúčiť |
|
||||
|
||||
Chýbajúca hodnota zodpovedá predvolenému významu príznaku v
|
||||
[Grav](https://learn.getgrav.org/2/content/headers). Táto politika určuje
|
||||
výber podľa `published`; API naďalej používa svoju existujúcu autentifikáciu.
|
||||
V aktuálnom korpuse nie sú nastavené `publish_date` ani `unpublish_date`.
|
||||
|
||||
SQL používa `COALESCE(published, 1) = 1`, graf efektívnu publikačnú hodnotu.
|
||||
Zdrojový JSON a SQLite zachovávajú pôvodné `null`; grafový builder ho
|
||||
normalizuje na efektívne `true`. Všetkých 16 pôvodne neoznačených dokumentov
|
||||
je teda dostupných v oboch vetvách. Jeden explicitne nepublikovaný dokument
|
||||
sa predvolene vylúči.
|
||||
|
||||
Pri RAG sa filter aplikuje na FTS, embeddingy aj všetky rozšírenia kontextu.
|
||||
Pri grafe platí pre katalóg entít, fakty, spoločné vlastnosti, počítanie,
|
||||
prechádzanie grafu a zoznam zdrojov. Entity doložené iba skrytými dokumentmi
|
||||
sa nezaradia do verejného katalógu. Pôvod názvu témy a canonical profilu
|
||||
osoby sa kontroluje podľa príslušného zdrojového dokumentu.
|
||||
|
||||
Výslovné zahrnutie nepublikovaných dokumentov pre autorizované volanie:
|
||||
|
||||
```json
|
||||
{"query": "vyhľadávací dotaz", "published_only": false}
|
||||
```
|
||||
|
||||
Python funkcie používajú rovnaký parameter `published_only=False`.
|
||||
Oba vyhľadávacie CLI podporujú `--include-unpublished`. Pred pripojením
|
||||
nástrojov do OpenWebUI sa používa aktuálna OpenAPI schéma s novým defaultom.
|
||||
|
||||
## Migrácia uloženého grafu
|
||||
|
||||
Po nasadení sa vykoná spoločná synchronizácia. Tá opraví staré zamenenie
|
||||
chýbajúcej hodnoty s `false` a doplní pôvod názvu témy. Verzia indexov obsahuje
|
||||
`publication_policy: explicit-false-hidden-v1`. Pred migráciou predvolené
|
||||
grafové vyhľadávanie vyžaduje synchronizáciu a health uvádza
|
||||
`publication_sync_required`. Existujúce historické merania sa neprepisujú;
|
||||
časť klasického baseline používala aj nepublikované dokumenty.
|
||||
|
||||
## `/health`
|
||||
|
||||
HTTP 200 a `status=ok` označujú živý API proces. `ready` znamená pripravenosť
|
||||
oboch vyhľadávacích nástrojov. Klient/agenta pri výbere konkrétneho nástroja
|
||||
zaujímajú samostatné položky `tools`:
|
||||
|
||||
- `tools.rag`: čitateľný SQLite/FTS5/embedding index, zhoda verzie a známa
|
||||
úspešná inicializácia embeddingového modelu. Úspešné vyhľadanie alebo sync
|
||||
obnoví stav modelu po prípadnom zlyhaní inicializácie.
|
||||
- `tools.neo4j`: dostupné spojenie a vykonanie read-only sondy v databáze.
|
||||
Sonda používa krátke časové limity a nevykonáva automatické opakovania transakcií.
|
||||
- `tools.graphrag`: dostupné Neo4j, neprázdny graf, zhodná generácia dát
|
||||
a migrovaná publikačná politika.
|
||||
|
||||
Výpadok Neo4j nespôsobí nedostupnosť RAG. Neplatný SQLite index môže vyradiť
|
||||
RAG, pričom graf ostane dostupný. Počas nejasného prepnutia generácie sa
|
||||
vyhľadávacie nástroje označia ako nedostupné; stav samotného Neo4j sa uvádza
|
||||
samostatne. Odpovede neobsahujú prihlasovacie údaje ani surové chyby drivera.
|
||||
|
||||
Príklad výpadku Neo4j, skrátený na rozhodujúce polia:
|
||||
|
||||
```json
|
||||
{
|
||||
"status": "ok",
|
||||
"ready": false,
|
||||
"tools": {
|
||||
"rag": {"ready": true, "status": "ready", "reason": null},
|
||||
"neo4j": {"ready": false, "status": "unavailable", "reason": "unreachable"},
|
||||
"graphrag": {"ready": false, "status": "unavailable", "reason": "neo4j_unavailable"}
|
||||
}
|
||||
}
|
||||
```
|
||||
|
||||
Ide o dostupnosť retrieval nástrojov. Health neposiela otázky školskému LLM
|
||||
a nemeria dostupnosť externého generatívneho modelu ani presnosť odpovedí.
|
||||
|
||||
## Overenie nasadenia 25. 10. 2026
|
||||
|
||||
- Kompletná regresná sada: **485 úspešných testov, 4 preskočené**. Zahŕňa
|
||||
skutočné Cypher testy filtrovania, agregácie a grafových prechodov nad
|
||||
izolovaným Neo4j grafom s rollbackom.
|
||||
- Docker image bol znovu zostavený a API nasadené. Autentifikovaný `/sync`
|
||||
bez Git pullu obnovil 114 dokumentov, 887 chunkov a graf 447 uzlov/879 vzťahov.
|
||||
- Reálne `/search`, `/rag` a `search_graph()` overili predvolené vylúčenie
|
||||
skrytého dokumentu aj jeho zahrnutie pri `published_only=false`.
|
||||
- HTTP `/health` hlási všetky tri stavy pripravené; SQLite, súborová verzia
|
||||
a Neo4j používajú rovnakú novú generáciu dát.
|
||||
- Sonda s nefunkčnou adresou Neo4j potvrdila dostupnosť RAG pri nedostupnom
|
||||
grafe. Sonda s chýbajúcim SQLite indexom potvrdila dostupnosť grafu pri
|
||||
nedostupnom RAG. Produkčné služby sa pri týchto sondách nevypínali.
|
||||
|
||||
Strojovo čitateľný výsledok a identifikácia dát:
|
||||
[publikovanie_a_dostupnost_overenie.json](publikovanie_a_dostupnost_overenie.json).
|
||||
162
docs/publikovanie_a_dostupnost_overenie.json
Normal file
162
docs/publikovanie_a_dostupnost_overenie.json
Normal file
@ -0,0 +1,162 @@
|
||||
{
|
||||
"status": "ok",
|
||||
"index_version": {
|
||||
"version": "ff682d98134d406081040902f234c44f",
|
||||
"git_revision": "3e892a1d49e9bce118cd03478ce15e01c2bebb4e",
|
||||
"created_at_utc": "2026-10-25T15:06:03.279424+00:00",
|
||||
"source_sha256": "007792c12f3467dd3203bb4951ccc197fdc0eef669580f1b1f893baf609ca363",
|
||||
"documents_sha256": "0542af2a373771cf7c4a95f93d14f4f687f6a0187846892c959aa6efc4bade52",
|
||||
"chunks_sha256": "437dde589be46e0c30842dd330de22d96a0173d2dbaff9c5f129568cb2bca4c9",
|
||||
"embedding_model": "intfloat/multilingual-e5-small",
|
||||
"publication_policy": "explicit-false-hidden-v1"
|
||||
},
|
||||
"health": {
|
||||
"status": "ok",
|
||||
"ready": true,
|
||||
"database_exists": true,
|
||||
"search_engine": "hybrid_fts5_embeddings",
|
||||
"rag_enabled": true,
|
||||
"zpwiki_exists": true,
|
||||
"security_configured": true,
|
||||
"index_version": {
|
||||
"version": "ff682d98134d406081040902f234c44f",
|
||||
"git_revision": "3e892a1d49e9bce118cd03478ce15e01c2bebb4e",
|
||||
"created_at_utc": "2026-10-25T15:06:03.279424+00:00",
|
||||
"source_sha256": "007792c12f3467dd3203bb4951ccc197fdc0eef669580f1b1f893baf609ca363",
|
||||
"documents_sha256": "0542af2a373771cf7c4a95f93d14f4f687f6a0187846892c959aa6efc4bade52",
|
||||
"chunks_sha256": "437dde589be46e0c30842dd330de22d96a0173d2dbaff9c5f129568cb2bca4c9",
|
||||
"embedding_model": "intfloat/multilingual-e5-small",
|
||||
"publication_policy": "explicit-false-hidden-v1"
|
||||
},
|
||||
"tools": {
|
||||
"rag": {
|
||||
"ready": true,
|
||||
"status": "ready",
|
||||
"reason": null,
|
||||
"embedding_model": "intfloat/multilingual-e5-small",
|
||||
"dimensions": 384,
|
||||
"index_version": {
|
||||
"version": "ff682d98134d406081040902f234c44f",
|
||||
"git_revision": "3e892a1d49e9bce118cd03478ce15e01c2bebb4e",
|
||||
"created_at_utc": "2026-10-25T15:06:03.279424+00:00",
|
||||
"source_sha256": "007792c12f3467dd3203bb4951ccc197fdc0eef669580f1b1f893baf609ca363",
|
||||
"documents_sha256": "0542af2a373771cf7c4a95f93d14f4f687f6a0187846892c959aa6efc4bade52",
|
||||
"chunks_sha256": "437dde589be46e0c30842dd330de22d96a0173d2dbaff9c5f129568cb2bca4c9",
|
||||
"embedding_model": "intfloat/multilingual-e5-small",
|
||||
"publication_policy": "explicit-false-hidden-v1"
|
||||
}
|
||||
},
|
||||
"neo4j": {
|
||||
"ready": true,
|
||||
"status": "ready",
|
||||
"reason": null
|
||||
},
|
||||
"graphrag": {
|
||||
"ready": true,
|
||||
"status": "ready",
|
||||
"reason": null,
|
||||
"index_version": {
|
||||
"chunks_sha256": "437dde589be46e0c30842dd330de22d96a0173d2dbaff9c5f129568cb2bca4c9",
|
||||
"created_at_utc": "2026-10-25T15:06:03.279424+00:00",
|
||||
"documents_sha256": "0542af2a373771cf7c4a95f93d14f4f687f6a0187846892c959aa6efc4bade52",
|
||||
"embedding_model": "intfloat/multilingual-e5-small",
|
||||
"git_revision": "3e892a1d49e9bce118cd03478ce15e01c2bebb4e",
|
||||
"publication_policy": "explicit-false-hidden-v1",
|
||||
"source_sha256": "007792c12f3467dd3203bb4951ccc197fdc0eef669580f1b1f893baf609ca363",
|
||||
"version": "ff682d98134d406081040902f234c44f"
|
||||
},
|
||||
"nodes": 447
|
||||
}
|
||||
}
|
||||
},
|
||||
"publication_counts": {
|
||||
"published_true": 97,
|
||||
"missing": 16,
|
||||
"published_false": 1,
|
||||
"default_visible": 113
|
||||
},
|
||||
"graph_document_counts": {
|
||||
"True": 113,
|
||||
"False": 1
|
||||
},
|
||||
"live_search_checks": {
|
||||
"/search": {
|
||||
"default_hides_unpublished": true,
|
||||
"explicit_opt_out_includes_it": true
|
||||
},
|
||||
"/rag": {
|
||||
"default_hides_unpublished": true,
|
||||
"explicit_opt_out_includes_it": true
|
||||
},
|
||||
"graphrag": {
|
||||
"default_hides_unpublished": true,
|
||||
"explicit_opt_out_includes_it": true,
|
||||
"default_status": "ok"
|
||||
}
|
||||
},
|
||||
"neo4j_outage_probe": {
|
||||
"rag": {
|
||||
"ready": true,
|
||||
"status": "ready",
|
||||
"reason": null,
|
||||
"embedding_model": "intfloat/multilingual-e5-small",
|
||||
"dimensions": 384,
|
||||
"index_version": {
|
||||
"version": "ff682d98134d406081040902f234c44f",
|
||||
"git_revision": "3e892a1d49e9bce118cd03478ce15e01c2bebb4e",
|
||||
"created_at_utc": "2026-10-25T15:06:03.279424+00:00",
|
||||
"source_sha256": "007792c12f3467dd3203bb4951ccc197fdc0eef669580f1b1f893baf609ca363",
|
||||
"documents_sha256": "0542af2a373771cf7c4a95f93d14f4f687f6a0187846892c959aa6efc4bade52",
|
||||
"chunks_sha256": "437dde589be46e0c30842dd330de22d96a0173d2dbaff9c5f129568cb2bca4c9",
|
||||
"embedding_model": "intfloat/multilingual-e5-small",
|
||||
"publication_policy": "explicit-false-hidden-v1"
|
||||
}
|
||||
},
|
||||
"neo4j": {
|
||||
"ready": false,
|
||||
"status": "unavailable",
|
||||
"reason": "unreachable"
|
||||
},
|
||||
"graphrag": {
|
||||
"ready": false,
|
||||
"status": "unavailable",
|
||||
"reason": "neo4j_unavailable"
|
||||
}
|
||||
},
|
||||
"rag_index_outage_probe": {
|
||||
"rag": {
|
||||
"ready": false,
|
||||
"status": "unavailable",
|
||||
"reason": "index_missing"
|
||||
},
|
||||
"neo4j": {
|
||||
"ready": true,
|
||||
"status": "ready",
|
||||
"reason": null
|
||||
},
|
||||
"graphrag": {
|
||||
"ready": true,
|
||||
"status": "ready",
|
||||
"reason": null,
|
||||
"index_version": {
|
||||
"chunks_sha256": "437dde589be46e0c30842dd330de22d96a0173d2dbaff9c5f129568cb2bca4c9",
|
||||
"created_at_utc": "2026-10-25T15:06:03.279424+00:00",
|
||||
"documents_sha256": "0542af2a373771cf7c4a95f93d14f4f687f6a0187846892c959aa6efc4bade52",
|
||||
"embedding_model": "intfloat/multilingual-e5-small",
|
||||
"git_revision": "3e892a1d49e9bce118cd03478ce15e01c2bebb4e",
|
||||
"publication_policy": "explicit-false-hidden-v1",
|
||||
"source_sha256": "007792c12f3467dd3203bb4951ccc197fdc0eef669580f1b1f893baf609ca363",
|
||||
"version": "ff682d98134d406081040902f234c44f"
|
||||
},
|
||||
"nodes": 447
|
||||
}
|
||||
},
|
||||
"checked_at_utc": "2026-10-25T15:09:42.459584+00:00",
|
||||
"regression": {
|
||||
"passed": 485,
|
||||
"skipped": 4,
|
||||
"failed": 0,
|
||||
"includes_real_neo4j_publication_tests": true
|
||||
},
|
||||
"scope": "Publikačný filter a dostupnosť retrieval nástrojov; nejde o nové meranie presnosti LLM."
|
||||
}
|
||||
93
docs/synchronizacia_indexov.md
Normal file
93
docs/synchronizacia_indexov.md
Normal file
@ -0,0 +1,93 @@
|
||||
# Spoločná synchronizácia RAG a GraphRAG
|
||||
|
||||
`POST /sync`, overený push webhook aj `python -m tools.rag.rebuild_index`
|
||||
používajú spoločnú pipeline v `tools/sync_indexes.py`. Obnova vyžaduje dostupné
|
||||
Neo4j a jeho konfiguráciu v prostredí. Pôvodné evaluačné výsledky sa nemenia.
|
||||
|
||||
## Priebeh
|
||||
|
||||
1. Procesový `.reindex.lock` pripustí iba jednu synchronizáciu nad data volume.
|
||||
2. Voliteľný `git pull --ff-only` zachováva pôvodné nastavenie synchronizácie.
|
||||
3. V `data/.sync-stage-*` vznikne kópia pôvodných README súborov. Dokumenty,
|
||||
chunky, SQLite/FTS5 a embeddingy sa pripravujú z tejto jednej kópie. Aktívne
|
||||
súbory sa počas prípravy nemenia a existujúce vyhľadávanie môže pokračovať.
|
||||
4. Overí sa, že sa zdrojové súbory ani Git revízia počas prípravy nezmenili.
|
||||
5. Pred aktiváciou vzniknú zálohy pôvodných súborov a trvalý marker
|
||||
`.sync-pending.json`. Exkluzívny publikačný zámok počká na rozbehnutých
|
||||
čitateľov. Nové požiadavky počas aktivácie dostanú dočasnú nedostupnosť.
|
||||
6. Jedna explicitná Neo4j transakcia odstráni starý spravovaný graf, zapíše
|
||||
nový graf a skontroluje počty uzlov/vzťahov oproti pripravenému payloadu.
|
||||
Verzia grafu sa zapisuje v tej istej transakcii.
|
||||
7. Pod publikačným zámkom sa aktivujú pripravené lokálne súbory a potvrdí sa
|
||||
grafová transakcia. Po úspechu sa odstráni marker a sprístupní nová verzia.
|
||||
|
||||
SQLite a Neo4j netvoria distribuovanú ACID transakciu. Konzistenciu pri tejto
|
||||
implementácii zaisťujú spoločný zámok pre podporované vyhľadávacie vstupy,
|
||||
verzie, zálohy a marker nedokončeného prepnutia. Používanie samotného nízkoúrovňového
|
||||
`search_graph_with_session` mimo publikačnej ochrany je určené pre kontrolované
|
||||
interné evaluácie/testy; produkčný volajúci používa chránené `search_graph`.
|
||||
|
||||
## Verzia a dohľadateľnosť
|
||||
|
||||
Každá generácia má identifikátor `version`, Git revíziu zdrojovej wiki,
|
||||
UTC čas prípravy, hash pôvodných README súborov, hashe dokumentov/chunkov
|
||||
a názov embeddingového modelu. Hash zdrojov zachytáva aj necommitnuté zmeny;
|
||||
samotný Git HEAD preto nie je jediným identifikátorom obsahu.
|
||||
|
||||
Rovnaký objekt `index_version` je uložený v:
|
||||
|
||||
- `data/index_version.json`,
|
||||
- SQLite tabuľke `index_state`,
|
||||
- operatívnom uzle Neo4j `IndexState` s ID `zpwiki`.
|
||||
|
||||
Operatívny uzol nie je súčasťou znalostného grafu označeného `graph_scope=zpwiki`.
|
||||
Verziu vracajú `/sync`, webhook, `/health`, RAG vyhľadávanie a verejná Python
|
||||
funkcia grafového vyhľadávania. Synchronizácia vracia aj `graph_counts`.
|
||||
|
||||
## Chyby a zotavenie
|
||||
|
||||
- Chyba prípravy, embeddingov alebo nedostupné Neo4j pred aktiváciou:
|
||||
pôvodné indexy ostávajú aktívne.
|
||||
- Chyba pri zápise grafu: celá grafová transakcia sa zruší.
|
||||
- Chyba pri aktivácii lokálneho súboru: obnovia sa pôvodné súbory a grafová
|
||||
transakcia sa zruší. Pri neúspešnej obnove marker zostáva.
|
||||
- Stratené potvrdenie COMMIT: najprv sa kontroluje skutočná verzia v Neo4j.
|
||||
Ak bola nová verzia potvrdená, staré lokálne dáta sa naslepo neobnovujú.
|
||||
- Pád procesu alebo neoveriteľný výsledok transakcie: marker a obnovovacie
|
||||
súbory ostávajú na disku. Vyhľadávanie odmietne nejasný snapshot; RAG API
|
||||
vracia 503 a `/health` má `ready=false`.
|
||||
|
||||
Po odstránení príčiny spusti znova autorizovaný `/sync` alebo:
|
||||
|
||||
```bash
|
||||
docker compose exec zp-agent-api python -m tools.rag.rebuild_index
|
||||
```
|
||||
|
||||
Úspešná synchronizácia vytvorí kompletnú novú generáciu oboch indexov a marker
|
||||
odstráni. Marker sa nemá ručne mazať ako náhrada opravy. Staršie adresáre
|
||||
prerušených behov môžu zostať ako podklady na obnovu; bežný úspešný staging
|
||||
sa automaticky odstraňuje.
|
||||
|
||||
## Samostatná obnova Neo4j
|
||||
|
||||
`python -m tools.graphrag.build_graphrag` používa rovnaký transakčný zápis.
|
||||
Zmena grafu sa potvrdí celá alebo sa zruší celá. Ak JSON vstupy zodpovedajú
|
||||
aktívnej generácii, jej proveniencia sa zachová. Iné vstupy alebo režim
|
||||
`--no-replace` nemôžu predstierať synchronizovanú verziu; verejný grafový
|
||||
vstup potom pri aktívnom manifeste vyžaduje spoločnú synchronizáciu.
|
||||
|
||||
## Overenie
|
||||
|
||||
Regresie pokrývajú chybu uprostred grafového zápisu, chybu po čiastočnej
|
||||
aktivácii súborov, stratenú odpoveď COMMIT, neznámy výsledok COMMIT, následné
|
||||
zotavenie, zámok pre čitateľov, nesúlad verzií, zmenu zdroja počas prípravy,
|
||||
odpovede `/sync` aj podpísaného webhooku a API 503 pri nejasnej generácii.
|
||||
Skutočné Neo4j testy overujú rollback po odstránení pôvodných uzlov a zápise
|
||||
časti náhrady v izolovanom scope. Pozitívny prípad overuje aj opakovateľnosť.
|
||||
|
||||
Záverečná sada po dokončení opravy: **464 passed, 4 skipped**. Reálny `/sync`
|
||||
v Docker API obnovil 114 dokumentov, 887 chunkov a 447 grafových uzlov /
|
||||
879 vzťahov za 87,72 s. Overené sú rovnaké verzie v manifeste, SQLite, Neo4j,
|
||||
health, skutočnej RAG odpovedi aj grafovom vyhľadávaní. Obsah znalostného
|
||||
grafu zodpovedá pôvodnej v4; nové meranie presnosti LLM sa nevykonávalo.
|
||||
Podrobné overenie: [záznam](synchronizacia_indexov_overenie.json).
|
||||
52
docs/synchronizacia_indexov_overenie.json
Normal file
52
docs/synchronizacia_indexov_overenie.json
Normal file
@ -0,0 +1,52 @@
|
||||
{
|
||||
"date": "2026-10-25",
|
||||
"changes": [
|
||||
"Coordinated RAG/Neo4j snapshot publication for /sync, push webhook and CLI.",
|
||||
"Atomic Neo4j replacement with rollback, count validation and data-version metadata."
|
||||
],
|
||||
"backup_directory": "/tmp/zp-agent-sync-backup-20261025T023515Z",
|
||||
"automated_tests": {
|
||||
"passed": 464,
|
||||
"skipped": 4
|
||||
},
|
||||
"live_sync": {
|
||||
"status": "ok",
|
||||
"pull_git": false,
|
||||
"duration_seconds": 87.72,
|
||||
"counts": {
|
||||
"documents": 114,
|
||||
"chunks": 887,
|
||||
"fts_chunks": 887,
|
||||
"embedding_chunks": 887,
|
||||
"tags": 2189,
|
||||
"categories": 1193
|
||||
},
|
||||
"index_version": {
|
||||
"version": "d4a6fbaa03b44a0a8aabb3cba2ddff36",
|
||||
"git_revision": "3e892a1d49e9bce118cd03478ce15e01c2bebb4e",
|
||||
"created_at_utc": "2026-10-25T02:50:27.976522+00:00",
|
||||
"source_sha256": "007792c12f3467dd3203bb4951ccc197fdc0eef669580f1b1f893baf609ca363",
|
||||
"documents_sha256": "0542af2a373771cf7c4a95f93d14f4f687f6a0187846892c959aa6efc4bade52",
|
||||
"chunks_sha256": "437dde589be46e0c30842dd330de22d96a0173d2dbaff9c5f129568cb2bca4c9",
|
||||
"embedding_model": "intfloat/multilingual-e5-small"
|
||||
},
|
||||
"graph_counts": {
|
||||
"nodes": 447,
|
||||
"relationships": 879
|
||||
}
|
||||
},
|
||||
"live_verification": {
|
||||
"ready": true,
|
||||
"rag_sources": 3,
|
||||
"graph_status": "ok",
|
||||
"versions_equal_in_sqlite_neo4j_manifest_and_responses": true,
|
||||
"knowledge_graph_unchanged_against_frozen_v4": true
|
||||
},
|
||||
"verification_scope": [
|
||||
"Full existing and new regression suite, including real isolated Neo4j rollback.",
|
||||
"Signed webhook and manual sync response tests.",
|
||||
"Actual /sync on deployed Docker API without Git pull.",
|
||||
"Actual authenticated /rag and public graph lookup on the same data generation."
|
||||
],
|
||||
"new_llm_accuracy_measurement": false
|
||||
}
|
||||
137
docs/vystupny_kontrakt.md
Normal file
137
docs/vystupny_kontrakt.md
Normal file
@ -0,0 +1,137 @@
|
||||
# Spoločný výstupný kontrakt RAG a GraphRAG
|
||||
|
||||
V7 rozširuje kontrolu formátov citácií a rozporov v úplnosti. Grafové
|
||||
generovanie má validované štruktúrované tvrdenia a deterministický renderer.
|
||||
[Aktuálny protokol](graphrag_v7_2026-10-26_worklog.md).
|
||||
|
||||
V6 prenáša polia úplnosti a verzie aj do kontextu LLM a kontroluje ich pri
|
||||
generovaní. Kontrola citácií sa vzťahuje na zoznam aj odkazy v texte odpovede.
|
||||
[Implementácia, meranie a obmedzenia](graphrag_v6_2026-10-25_worklog.md).
|
||||
|
||||
Kontrakt v1 zjednocuje polia pre hlavného agenta a budúce OpenWebUI nástroje.
|
||||
Vyhľadávanie naďalej vracia svoje pôvodné dáta. Klasický RAG zachováva
|
||||
`context`, `instructions`, `answer_format` a rozšírené zdroje; GraphRAG
|
||||
zachováva `facts`, `paths`, `documents`, `aggregation` a rozpoznané entity.
|
||||
Historické evaluačné súbory ani zmrazené manifesty sa neprepisujú.
|
||||
|
||||
## Spoločné polia
|
||||
|
||||
| Pole | Význam |
|
||||
|---|---|
|
||||
| `status` | `ok`, `no_answer`, `ambiguous` alebo `error` |
|
||||
| `reason` | Stabilný strojový dôvod; pri úspechu `null` |
|
||||
| `sources` | Zoznam zdrojov s `source_id`, `document_path`, `source_url`, `title` |
|
||||
| `index_version` | Spoločná generácia indexov vrátane Git revízie; `null`, ak nie je známa |
|
||||
| `complete` | `true`: úplné vyhľadanie v rozsahu nástroja; `false`: neúplné; `null`: úplnosť nemožno zaručiť |
|
||||
| `truncated` | Nástroj preukázateľne narazil na limit výberu alebo výstupu |
|
||||
| `truncation_reasons` | Konkrétne limity; prázdne pole, ak žiadny nebol zistený |
|
||||
|
||||
`source_id` má tvar `S1`, `S2`, … v rámci jednej odpovede. URL a názov
|
||||
môžu byť `null`, ak ich zdroj neposkytuje; nesmú sa domýšľať. RAG si v každom
|
||||
zdroji ponecháva aj text, sekcie a retrieval metadáta. GraphRAG pridáva
|
||||
`sources` popri pôvodnom `documents`, takže existujúci evaluator môže
|
||||
ďalej používať pôvodné polia. Zdrojový dokument je identifikovaný cestou.
|
||||
|
||||
`ok` znamená úspešné získanie dôkazov alebo výsledku agregácie. Neznamená,
|
||||
že LLM už odpovedal ani že vie zo zdrojov zodpovedať každú časť otázky.
|
||||
Nulová, korektne vykonaná agregácia môže mať `status=ok`, `count=0` a žiadne
|
||||
zdroje. `no_answer` označuje nenájdenie požadovaných faktov alebo entity;
|
||||
`ambiguous` označuje nejednoznačné rozpoznanie; `error` zlyhanie nástroja.
|
||||
|
||||
## Význam úplnosti
|
||||
|
||||
Úplnosť **nevyjadruje percento presnosti ani pravdivosť odpovede**.
|
||||
|
||||
RAG je radený výber kandidátov. Ak sa preukáže orezanie, uvádza
|
||||
`complete=false`; inak `null`, pretože nemôže zaručiť vyčerpávajúci zoznam
|
||||
všetkých významovo relevantných informácií. Hlási `candidate_limit`,
|
||||
`per_document_limit` a `result_limit`. Dodatočný kandidát slúži na detekciu
|
||||
orezania a nezaraďuje sa do pôvodného radeného výberu. Rozšírenia kontextu
|
||||
ďalej používajú svoje existujúce limity; `truncated=false` preto nie je
|
||||
zárukou úplnosti kontextu ani pokrytia celej wiki.
|
||||
|
||||
GraphRAG vyjadruje úplnosť v rámci podporovaných štruktúrovaných dotazov
|
||||
a nakonfigurovaných grafových prechodov. Hlási `entity_limit`,
|
||||
`evidence_limit`, `fact_limit` a `path_limit`. Pri prechádzaní grafu overí
|
||||
aj jeden výsledok nad limitom, aby rozpoznal orezanie už na úrovni Cypher.
|
||||
`complete=true` neznamená neobmedzený prechod celým grafom: všeobecné
|
||||
prechody naďalej používajú pôvodnú povolenú dĺžku ciest. Pri nejednoznačnosti
|
||||
alebo chybe je `complete=false`, aj keď `truncated=false`.
|
||||
|
||||
`aggregation.complete` ostáva osobitným príznakom úplnosti **výpočtu**.
|
||||
Príklad: presne napočítané 2 osoby, ale `limit=1` pre zobrazené dôkazy:
|
||||
|
||||
```json
|
||||
{
|
||||
"status": "ok",
|
||||
"reason": null,
|
||||
"aggregation": {"count": 2, "complete": true},
|
||||
"complete": false,
|
||||
"truncated": true,
|
||||
"truncation_reasons": ["fact_limit", "path_limit"]
|
||||
}
|
||||
```
|
||||
|
||||
Príklad je skrátený. Agent môže uviesť presný počet podľa agregácie,
|
||||
ale nesmie tvrdiť, že zobrazený výpis obsahuje všetky dôkazy.
|
||||
|
||||
## Nenájdenie a chyby
|
||||
|
||||
Nenájdenie používa napríklad `no_matching_sources`, `no_matching_facts`,
|
||||
`unknown_person`, `unknown_keyword` alebo `unknown_title`. Nejednoznačnosť
|
||||
používa napríklad `ambiguous_person`. Zostávajú zachované aj podrobnejšie
|
||||
grafové `reasons` a dôkazy zamietnutých kandidátov.
|
||||
|
||||
API `/rag` a `/search` vracia pri chybách rovnakú obálku; pôvodné HTTP kódy
|
||||
a `detail` zostávajú zachované. Dôvody zahŕňajú `invalid_query` (400),
|
||||
`unauthorized` (401), `invalid_request` (422), `retrieval_unavailable` (503)
|
||||
a `internal_error` (500). Validačné chyby nevracajú hodnoty zaslaných polí.
|
||||
|
||||
```json
|
||||
{
|
||||
"status": "error",
|
||||
"reason": "retrieval_unavailable",
|
||||
"sources": [],
|
||||
"index_version": null,
|
||||
"complete": false,
|
||||
"truncated": false,
|
||||
"truncation_reasons": [],
|
||||
"detail": "Vyhľadávací index alebo embeddingový model momentálne nie je dostupný."
|
||||
}
|
||||
```
|
||||
|
||||
Po chybe sa neuvádza verzia dát, ktorú nástroj úspešne neprečítal. Chybová
|
||||
obálka neobsahuje text interných výnimiek, heslá ani interné cesty.
|
||||
|
||||
Python knižničné funkcie naďalej vyhadzujú výnimky, aby existujúci kód mohol
|
||||
riešiť chyby pomocou `try/except`. Transportné rozhrania ich prevádzajú na
|
||||
obálku cez spoločné `error_result()`: HTTP API, grafový CLI a RAG CLI v režime
|
||||
`--json`. Chybový CLI skončí návratovým kódom 1. Pre budúci MCP/HTTP adaptér
|
||||
grafu sa použije ten istý prevod; nový grafový HTTP endpoint tento krok nepridáva.
|
||||
|
||||
## Použitie
|
||||
|
||||
```bash
|
||||
python -m tools.rag.search_db 'strojový preklad' --json --limit 5
|
||||
python -m tools.graphrag.graph_search 'Aký názov práce má Ján Holp?' --limit 5
|
||||
```
|
||||
|
||||
Spoločné Pydantic modely aj tvorba obálky sú v `tools/retrieval_contract.py`.
|
||||
OpenAPI pre `/rag` používa spoločné polia aj model chybovej odpovede.
|
||||
|
||||
## Overenie 25. 10. 2026
|
||||
|
||||
Kompletná sada projektu: **506 úspešných testov, 4 preskočené**. Nové testy
|
||||
overujú spoločné polia, zachovanie rozšírených zdrojov RAG, detekciu limitov,
|
||||
nejednoznačnosť, nenájdenie a chyby vrátane neplatného výstupu backendu.
|
||||
Grafové testy používajú skutočný Neo4j v izolovanej transakcii s rollbackom.
|
||||
|
||||
Na nasadenom API sa overili `/rag`, `/search`, chyby autentifikácie a validácie
|
||||
aj OpenAPI schéma. Skutočný GraphRAG napočítal 15 osôb s prácou v roku 2024;
|
||||
počet bol rovnaký pri limite 1 a 100. Pri limite 1 správne označil dôkazy
|
||||
za orezané, pričom samotný počet zostal úplný. Overilo sa tiež nenájdenie
|
||||
neexistujúcej osoby a JSON chybové výstupy oboch CLI s návratovým kódom 1.
|
||||
|
||||
Nasadenie nevyžadovalo reindexáciu: verzia dát zostala nezmenená. Toto
|
||||
overenie kontraktu nepredstavuje nové meranie presnosti LLM odpovedí.
|
||||
Strojový záznam je v [vystupny_kontrakt_overenie.json](vystupny_kontrakt_overenie.json).
|
||||
81
docs/vystupny_kontrakt_overenie.json
Normal file
81
docs/vystupny_kontrakt_overenie.json
Normal file
@ -0,0 +1,81 @@
|
||||
{
|
||||
"checked_at_utc": "2026-10-25T15:26:47.218274+00:00",
|
||||
"index_version": {
|
||||
"version": "ff682d98134d406081040902f234c44f",
|
||||
"git_revision": "3e892a1d49e9bce118cd03478ce15e01c2bebb4e",
|
||||
"created_at_utc": "2026-10-25T15:06:03.279424+00:00",
|
||||
"source_sha256": "007792c12f3467dd3203bb4951ccc197fdc0eef669580f1b1f893baf609ca363",
|
||||
"documents_sha256": "0542af2a373771cf7c4a95f93d14f4f687f6a0187846892c959aa6efc4bade52",
|
||||
"chunks_sha256": "437dde589be46e0c30842dd330de22d96a0173d2dbaff9c5f129568cb2bca4c9",
|
||||
"embedding_model": "intfloat/multilingual-e5-small",
|
||||
"publication_policy": "explicit-false-hidden-v1"
|
||||
},
|
||||
"shared_fields": [
|
||||
"complete",
|
||||
"index_version",
|
||||
"reason",
|
||||
"sources",
|
||||
"status",
|
||||
"truncated",
|
||||
"truncation_reasons"
|
||||
],
|
||||
"api": {
|
||||
"/rag": {
|
||||
"status": "ok",
|
||||
"source_count": 1,
|
||||
"complete": false,
|
||||
"truncated": true,
|
||||
"truncation_reasons": [
|
||||
"per_document_limit",
|
||||
"result_limit"
|
||||
],
|
||||
"unauthorized_contract": true,
|
||||
"validation_error_contract": true
|
||||
},
|
||||
"/search": {
|
||||
"status": "ok",
|
||||
"source_count": 2,
|
||||
"complete": false,
|
||||
"truncated": true,
|
||||
"truncation_reasons": [
|
||||
"per_document_limit",
|
||||
"result_limit"
|
||||
],
|
||||
"unauthorized_contract": true,
|
||||
"validation_error_contract": true
|
||||
}
|
||||
},
|
||||
"regression": {
|
||||
"passed": 506,
|
||||
"skipped": 4,
|
||||
"failed": 0
|
||||
},
|
||||
"openapi_common_fields_and_errors": true,
|
||||
"graphrag": {
|
||||
"status": "ok",
|
||||
"complete": false,
|
||||
"truncated": true,
|
||||
"truncation_reasons": [
|
||||
"fact_limit",
|
||||
"path_limit"
|
||||
],
|
||||
"exact_count": 15,
|
||||
"count_complete": true,
|
||||
"same_count_at_limit_1_and_100": true,
|
||||
"no_answer_reason": "unknown_person"
|
||||
},
|
||||
"cli_error_checks": {
|
||||
"rag": {
|
||||
"exit_code": 1,
|
||||
"reason": "invalid_query",
|
||||
"valid_contract": true
|
||||
},
|
||||
"graphrag": {
|
||||
"exit_code": 1,
|
||||
"reason": "retrieval_unavailable",
|
||||
"valid_contract": true
|
||||
}
|
||||
},
|
||||
"index_version_unchanged": true,
|
||||
"scope": "Overenie výstupného kontraktu retrieval nástrojov; nejde o meranie presnosti LLM."
|
||||
}
|
||||
@ -1,73 +0,0 @@
|
||||
id,category,mode,question,first_relevant_rank,reciprocal_rank,hit_at_1,hit_at_3,hit_at_5,recall_at_1,recall_at_3,recall_at_5,expected_documents,top_documents,top_source_urls
|
||||
q001,fact_year,fts,V akom roku robil Ján Holp diplomovú prácu?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q001,fact_year,vector,V akom roku robil Ján Holp diplomovú prácu?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2020/matus_suchanic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""]"
|
||||
q001,fact_year,hybrid,V akom roku robil Ján Holp diplomovú prácu?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md"", ""pages/students/2021/matej_novotny/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny""]"
|
||||
q002,fact_year,fts,V ktorom roku začal študovať Ján Holp?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q002,fact_year,vector,V ktorom roku začal študovať Ján Holp?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt""]"
|
||||
q002,fact_year,hybrid,V ktorom roku začal študovať Ján Holp?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]"
|
||||
q003,fact_title,fts,Aký je názov diplomovej práce Jána Holpa?,3,0.333333,0,1,1,0.0,1.0,1.0,"[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q003,fact_title,vector,Aký je názov diplomovej práce Jána Holpa?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2018/david_omasta/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]"
|
||||
q003,fact_title,hybrid,Aký je názov diplomovej práce Jána Holpa?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2016/mark_feher/README.md"", ""pages/students/2021/matej_novotny/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny""]"
|
||||
q004,fact_title,fts,Aký je názov diplomovej práce Maroša Harahusa?,5,0.2,0,0,1,0.0,0.0,1.0,"[""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q004,fact_title,vector,Aký je názov diplomovej práce Maroša Harahusa?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/dmytro_mural/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2019/samuel_horani/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani""]"
|
||||
q004,fact_title,hybrid,Aký je názov diplomovej práce Maroša Harahusa?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/students/2016/ediz_morochovic/README.md"", ""pages/students/2019/dmytro_mural/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural""]"
|
||||
q005,fact_topic,fts,Aká je téma diplomového projektu Jána Ptáka?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2022/yevhenii_leonov/README.md"", ""pages/topics/steel/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/lukas_pokryvka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/topics/steel"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]"
|
||||
q005,fact_topic,vector,Aká je téma diplomového projektu Jána Ptáka?,5,0.2,0,0,1,0.0,0.0,1.0,"[""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]"
|
||||
q005,fact_topic,hybrid,Aká je téma diplomového projektu Jána Ptáka?,2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2016/jan_holp/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021""]"
|
||||
q006,fact_year,fts,V ktorom roku začal študovať Ján Pták?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/students/2018/david_omasta/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]"
|
||||
q006,fact_year,vector,V ktorom roku začal študovať Ján Pták?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2021/nikita_bodnar/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2018/ondrej_megela/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]"
|
||||
q006,fact_year,hybrid,V ktorom roku začal študovať Ján Pták?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2021/nikita_bodnar/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q007,fact_tool,fts,Aké používateľské rozhranie má Ján Pták použiť pre svojho agenta?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md"", ""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]"
|
||||
q007,fact_tool,vector,Aké používateľské rozhranie má Ján Pták použiť pre svojho agenta?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]"
|
||||
q007,fact_tool,hybrid,Aké používateľské rozhranie má Ján Pták použiť pre svojho agenta?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]"
|
||||
q008,paraphrase,fts,Kto pracuje na agentovi na zlepšenie správy záverečných prác v ZP Wiki?,3,0.333333,0,1,1,0.0,1.0,1.0,"[""pages/students/2022/jan_ptak/README.md""]","[""pages/topics/faq/README.md"", ""pages/topics/otvorene/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]"
|
||||
q008,paraphrase,vector,Kto pracuje na agentovi na zlepšenie správy záverečných prác v ZP Wiki?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/students/2022/jan_ptak/README.md""]","[""pages/topics/akopisat/README.md"", ""pages/students/2019/michal_stromko/vp2021/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko/vp2021"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]"
|
||||
q008,paraphrase,hybrid,Kto pracuje na agentovi na zlepšenie správy záverečných prác v ZP Wiki?,5,0.2,0,0,1,0.0,0.0,1.0,"[""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2019/michal_stromko/vp2021/README.md"", ""pages/topics/akopisat/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko/vp2021"", ""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]"
|
||||
q009,fact_topic,fts,Aká je téma diplomového projektu Jána Malinovského?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/yevhenii_leonov/README.md"", ""pages/topics/steel/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/lukas_pokryvka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/topics/steel"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]"
|
||||
q009,fact_topic,vector,Aká je téma diplomového projektu Jána Malinovského?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2020/kamil_tomcufcik/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2020/kamil_tomcufcik"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q009,fact_topic,hybrid,Aká je téma diplomového projektu Jána Malinovského?,2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2016/jan_holp/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/README.md"", ""pages/students/2020/kamil_tomcufcik/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2020/kamil_tomcufcik"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q010,paraphrase,fts,"Ktorý študent vytvára znalostný graf z oblasti vzdelávania a agenta, ktorý v ňom vyhľadáva?",3,0.333333,0,1,1,0.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q010,paraphrase,vector,"Ktorý študent vytvára znalostný graf z oblasti vzdelávania a agenta, ktorý v ňom vyhľadáva?",2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]"
|
||||
q010,paraphrase,hybrid,"Ktorý študent vytvára znalostný graf z oblasti vzdelávania a agenta, ktorý v ňom vyhľadáva?",2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]"
|
||||
q011,fact_title,fts,Ako sa volá diplomová práca Mateja Novotného?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/students/2021/matej_novotny/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]"
|
||||
q011,fact_title,vector,Ako sa volá diplomová práca Mateja Novotného?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/matej_novotny/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2020/david_kostilnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik""]"
|
||||
q011,fact_title,hybrid,Ako sa volá diplomová práca Mateja Novotného?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/matej_novotny/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2020/david_kostilnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik""]"
|
||||
q012,fact_year,fts,V ktorom roku je uvedená diplomová práca Mateja Novotného?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/students/2021/matej_novotny/README.md""]","[""pages/topics/faq/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]"
|
||||
q012,fact_year,vector,V ktorom roku je uvedená diplomová práca Mateja Novotného?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/matej_novotny/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2020/david_kostilnik/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021""]"
|
||||
q012,fact_year,hybrid,V ktorom roku je uvedená diplomová práca Mateja Novotného?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/matej_novotny/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/mark_feher/README.md"", ""pages/students/2020/matus_suchanic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""]"
|
||||
q013,fact_title,fts,Aký je názov diplomovej práce Dominika Nagya?,2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/students/2016/dominik_nagy/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/topics/question/nezodpovedatelne/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne""]"
|
||||
q013,fact_title,vector,Aký je názov diplomovej práce Dominika Nagya?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/dominik_nagy/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/mark_feher/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2018/david_omasta/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]"
|
||||
q013,fact_title,hybrid,Aký je názov diplomovej práce Dominika Nagya?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/dominik_nagy/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/mark_feher/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2018/ondrej_megela/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]"
|
||||
q014,topic,fts,Nájdi dokumenty súvisiace so strojovým prekladom.,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/topics/translation/README.md""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/patrik_pavlisin/tp20/README.md"", ""pages/students/2016/patrik_pavlisin/dp22/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/tp20"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp22"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q014,topic,vector,Nájdi dokumenty súvisiace so strojovým prekladom.,3,0.333333,0,1,1,0.0,0.333333,0.333333,"[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/topics/translation/README.md""]","[""pages/students/2016/patrik_pavlisin/tp20/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2022/andrii_pervashov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/tp20"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]"
|
||||
q014,topic,hybrid,Nájdi dokumenty súvisiace so strojovým prekladom.,3,0.333333,0,1,1,0.0,0.333333,0.333333,"[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/topics/translation/README.md""]","[""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/patrik_pavlisin/tp20/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/tp20"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q015,fact_goal,fts,Na čom pracoval Oliver Pejic počas IAESTE stáže?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/oliver_pejic/README.md""]","[""pages/interns/oliver_pejic/README.md"", ""pages/interns/cesar_gutierrez/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/interns/yussef_ressaissi/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic"", ""https://zp.kemt.fei.tuke.sk/interns/cesar_gutierrez"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi""]"
|
||||
q015,fact_goal,vector,Na čom pracoval Oliver Pejic počas IAESTE stáže?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/oliver_pejic/README.md""]","[""pages/interns/oliver_pejic/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]"
|
||||
q015,fact_goal,hybrid,Na čom pracoval Oliver Pejic počas IAESTE stáže?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/oliver_pejic/README.md""]","[""pages/interns/oliver_pejic/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]"
|
||||
q016,paraphrase,fts,Ktorý stážista pripravoval MTEB evaluačné úlohy pre slovenský hate speech a question answering?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/oliver_pejic/README.md""]","[""pages/interns/oliver_pejic/README.md"", ""pages/topics/hatespeech/README.md"", ""pages/topics/question/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic"", ""https://zp.kemt.fei.tuke.sk/topics/hatespeech"", ""https://zp.kemt.fei.tuke.sk/topics/question"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak""]"
|
||||
q016,paraphrase,vector,Ktorý stážista pripravoval MTEB evaluačné úlohy pre slovenský hate speech a question answering?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/oliver_pejic/README.md""]","[""pages/interns/oliver_pejic/README.md"", ""pages/topics/hatespeech/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/topics/question/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic"", ""https://zp.kemt.fei.tuke.sk/topics/hatespeech"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/topics/question"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q016,paraphrase,hybrid,Ktorý stážista pripravoval MTEB evaluačné úlohy pre slovenský hate speech a question answering?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/oliver_pejic/README.md""]","[""pages/interns/oliver_pejic/README.md"", ""pages/topics/hatespeech/README.md"", ""pages/topics/question/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic"", ""https://zp.kemt.fei.tuke.sk/topics/hatespeech"", ""https://zp.kemt.fei.tuke.sk/topics/question"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q017,fact_topic,fts,Aká bola téma stáže Bogdana Paula Chișa?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/bogdan_paul_chis/README.md""]","[""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/students/2018/adrian_remias/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q017,fact_topic,vector,Aká bola téma stáže Bogdana Paula Chișa?,4,0.25,0,0,1,0.0,0.0,1.0,"[""pages/interns/bogdan_paul_chis/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/interns/bogdan_paul_chis/README.md"", ""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]"
|
||||
q017,fact_topic,hybrid,Aká bola téma stáže Bogdana Paula Chișa?,5,0.2,0,0,1,0.0,0.0,1.0,"[""pages/interns/bogdan_paul_chis/README.md""]","[""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/lukas_pokryvka/README.md"", ""pages/interns/bogdan_paul_chis/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis""]"
|
||||
q018,fact_tool,fts,Akými nástrojmi mal Bogdan Paul Chiș vyhodnocovať svojho agenta?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/bogdan_paul_chis/README.md""]","[""pages/interns/bogdan_paul_chis/README.md"", ""pages/topics/otvorene/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2022/daniil_huzenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""]"
|
||||
q018,fact_tool,vector,Akými nástrojmi mal Bogdan Paul Chiș vyhodnocovať svojho agenta?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/bogdan_paul_chis/README.md""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]"
|
||||
q018,fact_tool,hybrid,Akými nástrojmi mal Bogdan Paul Chiș vyhodnocovať svojho agenta?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/bogdan_paul_chis/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q019,fact_goal,fts,Aký bol cieľ stáže Youssefa Ressaissiho?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt""]"
|
||||
q019,fact_goal,vector,Aký bol cieľ stáže Youssefa Ressaissiho?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q019,fact_goal,hybrid,Aký bol cieľ stáže Youssefa Ressaissiho?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q020,fact_goal,fts,Aké boli hlavné ciele stáže Cesara Abascala Gutierreza?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/cesar_gutierrez/README.md""]","[""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2016/patrik_pavlisin/tp20/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/tp20"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]"
|
||||
q020,fact_goal,vector,Aké boli hlavné ciele stáže Cesara Abascala Gutierreza?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/cesar_gutierrez/README.md""]","[""pages/interns/cesar_gutierrez/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2020/pavol_hudak/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/cesar_gutierrez"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2020/pavol_hudak"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q020,fact_goal,hybrid,Aké boli hlavné ciele stáže Cesara Abascala Gutierreza?,3,0.333333,0,1,1,0.0,1.0,1.0,"[""pages/interns/cesar_gutierrez/README.md""]","[""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/ronald_zalacko/README.md"", ""pages/interns/cesar_gutierrez/README.md"", ""pages/students/2019/dmytro_mural/README.md"", ""pages/students/2020/pavol_hudak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/interns/cesar_gutierrez"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2020/pavol_hudak""]"
|
||||
q021,fact_goal,fts,Aký je cieľ projektu AI4Steel?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/steel/README.md""]","[""pages/topics/steel/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2016/jakub_maruniak/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/steel"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""]"
|
||||
q021,fact_goal,vector,Aký je cieľ projektu AI4Steel?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/steel/README.md""]","[""pages/topics/steel/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/steel"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q021,fact_goal,hybrid,Aký je cieľ projektu AI4Steel?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/steel/README.md""]","[""pages/topics/steel/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/steel"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q022,fact_topic,fts,Čomu sa venuje dizertačná práca Maroša Harahusa?,2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2016/patrik_pavlisin/tp20/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/tp20"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q022,fact_topic,vector,Čomu sa venuje dizertačná práca Maroša Harahusa?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/dmytro_mural/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt""]"
|
||||
q022,fact_topic,hybrid,Čomu sa venuje dizertačná práca Maroša Harahusa?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/dmytro_mural/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt""]"
|
||||
q023,multi_document,fts,"Nájdi dokumenty, v ktorých sa rieši Retrieval Augmented Generation alebo GraphRAG.",1,1.0,1,1,1,0.333333,0.333333,0.666667,"[""pages/interns/bogdan_paul_chis/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]"
|
||||
q023,multi_document,vector,"Nájdi dokumenty, v ktorých sa rieši Retrieval Augmented Generation alebo GraphRAG.",1,1.0,1,1,1,0.333333,0.333333,0.333333,"[""pages/interns/bogdan_paul_chis/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q023,multi_document,hybrid,"Nájdi dokumenty, v ktorých sa rieši Retrieval Augmented Generation alebo GraphRAG.",1,1.0,1,1,1,0.333333,0.333333,0.333333,"[""pages/interns/bogdan_paul_chis/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q024,negative,fts,Akú diplomovú prácu robil Ján Holp v roku 2016?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q024,negative,vector,Akú diplomovú prácu robil Ján Holp v roku 2016?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt""]"
|
||||
q024,negative,hybrid,Akú diplomovú prácu robil Ján Holp v roku 2016?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2021/matej_novotny/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny""]"
|
||||
|
File diff suppressed because it is too large
Load Diff
File diff suppressed because it is too large
Load Diff
@ -1,883 +0,0 @@
|
||||
id,split,category,difficulty,mode,question,first_relevant_rank,reciprocal_rank,hit_at_1,hit_at_3,hit_at_5,recall_at_1,recall_at_3,recall_at_5,expected_documents,top_documents,top_source_urls
|
||||
q0052,test,entity_lookup,easy,fts,Nájdi dokument o osobe Lukáš Pokrývka.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2016/lukas_pokryvka/dp2021/README.md"", ""pages/topics/spacy/README.md"", ""pages/students/2018/oleh_bilykh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/dp2021"", ""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""]"
|
||||
q0052,test,entity_lookup,easy,vector,Nájdi dokument o osobe Lukáš Pokrývka.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/interns/oliver_pejic/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas""]"
|
||||
q0052,test,entity_lookup,easy,hybrid,Nájdi dokument o osobe Lukáš Pokrývka.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/interns/oliver_pejic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic""]"
|
||||
q0053,test,fact_title,easy,fts,Aký je názov diplomová práca osoby Lukáš Pokrývka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2016/lukas_pokryvka/dp2021/README.md"", ""pages/topics/spacy/README.md"", ""pages/students/2018/oleh_bilykh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/dp2021"", ""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""]"
|
||||
q0053,test,fact_title,easy,vector,Aký je názov diplomová práca osoby Lukáš Pokrývka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q0053,test,fact_title,easy,hybrid,Aký je názov diplomová práca osoby Lukáš Pokrývka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021""]"
|
||||
q0054,test,reverse_lookup,medium,fts,Kto sa venuje práci s názvom „Paralelné trénovanie neurónových sietí“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2016/dominik_nagy/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy""]"
|
||||
q0054,test,reverse_lookup,medium,vector,Kto sa venuje práci s názvom „Paralelné trénovanie neurónových sietí“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/patrik_pavlisin/dp21/README.md"", ""pages/students/2018/adrian_remias/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp21"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias""]"
|
||||
q0054,test,reverse_lookup,medium,hybrid,Kto sa venuje práci s názvom „Paralelné trénovanie neurónových sietí“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2018/adrian_remias/README.md"", ""pages/students/2021/eduard_matovka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka""]"
|
||||
q0055,test,topic_lookup,medium,fts,"Nájdi študenta alebo dokument, ktorý rieši tému „Paralelné trénovanie neurónových sietí“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]"
|
||||
q0055,test,topic_lookup,medium,vector,"Nájdi študenta alebo dokument, ktorý rieši tému „Paralelné trénovanie neurónových sietí“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2018/adrian_remias/README.md"", ""pages/students/2016/patrik_pavlisin/dp21/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp21"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0055,test,topic_lookup,medium,hybrid,"Nájdi študenta alebo dokument, ktorý rieši tému „Paralelné trénovanie neurónových sietí“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2018/adrian_remias/README.md"", ""pages/students/2016/patrik_pavlisin/dp21/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp21""]"
|
||||
q0056,test,paraphrase,medium,fts,O čom je práca osoby Lukáš Pokrývka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2016/lukas_pokryvka/dp2021/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/topics/spacy/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/topics/spacy""]"
|
||||
q0056,test,paraphrase,medium,vector,O čom je práca osoby Lukáš Pokrývka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0056,test,paraphrase,medium,hybrid,O čom je práca osoby Lukáš Pokrývka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak""]"
|
||||
q0057,test,fact_start_year,easy,fts,V ktorom roku začal študovať Lukáš Pokrývka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2016/lukas_pokryvka/dp2021/README.md"", ""pages/topics/spacy/README.md"", ""pages/students/2021/eduard_matovka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/dp2021"", ""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka""]"
|
||||
q0057,test,fact_start_year,easy,vector,V ktorom roku začal študovať Lukáš Pokrývka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021""]"
|
||||
q0057,test,fact_start_year,easy,hybrid,V ktorom roku začal študovať Lukáš Pokrývka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md"", ""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]"
|
||||
q0058,test,verification,medium,fts,Je pri osobe Lukáš Pokrývka uvedený rok začiatku štúdia 2016?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2016/lukas_pokryvka/dp2021/README.md"", ""pages/students/2018/oleh_bilykh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""]"
|
||||
q0058,test,verification,medium,vector,Je pri osobe Lukáš Pokrývka uvedený rok začiatku štúdia 2016?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md"", ""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]"
|
||||
q0058,test,verification,medium,hybrid,Je pri osobe Lukáš Pokrývka uvedený rok začiatku štúdia 2016?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]"
|
||||
q0059,test,fact_work_year,easy,fts,V ktorom roku je pri osobe Lukáš Pokrývka uvedená diplomová práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2016/lukas_pokryvka/dp2021/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/topics/spacy/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/topics/spacy""]"
|
||||
q0059,test,fact_work_year,easy,vector,V ktorom roku je pri osobe Lukáš Pokrývka uvedená diplomová práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q0059,test,fact_work_year,easy,hybrid,V ktorom roku je pri osobe Lukáš Pokrývka uvedená diplomová práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021""]"
|
||||
q0060,test,disambiguation_year,hard,fts,Rozlíš rok začiatku štúdia a rok práce osoby Lukáš Pokrývka.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2016/lukas_pokryvka/dp2021/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/dp2021""]"
|
||||
q0060,test,disambiguation_year,hard,vector,Rozlíš rok začiatku štúdia a rok práce osoby Lukáš Pokrývka.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/topics/legal/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/topics/legal""]"
|
||||
q0060,test,disambiguation_year,hard,hybrid,Rozlíš rok začiatku štúdia a rok práce osoby Lukáš Pokrývka.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/topics/legal/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/topics/legal""]"
|
||||
q0061,test,adversarial_year,hard,fts,Je rok 2016 rokom záverečnej práce osoby Lukáš Pokrývka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2016/lukas_pokryvka/dp2021/README.md"", ""pages/topics/faq/README.md"", ""pages/topics/spacy/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/dp2021"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/topics/spacy""]"
|
||||
q0061,test,adversarial_year,hard,vector,Je rok 2016 rokom záverečnej práce osoby Lukáš Pokrývka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak""]"
|
||||
q0061,test,adversarial_year,hard,hybrid,Je rok 2016 rokom záverečnej práce osoby Lukáš Pokrývka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/topics/faq/README.md"", ""pages/topics/akopisat/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q0062,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou PyTorch a osobou Lukáš Pokrývka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2016/lukas_pokryvka/dp2021/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2018/ondrej_megela/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]"
|
||||
q0062,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou PyTorch a osobou Lukáš Pokrývka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q0062,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou PyTorch a osobou Lukáš Pokrývka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q0063,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou NCCL a osobou Lukáš Pokrývka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2016/lukas_pokryvka/dp2021/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/dp2021""]"
|
||||
q0063,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou NCCL a osobou Lukáš Pokrývka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/topics/question/nezodpovedatelne/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne""]"
|
||||
q0063,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou NCCL a osobou Lukáš Pokrývka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]"
|
||||
q0064,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou GPU a osobou Lukáš Pokrývka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2016/lukas_pokryvka/dp2021/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/dp2021""]"
|
||||
q0064,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou GPU a osobou Lukáš Pokrývka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]"
|
||||
q0064,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou GPU a osobou Lukáš Pokrývka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q0065,test,specific_fact,medium,fts,Aký dataset používal Lukáš Pokrývka pri experimentoch s detekciou rakoviny pľúc?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2016/lukas_pokryvka/dp2021/README.md"", ""pages/topics/spacy/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/dp2021"", ""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0065,test,specific_fact,medium,vector,Aký dataset používal Lukáš Pokrývka pri experimentoch s detekciou rakoviny pľúc?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q0065,test,specific_fact,medium,hybrid,Aký dataset používal Lukáš Pokrývka pri experimentoch s detekciou rakoviny pľúc?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]"
|
||||
q0066,test,specific_fact,medium,fts,Aký backend použil Lukáš Pokrývka pri trénovaní na dvoch strojoch?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2016/lukas_pokryvka/dp2021/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2018/ondrej_megela/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]"
|
||||
q0066,test,specific_fact,medium,vector,Aký backend použil Lukáš Pokrývka pri trénovaní na dvoch strojoch?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0066,test,specific_fact,medium,hybrid,Aký backend použil Lukáš Pokrývka pri trénovaní na dvoch strojoch?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md"", ""pages/students/2022/andrii_pervashov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]"
|
||||
q0067,test,entity_lookup,easy,fts,Nájdi dokument o osobe Dárius Lindvai.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md"", ""pages/students/2016/darius_lindvai/dp2021/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0067,test,entity_lookup,easy,vector,Nájdi dokument o osobe Dárius Lindvai.,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/adrian_remias/README.md"", ""pages/students/2018/david_ilas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_ilas""]"
|
||||
q0067,test,entity_lookup,easy,hybrid,Nájdi dokument o osobe Dárius Lindvai.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/adrian_remias/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias""]"
|
||||
q0068,test,fact_title,easy,fts,Aký je názov diplomová práca osoby Dárius Lindvai?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/students/2016/darius_lindvai/dp2021/README.md"", ""pages/students/2020/matus_suchanic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""]"
|
||||
q0068,test,fact_title,easy,vector,Aký je názov diplomová práca osoby Dárius Lindvai?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/mark_feher/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2018/david_omasta/README.md"", ""pages/students/2018/david_ilas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_ilas""]"
|
||||
q0068,test,fact_title,easy,hybrid,Aký je názov diplomová práca osoby Dárius Lindvai?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/mark_feher/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2018/david_omasta/README.md"", ""pages/students/2018/david_ilas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_ilas""]"
|
||||
q0069,test,reverse_lookup,medium,fts,Kto sa venuje práci s názvom „Obnovenie interpunkcie pomocou hlbokých neurónových sietí“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/topics/steel/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md"", ""pages/students/2016/patrik_pavlisin/tp20/README.md"", ""pages/students/2020/matus_suchanic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/topics/steel"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/tp20"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""]"
|
||||
q0069,test,reverse_lookup,medium,vector,Kto sa venuje práci s názvom „Obnovenie interpunkcie pomocou hlbokých neurónových sietí“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2018/adrian_remias/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2017/stanislav_matsunych/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2017/stanislav_matsunych""]"
|
||||
q0069,test,reverse_lookup,medium,hybrid,Kto sa venuje práci s názvom „Obnovenie interpunkcie pomocou hlbokých neurónových sietí“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2018/adrian_remias/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/students/2017/stanislav_matsunych/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/students/2017/stanislav_matsunych""]"
|
||||
q0070,test,topic_lookup,medium,fts,"Nájdi študenta alebo dokument, ktorý rieši tému „Obnovenie interpunkcie pomocou hlbokých neurónových sietí“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/topics/steel/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/topics/steel"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]"
|
||||
q0070,test,topic_lookup,medium,vector,"Nájdi študenta alebo dokument, ktorý rieši tému „Obnovenie interpunkcie pomocou hlbokých neurónových sietí“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2018/adrian_remias/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/topics/otvorene/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene""]"
|
||||
q0070,test,topic_lookup,medium,hybrid,"Nájdi študenta alebo dokument, ktorý rieši tému „Obnovenie interpunkcie pomocou hlbokých neurónových sietí“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2018/adrian_remias/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2017/stanislav_matsunych/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2017/stanislav_matsunych""]"
|
||||
q0071,test,paraphrase,medium,fts,O čom je práca osoby Dárius Lindvai?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/students/2016/darius_lindvai/dp2021/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0071,test,paraphrase,medium,vector,O čom je práca osoby Dárius Lindvai?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]"
|
||||
q0071,test,paraphrase,medium,hybrid,O čom je práca osoby Dárius Lindvai?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]"
|
||||
q0072,test,fact_start_year,easy,fts,V ktorom roku začal študovať Dárius Lindvai?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md"", ""pages/students/2016/darius_lindvai/dp2021/README.md"", ""pages/students/2021/eduard_matovka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka""]"
|
||||
q0072,test,fact_start_year,easy,vector,V ktorom roku začal študovať Dárius Lindvai?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2020/david_kostilnik/README.md"", ""pages/students/2018/david_ilas/README.md"", ""pages/students/2017/dmytro_ushatenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_ilas"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko""]"
|
||||
q0072,test,fact_start_year,easy,hybrid,V ktorom roku začal študovať Dárius Lindvai?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2020/david_kostilnik/README.md"", ""pages/students/2018/david_ilas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_ilas""]"
|
||||
q0073,test,verification,medium,fts,Je pri osobe Dárius Lindvai uvedený rok začiatku štúdia 2016?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/students/2016/darius_lindvai/dp2021/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]"
|
||||
q0073,test,verification,medium,vector,Je pri osobe Dárius Lindvai uvedený rok začiatku štúdia 2016?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2018/david_ilas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_ilas""]"
|
||||
q0073,test,verification,medium,hybrid,Je pri osobe Dárius Lindvai uvedený rok začiatku štúdia 2016?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2018/ondrej_megela/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]"
|
||||
q0074,test,fact_work_year,easy,fts,V ktorom roku je pri osobe Dárius Lindvai uvedená diplomová práca?,2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md"", ""pages/students/2016/darius_lindvai/dp2021/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0074,test,fact_work_year,easy,vector,V ktorom roku je pri osobe Dárius Lindvai uvedená diplomová práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/mark_feher/README.md"", ""pages/students/2018/david_omasta/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]"
|
||||
q0074,test,fact_work_year,easy,hybrid,V ktorom roku je pri osobe Dárius Lindvai uvedená diplomová práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/mark_feher/README.md"", ""pages/students/2018/david_omasta/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]"
|
||||
q0075,test,disambiguation_year,hard,fts,Rozlíš rok začiatku štúdia a rok práce osoby Dárius Lindvai.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/darius_lindvai/dp2021/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]"
|
||||
q0075,test,disambiguation_year,hard,vector,Rozlíš rok začiatku štúdia a rok práce osoby Dárius Lindvai.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/david_ilas/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_ilas"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0075,test,disambiguation_year,hard,hybrid,Rozlíš rok začiatku štúdia a rok práce osoby Dárius Lindvai.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/david_ilas/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_ilas"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0076,test,adversarial_year,hard,fts,Je rok 2016 rokom záverečnej práce osoby Dárius Lindvai?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/students/2016/darius_lindvai/dp2021/README.md"", ""pages/topics/faq/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/dp2021"", ""https://zp.kemt.fei.tuke.sk/topics/faq""]"
|
||||
q0076,test,adversarial_year,hard,vector,Je rok 2016 rokom záverečnej práce osoby Dárius Lindvai?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0076,test,adversarial_year,hard,hybrid,Je rok 2016 rokom záverečnej práce osoby Dárius Lindvai?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/topics/faq/README.md"", ""pages/topics/akopisat/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]"
|
||||
q0077,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou interpunkcia a osobou Dárius Lindvai?,2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md"", ""pages/students/2016/darius_lindvai/dp2021/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0077,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou interpunkcia a osobou Dárius Lindvai?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2018/david_omasta/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0077,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou interpunkcia a osobou Dárius Lindvai?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]"
|
||||
q0078,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou BiLSTM a osobou Dárius Lindvai?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md"", ""pages/students/2016/darius_lindvai/dp2021/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0078,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou BiLSTM a osobou Dárius Lindvai?,2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2018/david_omasta/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]"
|
||||
q0078,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou BiLSTM a osobou Dárius Lindvai?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2018/david_omasta/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]"
|
||||
q0079,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou CRF a osobou Dárius Lindvai?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md"", ""pages/students/2016/darius_lindvai/dp2021/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0079,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou CRF a osobou Dárius Lindvai?,2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/topics/faq/README.md"", ""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0079,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou CRF a osobou Dárius Lindvai?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0080,test,specific_fact,medium,fts,Akú architektúru Dárius Lindvai trénoval pri obnove interpunkcie?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md"", ""pages/students/2016/darius_lindvai/dp2021/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]"
|
||||
q0080,test,specific_fact,medium,vector,Akú architektúru Dárius Lindvai trénoval pri obnove interpunkcie?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/students/2018/adrian_remias/README.md"", ""pages/students/2022/andrii_pervashov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]"
|
||||
q0080,test,specific_fact,medium,hybrid,Akú architektúru Dárius Lindvai trénoval pri obnove interpunkcie?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/students/2018/adrian_remias/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2022/andrii_pervashov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]"
|
||||
q0081,test,specific_fact,medium,fts,Akými metrikami mal Dárius Lindvai vyhodnocovať model pre jednotlivé triedy?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md"", ""pages/students/2016/darius_lindvai/dp2021/README.md"", ""pages/students/2022/daniil_huzenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""]"
|
||||
q0081,test,specific_fact,medium,vector,Akými metrikami mal Dárius Lindvai vyhodnocovať model pre jednotlivé triedy?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2020/david_kostilnik/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2021/artur_hyrenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko""]"
|
||||
q0081,test,specific_fact,medium,hybrid,Akými metrikami mal Dárius Lindvai vyhodnocovať model pre jednotlivé triedy?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2020/david_kostilnik/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2021/artur_hyrenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko""]"
|
||||
q0093,test,entity_lookup,easy,fts,Nájdi dokument o osobe Márk Fehér.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2019/david_stromp/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0093,test,entity_lookup,easy,vector,Nájdi dokument o osobe Márk Fehér.,2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2016/mark_feher/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0093,test,entity_lookup,easy,hybrid,Nájdi dokument o osobe Márk Fehér.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0094,test,fact_title,easy,fts,Aký je názov diplomová práca osoby Márk Fehér?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]"
|
||||
q0094,test,fact_title,easy,vector,Aký je názov diplomová práca osoby Márk Fehér?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2020/david_kostilnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik""]"
|
||||
q0094,test,fact_title,easy,hybrid,Aký je názov diplomová práca osoby Márk Fehér?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0095,test,reverse_lookup,medium,fts,Kto sa venuje práci s názvom „Klasifikácia textu metódami strojového učenia“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2016/patrik_pavlisin/dp21/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp21""]"
|
||||
q0095,test,reverse_lookup,medium,vector,Kto sa venuje práci s názvom „Klasifikácia textu metódami strojového učenia“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]"
|
||||
q0095,test,reverse_lookup,medium,hybrid,Kto sa venuje práci s názvom „Klasifikácia textu metódami strojového učenia“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]"
|
||||
q0096,test,topic_lookup,medium,fts,"Nájdi študenta alebo dokument, ktorý rieši tému „Klasifikácia textu metódami strojového učenia“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2016/patrik_pavlisin/tp20/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/tp20"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0096,test,topic_lookup,medium,vector,"Nájdi študenta alebo dokument, ktorý rieši tému „Klasifikácia textu metódami strojového učenia“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0096,test,topic_lookup,medium,hybrid,"Nájdi študenta alebo dokument, ktorý rieši tému „Klasifikácia textu metódami strojového učenia“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q0097,test,paraphrase,medium,fts,O čom je práca osoby Márk Fehér?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/ediz_morochovic/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]"
|
||||
q0097,test,paraphrase,medium,vector,O čom je práca osoby Márk Fehér?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2020/david_kostilnik/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0097,test,paraphrase,medium,hybrid,O čom je práca osoby Márk Fehér?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2020/david_kostilnik/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q0098,test,fact_work_year,easy,fts,V ktorom roku je pri osobe Márk Fehér uvedená diplomová práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2018/david_omasta/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers""]"
|
||||
q0098,test,fact_work_year,easy,vector,V ktorom roku je pri osobe Márk Fehér uvedená diplomová práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/dominik_nagy/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy""]"
|
||||
q0098,test,fact_work_year,easy,hybrid,V ktorom roku je pri osobe Márk Fehér uvedená diplomová práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0099,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou klasifikácia textu a osobou Márk Fehér?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0099,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou klasifikácia textu a osobou Márk Fehér?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0099,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou klasifikácia textu a osobou Márk Fehér?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0100,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou strojové učenie a osobou Márk Fehér?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/patrik_pavlisin/dp21/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp21"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt""]"
|
||||
q0100,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou strojové učenie a osobou Márk Fehér?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]"
|
||||
q0100,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou strojové učenie a osobou Márk Fehér?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0101,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou scikit a osobou Márk Fehér?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0101,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou scikit a osobou Márk Fehér?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0101,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou scikit a osobou Márk Fehér?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0112,test,entity_lookup,easy,fts,Nájdi dokument o osobe Dmytro Ushatenko.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2019/dmytro_mural/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2019/david_stromp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp""]"
|
||||
q0112,test,entity_lookup,easy,vector,Nájdi dokument o osobe Dmytro Ushatenko.,3,0.333333,0,1,1,0.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/interns/oliver_pejic/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q0112,test,entity_lookup,easy,hybrid,Nájdi dokument o osobe Dmytro Ushatenko.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/interns/oliver_pejic/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0113,test,fact_title,easy,fts,Aký je názov bakalárska práca osoby Dmytro Ushatenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2019/dmytro_mural/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0113,test,fact_title,easy,vector,Aký je názov bakalárska práca osoby Dmytro Ushatenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2019/dmytro_mural/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2020/matus_suchanic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""]"
|
||||
q0113,test,fact_title,easy,hybrid,Aký je názov bakalárska práca osoby Dmytro Ushatenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2019/dmytro_mural/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]"
|
||||
q0114,test,reverse_lookup,medium,fts,Kto sa venuje práci s názvom „Jednoduchý chatbot v jazyku Python“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas""]"
|
||||
q0114,test,reverse_lookup,medium,vector,Kto sa venuje práci s názvom „Jednoduchý chatbot v jazyku Python“?,5,0.2,0,0,1,0.0,0.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2017/dmytro_ushatenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko""]"
|
||||
q0114,test,reverse_lookup,medium,hybrid,Kto sa venuje práci s názvom „Jednoduchý chatbot v jazyku Python“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0115,test,topic_lookup,medium,fts,"Nájdi študenta alebo dokument, ktorý rieši tému „Jednoduchý chatbot v jazyku Python“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2019/samuel_horani/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani""]"
|
||||
q0115,test,topic_lookup,medium,vector,"Nájdi študenta alebo dokument, ktorý rieši tému „Jednoduchý chatbot v jazyku Python“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2019/samuel_horani/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani""]"
|
||||
q0115,test,topic_lookup,medium,hybrid,"Nájdi študenta alebo dokument, ktorý rieši tému „Jednoduchý chatbot v jazyku Python“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2019/samuel_horani/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani""]"
|
||||
q0116,test,paraphrase,medium,fts,O čom je práca osoby Dmytro Ushatenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2019/dmytro_mural/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0116,test,paraphrase,medium,vector,O čom je práca osoby Dmytro Ushatenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q0116,test,paraphrase,medium,hybrid,O čom je práca osoby Dmytro Ushatenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2019/dmytro_mural/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0117,test,fact_work_year,easy,fts,V ktorom roku je pri osobe Dmytro Ushatenko uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2019/dmytro_mural/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers""]"
|
||||
q0117,test,fact_work_year,easy,vector,V ktorom roku je pri osobe Dmytro Ushatenko uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2019/dmytro_mural/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/matus_suchanic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""]"
|
||||
q0117,test,fact_work_year,easy,hybrid,V ktorom roku je pri osobe Dmytro Ushatenko uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2019/dmytro_mural/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/matus_suchanic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""]"
|
||||
q0118,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou chatbot a osobou Dmytro Ushatenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2019/dmytro_mural/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0118,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou chatbot a osobou Dmytro Ushatenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/artur_hyrenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko""]"
|
||||
q0118,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou chatbot a osobou Dmytro Ushatenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0119,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou Python a osobou Dmytro Ushatenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2019/dmytro_mural/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0119,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou Python a osobou Dmytro Ushatenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2018/oleh_bilykh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""]"
|
||||
q0119,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou Python a osobou Dmytro Ushatenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0120,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou dialógový systém a osobou Dmytro Ushatenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2019/dmytro_mural/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0120,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou dialógový systém a osobou Dmytro Ushatenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]"
|
||||
q0120,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou dialógový systém a osobou Dmytro Ushatenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/topics/faq/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/topics/faq""]"
|
||||
q0121,test,specific_fact,medium,fts,O čom mal informovať chatbot Dmytra Ushatenka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0121,test,specific_fact,medium,vector,O čom mal informovať chatbot Dmytra Ushatenka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2021/artur_hyrenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko""]"
|
||||
q0121,test,specific_fact,medium,hybrid,O čom mal informovať chatbot Dmytra Ushatenka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0132,test,entity_lookup,easy,fts,Nájdi dokument o osobe Martin Wencel.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/topics/spacy/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0132,test,entity_lookup,easy,vector,Nájdi dokument o osobe Martin Wencel.,2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]"
|
||||
q0132,test,entity_lookup,easy,hybrid,Nájdi dokument o osobe Martin Wencel.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q0133,test,fact_title,easy,fts,Aký je názov bakalárska práca osoby Martin Wencel?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/topics/spacy/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]"
|
||||
q0133,test,fact_title,easy,vector,Aký je názov bakalárska práca osoby Martin Wencel?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]"
|
||||
q0133,test,fact_title,easy,hybrid,Aký je názov bakalárska práca osoby Martin Wencel?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0134,test,reverse_lookup,medium,fts,Kto sa venuje práci s názvom „Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2018/NaN1name_buday/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday""]"
|
||||
q0134,test,reverse_lookup,medium,vector,Kto sa venuje práci s názvom „Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/topics/spacy/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/jakub_maruniak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""]"
|
||||
q0134,test,reverse_lookup,medium,hybrid,Kto sa venuje práci s názvom „Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/topics/spacy/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/jakub_maruniak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""]"
|
||||
q0135,test,topic_lookup,medium,fts,"Nájdi študenta alebo dokument, ktorý rieši tému „Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2018/NaN1name_buday/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday""]"
|
||||
q0135,test,topic_lookup,medium,vector,"Nájdi študenta alebo dokument, ktorý rieši tému „Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy“.",2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/topics/spacy/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2016/jakub_maruniak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""]"
|
||||
q0135,test,topic_lookup,medium,hybrid,"Nájdi študenta alebo dokument, ktorý rieši tému „Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/topics/spacy/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]"
|
||||
q0136,test,paraphrase,medium,fts,O čom je práca osoby Martin Wencel?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/topics/spacy/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]"
|
||||
q0136,test,paraphrase,medium,vector,O čom je práca osoby Martin Wencel?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/kamil_tomcufcik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/kamil_tomcufcik""]"
|
||||
q0136,test,paraphrase,medium,hybrid,O čom je práca osoby Martin Wencel?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0137,test,fact_work_year,easy,fts,V ktorom roku je pri osobe Martin Wencel uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/topics/spacy/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0137,test,fact_work_year,easy,vector,V ktorom roku je pri osobe Martin Wencel uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2016/ediz_morochovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic""]"
|
||||
q0137,test,fact_work_year,easy,hybrid,V ktorom roku je pri osobe Martin Wencel uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0138,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou Spacy a osobou Martin Wencel?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/topics/spacy/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]"
|
||||
q0138,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou Spacy a osobou Martin Wencel?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/topics/spacy/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0138,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou Spacy a osobou Martin Wencel?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/topics/spacy/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0139,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou morfologická analýza a osobou Martin Wencel?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/topics/morphology/README.md"", ""pages/topics/otvorene/README.md"", ""pages/topics/spacy/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/topics/morphology"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/topics/spacy""]"
|
||||
q0139,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou morfologická analýza a osobou Martin Wencel?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/topics/morphology/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2020/kamil_tomcufcik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/topics/morphology"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2020/kamil_tomcufcik""]"
|
||||
q0139,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou morfologická analýza a osobou Martin Wencel?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/topics/morphology/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/topics/morphology"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0140,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou pomenované entity a osobou Martin Wencel?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/topics/named-entity/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/topics/spacy/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/topics/named-entity"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/topics/spacy""]"
|
||||
q0140,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou pomenované entity a osobou Martin Wencel?,2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2016/ediz_morochovic/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2020/kamil_tomcufcik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2020/kamil_tomcufcik""]"
|
||||
q0140,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou pomenované entity a osobou Martin Wencel?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/topics/named-entity/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/topics/named-entity"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]"
|
||||
q0141,test,specific_fact,medium,fts,Aké tri NLP úlohy mal Martin Wencel vysvetliť v práci?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/topics/spacy/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]"
|
||||
q0141,test,specific_fact,medium,vector,Aké tri NLP úlohy mal Martin Wencel vysvetliť v práci?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2018/oleh_bilykh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""]"
|
||||
q0141,test,specific_fact,medium,hybrid,Aké tri NLP úlohy mal Martin Wencel vysvetliť v práci?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]"
|
||||
q0153,test,entity_lookup,easy,fts,Nájdi dokument o osobe Filip Tomáš.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2019/david_stromp/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0153,test,entity_lookup,easy,vector,Nájdi dokument o osobe Filip Tomáš.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/interns/yussef_ressaissi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi""]"
|
||||
q0153,test,entity_lookup,easy,hybrid,Nájdi dokument o osobe Filip Tomáš.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/interns/yussef_ressaissi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi""]"
|
||||
q0154,test,fact_title,easy,fts,Aký je názov bakalárska práca osoby Filip Tomáš?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/jakub_maruniak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""]"
|
||||
q0154,test,fact_title,easy,vector,Aký je názov bakalárska práca osoby Filip Tomáš?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/david_stromp/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]"
|
||||
q0154,test,fact_title,easy,hybrid,Aký je názov bakalárska práca osoby Filip Tomáš?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2019/david_stromp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp""]"
|
||||
q0155,test,reverse_lookup,medium,fts,Kto sa venuje práci s názvom „Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0155,test,reverse_lookup,medium,vector,Kto sa venuje práci s názvom „Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2017/than_trung_thanh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh""]"
|
||||
q0155,test,reverse_lookup,medium,hybrid,Kto sa venuje práci s názvom „Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2018/oleh_bilykh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""]"
|
||||
q0156,test,topic_lookup,medium,fts,"Nájdi študenta alebo dokument, ktorý rieši tému „Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/topics/steel/README.md"", ""pages/topics/faq/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/topics/steel"", ""https://zp.kemt.fei.tuke.sk/topics/faq""]"
|
||||
q0156,test,topic_lookup,medium,vector,"Nájdi študenta alebo dokument, ktorý rieši tému „Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/annotation/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021/annotation""]"
|
||||
q0156,test,topic_lookup,medium,hybrid,"Nájdi študenta alebo dokument, ktorý rieši tému „Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0157,test,paraphrase,medium,fts,O čom je práca osoby Filip Tomáš?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/topics/question/README.md"", ""pages/students/2023/denis_le_thanh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/topics/question"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""]"
|
||||
q0157,test,paraphrase,medium,vector,O čom je práca osoby Filip Tomáš?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2020/matus_suchanic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""]"
|
||||
q0157,test,paraphrase,medium,hybrid,O čom je práca osoby Filip Tomáš?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2020/matus_suchanic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""]"
|
||||
q0158,test,fact_work_year,easy,fts,V ktorom roku je pri osobe Filip Tomáš uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/topics/faq/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/topics/faq""]"
|
||||
q0158,test,fact_work_year,easy,vector,V ktorom roku je pri osobe Filip Tomáš uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2019/david_stromp/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0158,test,fact_work_year,easy,hybrid,V ktorom roku je pri osobe Filip Tomáš uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2019/david_stromp/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0159,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou CI/CD a osobou Filip Tomáš?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0159,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou CI/CD a osobou Filip Tomáš?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2018/oleh_bilykh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""]"
|
||||
q0159,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou CI/CD a osobou Filip Tomáš?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2018/oleh_bilykh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""]"
|
||||
q0160,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou Docker Compose a osobou Filip Tomáš?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0160,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou Docker Compose a osobou Filip Tomáš?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2018/samuel_sirotnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik""]"
|
||||
q0160,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou Docker Compose a osobou Filip Tomáš?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2018/samuel_sirotnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik""]"
|
||||
q0161,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou microk8s a osobou Filip Tomáš?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0161,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou microk8s a osobou Filip Tomáš?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2018/samuel_sirotnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik""]"
|
||||
q0161,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou microk8s a osobou Filip Tomáš?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2018/samuel_sirotnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik""]"
|
||||
q0162,test,specific_fact,medium,fts,Aký systém pre orchestráciu klastra mal Filip Tomáš skúmať?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/topics/bert/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/topics/bert""]"
|
||||
q0162,test,specific_fact,medium,vector,Aký systém pre orchestráciu klastra mal Filip Tomáš skúmať?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2019/david_stromp/README.md"", ""pages/students/2018/samuel_sirotnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik""]"
|
||||
q0162,test,specific_fact,medium,hybrid,Aký systém pre orchestráciu klastra mal Filip Tomáš skúmať?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2019/david_stromp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp""]"
|
||||
q0163,test,specific_fact,medium,fts,Koľko jednotiek Raspberry Pi 4 mal Filip Tomáš k dispozícii pri návrhu klastra?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/topics/python/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/topics/python""]"
|
||||
q0163,test,specific_fact,medium,vector,Koľko jednotiek Raspberry Pi 4 mal Filip Tomáš k dispozícii pri návrhu klastra?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2019/david_stromp/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q0163,test,specific_fact,medium,hybrid,Koľko jednotiek Raspberry Pi 4 mal Filip Tomáš k dispozícii pri návrhu klastra?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2019/david_stromp/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q0185,test,entity_lookup,easy,fts,Nájdi dokument o osobe Alina Vitko.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2019/david_stromp/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0185,test,entity_lookup,easy,vector,Nájdi dokument o osobe Alina Vitko.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2018/adrian_remias/README.md"", ""pages/interns/sevval_bulburu/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu""]"
|
||||
q0185,test,entity_lookup,easy,hybrid,Nájdi dokument o osobe Alina Vitko.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0186,test,fact_title,easy,fts,Aký je názov bakalárska práca osoby Alina Vitko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0186,test,fact_title,easy,vector,Aký je názov bakalárska práca osoby Alina Vitko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q0186,test,fact_title,easy,hybrid,Aký je názov bakalárska práca osoby Alina Vitko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2017/dmytro_ushatenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko""]"
|
||||
q0187,test,reverse_lookup,medium,fts,Kto sa venuje práci s názvom „Systémy pre generovanie odpovede na otázku v prirodzenom jazyku“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/topics/otvorene/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/topics/question/nezodpovedatelne/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne""]"
|
||||
q0187,test,reverse_lookup,medium,vector,Kto sa venuje práci s názvom „Systémy pre generovanie odpovede na otázku v prirodzenom jazyku“?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2017/stanislav_matsunych/README.md"", ""pages/topics/question/nezodpovedatelne/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2018/ondrej_megela/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2017/stanislav_matsunych"", ""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]"
|
||||
q0187,test,reverse_lookup,medium,hybrid,Kto sa venuje práci s názvom „Systémy pre generovanie odpovede na otázku v prirodzenom jazyku“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/topics/question/nezodpovedatelne/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/topics/otvorene/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene""]"
|
||||
q0188,test,topic_lookup,medium,fts,"Nájdi študenta alebo dokument, ktorý rieši tému „Systémy pre generovanie odpovede na otázku v prirodzenom jazyku“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/topics/otvorene/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/topics/question/nezodpovedatelne/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne""]"
|
||||
q0188,test,topic_lookup,medium,vector,"Nájdi študenta alebo dokument, ktorý rieši tému „Systémy pre generovanie odpovede na otázku v prirodzenom jazyku“.",,0.0,0,0,0,0.0,0.0,0.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/topics/question/nezodpovedatelne/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/topics/otvorene/README.md"", ""pages/topics/question/validacie/README.md"", ""pages/students/2017/stanislav_matsunych/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/topics/question/validacie"", ""https://zp.kemt.fei.tuke.sk/students/2017/stanislav_matsunych""]"
|
||||
q0188,test,topic_lookup,medium,hybrid,"Nájdi študenta alebo dokument, ktorý rieši tému „Systémy pre generovanie odpovede na otázku v prirodzenom jazyku“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/topics/question/nezodpovedatelne/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/topics/otvorene/README.md"", ""pages/topics/question/validacie/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/topics/question/validacie""]"
|
||||
q0189,test,paraphrase,medium,fts,O čom je práca osoby Alina Vitko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0189,test,paraphrase,medium,vector,O čom je práca osoby Alina Vitko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]"
|
||||
q0189,test,paraphrase,medium,hybrid,O čom je práca osoby Alina Vitko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]"
|
||||
q0190,test,fact_start_year,easy,fts,V ktorom roku začal študovať Alina Vitko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0190,test,fact_start_year,easy,vector,V ktorom roku začal študovať Alina Vitko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2021/nikita_bodnar/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/david_kostilnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik""]"
|
||||
q0190,test,fact_start_year,easy,hybrid,V ktorom roku začal študovať Alina Vitko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2021/nikita_bodnar/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0191,test,verification,medium,fts,Je pri osobe Alina Vitko uvedený rok začiatku štúdia 2019?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]"
|
||||
q0191,test,verification,medium,vector,Je pri osobe Alina Vitko uvedený rok začiatku štúdia 2019?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]"
|
||||
q0191,test,verification,medium,hybrid,Je pri osobe Alina Vitko uvedený rok začiatku štúdia 2019?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]"
|
||||
q0192,test,fact_work_year,easy,fts,V ktorom roku je pri osobe Alina Vitko uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/patrik_pavlisin/tp20/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/tp20""]"
|
||||
q0192,test,fact_work_year,easy,vector,V ktorom roku je pri osobe Alina Vitko uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0192,test,fact_work_year,easy,hybrid,V ktorom roku je pri osobe Alina Vitko uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0193,test,disambiguation_year,hard,fts,Rozlíš rok začiatku štúdia a rok práce osoby Alina Vitko.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2016/ediz_morochovic/README.md"", ""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]"
|
||||
q0193,test,disambiguation_year,hard,vector,Rozlíš rok začiatku štúdia a rok práce osoby Alina Vitko.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]"
|
||||
q0193,test,disambiguation_year,hard,hybrid,Rozlíš rok začiatku štúdia a rok práce osoby Alina Vitko.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]"
|
||||
q0194,test,adversarial_year,hard,fts,Je rok 2019 rokom záverečnej práce osoby Alina Vitko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/topics/faq/README.md"", ""pages/topics/akopisat/README.md"", ""pages/students/2019/dmytro_mural/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]"
|
||||
q0194,test,adversarial_year,hard,vector,Je rok 2019 rokom záverečnej práce osoby Alina Vitko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/topics/akopisat/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0194,test,adversarial_year,hard,hybrid,Je rok 2019 rokom záverečnej práce osoby Alina Vitko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/topics/akopisat/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0195,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou Question Answering a osobou Alina Vitko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/topics/question/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2018/david_omasta/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/topics/question"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]"
|
||||
q0195,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou Question Answering a osobou Alina Vitko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/topics/question/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/topics/question/navod/README.md"", ""pages/topics/question/nezodpovedatelne/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/topics/question"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/topics/question/navod"", ""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne""]"
|
||||
q0195,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou Question Answering a osobou Alina Vitko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/topics/question/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/topics/question/nezodpovedatelne/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/topics/question"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne""]"
|
||||
q0196,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou Streamlit a osobou Alina Vitko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0196,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou Streamlit a osobou Alina Vitko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/annotation/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021/annotation""]"
|
||||
q0196,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou Streamlit a osobou Alina Vitko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/annotation/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021/annotation"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]"
|
||||
q0197,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou Docker a osobou Alina Vitko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]"
|
||||
q0197,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou Docker a osobou Alina Vitko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0197,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou Docker a osobou Alina Vitko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/topics/faq/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/topics/faq""]"
|
||||
q0198,test,specific_fact,medium,fts,Aké webové rozhranie mala Alina Vitko použiť pre demo aplikáciu?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2018/oleh_bilykh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""]"
|
||||
q0198,test,specific_fact,medium,vector,Aké webové rozhranie mala Alina Vitko použiť pre demo aplikáciu?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/topics/faq/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/topics/faq""]"
|
||||
q0198,test,specific_fact,medium,hybrid,Aké webové rozhranie mala Alina Vitko použiť pre demo aplikáciu?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]"
|
||||
q0199,test,specific_fact,medium,fts,Aký slovenský model mala Alina Vitko vyskúšať podľa zadania?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/students/2018/ondrej_megela/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]"
|
||||
q0199,test,specific_fact,medium,vector,Aký slovenský model mala Alina Vitko vyskúšať podľa zadania?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/topics/bert/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/topics/bert"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]"
|
||||
q0199,test,specific_fact,medium,hybrid,Aký slovenský model mala Alina Vitko vyskúšať podľa zadania?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/topics/bert/README.md"", ""pages/students/2021/nikita_bodnar/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/topics/bert"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar""]"
|
||||
q0214,test,entity_lookup,easy,fts,Nájdi dokument o osobe Martin Šarišský.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/topics/chatbot/README.md"", ""pages/topics/legal/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/topics/legal"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0214,test,entity_lookup,easy,vector,Nájdi dokument o osobe Martin Šarišský.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/interns/sevval_bulburu/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu""]"
|
||||
q0214,test,entity_lookup,easy,hybrid,Nájdi dokument o osobe Martin Šarišský.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/interns/sevval_bulburu/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu""]"
|
||||
q0215,test,fact_title,easy,fts,Aký je názov diplomová práca osoby Martin Šarišský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2020/matus_suchanic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""]"
|
||||
q0215,test,fact_title,easy,vector,Aký je názov diplomová práca osoby Martin Šarišský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/mark_feher/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher""]"
|
||||
q0215,test,fact_title,easy,hybrid,Aký je názov diplomová práca osoby Martin Šarišský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/mark_feher/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]"
|
||||
q0216,test,reverse_lookup,medium,fts,Kto sa venuje práci s názvom „Agentové systémy pomocou veľkého jazykového modelu“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2019/david_stromp/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0216,test,reverse_lookup,medium,vector,Kto sa venuje práci s názvom „Agentové systémy pomocou veľkého jazykového modelu“?,2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2020/kamil_tomcufcik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2020/kamil_tomcufcik""]"
|
||||
q0216,test,reverse_lookup,medium,hybrid,Kto sa venuje práci s názvom „Agentové systémy pomocou veľkého jazykového modelu“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2020/kamil_tomcufcik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/kamil_tomcufcik""]"
|
||||
q0217,test,topic_lookup,medium,fts,"Nájdi študenta alebo dokument, ktorý rieši tému „Agentové systémy pomocou veľkého jazykového modelu“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2019/david_stromp/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2021/artur_hyrenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko""]"
|
||||
q0217,test,topic_lookup,medium,vector,"Nájdi študenta alebo dokument, ktorý rieši tému „Agentové systémy pomocou veľkého jazykového modelu“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2020/kamil_tomcufcik/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/kamil_tomcufcik"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q0217,test,topic_lookup,medium,hybrid,"Nájdi študenta alebo dokument, ktorý rieši tému „Agentové systémy pomocou veľkého jazykového modelu“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0218,test,paraphrase,medium,fts,O čom je práca osoby Martin Šarišský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2018/NaN1name_buday/README.md"", ""pages/topics/legal/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday"", ""https://zp.kemt.fei.tuke.sk/topics/legal""]"
|
||||
q0218,test,paraphrase,medium,vector,O čom je práca osoby Martin Šarišský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2018/NaN1name_buday/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]"
|
||||
q0218,test,paraphrase,medium,hybrid,O čom je práca osoby Martin Šarišský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2018/NaN1name_buday/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q0219,test,fact_start_year,easy,fts,V ktorom roku začal študovať Martin Šarišský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0219,test,fact_start_year,easy,vector,V ktorom roku začal študovať Martin Šarišský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2021/artur_hyrenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko""]"
|
||||
q0219,test,fact_start_year,easy,hybrid,V ktorom roku začal študovať Martin Šarišský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2018/martin_wencel/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]"
|
||||
q0220,test,verification,medium,fts,Je pri osobe Martin Šarišský uvedený rok začiatku štúdia 2021?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2018/NaN1name_buday/README.md"", ""pages/students/2018/martin_wencel/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]"
|
||||
q0220,test,verification,medium,vector,Je pri osobe Martin Šarišský uvedený rok začiatku štúdia 2021?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0220,test,verification,medium,hybrid,Je pri osobe Martin Šarišský uvedený rok začiatku štúdia 2021?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2018/NaN1name_buday/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0221,test,fact_work_year,easy,fts,V ktorom roku je pri osobe Martin Šarišský uvedená diplomová práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/topics/legal/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/topics/legal""]"
|
||||
q0221,test,fact_work_year,easy,vector,V ktorom roku je pri osobe Martin Šarišský uvedená diplomová práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0221,test,fact_work_year,easy,hybrid,V ktorom roku je pri osobe Martin Šarišský uvedená diplomová práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]"
|
||||
q0222,test,disambiguation_year,hard,fts,Rozlíš rok začiatku štúdia a rok práce osoby Martin Šarišský.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2018/NaN1name_buday/README.md"", ""pages/students/2018/martin_wencel/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]"
|
||||
q0222,test,disambiguation_year,hard,vector,Rozlíš rok začiatku štúdia a rok práce osoby Martin Šarišský.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q0222,test,disambiguation_year,hard,hybrid,Rozlíš rok začiatku štúdia a rok práce osoby Martin Šarišský.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q0223,test,adversarial_year,hard,fts,Je rok 2021 rokom záverečnej práce osoby Martin Šarišský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0223,test,adversarial_year,hard,vector,Je rok 2021 rokom záverečnej práce osoby Martin Šarišský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2018/martin_wencel/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]"
|
||||
q0223,test,adversarial_year,hard,hybrid,Je rok 2021 rokom záverečnej práce osoby Martin Šarišský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0224,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou agent a osobou Martin Šarišský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/topics/legal/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/topics/legal"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0224,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou agent a osobou Martin Šarišský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/topics/faq/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/topics/faq""]"
|
||||
q0224,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou agent a osobou Martin Šarišský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/topics/legal/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/topics/legal""]"
|
||||
q0225,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou právne informácie a osobou Martin Šarišský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/topics/legal/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/topics/legal""]"
|
||||
q0225,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou právne informácie a osobou Martin Šarišský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/topics/faq/README.md"", ""pages/topics/legal/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/topics/legal"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0225,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou právne informácie a osobou Martin Šarišský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/topics/legal/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/topics/legal"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]"
|
||||
q0226,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou DeepEval a osobou Martin Šarišský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]"
|
||||
q0226,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou DeepEval a osobou Martin Šarišský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0226,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou DeepEval a osobou Martin Šarišský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]"
|
||||
q0227,test,specific_fact,medium,fts,Aké tri metriky sa uvádzajú pri vyhodnotení systému Martina Šarišského?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2016/patrik_pavlisin/tp20/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/tp20"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0227,test,specific_fact,medium,vector,Aké tri metriky sa uvádzajú pri vyhodnotení systému Martina Šarišského?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0227,test,specific_fact,medium,hybrid,Aké tri metriky sa uvádzajú pri vyhodnotení systému Martina Šarišského?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2016/patrik_pavlisin/tp20/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/tp20"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0228,test,specific_fact,medium,fts,Aký parser mal Martin Šarišský zvážiť namiesto BeautifulSoup?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]"
|
||||
q0228,test,specific_fact,medium,vector,Aký parser mal Martin Šarišský zvážiť namiesto BeautifulSoup?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2018/NaN1name_buday/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]"
|
||||
q0228,test,specific_fact,medium,hybrid,Aký parser mal Martin Šarišský zvážiť namiesto BeautifulSoup?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2018/NaN1name_buday/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]"
|
||||
q0260,test,entity_lookup,easy,fts,Nájdi dokument o osobe Eduard Matovka.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2019/david_stromp/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0260,test,entity_lookup,easy,vector,Nájdi dokument o osobe Eduard Matovka.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/interns/oliver_pejic/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/interns/sevval_bulburu/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu""]"
|
||||
q0260,test,entity_lookup,easy,hybrid,Nájdi dokument o osobe Eduard Matovka.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/interns/oliver_pejic/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q0261,test,fact_title,easy,fts,Aký je názov bakalárska práca osoby Eduard Matovka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/jakub_maruniak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""]"
|
||||
q0261,test,fact_title,easy,vector,Aký je názov bakalárska práca osoby Eduard Matovka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2016/ediz_morochovic/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]"
|
||||
q0261,test,fact_title,easy,hybrid,Aký je názov bakalárska práca osoby Eduard Matovka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2016/ediz_morochovic/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q0262,test,reverse_lookup,medium,fts,Kto sa venuje práci s názvom „Slovenská konverzačná umelá inteligencia“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/topics/question/navod/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/topics/question/navod""]"
|
||||
q0262,test,reverse_lookup,medium,vector,Kto sa venuje práci s názvom „Slovenská konverzačná umelá inteligencia“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/topics/steel/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/topics/steel"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0262,test,reverse_lookup,medium,hybrid,Kto sa venuje práci s názvom „Slovenská konverzačná umelá inteligencia“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/topics/steel/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/topics/steel"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0263,test,topic_lookup,medium,fts,"Nájdi študenta alebo dokument, ktorý rieši tému „Slovenská konverzačná umelá inteligencia“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2016/patrik_pavlisin/dp21/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp21""]"
|
||||
q0263,test,topic_lookup,medium,vector,"Nájdi študenta alebo dokument, ktorý rieši tému „Slovenská konverzačná umelá inteligencia“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]"
|
||||
q0263,test,topic_lookup,medium,hybrid,"Nájdi študenta alebo dokument, ktorý rieši tému „Slovenská konverzačná umelá inteligencia“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/topics/steel/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/topics/steel""]"
|
||||
q0264,test,paraphrase,medium,fts,O čom je práca osoby Eduard Matovka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2020/pavol_hudak/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2020/pavol_hudak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0264,test,paraphrase,medium,vector,O čom je práca osoby Eduard Matovka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q0264,test,paraphrase,medium,hybrid,O čom je práca osoby Eduard Matovka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2016/ediz_morochovic/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0265,test,fact_start_year,easy,fts,V ktorom roku začal študovať Eduard Matovka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0265,test,fact_start_year,easy,vector,V ktorom roku začal študovať Eduard Matovka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2016/ediz_morochovic/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0265,test,fact_start_year,easy,hybrid,V ktorom roku začal študovať Eduard Matovka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2016/ediz_morochovic/README.md"", ""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0266,test,verification,medium,fts,Je pri osobe Eduard Matovka uvedený rok začiatku štúdia 2021?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas""]"
|
||||
q0266,test,verification,medium,vector,Je pri osobe Eduard Matovka uvedený rok začiatku štúdia 2021?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2018/martin_wencel/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]"
|
||||
q0266,test,verification,medium,hybrid,Je pri osobe Eduard Matovka uvedený rok začiatku štúdia 2021?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2020/matus_suchanic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""]"
|
||||
q0267,test,fact_work_year,easy,fts,V ktorom roku je pri osobe Eduard Matovka uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/topics/faq/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/topics/faq""]"
|
||||
q0267,test,fact_work_year,easy,vector,V ktorom roku je pri osobe Eduard Matovka uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2016/ediz_morochovic/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]"
|
||||
q0267,test,fact_work_year,easy,hybrid,V ktorom roku je pri osobe Eduard Matovka uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2016/ediz_morochovic/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q0268,test,disambiguation_year,hard,fts,Rozlíš rok začiatku štúdia a rok práce osoby Eduard Matovka.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2016/ediz_morochovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic""]"
|
||||
q0268,test,disambiguation_year,hard,vector,Rozlíš rok začiatku štúdia a rok práce osoby Eduard Matovka.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/ediz_morochovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic""]"
|
||||
q0268,test,disambiguation_year,hard,hybrid,Rozlíš rok začiatku štúdia a rok práce osoby Eduard Matovka.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/ediz_morochovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic""]"
|
||||
q0269,test,adversarial_year,hard,fts,Je rok 2021 rokom záverečnej práce osoby Eduard Matovka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/topics/faq/README.md"", ""pages/topics/akopisat/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0269,test,adversarial_year,hard,vector,Je rok 2021 rokom záverečnej práce osoby Eduard Matovka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q0269,test,adversarial_year,hard,hybrid,Je rok 2021 rokom záverečnej práce osoby Eduard Matovka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2020/matus_suchanic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""]"
|
||||
q0270,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou slovenský jazykový model a osobou Eduard Matovka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/topics/bert/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2020/pavol_hudak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/topics/bert"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2020/pavol_hudak""]"
|
||||
q0270,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou slovenský jazykový model a osobou Eduard Matovka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/topics/bert/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/topics/bert"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]"
|
||||
q0270,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou slovenský jazykový model a osobou Eduard Matovka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/topics/bert/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/topics/bert"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]"
|
||||
q0271,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou LLAMA a osobou Eduard Matovka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2020/pavol_hudak/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2020/pavol_hudak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0271,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou LLAMA a osobou Eduard Matovka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2018/david_omasta/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]"
|
||||
q0271,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou LLAMA a osobou Eduard Matovka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2018/david_omasta/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]"
|
||||
q0272,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou SlovakAlpaca a osobou Eduard Matovka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2020/pavol_hudak/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2020/pavol_hudak"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0272,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou SlovakAlpaca a osobou Eduard Matovka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/topics/resources/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/topics/resources""]"
|
||||
q0272,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou SlovakAlpaca a osobou Eduard Matovka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2021/matej_novotny/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny""]"
|
||||
q0273,test,specific_fact,medium,fts,Aký bol predbežný cieľ práce Eduarda Matovku?,4,0.25,0,0,1,0.0,0.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2016/jakub_maruniak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""]"
|
||||
q0273,test,specific_fact,medium,vector,Aký bol predbežný cieľ práce Eduarda Matovku?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/ediz_morochovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic""]"
|
||||
q0273,test,specific_fact,medium,hybrid,Aký bol predbežný cieľ práce Eduarda Matovku?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0274,test,specific_fact,medium,fts,Aké modely mal Eduard Matovka vyskúšať okrem LLAMA?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2020/pavol_hudak/README.md"", ""pages/students/2022/jakub_schwarc/README.md"", ""pages/students/2021/artur_hyrenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2020/pavol_hudak"", ""https://zp.kemt.fei.tuke.sk/students/2022/jakub_schwarc"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko""]"
|
||||
q0274,test,specific_fact,medium,vector,Aké modely mal Eduard Matovka vyskúšať okrem LLAMA?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2018/david_omasta/README.md"", ""pages/students/2020/pavol_hudak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2020/pavol_hudak""]"
|
||||
q0274,test,specific_fact,medium,hybrid,Aké modely mal Eduard Matovka vyskúšať okrem LLAMA?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2020/pavol_hudak/README.md"", ""pages/students/2018/david_omasta/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2020/pavol_hudak"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]"
|
||||
q0288,test,entity_lookup,easy,fts,Nájdi dokument o osobe Andrii Pervashov.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2021/nikita_bodnar/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2019/david_stromp/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0288,test,entity_lookup,easy,vector,Nájdi dokument o osobe Andrii Pervashov.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/students/2018/adrian_remias/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0288,test,entity_lookup,easy,hybrid,Nájdi dokument o osobe Andrii Pervashov.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/students/2018/adrian_remias/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0289,test,fact_title,easy,fts,Aký je názov diplomová práca osoby Andrii Pervashov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2021/nikita_bodnar/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2016/mark_feher/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]"
|
||||
q0289,test,fact_title,easy,vector,Aký je názov diplomová práca osoby Andrii Pervashov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/mark_feher/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher""]"
|
||||
q0289,test,fact_title,easy,hybrid,Aký je názov diplomová práca osoby Andrii Pervashov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2016/mark_feher/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]"
|
||||
q0290,test,reverse_lookup,medium,fts,Kto sa venuje práci s názvom „Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/topics/seq2seq/README.md"", ""pages/students/2018/adrian_remias/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/david_stromp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/topics/seq2seq"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp""]"
|
||||
q0290,test,reverse_lookup,medium,vector,Kto sa venuje práci s názvom „Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]"
|
||||
q0290,test,reverse_lookup,medium,hybrid,Kto sa venuje práci s názvom „Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2022/yevhenii_leonov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov""]"
|
||||
q0291,test,topic_lookup,medium,fts,"Nájdi študenta alebo dokument, ktorý rieši tému „Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/topics/seq2seq/README.md"", ""pages/students/2019/david_stromp/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/topics/seq2seq"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0291,test,topic_lookup,medium,vector,"Nájdi študenta alebo dokument, ktorý rieši tému „Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]"
|
||||
q0291,test,topic_lookup,medium,hybrid,"Nájdi študenta alebo dokument, ktorý rieši tému „Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0292,test,paraphrase,medium,fts,O čom je práca osoby Andrii Pervashov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2021/nikita_bodnar/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0292,test,paraphrase,medium,vector,O čom je práca osoby Andrii Pervashov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/topics/question/nezodpovedatelne/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2020/matus_suchanic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""]"
|
||||
q0292,test,paraphrase,medium,hybrid,O čom je práca osoby Andrii Pervashov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/topics/question/nezodpovedatelne/README.md"", ""pages/students/2020/matus_suchanic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""]"
|
||||
q0293,test,fact_start_year,easy,fts,V ktorom roku začal študovať Andrii Pervashov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/students/2021/nikita_bodnar/README.md"", ""pages/topics/faq/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""https://zp.kemt.fei.tuke.sk/topics/faq""]"
|
||||
q0293,test,fact_start_year,easy,vector,V ktorom roku začal študovať Andrii Pervashov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2017/stanislav_matsunych/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2021/nikita_bodnar/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2017/stanislav_matsunych"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]"
|
||||
q0293,test,fact_start_year,easy,hybrid,V ktorom roku začal študovať Andrii Pervashov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2017/stanislav_matsunych/README.md"", ""pages/students/2021/nikita_bodnar/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2017/stanislav_matsunych"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar""]"
|
||||
q0294,test,verification,medium,fts,Je pri osobe Andrii Pervashov uvedený rok začiatku štúdia 2022?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/tetiana_mohorian/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0294,test,verification,medium,vector,Je pri osobe Andrii Pervashov uvedený rok začiatku štúdia 2022?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2020/matus_suchanic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""]"
|
||||
q0294,test,verification,medium,hybrid,Je pri osobe Andrii Pervashov uvedený rok začiatku štúdia 2022?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2020/matus_suchanic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""]"
|
||||
q0295,test,fact_work_year,easy,fts,V ktorom roku je pri osobe Andrii Pervashov uvedená diplomová práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2021/nikita_bodnar/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2018/david_omasta/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers""]"
|
||||
q0295,test,fact_work_year,easy,vector,V ktorom roku je pri osobe Andrii Pervashov uvedená diplomová práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021""]"
|
||||
q0295,test,fact_work_year,easy,hybrid,V ktorom roku je pri osobe Andrii Pervashov uvedená diplomová práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021""]"
|
||||
q0296,test,disambiguation_year,hard,fts,Rozlíš rok začiatku štúdia a rok práce osoby Andrii Pervashov.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2016/ediz_morochovic/README.md"", ""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]"
|
||||
q0296,test,disambiguation_year,hard,vector,Rozlíš rok začiatku štúdia a rok práce osoby Andrii Pervashov.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu""]"
|
||||
q0296,test,disambiguation_year,hard,hybrid,Rozlíš rok začiatku štúdia a rok práce osoby Andrii Pervashov.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu""]"
|
||||
q0297,test,adversarial_year,hard,fts,Je rok 2022 rokom záverečnej práce osoby Andrii Pervashov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/topics/faq/README.md"", ""pages/topics/akopisat/README.md"", ""pages/students/2021/nikita_bodnar/README.md"", ""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]"
|
||||
q0297,test,adversarial_year,hard,vector,Je rok 2022 rokom záverečnej práce osoby Andrii Pervashov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0297,test,adversarial_year,hard,hybrid,Je rok 2022 rokom záverečnej práce osoby Andrii Pervashov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0298,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou speech-to-text a osobou Andrii Pervashov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2021/nikita_bodnar/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0298,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou speech-to-text a osobou Andrii Pervashov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/topics/hatespeech/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/topics/hatespeech"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu""]"
|
||||
q0298,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou speech-to-text a osobou Andrii Pervashov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/topics/hatespeech/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/topics/hatespeech"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]"
|
||||
q0299,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou OpenWebUI a osobou Andrii Pervashov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2021/nikita_bodnar/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]"
|
||||
q0299,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou OpenWebUI a osobou Andrii Pervashov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]"
|
||||
q0299,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou OpenWebUI a osobou Andrii Pervashov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]"
|
||||
q0300,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou štruktúrované informácie a osobou Andrii Pervashov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2021/nikita_bodnar/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0300,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou štruktúrované informácie a osobou Andrii Pervashov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]"
|
||||
q0300,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou štruktúrované informácie a osobou Andrii Pervashov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]"
|
||||
q0301,test,specific_fact,medium,fts,Aké rozhranie alebo systém má Andrii Pervashov naštudovať pre svoju prácu?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2021/nikita_bodnar/README.md"", ""pages/topics/named-entity/navod/README.md"", ""pages/students/2019/samuel_horani/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""https://zp.kemt.fei.tuke.sk/topics/named-entity/navod"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani""]"
|
||||
q0301,test,specific_fact,medium,vector,Aké rozhranie alebo systém má Andrii Pervashov naštudovať pre svoju prácu?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]"
|
||||
q0301,test,specific_fact,medium,hybrid,Aké rozhranie alebo systém má Andrii Pervashov naštudovať pre svoju prácu?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2019/samuel_horani/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani""]"
|
||||
q0302,test,specific_fact,medium,fts,Do akej podoby má agent Andriiho Pervashova transformovať rečový vstup?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/patrik_pavlisin/tp20/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/tp20"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0302,test,specific_fact,medium,vector,Do akej podoby má agent Andriiho Pervashova transformovať rečový vstup?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]"
|
||||
q0302,test,specific_fact,medium,hybrid,Do akej podoby má agent Andriiho Pervashova transformovať rečový vstup?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0317,test,entity_lookup,easy,fts,Nájdi dokument o osobe Oleh Poiasnik.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2018/oleh_bilykh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""]"
|
||||
q0317,test,entity_lookup,easy,vector,Nájdi dokument o osobe Oleh Poiasnik.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2018/adrian_remias/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q0317,test,entity_lookup,easy,hybrid,Nájdi dokument o osobe Oleh Poiasnik.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2018/adrian_remias/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias""]"
|
||||
q0318,test,fact_title,easy,fts,Aký je názov diplomová práca osoby Oleh Poiasnik?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2020/matus_suchanic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""]"
|
||||
q0318,test,fact_title,easy,vector,Aký je názov diplomová práca osoby Oleh Poiasnik?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2018/oleh_bilykh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""]"
|
||||
q0318,test,fact_title,easy,hybrid,Aký je názov diplomová práca osoby Oleh Poiasnik?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2022/yevhenii_leonov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov""]"
|
||||
q0319,test,reverse_lookup,medium,fts,Kto sa venuje práci s názvom „Expertný agentový systém na podporu rozhodovania v lekárni“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/topics/steel/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/topics/steel"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q0319,test,reverse_lookup,medium,vector,Kto sa venuje práci s názvom „Expertný agentový systém na podporu rozhodovania v lekárni“?,3,0.333333,0,1,1,0.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0319,test,reverse_lookup,medium,hybrid,Kto sa venuje práci s názvom „Expertný agentový systém na podporu rozhodovania v lekárni“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]"
|
||||
q0320,test,topic_lookup,medium,fts,"Nájdi študenta alebo dokument, ktorý rieši tému „Expertný agentový systém na podporu rozhodovania v lekárni“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/topics/steel/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/topics/steel"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0320,test,topic_lookup,medium,vector,"Nájdi študenta alebo dokument, ktorý rieši tému „Expertný agentový systém na podporu rozhodovania v lekárni“.",4,0.25,0,0,1,0.0,0.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0320,test,topic_lookup,medium,hybrid,"Nájdi študenta alebo dokument, ktorý rieši tému „Expertný agentový systém na podporu rozhodovania v lekárni“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]"
|
||||
q0321,test,paraphrase,medium,fts,O čom je práca osoby Oleh Poiasnik?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2022/yevhenii_leonov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov""]"
|
||||
q0321,test,paraphrase,medium,vector,O čom je práca osoby Oleh Poiasnik?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]"
|
||||
q0321,test,paraphrase,medium,hybrid,O čom je práca osoby Oleh Poiasnik?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q0322,test,fact_start_year,easy,fts,V ktorom roku začal študovať Oleh Poiasnik?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt""]"
|
||||
q0322,test,fact_start_year,easy,vector,V ktorom roku začal študovať Oleh Poiasnik?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0322,test,fact_start_year,easy,hybrid,V ktorom roku začal študovať Oleh Poiasnik?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0323,test,verification,medium,fts,Je pri osobe Oleh Poiasnik uvedený rok začiatku štúdia 2022?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2022/tetiana_mohorian/README.md"", ""pages/students/2022/daniil_huzenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""]"
|
||||
q0323,test,verification,medium,vector,Je pri osobe Oleh Poiasnik uvedený rok začiatku štúdia 2022?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0323,test,verification,medium,hybrid,Je pri osobe Oleh Poiasnik uvedený rok začiatku štúdia 2022?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0324,test,fact_work_year,easy,fts,V ktorom roku je pri osobe Oleh Poiasnik uvedená diplomová práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2018/oleh_bilykh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""]"
|
||||
q0324,test,fact_work_year,easy,vector,V ktorom roku je pri osobe Oleh Poiasnik uvedená diplomová práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0324,test,fact_work_year,easy,hybrid,V ktorom roku je pri osobe Oleh Poiasnik uvedená diplomová práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/yevhenii_leonov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov""]"
|
||||
q0325,test,disambiguation_year,hard,fts,Rozlíš rok začiatku štúdia a rok práce osoby Oleh Poiasnik.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]"
|
||||
q0325,test,disambiguation_year,hard,vector,Rozlíš rok začiatku štúdia a rok práce osoby Oleh Poiasnik.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/interns/oliver_pejic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic""]"
|
||||
q0325,test,disambiguation_year,hard,hybrid,Rozlíš rok začiatku štúdia a rok práce osoby Oleh Poiasnik.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2018/oleh_bilykh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""]"
|
||||
q0326,test,adversarial_year,hard,fts,Je rok 2022 rokom záverečnej práce osoby Oleh Poiasnik?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0326,test,adversarial_year,hard,vector,Je rok 2022 rokom záverečnej práce osoby Oleh Poiasnik?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0326,test,adversarial_year,hard,hybrid,Je rok 2022 rokom záverečnej práce osoby Oleh Poiasnik?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0327,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou lekáreň a osobou Oleh Poiasnik?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/yevhenii_leonov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov""]"
|
||||
q0327,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou lekáreň a osobou Oleh Poiasnik?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/topics/faq/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/topics/faq""]"
|
||||
q0327,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou lekáreň a osobou Oleh Poiasnik?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/topics/faq/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/topics/faq""]"
|
||||
q0328,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou znalostný graf a osobou Oleh Poiasnik?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]"
|
||||
q0328,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou znalostný graf a osobou Oleh Poiasnik?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]"
|
||||
q0328,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou znalostný graf a osobou Oleh Poiasnik?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]"
|
||||
q0329,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou LightRAG a osobou Oleh Poiasnik?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0329,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou LightRAG a osobou Oleh Poiasnik?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0329,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou LightRAG a osobou Oleh Poiasnik?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2022/yevhenii_leonov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov""]"
|
||||
q0330,test,specific_fact,medium,fts,Z akej databázy mal Oleh Poiasnik zostaviť znalostný graf?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0330,test,specific_fact,medium,vector,Z akej databázy mal Oleh Poiasnik zostaviť znalostný graf?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]"
|
||||
q0330,test,specific_fact,medium,hybrid,Z akej databázy mal Oleh Poiasnik zostaviť znalostný graf?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]"
|
||||
q0331,test,specific_fact,medium,fts,Aký nástroj použil Oleh Poiasnik na vytvorenie znalostného grafu?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]"
|
||||
q0331,test,specific_fact,medium,vector,Aký nástroj použil Oleh Poiasnik na vytvorenie znalostného grafu?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]"
|
||||
q0331,test,specific_fact,medium,hybrid,Aký nástroj použil Oleh Poiasnik na vytvorenie znalostného grafu?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]"
|
||||
q0332,test,specific_fact,medium,fts,Pre približne koľko liekov bol vytvorený znalostný graf v stave práce Oleha Poiasnika?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2016/lukas_pokryvka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]"
|
||||
q0332,test,specific_fact,medium,vector,Pre približne koľko liekov bol vytvorený znalostný graf v stave práce Oleha Poiasnika?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0332,test,specific_fact,medium,hybrid,Pre približne koľko liekov bol vytvorený znalostný graf v stave práce Oleha Poiasnika?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko""]"
|
||||
q0348,test,entity_lookup,easy,fts,Nájdi dokument o osobe Vladyslav Yanchenko.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2019/david_stromp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp""]"
|
||||
q0348,test,entity_lookup,easy,vector,Nájdi dokument o osobe Vladyslav Yanchenko.,3,0.333333,0,1,1,0.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/interns/sevval_bulburu/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0348,test,entity_lookup,easy,hybrid,Nájdi dokument o osobe Vladyslav Yanchenko.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0349,test,fact_title,easy,fts,Aký je názov bakalárska práca osoby Vladyslav Yanchenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0349,test,fact_title,easy,vector,Aký je názov bakalárska práca osoby Vladyslav Yanchenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0349,test,fact_title,easy,hybrid,Aký je názov bakalárska práca osoby Vladyslav Yanchenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]"
|
||||
q0350,test,reverse_lookup,medium,fts,Kto sa venuje práci s názvom „Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/topics/named-entity/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/topics/named-entity"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0350,test,reverse_lookup,medium,vector,Kto sa venuje práci s názvom „Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0350,test,reverse_lookup,medium,hybrid,Kto sa venuje práci s názvom „Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0351,test,topic_lookup,medium,fts,"Nájdi študenta alebo dokument, ktorý rieši tému „Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/topics/faq/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/topics/faq""]"
|
||||
q0351,test,topic_lookup,medium,vector,"Nájdi študenta alebo dokument, ktorý rieši tému „Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0351,test,topic_lookup,medium,hybrid,"Nájdi študenta alebo dokument, ktorý rieši tému „Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu""]"
|
||||
q0352,test,paraphrase,medium,fts,O čom je práca osoby Vladyslav Yanchenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0352,test,paraphrase,medium,vector,O čom je práca osoby Vladyslav Yanchenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]"
|
||||
q0352,test,paraphrase,medium,hybrid,O čom je práca osoby Vladyslav Yanchenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2021/artur_hyrenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko""]"
|
||||
q0353,test,fact_start_year,easy,fts,V ktorom roku začal študovať Vladyslav Yanchenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q0353,test,fact_start_year,easy,vector,V ktorom roku začal študovať Vladyslav Yanchenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]"
|
||||
q0353,test,fact_start_year,easy,hybrid,V ktorom roku začal študovať Vladyslav Yanchenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]"
|
||||
q0354,test,verification,medium,fts,Je pri osobe Vladyslav Yanchenko uvedený rok začiatku štúdia 2022?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]"
|
||||
q0354,test,verification,medium,vector,Je pri osobe Vladyslav Yanchenko uvedený rok začiatku štúdia 2022?,2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2022/yevhenii_leonov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov""]"
|
||||
q0354,test,verification,medium,hybrid,Je pri osobe Vladyslav Yanchenko uvedený rok začiatku štúdia 2022?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]"
|
||||
q0355,test,fact_work_year,easy,fts,V ktorom roku je pri osobe Vladyslav Yanchenko uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers""]"
|
||||
q0355,test,fact_work_year,easy,vector,V ktorom roku je pri osobe Vladyslav Yanchenko uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0355,test,fact_work_year,easy,hybrid,V ktorom roku je pri osobe Vladyslav Yanchenko uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0356,test,disambiguation_year,hard,fts,Rozlíš rok začiatku štúdia a rok práce osoby Vladyslav Yanchenko.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2016/ediz_morochovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic""]"
|
||||
q0356,test,disambiguation_year,hard,vector,Rozlíš rok začiatku štúdia a rok práce osoby Vladyslav Yanchenko.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q0356,test,disambiguation_year,hard,hybrid,Rozlíš rok začiatku štúdia a rok práce osoby Vladyslav Yanchenko.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q0357,test,adversarial_year,hard,fts,Je rok 2022 rokom záverečnej práce osoby Vladyslav Yanchenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/topics/akopisat/README.md"", ""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]"
|
||||
q0357,test,adversarial_year,hard,vector,Je rok 2022 rokom záverečnej práce osoby Vladyslav Yanchenko?,2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0357,test,adversarial_year,hard,hybrid,Je rok 2022 rokom záverečnej práce osoby Vladyslav Yanchenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0358,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou cloud a osobou Vladyslav Yanchenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0358,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou cloud a osobou Vladyslav Yanchenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0358,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou cloud a osobou Vladyslav Yanchenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q0359,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou Kubernetes a osobou Vladyslav Yanchenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2022/daniil_huzenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""]"
|
||||
q0359,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou Kubernetes a osobou Vladyslav Yanchenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q0359,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou Kubernetes a osobou Vladyslav Yanchenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0360,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou Azure a osobou Vladyslav Yanchenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0360,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou Azure a osobou Vladyslav Yanchenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0360,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou Azure a osobou Vladyslav Yanchenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2022/daniil_huzenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""]"
|
||||
q0361,test,specific_fact,medium,fts,Aké technológie používal Vladyslav Yanchenko pre backend a frontend?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2018/martin_wencel/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]"
|
||||
q0361,test,specific_fact,medium,vector,Aké technológie používal Vladyslav Yanchenko pre backend a frontend?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas""]"
|
||||
q0361,test,specific_fact,medium,hybrid,Aké technológie používal Vladyslav Yanchenko pre backend a frontend?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]"
|
||||
q0362,test,specific_fact,medium,fts,Akú databázovú službu v Azure Vladyslav Yanchenko aktivoval?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2019/michal_stromko/vp2021/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko/vp2021"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0362,test,specific_fact,medium,vector,Akú databázovú službu v Azure Vladyslav Yanchenko aktivoval?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2016/lukas_pokryvka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]"
|
||||
q0362,test,specific_fact,medium,hybrid,Akú databázovú službu v Azure Vladyslav Yanchenko aktivoval?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0394,test,entity_lookup,easy,fts,Nájdi dokument o osobe Ján Malinovský.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0394,test,entity_lookup,easy,vector,Nájdi dokument o osobe Ján Malinovský.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2018/adrian_remias/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias""]"
|
||||
q0394,test,entity_lookup,easy,hybrid,Nájdi dokument o osobe Ján Malinovský.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2018/adrian_remias/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias""]"
|
||||
q0395,test,fact_title,easy,fts,Aký je názov diplomový projekt osoby Ján Malinovský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt""]"
|
||||
q0395,test,fact_title,easy,vector,Aký je názov diplomový projekt osoby Ján Malinovský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0395,test,fact_title,easy,hybrid,Aký je názov diplomový projekt osoby Ján Malinovský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/annotation/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021/annotation"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0396,test,reverse_lookup,medium,fts,Kto sa venuje práci s názvom „Grafové vyhľadávanie pre podporu vzdelávania“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2019/dmytro_mural/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0396,test,reverse_lookup,medium,vector,Kto sa venuje práci s názvom „Grafové vyhľadávanie pre podporu vzdelávania“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0396,test,reverse_lookup,medium,hybrid,Kto sa venuje práci s názvom „Grafové vyhľadávanie pre podporu vzdelávania“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2019/dmytro_mural/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0397,test,topic_lookup,medium,fts,"Nájdi študenta alebo dokument, ktorý rieši tému „Grafové vyhľadávanie pre podporu vzdelávania“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]"
|
||||
q0397,test,topic_lookup,medium,vector,"Nájdi študenta alebo dokument, ktorý rieši tému „Grafové vyhľadávanie pre podporu vzdelávania“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]"
|
||||
q0397,test,topic_lookup,medium,hybrid,"Nájdi študenta alebo dokument, ktorý rieši tému „Grafové vyhľadávanie pre podporu vzdelávania“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]"
|
||||
q0398,test,paraphrase,medium,fts,O čom je práca osoby Ján Malinovský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0398,test,paraphrase,medium,vector,O čom je práca osoby Ján Malinovský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q0398,test,paraphrase,medium,hybrid,O čom je práca osoby Ján Malinovský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]"
|
||||
q0399,test,fact_start_year,easy,fts,V ktorom roku začal študovať Ján Malinovský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/students/2018/david_omasta/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]"
|
||||
q0399,test,fact_start_year,easy,vector,V ktorom roku začal študovať Ján Malinovský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2018/oleh_bilykh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""]"
|
||||
q0399,test,fact_start_year,easy,hybrid,V ktorom roku začal študovať Ján Malinovský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0400,test,verification,medium,fts,Je pri osobe Ján Malinovský uvedený rok začiatku štúdia 2022?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2022/tetiana_mohorian/README.md"", ""pages/students/2022/daniil_huzenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""]"
|
||||
q0400,test,verification,medium,vector,Je pri osobe Ján Malinovský uvedený rok začiatku štúdia 2022?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2018/martin_wencel/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]"
|
||||
q0400,test,verification,medium,hybrid,Je pri osobe Ján Malinovský uvedený rok začiatku štúdia 2022?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0401,test,fact_work_year,easy,fts,V ktorom roku je pri osobe Ján Malinovský uvedená diplomový projekt?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2018/david_omasta/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]"
|
||||
q0401,test,fact_work_year,easy,vector,V ktorom roku je pri osobe Ján Malinovský uvedená diplomový projekt?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0401,test,fact_work_year,easy,hybrid,V ktorom roku je pri osobe Ján Malinovský uvedená diplomový projekt?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0402,test,disambiguation_year,hard,fts,Rozlíš rok začiatku štúdia a rok práce osoby Ján Malinovský.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]"
|
||||
q0402,test,disambiguation_year,hard,vector,Rozlíš rok začiatku štúdia a rok práce osoby Ján Malinovský.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]"
|
||||
q0402,test,disambiguation_year,hard,hybrid,Rozlíš rok začiatku štúdia a rok práce osoby Ján Malinovský.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0403,test,adversarial_year,hard,fts,Je rok 2022 rokom záverečnej práce osoby Ján Malinovský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/topics/akopisat/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/topics/akopisat""]"
|
||||
q0403,test,adversarial_year,hard,vector,Je rok 2022 rokom záverečnej práce osoby Ján Malinovský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2021/eduard_matovka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka""]"
|
||||
q0403,test,adversarial_year,hard,hybrid,Je rok 2022 rokom záverečnej práce osoby Ján Malinovský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2021/eduard_matovka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka""]"
|
||||
q0404,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou RAG a osobou Ján Malinovský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]"
|
||||
q0404,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou RAG a osobou Ján Malinovský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]"
|
||||
q0404,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou RAG a osobou Ján Malinovský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0405,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou GraphRAG a osobou Ján Malinovský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]"
|
||||
q0405,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou GraphRAG a osobou Ján Malinovský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0405,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou GraphRAG a osobou Ján Malinovský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0406,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou znalostný graf a osobou Ján Malinovský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0406,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou znalostný graf a osobou Ján Malinovský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]"
|
||||
q0406,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou znalostný graf a osobou Ján Malinovský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]"
|
||||
q0407,test,specific_fact,medium,fts,Z akej oblasti má Ján Malinovský zostaviť malý znalostný graf?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]"
|
||||
q0407,test,specific_fact,medium,vector,Z akej oblasti má Ján Malinovský zostaviť malý znalostný graf?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0407,test,specific_fact,medium,hybrid,Z akej oblasti má Ján Malinovský zostaviť malý znalostný graf?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]"
|
||||
q0408,test,specific_fact,medium,fts,Aké príklady oblastí obsahu sú uvedené pri práci Jána Malinovského?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/students/2016/patrik_pavlisin/tp20/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2016/patrik_pavlisin/dp22/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/tp20"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp22""]"
|
||||
q0408,test,specific_fact,medium,vector,Aké príklady oblastí obsahu sú uvedené pri práci Jána Malinovského?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0408,test,specific_fact,medium,hybrid,Aké príklady oblastí obsahu sú uvedené pri práci Jána Malinovského?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]"
|
||||
q0409,test,entity_lookup,easy,fts,Nájdi dokument o osobe Maksym Zatirka.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2019/david_stromp/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0409,test,entity_lookup,easy,vector,Nájdi dokument o osobe Maksym Zatirka.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/interns/oliver_pejic/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]"
|
||||
q0409,test,entity_lookup,easy,hybrid,Nájdi dokument o osobe Maksym Zatirka.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/interns/oliver_pejic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic""]"
|
||||
q0410,test,fact_title,easy,fts,Aký je názov bakalárska práca osoby Maksym Zatirka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0410,test,fact_title,easy,vector,Aký je názov bakalárska práca osoby Maksym Zatirka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q0410,test,fact_title,easy,hybrid,Aký je názov bakalárska práca osoby Maksym Zatirka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/ediz_morochovic/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0411,test,reverse_lookup,medium,fts,Kto sa venuje práci s názvom „Grafová databáza pre podporu generovania slovenského jazyka“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q0411,test,reverse_lookup,medium,vector,Kto sa venuje práci s názvom „Grafová databáza pre podporu generovania slovenského jazyka“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2017/stanislav_matsunych/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2017/stanislav_matsunych"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0411,test,reverse_lookup,medium,hybrid,Kto sa venuje práci s názvom „Grafová databáza pre podporu generovania slovenského jazyka“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2017/stanislav_matsunych/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/topics/bert/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2017/stanislav_matsunych"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/topics/bert""]"
|
||||
q0412,test,topic_lookup,medium,fts,"Nájdi študenta alebo dokument, ktorý rieši tému „Grafová databáza pre podporu generovania slovenského jazyka“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0412,test,topic_lookup,medium,vector,"Nájdi študenta alebo dokument, ktorý rieši tému „Grafová databáza pre podporu generovania slovenského jazyka“.",2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0412,test,topic_lookup,medium,hybrid,"Nájdi študenta alebo dokument, ktorý rieši tému „Grafová databáza pre podporu generovania slovenského jazyka“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2017/stanislav_matsunych/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/andrii_pervashov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2017/stanislav_matsunych"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]"
|
||||
q0413,test,paraphrase,medium,fts,O čom je práca osoby Maksym Zatirka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0413,test,paraphrase,medium,vector,O čom je práca osoby Maksym Zatirka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]"
|
||||
q0413,test,paraphrase,medium,hybrid,O čom je práca osoby Maksym Zatirka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]"
|
||||
q0414,test,fact_start_year,easy,fts,V ktorom roku začal študovať Maksym Zatirka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0414,test,fact_start_year,easy,vector,V ktorom roku začal študovať Maksym Zatirka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2021/nikita_bodnar/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/david_kostilnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik""]"
|
||||
q0414,test,fact_start_year,easy,hybrid,V ktorom roku začal študovať Maksym Zatirka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2021/nikita_bodnar/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/david_kostilnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik""]"
|
||||
q0415,test,verification,medium,fts,Je pri osobe Maksym Zatirka uvedený rok začiatku štúdia 2023?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]"
|
||||
q0415,test,verification,medium,vector,Je pri osobe Maksym Zatirka uvedený rok začiatku štúdia 2023?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q0415,test,verification,medium,hybrid,Je pri osobe Maksym Zatirka uvedený rok začiatku štúdia 2023?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2018/martin_wencel/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]"
|
||||
q0416,test,fact_work_year,easy,fts,V ktorom roku je pri osobe Maksym Zatirka uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/patrik_pavlisin/tp20/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/tp20""]"
|
||||
q0416,test,fact_work_year,easy,vector,V ktorom roku je pri osobe Maksym Zatirka uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/ediz_morochovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic""]"
|
||||
q0416,test,fact_work_year,easy,hybrid,V ktorom roku je pri osobe Maksym Zatirka uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]"
|
||||
q0417,test,disambiguation_year,hard,fts,Rozlíš rok začiatku štúdia a rok práce osoby Maksym Zatirka.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2016/ediz_morochovic/README.md"", ""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]"
|
||||
q0417,test,disambiguation_year,hard,vector,Rozlíš rok začiatku štúdia a rok práce osoby Maksym Zatirka.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0417,test,disambiguation_year,hard,hybrid,Rozlíš rok začiatku štúdia a rok práce osoby Maksym Zatirka.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0418,test,adversarial_year,hard,fts,Je rok 2023 rokom záverečnej práce osoby Maksym Zatirka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/topics/faq/README.md"", ""pages/topics/akopisat/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0418,test,adversarial_year,hard,vector,Je rok 2023 rokom záverečnej práce osoby Maksym Zatirka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0418,test,adversarial_year,hard,hybrid,Je rok 2023 rokom záverečnej práce osoby Maksym Zatirka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0419,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou grafová databáza a osobou Maksym Zatirka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/train_experiments/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021/train_experiments""]"
|
||||
q0419,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou grafová databáza a osobou Maksym Zatirka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0419,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou grafová databáza a osobou Maksym Zatirka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0420,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou slovenské právo a osobou Maksym Zatirka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/topics/bert/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/topics/bert"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0420,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou slovenské právo a osobou Maksym Zatirka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0420,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou slovenské právo a osobou Maksym Zatirka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0421,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou znalostný graf a osobou Maksym Zatirka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]"
|
||||
q0421,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou znalostný graf a osobou Maksym Zatirka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0421,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou znalostný graf a osobou Maksym Zatirka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/topics/faq/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/topics/faq""]"
|
||||
q0422,test,specific_fact,medium,fts,Pre akú doménu má Maksym Zatirka zostaviť znalostný graf?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0422,test,specific_fact,medium,vector,Pre akú doménu má Maksym Zatirka zostaviť znalostný graf?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0422,test,specific_fact,medium,hybrid,Pre akú doménu má Maksym Zatirka zostaviť znalostný graf?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0452,test,entity_lookup,easy,fts,Nájdi dokument o osobe Ronald Zalacko.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2019/david_stromp/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0452,test,entity_lookup,easy,vector,Nájdi dokument o osobe Ronald Zalacko.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2018/adrian_remias/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias""]"
|
||||
q0452,test,entity_lookup,easy,hybrid,Nájdi dokument o osobe Ronald Zalacko.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]"
|
||||
q0453,test,fact_title,easy,fts,Aký je názov bakalárska práca osoby Ronald Zalacko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0453,test,fact_title,easy,vector,Aký je názov bakalárska práca osoby Ronald Zalacko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0453,test,fact_title,easy,hybrid,Aký je názov bakalárska práca osoby Ronald Zalacko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2021/eduard_matovka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka""]"
|
||||
q0454,test,reverse_lookup,medium,fts,Kto sa venuje práci s názvom „Skórovací online systém pre robotické súťaže“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/students/2016/patrik_pavlisin/dp21/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp21"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt""]"
|
||||
q0454,test,reverse_lookup,medium,vector,Kto sa venuje práci s názvom „Skórovací online systém pre robotické súťaže“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0454,test,reverse_lookup,medium,hybrid,Kto sa venuje práci s názvom „Skórovací online systém pre robotické súťaže“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0455,test,topic_lookup,medium,fts,"Nájdi študenta alebo dokument, ktorý rieši tému „Skórovací online systém pre robotické súťaže“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2021/artur_hyrenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko""]"
|
||||
q0455,test,topic_lookup,medium,vector,"Nájdi študenta alebo dokument, ktorý rieši tému „Skórovací online systém pre robotické súťaže“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/topics/legal/README.md"", ""pages/students/2022/andrii_pervashov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/topics/legal"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]"
|
||||
q0455,test,topic_lookup,medium,hybrid,"Nájdi študenta alebo dokument, ktorý rieši tému „Skórovací online systém pre robotické súťaže“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/topics/legal/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/topics/legal""]"
|
||||
q0456,test,paraphrase,medium,fts,O čom je práca osoby Ronald Zalacko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0456,test,paraphrase,medium,vector,O čom je práca osoby Ronald Zalacko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2019/alina_vitko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]"
|
||||
q0456,test,paraphrase,medium,hybrid,O čom je práca osoby Ronald Zalacko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]"
|
||||
q0457,test,fact_start_year,easy,fts,V ktorom roku začal študovať Ronald Zalacko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0457,test,fact_start_year,easy,vector,V ktorom roku začal študovať Ronald Zalacko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]"
|
||||
q0457,test,fact_start_year,easy,hybrid,V ktorom roku začal študovať Ronald Zalacko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2022/andrii_pervashov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]"
|
||||
q0458,test,verification,medium,fts,Je pri osobe Ronald Zalacko uvedený rok začiatku štúdia 2023?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/denis_le_thanh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""]"
|
||||
q0458,test,verification,medium,vector,Je pri osobe Ronald Zalacko uvedený rok začiatku štúdia 2023?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0458,test,verification,medium,hybrid,Je pri osobe Ronald Zalacko uvedený rok začiatku štúdia 2023?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]"
|
||||
q0459,test,fact_work_year,easy,fts,V ktorom roku je pri osobe Ronald Zalacko uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/patrik_pavlisin/tp20/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/tp20""]"
|
||||
q0459,test,fact_work_year,easy,vector,V ktorom roku je pri osobe Ronald Zalacko uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0459,test,fact_work_year,easy,hybrid,V ktorom roku je pri osobe Ronald Zalacko uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0460,test,disambiguation_year,hard,fts,Rozlíš rok začiatku štúdia a rok práce osoby Ronald Zalacko.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2016/ediz_morochovic/README.md"", ""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]"
|
||||
q0460,test,disambiguation_year,hard,vector,Rozlíš rok začiatku štúdia a rok práce osoby Ronald Zalacko.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2022/andrii_pervashov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]"
|
||||
q0460,test,disambiguation_year,hard,hybrid,Rozlíš rok začiatku štúdia a rok práce osoby Ronald Zalacko.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2022/andrii_pervashov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]"
|
||||
q0461,test,adversarial_year,hard,fts,Je rok 2023 rokom záverečnej práce osoby Ronald Zalacko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/topics/faq/README.md"", ""pages/topics/akopisat/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0461,test,adversarial_year,hard,vector,Je rok 2023 rokom záverečnej práce osoby Ronald Zalacko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2019/alina_vitko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]"
|
||||
q0461,test,adversarial_year,hard,hybrid,Je rok 2023 rokom záverečnej práce osoby Ronald Zalacko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/topics/akopisat/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q0462,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou robotické súťaže a osobou Ronald Zalacko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q0462,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou robotické súťaže a osobou Ronald Zalacko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0462,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou robotické súťaže a osobou Ronald Zalacko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0463,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou Docker a osobou Ronald Zalacko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]"
|
||||
q0463,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou Docker a osobou Ronald Zalacko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]"
|
||||
q0463,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou Docker a osobou Ronald Zalacko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q0464,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou webová aplikácia a osobou Ronald Zalacko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0464,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou webová aplikácia a osobou Ronald Zalacko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]"
|
||||
q0464,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou webová aplikácia a osobou Ronald Zalacko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]"
|
||||
q0465,test,specific_fact,medium,fts,Na akú oblasť je zameraná aplikácia Ronalda Zalacka?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/topics/named-entity/navod/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/topics/named-entity/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/topics/named-entity/navod"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/topics/named-entity""]"
|
||||
q0465,test,specific_fact,medium,vector,Na akú oblasť je zameraná aplikácia Ronalda Zalacka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/jakub_schwarc/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/jakub_schwarc""]"
|
||||
q0465,test,specific_fact,medium,hybrid,Na akú oblasť je zameraná aplikácia Ronalda Zalacka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/jakub_schwarc/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/jakub_schwarc""]"
|
||||
q0466,test,entity_lookup,easy,fts,Nájdi dokument o osobe Oleksandr Dorybohov.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/topics/legal/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2019/david_stromp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/topics/legal"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp""]"
|
||||
q0466,test,entity_lookup,easy,vector,Nájdi dokument o osobe Oleksandr Dorybohov.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/students/2018/david_ilas/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_ilas"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]"
|
||||
q0466,test,entity_lookup,easy,hybrid,Nájdi dokument o osobe Oleksandr Dorybohov.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/topics/legal/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/topics/legal""]"
|
||||
q0467,test,fact_title,easy,fts,Aký je názov bakalárska práca osoby Oleksandr Dorybohov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/topics/legal/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/topics/legal"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0467,test,fact_title,easy,vector,Aký je názov bakalárska práca osoby Oleksandr Dorybohov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]"
|
||||
q0467,test,fact_title,easy,hybrid,Aký je názov bakalárska práca osoby Oleksandr Dorybohov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2016/ediz_morochovic/README.md"", ""pages/students/2018/oleh_bilykh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""]"
|
||||
q0468,test,reverse_lookup,medium,fts,Kto sa venuje práci s názvom „Automatické odpovede na otázky v právnej oblasti“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2018/david_omasta/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0468,test,reverse_lookup,medium,vector,Kto sa venuje práci s názvom „Automatické odpovede na otázky v právnej oblasti“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/topics/question/nezodpovedatelne/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0468,test,reverse_lookup,medium,hybrid,Kto sa venuje práci s názvom „Automatické odpovede na otázky v právnej oblasti“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/topics/question/nezodpovedatelne/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0469,test,topic_lookup,medium,fts,"Nájdi študenta alebo dokument, ktorý rieši tému „Automatické odpovede na otázky v právnej oblasti“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers""]"
|
||||
q0469,test,topic_lookup,medium,vector,"Nájdi študenta alebo dokument, ktorý rieši tému „Automatické odpovede na otázky v právnej oblasti“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/topics/question/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/topics/question""]"
|
||||
q0469,test,topic_lookup,medium,hybrid,"Nájdi študenta alebo dokument, ktorý rieši tému „Automatické odpovede na otázky v právnej oblasti“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/topics/faq/README.md"", ""pages/topics/question/nezodpovedatelne/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0470,test,paraphrase,medium,fts,O čom je práca osoby Oleksandr Dorybohov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/topics/legal/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/topics/legal"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0470,test,paraphrase,medium,vector,O čom je práca osoby Oleksandr Dorybohov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2017/dmytro_ushatenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko""]"
|
||||
q0470,test,paraphrase,medium,hybrid,O čom je práca osoby Oleksandr Dorybohov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/oleh_bilykh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""]"
|
||||
q0471,test,fact_start_year,easy,fts,V ktorom roku začal študovať Oleksandr Dorybohov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/topics/legal/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/topics/legal"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko""]"
|
||||
q0471,test,fact_start_year,easy,vector,V ktorom roku začal študovať Oleksandr Dorybohov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q0471,test,fact_start_year,easy,hybrid,V ktorom roku začal študovať Oleksandr Dorybohov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q0472,test,verification,medium,fts,Je pri osobe Oleksandr Dorybohov uvedený rok začiatku štúdia 2023?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/topics/legal/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/topics/legal"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]"
|
||||
q0472,test,verification,medium,vector,Je pri osobe Oleksandr Dorybohov uvedený rok začiatku štúdia 2023?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2018/david_ilas/README.md"", ""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_ilas"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0472,test,verification,medium,hybrid,Je pri osobe Oleksandr Dorybohov uvedený rok začiatku štúdia 2023?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2018/david_ilas/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2017/dmytro_ushatenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_ilas"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko""]"
|
||||
q0473,test,fact_work_year,easy,fts,V ktorom roku je pri osobe Oleksandr Dorybohov uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/topics/legal/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/topics/legal"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers""]"
|
||||
q0473,test,fact_work_year,easy,vector,V ktorom roku je pri osobe Oleksandr Dorybohov uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2016/ediz_morochovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic""]"
|
||||
q0473,test,fact_work_year,easy,hybrid,V ktorom roku je pri osobe Oleksandr Dorybohov uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2016/ediz_morochovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic""]"
|
||||
q0474,test,disambiguation_year,hard,fts,Rozlíš rok začiatku štúdia a rok práce osoby Oleksandr Dorybohov.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/topics/legal/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/topics/legal""]"
|
||||
q0474,test,disambiguation_year,hard,vector,Rozlíš rok začiatku štúdia a rok práce osoby Oleksandr Dorybohov.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/topics/legal/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/topics/legal"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu""]"
|
||||
q0474,test,disambiguation_year,hard,hybrid,Rozlíš rok začiatku štúdia a rok práce osoby Oleksandr Dorybohov.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/topics/legal/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/topics/legal"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu""]"
|
||||
q0475,test,adversarial_year,hard,fts,Je rok 2023 rokom záverečnej práce osoby Oleksandr Dorybohov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/topics/legal/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/topics/akopisat/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/topics/legal"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/topics/akopisat""]"
|
||||
q0475,test,adversarial_year,hard,vector,Je rok 2023 rokom záverečnej práce osoby Oleksandr Dorybohov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2018/oleh_bilykh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""]"
|
||||
q0475,test,adversarial_year,hard,hybrid,Je rok 2023 rokom záverečnej práce osoby Oleksandr Dorybohov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0476,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou právo a osobou Oleksandr Dorybohov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/topics/legal/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/topics/legal"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0476,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou právo a osobou Oleksandr Dorybohov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/topics/legal/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/topics/legal""]"
|
||||
q0476,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou právo a osobou Oleksandr Dorybohov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/topics/faq/README.md"", ""pages/topics/legal/README.md"", ""pages/students/2018/david_omasta/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/topics/legal"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]"
|
||||
q0477,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou agent a osobou Oleksandr Dorybohov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/topics/legal/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/topics/legal"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0477,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou agent a osobou Oleksandr Dorybohov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/topics/legal/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/topics/legal""]"
|
||||
q0477,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou agent a osobou Oleksandr Dorybohov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/topics/legal/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2018/oleh_bilykh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/topics/legal"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""]"
|
||||
q0478,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou API a osobou Oleksandr Dorybohov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/topics/legal/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/topics/legal"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0478,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou API a osobou Oleksandr Dorybohov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/topics/legal/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/topics/legal""]"
|
||||
q0478,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou API a osobou Oleksandr Dorybohov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/topics/legal/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/topics/legal""]"
|
||||
q0479,test,specific_fact,medium,fts,Pre akú doménu má agent Oleksandra Dorybohova odpovedať na otázky?,2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/topics/question/validacie/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/topics/question/validacie""]"
|
||||
q0479,test,specific_fact,medium,vector,Pre akú doménu má agent Oleksandra Dorybohova odpovedať na otázky?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/topics/question/nezodpovedatelne/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0479,test,specific_fact,medium,hybrid,Pre akú doménu má agent Oleksandra Dorybohova odpovedať na otázky?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]"
|
||||
q0510,test,entity_lookup,easy,fts,Nájdi dokument o osobe Samuel Vasiľ.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0510,test,entity_lookup,easy,vector,Nájdi dokument o osobe Samuel Vasiľ.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2019/samuel_horani/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani""]"
|
||||
q0510,test,entity_lookup,easy,hybrid,Nájdi dokument o osobe Samuel Vasiľ.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu""]"
|
||||
q0511,test,fact_title,easy,fts,Aký je názov bakalárska práca osoby Samuel Vasiľ?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2019/samuel_horani/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani""]"
|
||||
q0511,test,fact_title,easy,vector,Aký je názov bakalárska práca osoby Samuel Vasiľ?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q0511,test,fact_title,easy,hybrid,Aký je názov bakalárska práca osoby Samuel Vasiľ?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]"
|
||||
q0512,test,reverse_lookup,medium,fts,Kto sa venuje práci s názvom „Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md"", ""pages/students/2020/kamil_tomcufcik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian"", ""https://zp.kemt.fei.tuke.sk/students/2020/kamil_tomcufcik""]"
|
||||
q0512,test,reverse_lookup,medium,vector,Kto sa venuje práci s názvom „Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/topics/bert/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2022/andrii_pervashov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/topics/bert"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]"
|
||||
q0512,test,reverse_lookup,medium,hybrid,Kto sa venuje práci s názvom „Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]"
|
||||
q0513,test,topic_lookup,medium,fts,"Nájdi študenta alebo dokument, ktorý rieši tému „Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md"", ""pages/students/2022/tetiana_mohorian/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0513,test,topic_lookup,medium,vector,"Nájdi študenta alebo dokument, ktorý rieši tému „Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/topics/bert/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/topics/bert""]"
|
||||
q0513,test,topic_lookup,medium,hybrid,"Nájdi študenta alebo dokument, ktorý rieši tému „Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]"
|
||||
q0514,test,paraphrase,medium,fts,O čom je práca osoby Samuel Vasiľ?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0514,test,paraphrase,medium,vector,O čom je práca osoby Samuel Vasiľ?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q0514,test,paraphrase,medium,hybrid,O čom je práca osoby Samuel Vasiľ?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q0515,test,fact_start_year,easy,fts,V ktorom roku začal študovať Samuel Vasiľ?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/students/2018/samuel_sirotnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik""]"
|
||||
q0515,test,fact_start_year,easy,vector,V ktorom roku začal študovať Samuel Vasiľ?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2021/nikita_bodnar/README.md"", ""pages/students/2020/david_kostilnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik""]"
|
||||
q0515,test,fact_start_year,easy,hybrid,V ktorom roku začal študovať Samuel Vasiľ?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q0516,test,verification,medium,fts,Je pri osobe Samuel Vasiľ uvedený rok začiatku štúdia 2022?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]"
|
||||
q0516,test,verification,medium,vector,Je pri osobe Samuel Vasiľ uvedený rok začiatku štúdia 2022?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0516,test,verification,medium,hybrid,Je pri osobe Samuel Vasiľ uvedený rok začiatku štúdia 2022?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2018/samuel_sirotnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik""]"
|
||||
q0517,test,fact_work_year,easy,fts,V ktorom roku je pri osobe Samuel Vasiľ uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2018/samuel_sirotnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik""]"
|
||||
q0517,test,fact_work_year,easy,vector,V ktorom roku je pri osobe Samuel Vasiľ uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q0517,test,fact_work_year,easy,hybrid,V ktorom roku je pri osobe Samuel Vasiľ uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q0518,test,disambiguation_year,hard,fts,Rozlíš rok začiatku štúdia a rok práce osoby Samuel Vasiľ.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]"
|
||||
q0518,test,disambiguation_year,hard,vector,Rozlíš rok začiatku štúdia a rok práce osoby Samuel Vasiľ.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q0518,test,disambiguation_year,hard,hybrid,Rozlíš rok začiatku štúdia a rok práce osoby Samuel Vasiľ.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2018/samuel_sirotnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik""]"
|
||||
q0519,test,adversarial_year,hard,fts,Je rok 2022 rokom záverečnej práce osoby Samuel Vasiľ?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/topics/akopisat/README.md"", ""pages/students/2019/samuel_horani/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani""]"
|
||||
q0519,test,adversarial_year,hard,vector,Je rok 2022 rokom záverečnej práce osoby Samuel Vasiľ?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q0519,test,adversarial_year,hard,hybrid,Je rok 2022 rokom záverečnej práce osoby Samuel Vasiľ?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q0520,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou OpenWebUI a osobou Samuel Vasiľ?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2019/samuel_horani/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani""]"
|
||||
q0520,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou OpenWebUI a osobou Samuel Vasiľ?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2018/samuel_sirotnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik""]"
|
||||
q0520,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou OpenWebUI a osobou Samuel Vasiľ?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2018/samuel_sirotnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik""]"
|
||||
q0521,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou MCP a osobou Samuel Vasiľ?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2018/samuel_sirotnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik""]"
|
||||
q0521,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou MCP a osobou Samuel Vasiľ?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q0521,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou MCP a osobou Samuel Vasiľ?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/martin_wencel/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]"
|
||||
q0522,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou RAG a osobou Samuel Vasiľ?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]"
|
||||
q0522,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou RAG a osobou Samuel Vasiľ?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]"
|
||||
q0522,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou RAG a osobou Samuel Vasiľ?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0523,test,specific_fact,medium,fts,Aké rozhranie má Samuel Vasiľ nasadiť pomocou Docker Compose?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]"
|
||||
q0523,test,specific_fact,medium,vector,Aké rozhranie má Samuel Vasiľ nasadiť pomocou Docker Compose?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]"
|
||||
q0523,test,specific_fact,medium,hybrid,Aké rozhranie má Samuel Vasiľ nasadiť pomocou Docker Compose?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]"
|
||||
q0524,test,specific_fact,medium,fts,Aké rozšírenia má systém Samuela Vasiľa podporovať?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0524,test,specific_fact,medium,vector,Aké rozšírenia má systém Samuela Vasiľa podporovať?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/artur_hyrenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko""]"
|
||||
q0524,test,specific_fact,medium,hybrid,Aké rozšírenia má systém Samuela Vasiľa podporovať?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0525,test,entity_lookup,easy,fts,Nájdi dokument o osobe Denis Le Thanh.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2019/david_stromp/README.md"", ""pages/students/2016/patrik_pavlisin/dp21/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp21""]"
|
||||
q0525,test,entity_lookup,easy,vector,Nájdi dokument o osobe Denis Le Thanh.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/students/2021/matej_novotny/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny""]"
|
||||
q0525,test,entity_lookup,easy,hybrid,Nájdi dokument o osobe Denis Le Thanh.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2016/dominik_nagy/timovy_projekt/README.md"", ""pages/interns/sevval_bulburu/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu""]"
|
||||
q0526,test,fact_title,easy,fts,Aký je názov bakalárska práca osoby Denis Le Thanh?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/jakub_maruniak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""]"
|
||||
q0526,test,fact_title,easy,vector,Aký je názov bakalárska práca osoby Denis Le Thanh?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2016/ediz_morochovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic""]"
|
||||
q0526,test,fact_title,easy,hybrid,Aký je názov bakalárska práca osoby Denis Le Thanh?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2016/ediz_morochovic/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]"
|
||||
q0527,test,reverse_lookup,medium,fts,Kto sa venuje práci s názvom „Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/students/2019/alina_vitko/README.md"", ""pages/topics/otvorene/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene""]"
|
||||
q0527,test,reverse_lookup,medium,vector,Kto sa venuje práci s názvom „Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/topics/bert/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2017/stanislav_matsunych/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/topics/bert"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2017/stanislav_matsunych""]"
|
||||
q0527,test,reverse_lookup,medium,hybrid,Kto sa venuje práci s názvom „Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/topics/bert/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/artur_hyrenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/topics/bert"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko""]"
|
||||
q0528,test,topic_lookup,medium,fts,"Nájdi študenta alebo dokument, ktorý rieši tému „Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt""]"
|
||||
q0528,test,topic_lookup,medium,vector,"Nájdi študenta alebo dokument, ktorý rieši tému „Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/topics/bert/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2022/andrii_pervashov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/topics/bert"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]"
|
||||
q0528,test,topic_lookup,medium,hybrid,"Nájdi študenta alebo dokument, ktorý rieši tému „Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2021/artur_hyrenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko""]"
|
||||
q0529,test,paraphrase,medium,fts,O čom je práca osoby Denis Le Thanh?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/patrik_pavlisin/dp21/README.md"", ""pages/students/2016/dominik_nagy/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp21"", ""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy/timovy_projekt""]"
|
||||
q0529,test,paraphrase,medium,vector,O čom je práca osoby Denis Le Thanh?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2022/tetiana_mohorian/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q0529,test,paraphrase,medium,hybrid,O čom je práca osoby Denis Le Thanh?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2022/tetiana_mohorian/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q0530,test,fact_start_year,easy,fts,V ktorom roku začal študovať Denis Le Thanh?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/topics/faq/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/topics/faq""]"
|
||||
q0530,test,fact_start_year,easy,vector,V ktorom roku začal študovať Denis Le Thanh?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2020/kamil_tomcufcik/README.md"", ""pages/students/2018/martin_wencel/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2020/kamil_tomcufcik"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]"
|
||||
q0530,test,fact_start_year,easy,hybrid,V ktorom roku začal študovať Denis Le Thanh?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2020/kamil_tomcufcik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2020/kamil_tomcufcik""]"
|
||||
q0531,test,verification,medium,fts,Je pri osobe Denis Le Thanh uvedený rok začiatku štúdia 2023?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]"
|
||||
q0531,test,verification,medium,vector,Je pri osobe Denis Le Thanh uvedený rok začiatku štúdia 2023?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0531,test,verification,medium,hybrid,Je pri osobe Denis Le Thanh uvedený rok začiatku štúdia 2023?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0532,test,fact_work_year,easy,fts,V ktorom roku je pri osobe Denis Le Thanh uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/topics/faq/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/topics/faq""]"
|
||||
q0532,test,fact_work_year,easy,vector,V ktorom roku je pri osobe Denis Le Thanh uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2016/ediz_morochovic/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas""]"
|
||||
q0532,test,fact_work_year,easy,hybrid,V ktorom roku je pri osobe Denis Le Thanh uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2016/ediz_morochovic/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas""]"
|
||||
q0533,test,disambiguation_year,hard,fts,Rozlíš rok začiatku štúdia a rok práce osoby Denis Le Thanh.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2016/ediz_morochovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic""]"
|
||||
q0533,test,disambiguation_year,hard,vector,Rozlíš rok začiatku štúdia a rok práce osoby Denis Le Thanh.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2018/martin_wencel/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]"
|
||||
q0533,test,disambiguation_year,hard,hybrid,Rozlíš rok začiatku štúdia a rok práce osoby Denis Le Thanh.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2018/martin_wencel/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]"
|
||||
q0534,test,adversarial_year,hard,fts,Je rok 2023 rokom záverečnej práce osoby Denis Le Thanh?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/topics/akopisat/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]"
|
||||
q0534,test,adversarial_year,hard,vector,Je rok 2023 rokom záverečnej práce osoby Denis Le Thanh?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]"
|
||||
q0534,test,adversarial_year,hard,hybrid,Je rok 2023 rokom záverečnej práce osoby Denis Le Thanh?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0535,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou Slovak Mistral a osobou Denis Le Thanh?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak""]"
|
||||
q0535,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou Slovak Mistral a osobou Denis Le Thanh?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2018/martin_wencel/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]"
|
||||
q0535,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou Slovak Mistral a osobou Denis Le Thanh?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0536,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou inštrukcie a osobou Denis Le Thanh?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/patrik_pavlisin/dp21/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp21""]"
|
||||
q0536,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou inštrukcie a osobou Denis Le Thanh?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/andrii_pervashov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]"
|
||||
q0536,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou inštrukcie a osobou Denis Le Thanh?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2018/david_omasta/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0537,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou kyberbezpečnosť a osobou Denis Le Thanh?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/patrik_pavlisin/dp21/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp21""]"
|
||||
q0537,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou kyberbezpečnosť a osobou Denis Le Thanh?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/lukas_pokryvka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]"
|
||||
q0537,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou kyberbezpečnosť a osobou Denis Le Thanh?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/topics/faq/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/topics/faq""]"
|
||||
q0538,test,specific_fact,medium,fts,Aký slovenský generatívny model chce Denis Le Thanh dotrénovať?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2018/david_omasta/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0538,test,specific_fact,medium,vector,Aký slovenský generatívny model chce Denis Le Thanh dotrénovať?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2018/david_omasta/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2021/eduard_matovka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka""]"
|
||||
q0538,test,specific_fact,medium,hybrid,Aký slovenský generatívny model chce Denis Le Thanh dotrénovať?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2018/david_omasta/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2021/matej_novotny/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny""]"
|
||||
q0539,test,entity_lookup,easy,fts,Nájdi dokument o stážistovi Youssef Ressaissi.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/interns/yussef_ressaissi/README.md"", ""pages/students/2019/david_stromp/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0539,test,entity_lookup,easy,vector,Nájdi dokument o stážistovi Youssef Ressaissi.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/interns/yussef_ressaissi/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/interns/oliver_pejic/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q0539,test,entity_lookup,easy,hybrid,Nájdi dokument o stážistovi Youssef Ressaissi.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/interns/yussef_ressaissi/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/interns/oliver_pejic/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q0540,test,internship_year,easy,fts,V ktorom roku prebiehala stáž osoby Youssef Ressaissi?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/interns/yussef_ressaissi/README.md"", ""pages/students/2016/patrik_pavlisin/dp22/README.md"", ""pages/topics/prodigy/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp22"", ""https://zp.kemt.fei.tuke.sk/topics/prodigy"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0540,test,internship_year,easy,vector,V ktorom roku prebiehala stáž osoby Youssef Ressaissi?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q0540,test,internship_year,easy,hybrid,V ktorom roku prebiehala stáž osoby Youssef Ressaissi?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/interns/yussef_ressaissi/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0541,test,internship_topic,medium,fts,Akému problému alebo téme sa venovala stáž osoby Youssef Ressaissi?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/interns/yussef_ressaissi/README.md"", ""pages/topics/prodigy/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/patrik_pavlisin/dp22/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi"", ""https://zp.kemt.fei.tuke.sk/topics/prodigy"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp22"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]"
|
||||
q0541,test,internship_topic,medium,vector,Akému problému alebo téme sa venovala stáž osoby Youssef Ressaissi?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/students/2019/alina_vitko/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/topics/question/nezodpovedatelne/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne""]"
|
||||
q0541,test,internship_topic,medium,hybrid,Akému problému alebo téme sa venovala stáž osoby Youssef Ressaissi?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/interns/yussef_ressaissi/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/students/2019/alina_vitko/README.md"", ""pages/students/2022/yevhenii_leonov/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov""]"
|
||||
q0542,test,reverse_lookup,medium,fts,Kto pracoval na téme sumarizácia v slovenskej medicínskej alebo právnej doméne?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/students/2022/valerii_kutsenko/README.md"", ""pages/topics/otvorene/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial""]"
|
||||
q0542,test,reverse_lookup,medium,vector,Kto pracoval na téme sumarizácia v slovenskej medicínskej alebo právnej doméne?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/topics/legal/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2022/andrii_pervashov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/topics/legal"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]"
|
||||
q0542,test,reverse_lookup,medium,hybrid,Kto pracoval na téme sumarizácia v slovenskej medicínskej alebo právnej doméne?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/topics/legal/README.md"", ""pages/students/2020/matus_suchanic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/topics/legal"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""]"
|
||||
q0543,test,keyword_grounding,medium,fts,Ktorá stáž osoby Youssef Ressaissi súvisela s témou summarization?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/interns/yussef_ressaissi/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/topics/prodigy/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/topics/prodigy"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0543,test,keyword_grounding,medium,vector,Ktorá stáž osoby Youssef Ressaissi súvisela s témou summarization?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/interns/yussef_ressaissi/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0543,test,keyword_grounding,medium,hybrid,Ktorá stáž osoby Youssef Ressaissi súvisela s témou summarization?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/interns/yussef_ressaissi/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/topics/legal/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/topics/legal"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]"
|
||||
q0544,test,keyword_grounding,medium,fts,Ktorá stáž osoby Youssef Ressaissi súvisela s témou Slovak?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/interns/yussef_ressaissi/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/topics/prodigy/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/topics/prodigy"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0544,test,keyword_grounding,medium,vector,Ktorá stáž osoby Youssef Ressaissi súvisela s témou Slovak?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/topics/resources/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/topics/resources"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0544,test,keyword_grounding,medium,hybrid,Ktorá stáž osoby Youssef Ressaissi súvisela s témou Slovak?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/interns/yussef_ressaissi/README.md"", ""pages/topics/resources/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi"", ""https://zp.kemt.fei.tuke.sk/topics/resources"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]"
|
||||
q0545,test,keyword_grounding,medium,fts,Ktorá stáž osoby Youssef Ressaissi súvisela s témou ROUGE?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/interns/yussef_ressaissi/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/topics/prodigy/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/topics/prodigy"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0545,test,keyword_grounding,medium,vector,Ktorá stáž osoby Youssef Ressaissi súvisela s témou ROUGE?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/students/2022/yevhenii_leonov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov""]"
|
||||
q0545,test,keyword_grounding,medium,hybrid,Ktorá stáž osoby Youssef Ressaissi súvisela s témou ROUGE?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/interns/yussef_ressaissi/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2021/eduard_matovka/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka""]"
|
||||
q0546,test,specific_fact,medium,fts,Aký bol hlavný cieľ stáže Youssefa Ressaissiho?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q0546,test,specific_fact,medium,vector,Aký bol hlavný cieľ stáže Youssefa Ressaissiho?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q0546,test,specific_fact,medium,hybrid,Aký bol hlavný cieľ stáže Youssefa Ressaissiho?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q0547,test,specific_fact,medium,fts,Aké dve klasické metriky používal Youssef Ressaissi pri sumarizácii?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/interns/yussef_ressaissi/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2020/kamil_tomcufcik/README.md"", ""pages/students/2021/eduard_matovka/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/kamil_tomcufcik"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka""]"
|
||||
q0547,test,specific_fact,medium,vector,Aké dve klasické metriky používal Youssef Ressaissi pri sumarizácii?,3,0.333333,0,1,1,0.0,1.0,1.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/interns/yussef_ressaissi/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/yevhenii_leonov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov""]"
|
||||
q0547,test,specific_fact,medium,hybrid,Aké dve klasické metriky používal Youssef Ressaissi pri sumarizácii?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/interns/yussef_ressaissi/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0548,test,specific_fact,medium,fts,Ktoré modely podľa stavu vyzerali najlepšie pri práci Youssefa Ressaissiho?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/topics/steel/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2016/patrik_pavlisin/tp20/README.md"", ""pages/topics/akopisat/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/steel"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/tp20"", ""https://zp.kemt.fei.tuke.sk/topics/akopisat""]"
|
||||
q0548,test,specific_fact,medium,vector,Ktoré modely podľa stavu vyzerali najlepšie pri práci Youssefa Ressaissiho?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/train_experiments/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2021/artur_hyrenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021/train_experiments"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko""]"
|
||||
q0548,test,specific_fact,medium,hybrid,Ktoré modely podľa stavu vyzerali najlepšie pri práci Youssefa Ressaissiho?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0558,test,entity_lookup,easy,fts,Nájdi dokument o stážistovi Sevval Bulburu.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/interns/sevval_bulburu/README.md"", ""pages/topics/hatespeech/README.md"", ""pages/students/2019/david_stromp/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/topics/hatespeech"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0558,test,entity_lookup,easy,vector,Nájdi dokument o stážistovi Sevval Bulburu.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/interns/sevval_bulburu/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/interns/oliver_pejic/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q0558,test,entity_lookup,easy,hybrid,Nájdi dokument o stážistovi Sevval Bulburu.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/interns/sevval_bulburu/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/interns/oliver_pejic/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q0559,test,internship_year,easy,fts,V ktorom roku prebiehala stáž osoby Sevval Bulburu?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/interns/sevval_bulburu/README.md"", ""pages/topics/hatespeech/README.md"", ""pages/students/2016/patrik_pavlisin/dp22/README.md"", ""pages/topics/prodigy/README.md"", ""pages/topics/faq/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/topics/hatespeech"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp22"", ""https://zp.kemt.fei.tuke.sk/topics/prodigy"", ""https://zp.kemt.fei.tuke.sk/topics/faq""]"
|
||||
q0559,test,internship_year,easy,vector,V ktorom roku prebiehala stáž osoby Sevval Bulburu?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md"", ""pages/students/2022/serhii_yemets/README.md"", ""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi"", ""https://zp.kemt.fei.tuke.sk/students/2022/serhii_yemets"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]"
|
||||
q0559,test,internship_year,easy,hybrid,V ktorom roku prebiehala stáž osoby Sevval Bulburu?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/interns/sevval_bulburu/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md"", ""pages/students/2022/serhii_yemets/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi"", ""https://zp.kemt.fei.tuke.sk/students/2022/serhii_yemets""]"
|
||||
q0560,test,internship_topic,medium,fts,Akému problému alebo téme sa venovala stáž osoby Sevval Bulburu?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/interns/sevval_bulburu/README.md"", ""pages/topics/hatespeech/README.md"", ""pages/topics/prodigy/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/patrik_pavlisin/dp22/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/topics/hatespeech"", ""https://zp.kemt.fei.tuke.sk/topics/prodigy"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp22""]"
|
||||
q0560,test,internship_topic,medium,vector,Akému problému alebo téme sa venovala stáž osoby Sevval Bulburu?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/students/2018/oleh_bilykh/README.md"", ""pages/topics/question/nezodpovedatelne/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2019/alina_vitko/README.md"", ""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]"
|
||||
q0560,test,internship_topic,medium,hybrid,Akému problému alebo téme sa venovala stáž osoby Sevval Bulburu?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/interns/sevval_bulburu/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/topics/question/nezodpovedatelne/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2019/alina_vitko/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]"
|
||||
q0562,test,keyword_grounding,medium,fts,Ktorá stáž osoby Sevval Bulburu súvisela s témou Hate Speech?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/interns/sevval_bulburu/README.md"", ""pages/topics/hatespeech/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md"", ""pages/interns/oliver_pejic/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/topics/hatespeech"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak"", ""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic""]"
|
||||
q0562,test,keyword_grounding,medium,vector,Ktorá stáž osoby Sevval Bulburu súvisela s témou Hate Speech?,2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/topics/hatespeech/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/interns/oliver_pejic/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/hatespeech"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic""]"
|
||||
q0562,test,keyword_grounding,medium,hybrid,Ktorá stáž osoby Sevval Bulburu súvisela s témou Hate Speech?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/interns/sevval_bulburu/README.md"", ""pages/topics/hatespeech/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/topics/hatespeech"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0563,test,keyword_grounding,medium,fts,Ktorá stáž osoby Sevval Bulburu súvisela s témou BERT?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/interns/sevval_bulburu/README.md"", ""pages/topics/hatespeech/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/topics/prodigy/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/topics/hatespeech"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/topics/prodigy"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0563,test,keyword_grounding,medium,vector,Ktorá stáž osoby Sevval Bulburu súvisela s témou BERT?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md"", ""pages/students/2022/serhii_yemets/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas"", ""https://zp.kemt.fei.tuke.sk/students/2022/serhii_yemets""]"
|
||||
q0563,test,keyword_grounding,medium,hybrid,Ktorá stáž osoby Sevval Bulburu súvisela s témou BERT?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/interns/sevval_bulburu/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]"
|
||||
q0564,test,keyword_grounding,medium,fts,Ktorá stáž osoby Sevval Bulburu súvisela s témou SMOTE?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/interns/sevval_bulburu/README.md"", ""pages/topics/hatespeech/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/topics/prodigy/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/topics/hatespeech"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/topics/prodigy"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0564,test,keyword_grounding,medium,vector,Ktorá stáž osoby Sevval Bulburu súvisela s témou SMOTE?,4,0.25,0,0,1,0.0,0.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/students/2019/michal_stromko/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/students/2019/alina_vitko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]"
|
||||
q0564,test,keyword_grounding,medium,hybrid,Ktorá stáž osoby Sevval Bulburu súvisela s témou SMOTE?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/interns/sevval_bulburu/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]"
|
||||
q0565,test,specific_fact,medium,fts,Akú metódu upsamplingu Sevval Bulburu vyskúšala a nefungovala?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/interns/sevval_bulburu/README.md"", ""pages/topics/hatespeech/README.md"", ""pages/students/2018/adrian_remias/README.md"", ""pages/topics/faq/README.md"", ""pages/topics/akopisat/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/topics/hatespeech"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/topics/akopisat""]"
|
||||
q0565,test,specific_fact,medium,vector,Akú metódu upsamplingu Sevval Bulburu vyskúšala a nefungovala?,2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/students/2018/oleh_bilykh/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]"
|
||||
q0565,test,specific_fact,medium,hybrid,Akú metódu upsamplingu Sevval Bulburu vyskúšala a nefungovala?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/interns/sevval_bulburu/README.md"", ""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]"
|
||||
q0566,test,specific_fact,medium,fts,Aký webový framework použila Sevval Bulburu pre aplikáciu?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/interns/sevval_bulburu/README.md"", ""pages/topics/hatespeech/README.md"", ""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/topics/hatespeech"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]"
|
||||
q0566,test,specific_fact,medium,vector,Aký webový framework použila Sevval Bulburu pre aplikáciu?,2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]"
|
||||
q0566,test,specific_fact,medium,hybrid,Aký webový framework použila Sevval Bulburu pre aplikáciu?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/interns/sevval_bulburu/README.md"", ""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2019/alina_vitko/README.md"", ""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]"
|
||||
q0567,test,specific_fact,medium,fts,Aký anotačný nástroj si Sevval Bulburu naštudovala?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/interns/sevval_bulburu/README.md"", ""pages/topics/hatespeech/README.md"", ""pages/topics/named-entity/README.md"", ""pages/topics/nlp/README.md"", ""pages/students/2018/NaN1name_buday/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/topics/hatespeech"", ""https://zp.kemt.fei.tuke.sk/topics/named-entity"", ""https://zp.kemt.fei.tuke.sk/topics/nlp"", ""https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday""]"
|
||||
q0567,test,specific_fact,medium,vector,Aký anotačný nástroj si Sevval Bulburu naštudovala?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/interns/sevval_bulburu/README.md"", ""pages/students/2022/serhii_yemets/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2022/serhii_yemets"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]"
|
||||
q0567,test,specific_fact,medium,hybrid,Aký anotačný nástroj si Sevval Bulburu naštudovala?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/interns/sevval_bulburu/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2022/serhii_yemets/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/serhii_yemets"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021""]"
|
||||
q0606,test,topic_page_lookup,easy,fts,Nájdi projektovú alebo informačnú stránku „Podpora slovenčiny v knižnici Spacy“.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/spacy/README.md""]","[""pages/topics/spacy/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2017/than_trung_thanh/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh""]"
|
||||
q0606,test,topic_page_lookup,easy,vector,Nájdi projektovú alebo informačnú stránku „Podpora slovenčiny v knižnici Spacy“.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/spacy/README.md""]","[""pages/topics/spacy/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0606,test,topic_page_lookup,easy,hybrid,Nájdi projektovú alebo informačnú stránku „Podpora slovenčiny v knižnici Spacy“.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/spacy/README.md""]","[""pages/topics/spacy/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt""]"
|
||||
q0607,test,topic_page_lookup,medium,fts,Ktorý dokument v ZP Wiki sa priamo venuje téme „Podpora slovenčiny v knižnici Spacy“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/spacy/README.md""]","[""pages/topics/spacy/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2019/samuel_horani/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani""]"
|
||||
q0607,test,topic_page_lookup,medium,vector,Ktorý dokument v ZP Wiki sa priamo venuje téme „Podpora slovenčiny v knižnici Spacy“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/spacy/README.md""]","[""pages/topics/spacy/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/topics/resources/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/topics/resources"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt""]"
|
||||
q0607,test,topic_page_lookup,medium,hybrid,Ktorý dokument v ZP Wiki sa priamo venuje téme „Podpora slovenčiny v knižnici Spacy“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/spacy/README.md""]","[""pages/topics/spacy/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/topics/resources/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/topics/resources""]"
|
||||
q0608,test,source_url,easy,fts,Aký source_url patrí k stránke „Podpora slovenčiny v knižnici Spacy“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/spacy/README.md""]","[""pages/topics/spacy/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt""]"
|
||||
q0608,test,source_url,easy,vector,Aký source_url patrí k stránke „Podpora slovenčiny v knižnici Spacy“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/spacy/README.md""]","[""pages/topics/spacy/README.md"", ""pages/topics/resources/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/students/2016/jakub_maruniak/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/topics/resources"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""]"
|
||||
q0608,test,source_url,easy,hybrid,Aký source_url patrí k stránke „Podpora slovenčiny v knižnici Spacy“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/spacy/README.md""]","[""pages/topics/spacy/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/topics/resources/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/topics/resources""]"
|
||||
q0612,test,specific_fact,medium,fts,Aké dve hlavné štatistické úlohy má projekt podpory slovenčiny v Spacy trénovať?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/spacy/README.md""]","[""pages/topics/spacy/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/students/2016/lukas_pokryvka/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]"
|
||||
q0612,test,specific_fact,medium,vector,Aké dve hlavné štatistické úlohy má projekt podpory slovenčiny v Spacy trénovať?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/spacy/README.md""]","[""pages/topics/spacy/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/annotation/README.md"", ""pages/students/2016/jakub_maruniak/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021/annotation"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""]"
|
||||
q0612,test,specific_fact,medium,hybrid,Aké dve hlavné štatistické úlohy má projekt podpory slovenčiny v Spacy trénovať?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/spacy/README.md""]","[""pages/topics/spacy/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2018/martin_wencel/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]"
|
||||
q0613,test,specific_fact,medium,fts,Aké slovné vektory boli zahrnuté do modelu Spacy?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/spacy/README.md""]","[""pages/topics/spacy/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2022/serhii_yemets/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2022/serhii_yemets"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0613,test,specific_fact,medium,vector,Aké slovné vektory boli zahrnuté do modelu Spacy?,2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/topics/spacy/README.md""]","[""pages/students/2019/kristian_sopkovic/README.md"", ""pages/topics/spacy/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0613,test,specific_fact,medium,hybrid,Aké slovné vektory boli zahrnuté do modelu Spacy?,2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/topics/spacy/README.md""]","[""pages/students/2019/kristian_sopkovic/README.md"", ""pages/topics/spacy/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2022/serhii_yemets/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2022/serhii_yemets""]"
|
||||
q0614,test,specific_fact,medium,fts,Ktorí ľudia sú uvedení pri projekte podpory slovenčiny v Spacy?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/spacy/README.md""]","[""pages/topics/spacy/README.md"", ""pages/students/2019/michal_stromko/vp2021/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/topics/faq/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko/vp2021"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/topics/faq""]"
|
||||
q0614,test,specific_fact,medium,vector,Ktorí ľudia sú uvedení pri projekte podpory slovenčiny v Spacy?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/spacy/README.md""]","[""pages/topics/spacy/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0614,test,specific_fact,medium,hybrid,Ktorí ľudia sú uvedení pri projekte podpory slovenčiny v Spacy?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/spacy/README.md""]","[""pages/topics/spacy/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]"
|
||||
q0625,test,topic_page_lookup,easy,fts,Nájdi projektovú alebo informačnú stránku „Morfologická analýza slovenského jazyka“.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/morphology/README.md""]","[""pages/topics/morphology/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/topics/otvorene/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/topics/bert/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/morphology"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/topics/bert""]"
|
||||
q0625,test,topic_page_lookup,easy,vector,Nájdi projektovú alebo informačnú stránku „Morfologická analýza slovenského jazyka“.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/morphology/README.md""]","[""pages/topics/morphology/README.md"", ""pages/topics/otvorene/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/topics/hatespeech/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/morphology"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/topics/hatespeech"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0625,test,topic_page_lookup,easy,hybrid,Nájdi projektovú alebo informačnú stránku „Morfologická analýza slovenského jazyka“.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/morphology/README.md""]","[""pages/topics/morphology/README.md"", ""pages/topics/otvorene/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/topics/bert/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/morphology"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/topics/bert"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q0626,test,topic_page_lookup,medium,fts,Ktorý dokument v ZP Wiki sa priamo venuje téme „Morfologická analýza slovenského jazyka“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/morphology/README.md""]","[""pages/topics/morphology/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/topics/otvorene/README.md"", ""pages/topics/bert/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/morphology"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/topics/bert"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0626,test,topic_page_lookup,medium,vector,Ktorý dokument v ZP Wiki sa priamo venuje téme „Morfologická analýza slovenského jazyka“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/morphology/README.md""]","[""pages/topics/morphology/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/topics/resources/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/jakub_maruniak/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/morphology"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/topics/resources"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""]"
|
||||
q0626,test,topic_page_lookup,medium,hybrid,Ktorý dokument v ZP Wiki sa priamo venuje téme „Morfologická analýza slovenského jazyka“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/morphology/README.md""]","[""pages/topics/morphology/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/topics/faq/README.md"", ""pages/topics/bert/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/morphology"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/topics/bert""]"
|
||||
q0627,test,source_url,easy,fts,Aký source_url patrí k stránke „Morfologická analýza slovenského jazyka“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/morphology/README.md""]","[""pages/topics/morphology/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/topics/otvorene/README.md"", ""pages/topics/bert/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/morphology"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/topics/bert"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0627,test,source_url,easy,vector,Aký source_url patrí k stránke „Morfologická analýza slovenského jazyka“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/morphology/README.md""]","[""pages/topics/morphology/README.md"", ""pages/topics/resources/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/topics/bert/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/morphology"", ""https://zp.kemt.fei.tuke.sk/topics/resources"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/topics/bert"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0627,test,source_url,easy,hybrid,Aký source_url patrí k stránke „Morfologická analýza slovenského jazyka“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/morphology/README.md""]","[""pages/topics/morphology/README.md"", ""pages/topics/bert/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/topics/resources/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/morphology"", ""https://zp.kemt.fei.tuke.sk/topics/bert"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/topics/resources"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0631,test,specific_fact,medium,fts,Aké tri prístupy alebo nástroje sú uvedené pri morfologickej analýze slovenského jazyka?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/topics/morphology/README.md""]","[""pages/topics/otvorene/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/topics/bert/README.md"", ""pages/topics/nlp/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/topics/bert"", ""https://zp.kemt.fei.tuke.sk/topics/nlp""]"
|
||||
q0631,test,specific_fact,medium,vector,Aké tri prístupy alebo nástroje sú uvedené pri morfologickej analýze slovenského jazyka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/morphology/README.md""]","[""pages/topics/morphology/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/topics/resources/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/morphology"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/topics/resources""]"
|
||||
q0631,test,specific_fact,medium,hybrid,Aké tri prístupy alebo nástroje sú uvedené pri morfologickej analýze slovenského jazyka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/morphology/README.md""]","[""pages/topics/morphology/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/topics/nlp/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/morphology"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/topics/nlp""]"
|
||||
q0642,test,topic_page_lookup,easy,fts,Nájdi projektovú alebo informačnú stránku „Jazyk Python“.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/python/README.md""]","[""pages/topics/python/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/python"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0642,test,topic_page_lookup,easy,vector,Nájdi projektovú alebo informačnú stránku „Jazyk Python“.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/python/README.md""]","[""pages/topics/python/README.md"", ""pages/students/2022/tetiana_mohorian/README.md"", ""pages/students/2017/stanislav_matsunych/README.md"", ""pages/students/2016/darius_lindvai/README.md"", ""pages/topics/otvorene/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/python"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian"", ""https://zp.kemt.fei.tuke.sk/students/2017/stanislav_matsunych"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene""]"
|
||||
q0642,test,topic_page_lookup,easy,hybrid,Nájdi projektovú alebo informačnú stránku „Jazyk Python“.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/python/README.md""]","[""pages/topics/python/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md"", ""pages/topics/nlp/README.md"", ""pages/students/2021/eduard_matovka/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/python"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian"", ""https://zp.kemt.fei.tuke.sk/topics/nlp"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka""]"
|
||||
q0643,test,topic_page_lookup,medium,fts,Ktorý dokument v ZP Wiki sa priamo venuje téme „Jazyk Python“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/python/README.md""]","[""pages/topics/python/README.md"", ""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2019/michal_stromko/vp2021/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/python"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko/vp2021"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]"
|
||||
q0643,test,topic_page_lookup,medium,vector,Ktorý dokument v ZP Wiki sa priamo venuje téme „Jazyk Python“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/python/README.md""]","[""pages/topics/python/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2019/michal_stromko/vp2021/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/python"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko/vp2021""]"
|
||||
q0643,test,topic_page_lookup,medium,hybrid,Ktorý dokument v ZP Wiki sa priamo venuje téme „Jazyk Python“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/python/README.md""]","[""pages/topics/python/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2019/michal_stromko/vp2021/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/python"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko/vp2021"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt""]"
|
||||
q0644,test,source_url,easy,fts,Aký source_url patrí k stránke „Jazyk Python“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/python/README.md""]","[""pages/topics/python/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/python"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial""]"
|
||||
q0644,test,source_url,easy,vector,Aký source_url patrí k stránke „Jazyk Python“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/python/README.md""]","[""pages/topics/python/README.md"", ""pages/topics/nlp/README.md"", ""pages/topics/resources/README.md"", ""pages/students/2017/stanislav_matsunych/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/python"", ""https://zp.kemt.fei.tuke.sk/topics/nlp"", ""https://zp.kemt.fei.tuke.sk/topics/resources"", ""https://zp.kemt.fei.tuke.sk/students/2017/stanislav_matsunych"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas""]"
|
||||
q0644,test,source_url,easy,hybrid,Aký source_url patrí k stránke „Jazyk Python“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/python/README.md""]","[""pages/topics/python/README.md"", ""pages/students/2017/stanislav_matsunych/README.md"", ""pages/topics/nlp/README.md"", ""pages/topics/resources/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/python"", ""https://zp.kemt.fei.tuke.sk/students/2017/stanislav_matsunych"", ""https://zp.kemt.fei.tuke.sk/topics/nlp"", ""https://zp.kemt.fei.tuke.sk/topics/resources"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas""]"
|
||||
q0646,test,topic_page_lookup,easy,fts,Nájdi projektovú alebo informačnú stránku „Záverečné práce a projekty“.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/akopisat/README.md""]","[""pages/topics/akopisat/README.md"", ""pages/topics/otvorene/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2018/ondrej_megela/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]"
|
||||
q0646,test,topic_page_lookup,easy,vector,Nájdi projektovú alebo informačnú stránku „Záverečné práce a projekty“.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/akopisat/README.md""]","[""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/topics/otvorene/README.md"", ""pages/students/2019/michal_stromko/vp2021/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko/vp2021""]"
|
||||
q0646,test,topic_page_lookup,easy,hybrid,Nájdi projektovú alebo informačnú stránku „Záverečné práce a projekty“.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/akopisat/README.md""]","[""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md"", ""pages/topics/otvorene/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2019/michal_stromko/vp2021/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko/vp2021""]"
|
||||
q0647,test,topic_page_lookup,medium,fts,Ktorý dokument v ZP Wiki sa priamo venuje téme „Záverečné práce a projekty“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/akopisat/README.md""]","[""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/topics/otvorene/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene""]"
|
||||
q0647,test,topic_page_lookup,medium,vector,Ktorý dokument v ZP Wiki sa priamo venuje téme „Záverečné práce a projekty“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/akopisat/README.md""]","[""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2019/michal_stromko/vp2021/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko/vp2021"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0647,test,topic_page_lookup,medium,hybrid,Ktorý dokument v ZP Wiki sa priamo venuje téme „Záverečné práce a projekty“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/akopisat/README.md""]","[""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2019/michal_stromko/vp2021/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/topics/otvorene/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko/vp2021"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene""]"
|
||||
q0648,test,source_url,easy,fts,Aký source_url patrí k stránke „Záverečné práce a projekty“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/akopisat/README.md""]","[""pages/topics/akopisat/README.md"", ""pages/topics/otvorene/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md"", ""pages/topics/bert/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi"", ""https://zp.kemt.fei.tuke.sk/topics/bert""]"
|
||||
q0648,test,source_url,easy,vector,Aký source_url patrí k stránke „Záverečné práce a projekty“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/akopisat/README.md""]","[""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md"", ""pages/topics/otvorene/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2019/michal_stromko/vp2021/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko/vp2021""]"
|
||||
q0648,test,source_url,easy,hybrid,Aký source_url patrí k stránke „Záverečné práce a projekty“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/akopisat/README.md""]","[""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md"", ""pages/topics/otvorene/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2019/michal_stromko/vp2021/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko/vp2021""]"
|
||||
q0654,test,topic_page_lookup,easy,fts,Nájdi projektovú alebo informačnú stránku „Prepis postupností“.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/seq2seq/README.md""]","[""pages/topics/seq2seq/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/patrik_pavlisin/dp22/README.md"", ""pages/topics/question/navod/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/seq2seq"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp22"", ""https://zp.kemt.fei.tuke.sk/topics/question/navod""]"
|
||||
q0654,test,topic_page_lookup,easy,vector,Nájdi projektovú alebo informačnú stránku „Prepis postupností“.,3,0.333333,0,1,1,0.0,1.0,1.0,"[""pages/topics/seq2seq/README.md""]","[""pages/topics/akopisat/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/topics/seq2seq/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/topics/faq/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/topics/seq2seq"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/topics/faq""]"
|
||||
q0654,test,topic_page_lookup,easy,hybrid,Nájdi projektovú alebo informačnú stránku „Prepis postupností“.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/seq2seq/README.md""]","[""pages/topics/seq2seq/README.md"", ""pages/topics/akopisat/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/topics/faq/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/seq2seq"", ""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/topics/faq""]"
|
||||
q0655,test,topic_page_lookup,medium,fts,Ktorý dokument v ZP Wiki sa priamo venuje téme „Prepis postupností“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/seq2seq/README.md""]","[""pages/topics/seq2seq/README.md"", ""pages/students/2016/patrik_pavlisin/dp22/README.md"", ""pages/topics/steel/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/patrik_pavlisin/dp21/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/seq2seq"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp22"", ""https://zp.kemt.fei.tuke.sk/topics/steel"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp21""]"
|
||||
q0655,test,topic_page_lookup,medium,vector,Ktorý dokument v ZP Wiki sa priamo venuje téme „Prepis postupností“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/seq2seq/README.md""]","[""pages/topics/seq2seq/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/seq2seq"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0655,test,topic_page_lookup,medium,hybrid,Ktorý dokument v ZP Wiki sa priamo venuje téme „Prepis postupností“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/seq2seq/README.md""]","[""pages/topics/seq2seq/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2016/jakub_maruniak/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/seq2seq"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""]"
|
||||
q0656,test,source_url,easy,fts,Aký source_url patrí k stránke „Prepis postupností“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/seq2seq/README.md""]","[""pages/topics/seq2seq/README.md"", ""pages/students/2016/patrik_pavlisin/dp21/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2016/patrik_pavlisin/dp22/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/seq2seq"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp21"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp22"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak""]"
|
||||
q0656,test,source_url,easy,vector,Aký source_url patrí k stránke „Prepis postupností“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/seq2seq/README.md""]","[""pages/topics/seq2seq/README.md"", ""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/seq2seq"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q0656,test,source_url,easy,hybrid,Aký source_url patrí k stránke „Prepis postupností“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/seq2seq/README.md""]","[""pages/topics/seq2seq/README.md"", ""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/seq2seq"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q0664,test,topic_page_lookup,easy,fts,Nájdi projektovú alebo informačnú stránku „Nástroje a zdroje pre spracovanie prirodzeného jazyka“.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/nlp/README.md""]","[""pages/topics/nlp/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2018/NaN1name_buday/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/nlp"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday""]"
|
||||
q0664,test,topic_page_lookup,easy,vector,Nájdi projektovú alebo informačnú stránku „Nástroje a zdroje pre spracovanie prirodzeného jazyka“.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/nlp/README.md""]","[""pages/topics/nlp/README.md"", ""pages/topics/otvorene/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/students/2018/NaN1name_buday/README.md"", ""pages/topics/hatespeech/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/nlp"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday"", ""https://zp.kemt.fei.tuke.sk/topics/hatespeech""]"
|
||||
q0664,test,topic_page_lookup,easy,hybrid,Nájdi projektovú alebo informačnú stránku „Nástroje a zdroje pre spracovanie prirodzeného jazyka“.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/nlp/README.md""]","[""pages/topics/nlp/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/students/2018/NaN1name_buday/README.md"", ""pages/topics/otvorene/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/nlp"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt""]"
|
||||
q0665,test,topic_page_lookup,medium,fts,Ktorý dokument v ZP Wiki sa priamo venuje téme „Nástroje a zdroje pre spracovanie prirodzeného jazyka“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/nlp/README.md""]","[""pages/topics/nlp/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/nlp"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0665,test,topic_page_lookup,medium,vector,Ktorý dokument v ZP Wiki sa priamo venuje téme „Nástroje a zdroje pre spracovanie prirodzeného jazyka“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/nlp/README.md""]","[""pages/topics/nlp/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/topics/resources/README.md"", ""pages/students/2019/michal_stromko/vp2021/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/nlp"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/topics/resources"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko/vp2021"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt""]"
|
||||
q0665,test,topic_page_lookup,medium,hybrid,Ktorý dokument v ZP Wiki sa priamo venuje téme „Nástroje a zdroje pre spracovanie prirodzeného jazyka“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/nlp/README.md""]","[""pages/topics/nlp/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/topics/resources/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2016/lukas_pokryvka/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/nlp"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/topics/resources"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]"
|
||||
q0666,test,source_url,easy,fts,Aký source_url patrí k stránke „Nástroje a zdroje pre spracovanie prirodzeného jazyka“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/nlp/README.md""]","[""pages/topics/nlp/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2018/NaN1name_buday/README.md"", ""pages/students/2016/patrik_pavlisin/tp20/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/nlp"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/tp20""]"
|
||||
q0666,test,source_url,easy,vector,Aký source_url patrí k stránke „Nástroje a zdroje pre spracovanie prirodzeného jazyka“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/nlp/README.md""]","[""pages/topics/nlp/README.md"", ""pages/topics/resources/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/interns/sevval_bulburu/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/nlp"", ""https://zp.kemt.fei.tuke.sk/topics/resources"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu""]"
|
||||
q0666,test,source_url,easy,hybrid,Aký source_url patrí k stránke „Nástroje a zdroje pre spracovanie prirodzeného jazyka“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/nlp/README.md""]","[""pages/topics/nlp/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/topics/resources/README.md"", ""pages/students/2016/lukas_pokryvka/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/nlp"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/topics/resources"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]"
|
||||
q0670,test,topic_page_lookup,easy,fts,Nájdi projektovú alebo informačnú stránku „Tvorba nezodpovedateľných otázok“.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/question/nezodpovedatelne/README.md""]","[""pages/topics/question/nezodpovedatelne/README.md"", ""pages/topics/question/navod/README.md"", ""pages/topics/otvorene/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/topics/question/navod"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0670,test,topic_page_lookup,easy,vector,Nájdi projektovú alebo informačnú stránku „Tvorba nezodpovedateľných otázok“.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/question/nezodpovedatelne/README.md""]","[""pages/topics/question/nezodpovedatelne/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/topics/otvorene/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0670,test,topic_page_lookup,easy,hybrid,Nájdi projektovú alebo informačnú stránku „Tvorba nezodpovedateľných otázok“.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/question/nezodpovedatelne/README.md""]","[""pages/topics/question/nezodpovedatelne/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/topics/otvorene/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0671,test,topic_page_lookup,medium,fts,Ktorý dokument v ZP Wiki sa priamo venuje téme „Tvorba nezodpovedateľných otázok“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/question/nezodpovedatelne/README.md""]","[""pages/topics/question/nezodpovedatelne/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/topics/otvorene/README.md"", ""pages/topics/question/navod/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/topics/question/navod""]"
|
||||
q0671,test,topic_page_lookup,medium,vector,Ktorý dokument v ZP Wiki sa priamo venuje téme „Tvorba nezodpovedateľných otázok“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/question/nezodpovedatelne/README.md""]","[""pages/topics/question/nezodpovedatelne/README.md"", ""pages/topics/faq/README.md"", ""pages/topics/question/navod/README.md"", ""pages/topics/question/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/topics/question/navod"", ""https://zp.kemt.fei.tuke.sk/topics/question"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0671,test,topic_page_lookup,medium,hybrid,Ktorý dokument v ZP Wiki sa priamo venuje téme „Tvorba nezodpovedateľných otázok“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/question/nezodpovedatelne/README.md""]","[""pages/topics/question/nezodpovedatelne/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/michal_stromko/vp2021/README.md"", ""pages/topics/question/validacie/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko/vp2021"", ""https://zp.kemt.fei.tuke.sk/topics/question/validacie""]"
|
||||
q0672,test,source_url,easy,fts,Aký source_url patrí k stránke „Tvorba nezodpovedateľných otázok“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/question/nezodpovedatelne/README.md""]","[""pages/topics/question/nezodpovedatelne/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/patrik_pavlisin/dp22/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp22""]"
|
||||
q0672,test,source_url,easy,vector,Aký source_url patrí k stránke „Tvorba nezodpovedateľných otázok“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/question/nezodpovedatelne/README.md""]","[""pages/topics/question/nezodpovedatelne/README.md"", ""pages/topics/question/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/topics/question"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0672,test,source_url,easy,hybrid,Aký source_url patrí k stránke „Tvorba nezodpovedateľných otázok“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/question/nezodpovedatelne/README.md""]","[""pages/topics/question/nezodpovedatelne/README.md"", ""pages/topics/question/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/topics/question"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0680,test,topic_page_lookup,easy,fts,Nájdi projektovú alebo informačnú stránku „Validácia otázok a odpovedí“.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/question/validacie/README.md""]","[""pages/topics/question/validacie/README.md"", ""pages/topics/question/navod/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/question/validacie"", ""https://zp.kemt.fei.tuke.sk/topics/question/navod"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0680,test,topic_page_lookup,easy,vector,Nájdi projektovú alebo informačnú stránku „Validácia otázok a odpovedí“.,2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/topics/question/validacie/README.md""]","[""pages/students/2016/tomas_kucharik/README.md"", ""pages/topics/question/validacie/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/topics/question/validacie"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0680,test,topic_page_lookup,easy,hybrid,Nájdi projektovú alebo informačnú stránku „Validácia otázok a odpovedí“.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/question/validacie/README.md""]","[""pages/topics/question/validacie/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/topics/question/nezodpovedatelne/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/question/validacie"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne""]"
|
||||
q0681,test,topic_page_lookup,medium,fts,Ktorý dokument v ZP Wiki sa priamo venuje téme „Validácia otázok a odpovedí“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/question/validacie/README.md""]","[""pages/topics/question/validacie/README.md"", ""pages/topics/question/navod/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/question/validacie"", ""https://zp.kemt.fei.tuke.sk/topics/question/navod"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0681,test,topic_page_lookup,medium,vector,Ktorý dokument v ZP Wiki sa priamo venuje téme „Validácia otázok a odpovedí“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/question/validacie/README.md""]","[""pages/topics/question/validacie/README.md"", ""pages/topics/faq/README.md"", ""pages/topics/question/nezodpovedatelne/README.md"", ""pages/topics/question/navod/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/question/validacie"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/topics/question/navod"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0681,test,topic_page_lookup,medium,hybrid,Ktorý dokument v ZP Wiki sa priamo venuje téme „Validácia otázok a odpovedí“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/question/validacie/README.md""]","[""pages/topics/question/validacie/README.md"", ""pages/topics/faq/README.md"", ""pages/topics/question/navod/README.md"", ""pages/topics/question/nezodpovedatelne/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/question/validacie"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/topics/question/navod"", ""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0682,test,source_url,easy,fts,Aký source_url patrí k stránke „Validácia otázok a odpovedí“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/question/validacie/README.md""]","[""pages/topics/question/validacie/README.md"", ""pages/topics/question/navod/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/question/validacie"", ""https://zp.kemt.fei.tuke.sk/topics/question/navod"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak""]"
|
||||
q0682,test,source_url,easy,vector,Aký source_url patrí k stránke „Validácia otázok a odpovedí“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/question/validacie/README.md""]","[""pages/topics/question/validacie/README.md"", ""pages/topics/faq/README.md"", ""pages/topics/question/README.md"", ""pages/topics/resources/README.md"", ""pages/topics/question/navod/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/question/validacie"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/topics/question"", ""https://zp.kemt.fei.tuke.sk/topics/resources"", ""https://zp.kemt.fei.tuke.sk/topics/question/navod""]"
|
||||
q0682,test,source_url,easy,hybrid,Aký source_url patrí k stránke „Validácia otázok a odpovedí“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/question/validacie/README.md""]","[""pages/topics/question/validacie/README.md"", ""pages/topics/question/navod/README.md"", ""pages/topics/question/nezodpovedatelne/README.md"", ""pages/topics/faq/README.md"", ""pages/topics/question/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/question/validacie"", ""https://zp.kemt.fei.tuke.sk/topics/question/navod"", ""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/topics/question""]"
|
||||
|
Can't render this file because it is too large.
|
File diff suppressed because it is too large
Load Diff
@ -6,3 +6,4 @@ tiktoken>=0.8,<1
|
||||
uvicorn[standard]==0.48.0
|
||||
numpy==2.2.6
|
||||
sentence-transformers==5.7.0
|
||||
neo4j==6.3.1
|
||||
|
||||
@ -9,7 +9,7 @@ from fastapi.testclient import TestClient
|
||||
|
||||
import app.main as main
|
||||
import app.routes as routes
|
||||
from scripts.rebuild_index import (
|
||||
from tools.rag.rebuild_index import (
|
||||
ReindexInProgressError,
|
||||
)
|
||||
|
||||
|
||||
113
test/test_bod3_closure.py
Normal file
113
test/test_bod3_closure.py
Normal file
@ -0,0 +1,113 @@
|
||||
import copy
|
||||
import json
|
||||
|
||||
import pytest
|
||||
|
||||
from tools.answer_evaluation.context_policy import answer_context_issues, citation_check, coverage_issues, prose_issues, text_contains_value
|
||||
from tools.answer_evaluation.checked_generation import generate_checked_answer
|
||||
from tools.answer_evaluation.render_answer import render_graph_answer
|
||||
from tools.graphrag.graph_search import extract_query_constraints
|
||||
from tools.graphrag.graphrag import extract_start_year
|
||||
|
||||
|
||||
@pytest.fixture
|
||||
def context():
|
||||
return {'status': 'ok', 'complete': True, 'truncated': False, 'aggregation': None,
|
||||
'sources': [{'source_url': 'https://example.test/students/2018/eva'}],
|
||||
'facts': [{'person': 'Eva Nová', 'year': 2026, 'title': 'Práca o 3 modeloch',
|
||||
'source_url': 'https://example.test/students/2018/eva'}], 'answer_candidates': []}
|
||||
|
||||
|
||||
@pytest.fixture
|
||||
def answer(context):
|
||||
return {'answer': '', 'status': 'ok', 'claims': [{'person': 'Eva Nová', 'year': 2026, 'title': 'Práca o 3 modeloch'}],
|
||||
'source_urls': [context['sources'][0]['source_url']], 'count': None}
|
||||
|
||||
|
||||
@pytest.mark.parametrize('year', [1899, 1999, 2099, 2100, 9999])
|
||||
def test_year_constraint_is_never_silently_dropped(year):
|
||||
assert extract_query_constraints(f'Aká práca je v roku {year}?')['years'] == [year]
|
||||
|
||||
|
||||
@pytest.mark.parametrize('text', ['Toto je úplný zoznam. Výpis je neúplný.',
|
||||
'Uvádzam všetkých študentov. Výpis je neúplný.',
|
||||
'Úplný zoznam, ale dôkazy sú orezané.'])
|
||||
def test_caveat_does_not_license_contradictory_exhaustive_claim(text):
|
||||
assert 'unsupported_exhaustive_statement' in coverage_issues({'answer': text, 'status': 'ok'}, {'complete': False})
|
||||
|
||||
|
||||
@pytest.mark.parametrize('text', ['Výpis je neúplný.', 'Toto nie je úplný zoznam.', 'Nie je to úplný zoznam.'])
|
||||
def test_truthful_scope_notice_is_not_rejected(text):
|
||||
assert coverage_issues({'answer': text, 'status': 'ok'}, {'complete': False}) == []
|
||||
|
||||
|
||||
@pytest.mark.parametrize('text', ['[zdroj][s]\n\n[s]: /vymysleny', '<a href="/vymysleny">zdroj</a>',
|
||||
'<img src="//evil.test/x">', '[s]: javascript:alert(1)',
|
||||
'<a href="https://evil.test/x">x</a>'])
|
||||
def test_all_citation_syntaxes_are_checked(text):
|
||||
assert not citation_check({'answer': text, 'source_urls': []}, {'https://example.test/a'})['citations_ok']
|
||||
|
||||
|
||||
def test_legitimate_balanced_parentheses_and_reference_html_links():
|
||||
url = 'https://example.test/a_(b)'
|
||||
text = f'[x]({url}) a {url}.\n[s]: <{url}>\n<a href="{url}">x</a>'
|
||||
assert citation_check({'answer': text, 'source_urls': [url]}, {url})['citations_ok']
|
||||
|
||||
|
||||
def test_count_requires_explicit_complete_aggregation(context, answer):
|
||||
answer['count'] = 98765
|
||||
assert 'unsupported_total_count' in answer_context_issues(answer, context, check_text=False)
|
||||
|
||||
|
||||
@pytest.mark.parametrize('field,issue', [('claims', 'missing_required_claims'), ('source_urls', 'missing_required_citations')])
|
||||
def test_positive_answer_needs_facts_and_citations(context, answer, field, issue):
|
||||
answer[field] = []
|
||||
assert issue in answer_context_issues(answer, context, check_text=False)
|
||||
|
||||
|
||||
def test_every_claim_field_needs_its_source(context, answer):
|
||||
context['facts'].append({'person': 'Eva Nová', 'keyword': 'python', 'source_url': 'https://example.test/child'})
|
||||
context['sources'].append({'source_url': 'https://example.test/child'})
|
||||
answer['claims'][0]['keyword'] = 'python'
|
||||
assert 'missing_claim_source' in answer_context_issues(answer, context, check_text=False)
|
||||
answer['source_urls'].append('https://example.test/child')
|
||||
assert answer_context_issues(answer, context, check_text=False) == []
|
||||
|
||||
|
||||
def test_wrong_extra_prose_year_is_rejected_but_citation_path_year_is_not(context, answer):
|
||||
answer['answer'] = 'Eva Nová má prácu z roku 2026. ' + answer['source_urls'][0]
|
||||
assert prose_issues(answer) == []
|
||||
answer['answer'] += ' Obhajoba bola v roku 2099.'
|
||||
assert prose_issues(answer) == ['unsupported_prose_number']
|
||||
|
||||
|
||||
def test_renderer_uses_only_validated_fields_and_preserves_model_reply(context, answer):
|
||||
original = copy.deepcopy(answer)
|
||||
def complete(_): return {'choices': [{'message': {'content': json.dumps(answer)}}]}
|
||||
result = generate_checked_answer('Názov a rok?', context, 'Pokyny', complete)
|
||||
parsed_original = {key: value for key, value in original.items() if value is not None}
|
||||
assert result['accepted_for_delivery'] and result['model_answer'] == parsed_original
|
||||
assert result['attempts'][0]['answer'] == parsed_original
|
||||
assert result['attempts'][0]['response']['choices'][0]['message']['content'] == json.dumps(original)
|
||||
assert '2026' in result['answer']['answer'] and 'Práca o 3 modeloch' in result['answer']['answer']
|
||||
assert answer == original
|
||||
|
||||
|
||||
def test_zero_count_is_valid_without_claims_or_sources():
|
||||
context = {'status': 'ok', 'facts': [], 'sources': [], 'complete': True,
|
||||
'aggregation': {'count': 0, 'complete': True}}
|
||||
answer = {'answer': '', 'status': 'ok', 'claims': [], 'source_urls': [], 'count': 0}
|
||||
rendered = render_graph_answer(answer, context)
|
||||
assert answer_context_issues(rendered, context) == []
|
||||
|
||||
|
||||
def test_directory_cohort_does_not_become_study_start():
|
||||
assert extract_start_year('pages/students/2016/eva/README.md', [{'text': 'Diplomová práca 2026'}]) is None
|
||||
assert extract_start_year('pages/students/2016/eva/README.md', [{'text': 'Rok začiatku štúdia: 2017'}]) == 2017
|
||||
assert extract_start_year('pages/students/2016/eva/README.md', [{'text': 'Beginning of the study: 2018'}]) == 2018
|
||||
|
||||
|
||||
def test_person_inflection_keeps_distinct_names_distinct():
|
||||
assert text_contains_value('Adriána Remiáša a Martina NaN1', 'Martin NaN1', person=True)
|
||||
assert not text_contains_value('Martin Jančura', 'Martin NaN1', person=True)
|
||||
assert not text_contains_value('Martin Malinovský', 'Martin Malý', person=True)
|
||||
@ -81,7 +81,11 @@ def test_runtime_requirements_contain_only_direct_dependencies() -> None:
|
||||
|
||||
|
||||
def test_all_application_python_files_compile() -> None:
|
||||
targets = [PROJECT_ROOT / "app", PROJECT_ROOT / "scripts"]
|
||||
targets = [
|
||||
PROJECT_ROOT / "app",
|
||||
PROJECT_ROOT / "tools" / "rag",
|
||||
PROJECT_ROOT / "tools" / "graphrag",
|
||||
]
|
||||
|
||||
for directory in targets:
|
||||
for path in directory.rglob("*.py"):
|
||||
|
||||
191
test/test_context_policy.py
Normal file
191
test/test_context_policy.py
Normal file
@ -0,0 +1,191 @@
|
||||
import copy
|
||||
import json
|
||||
|
||||
import pytest
|
||||
|
||||
from tools.answer_evaluation.context_policy import citation_check, answer_context_issues, joined_candidates
|
||||
from tools.answer_evaluation.checked_generation import generate_checked_answer
|
||||
from tools.answer_evaluation.evaluate_graph_answers import graph_context,grade_answer
|
||||
|
||||
|
||||
@pytest.fixture
|
||||
def context():
|
||||
return {'status':'ok','reason':None,'complete':True,'truncated':False,'truncation_reasons':[],
|
||||
'index_version':{'version':'generation-1'},'aggregation':None,
|
||||
'sources':[{'source_id':'S1','document_path':'a.md','source_url':'https://example.test/a'}],
|
||||
'facts':[{'person':'Eva Nová','title':'Vyhľadávanie informácií','year':2026,
|
||||
'document_path':'a.md','source_url':'https://example.test/a'},
|
||||
{'person':'Eva Nová','keyword':'RAG','document_path':'a.md','source_url':'https://example.test/a'}],
|
||||
'answer_candidates':[]}
|
||||
|
||||
|
||||
@pytest.fixture
|
||||
def answer():
|
||||
return {'status':'ok','answer':'Eva Nová má prácu Vyhľadávanie informácií z roku 2026. https://example.test/a',
|
||||
'claims':[{'person':'Eva Nová','title':'Vyhľadávanie informácií','year':2026}],
|
||||
'source_urls':['https://example.test/a'],'count':None}
|
||||
|
||||
|
||||
def test_graph_context_forwards_exact_contract_without_inventing_version(context):
|
||||
raw={**context,'constraints':{'mentions_title':True,'mentions_academic_year':False,'years':[],
|
||||
'mentions_start_year':False},'documents':[]}
|
||||
out=graph_context(raw)
|
||||
for key in ['complete','truncated','truncation_reasons','index_version','sources']:
|
||||
assert out[key]==context[key]
|
||||
legacy=copy.deepcopy(raw);legacy.pop('index_version')
|
||||
assert graph_context(legacy)['index_version'] is None
|
||||
|
||||
|
||||
@pytest.mark.parametrize('location',['source_urls','answer'])
|
||||
def test_unknown_citation_is_rejected_in_list_and_prose(answer,location):
|
||||
if location=='source_urls':answer['source_urls'].append('https://invented.test/x')
|
||||
else:answer['answer']+=' https://invented.test/x'
|
||||
assert not citation_check(answer,{'https://example.test/a'})['citations_ok']
|
||||
|
||||
|
||||
def test_legitimate_markdown_quoted_and_punctuated_urls_are_accepted(answer):
|
||||
answer['answer']='[Zdroj](https://example.test/a), `https://example.test/a` a „https://example.test/a“. '
|
||||
assert citation_check(answer,{'https://example.test/a'})['citations_ok']
|
||||
|
||||
|
||||
@pytest.mark.parametrize('link', ['[zdroj](/invented)', 'www.invented.test/a', '[zdroj](mailto:fake@example.test)'])
|
||||
def test_non_http_and_relative_citations_are_checked(answer, link):
|
||||
answer['answer'] += ' ' + link
|
||||
assert not citation_check(answer, {'https://example.test/a'})['citations_ok']
|
||||
|
||||
|
||||
def test_rag_grader_rejects_extra_citation_despite_required_source_present():
|
||||
from tools.rag.evaluation.rag_metrics import evaluate_answer
|
||||
question = {'should_answer': True, 'expected_answer_contains': ['SQLite'],
|
||||
'expected_source_urls': ['https://example.test/a']}
|
||||
text = 'SQLite. https://example.test/a'
|
||||
assert evaluate_answer(question, text, tool_called=True,
|
||||
allowed_source_urls=['https://example.test/a'])['strict_pass']
|
||||
result = evaluate_answer(question, text + ' https://invented.test', tool_called=True,
|
||||
allowed_source_urls=['https://example.test/a'])
|
||||
assert not result['strict_pass'] and result['unsupported_urls'] == ['https://invented.test']
|
||||
|
||||
|
||||
@pytest.mark.parametrize('complete,reasons', [(None, []), (False, []), (False, ['source_limit'])])
|
||||
def test_rag_prompt_metadata_matches_top_level_contract(monkeypatch, tmp_path, complete, reasons):
|
||||
from tools.rag import rag_utils
|
||||
version = {'version': 'test-generation'}
|
||||
monkeypatch.setattr(rag_utils, 'search_database', lambda *a, **k: {
|
||||
'results': [], 'engine': 'test', 'strategies': [], 'complete': complete,
|
||||
'truncated': bool(reasons), 'truncation_reasons': reasons, 'index_version': version})
|
||||
result = rag_utils.build_rag_context(tmp_path / 'test.sqlite', 'Neznáma osoba')
|
||||
metadata = json.loads(result['context'].splitlines()[1])
|
||||
assert metadata == {key: result[key] for key in
|
||||
['complete', 'truncated', 'truncation_reasons', 'index_version']}
|
||||
assert metadata['index_version'] == version
|
||||
|
||||
|
||||
def test_known_wiki_url_outside_this_context_is_rejected(context,answer):
|
||||
answer['source_urls'].append('https://example.test/other-person')
|
||||
assert 'unsupported_citation' in answer_context_issues(answer,context)
|
||||
|
||||
|
||||
def test_type_of_work_cannot_become_a_keyword(context,answer):
|
||||
answer['claims'][0]['keyword']='diplomový projekt'
|
||||
assert 'unsupported_keyword' in answer_context_issues(answer,context)
|
||||
|
||||
|
||||
def test_title_and_year_must_share_one_actual_record(context,answer):
|
||||
context['facts'].append({'person':'Eva Nová','title':'Iný názov','year':2025})
|
||||
answer['claims'][0]['year']=2025
|
||||
assert 'unsupported_academic_binding' in answer_context_issues(answer,context)
|
||||
|
||||
|
||||
def test_person_join_supports_child_document_but_never_another_person(context,answer):
|
||||
context['facts'][1]['document_path']='child.md'
|
||||
intent={'mentions_title':True,'mentions_keyword':True}
|
||||
candidates=joined_candidates(context['facts'],intent)
|
||||
assert candidates[0]['evidence_documents']==['a.md','child.md']
|
||||
context['answer_candidates']=candidates
|
||||
answer['claims'][0]['keyword']='RAG'
|
||||
assert answer_context_issues(answer,context)==[]
|
||||
context['facts'][1]['person']='Boris Iný'
|
||||
assert joined_candidates(context['facts'],intent)==[]
|
||||
|
||||
|
||||
def test_year_and_keyword_join_does_not_require_a_title(context, answer):
|
||||
context['facts'][0].pop('title')
|
||||
context['facts'][1]['document_path'] = 'child.md'
|
||||
candidates = joined_candidates(context['facts'], {'years': [2026], 'mentions_keyword': True})
|
||||
assert candidates[0]['year'] == 2026 and 'title' not in candidates[0]
|
||||
assert candidates[0]['evidence_documents'] == ['a.md', 'child.md']
|
||||
context['answer_candidates'] = candidates
|
||||
answer.update(status='no_answer', claims=[])
|
||||
assert 'rejected_supported_person_join' in answer_context_issues(answer, context)
|
||||
answer.update(status='ok', claims=[{'person': 'Eva Nová', 'year': 2026, 'keyword': 'RAG'}])
|
||||
assert answer_context_issues(answer, context) == []
|
||||
|
||||
|
||||
def test_known_join_cannot_be_rejected_or_split(context,answer):
|
||||
context['answer_candidates']=joined_candidates(context['facts'],{'mentions_title':True,'mentions_keyword':True})
|
||||
answer['status']='no_answer';answer['claims']=[]
|
||||
assert 'rejected_supported_person_join' in answer_context_issues(answer,context)
|
||||
answer['status']='ok';answer['claims']=[{'person':'Eva Nová','title':'Vyhľadávanie informácií','year':2026},
|
||||
{'person':'Eva Nová','keyword':'RAG'}]
|
||||
assert 'split_or_missing_person_join' in answer_context_issues(answer,context)
|
||||
|
||||
|
||||
@pytest.mark.parametrize('complete,truncated',[(False,False),(True,True),(None,False)])
|
||||
def test_incomplete_or_unknown_context_cannot_claim_full_list(context,answer,complete,truncated):
|
||||
context.update(complete=complete,truncated=truncated)
|
||||
answer['answer']='Toto je úplný zoznam: Eva Nová.'
|
||||
assert 'unsupported_exhaustive_statement' in answer_context_issues(answer,context)
|
||||
answer['answer']='Eva Nová. Výpis je neúplný.'
|
||||
assert answer_context_issues(answer,context)==[]
|
||||
|
||||
|
||||
def test_exact_count_survives_truncated_evidence_with_notice(context,answer):
|
||||
context.update(complete=False,truncated=True,aggregation={'count':2,'complete':True})
|
||||
answer.update(count=2,answer='Počet je úplný, dôkazy sú orezané.')
|
||||
assert answer_context_issues(answer,context)==[]
|
||||
answer['count']=3
|
||||
assert 'incorrect_context_count' in answer_context_issues(answer,context)
|
||||
context['aggregation']['complete']=False
|
||||
assert 'unsupported_total_count' in answer_context_issues(answer,context)
|
||||
|
||||
|
||||
def response(answer):
|
||||
return {'choices':[{'message':{'content':answer if isinstance(answer,str) else json.dumps(answer)}}]}
|
||||
|
||||
|
||||
def test_one_correction_for_bad_citation_preserves_both_attempts(context,answer):
|
||||
bad=copy.deepcopy(answer);bad['source_urls'].append('https://invented.test/x')
|
||||
replies=iter([response(bad),response(answer)]);messages=[]
|
||||
def complete(rows):
|
||||
messages.append(copy.deepcopy(rows));return next(replies)
|
||||
out=generate_checked_answer('Otázka',context,'Pokyny',complete)
|
||||
assert out['accepted_for_delivery'] and len(out['attempts'])==2
|
||||
assert out['attempts'][0]['context_issues']==['unsupported_citation']
|
||||
assert len(messages[0])==2 and len(messages[1])==4
|
||||
assert 'expected_bindings' not in json.dumps(messages)
|
||||
|
||||
|
||||
def test_one_total_correction_covers_format_then_context_failure(context,answer):
|
||||
bad=copy.deepcopy(answer);bad['claims'][0]['year']=1901
|
||||
replies=iter([response('{bad json'),response(bad)])
|
||||
out=generate_checked_answer('Otázka',context,'Pokyny',lambda _:next(replies))
|
||||
assert not out['accepted_for_delivery'] and len(out['attempts'])==2
|
||||
assert out['attempts'][0]['format_error'] and out['context_rejected']
|
||||
|
||||
|
||||
def test_valid_context_answer_never_retries_based_on_gold(context,answer):
|
||||
calls=[]
|
||||
def complete(rows):calls.append(rows);return response(answer)
|
||||
out=generate_checked_answer('Otázka',context,'Pokyny',complete)
|
||||
assert out['accepted_for_delivery'] and len(calls)==1
|
||||
|
||||
|
||||
def test_grader_rejects_extra_url_without_rejecting_correct_answer(context,answer):
|
||||
oracle={'people':{'Eva Nová':{'documents':['a.md'],'academics':[{'year':2026,'title':'Vyhľadávanie informácií'}]}},
|
||||
'documents':{'a.md':{'source_url':'https://example.test/a','tags':[],'categories':[],'author':None}}}
|
||||
case={'expected_answer_contains':['Eva Nová','2026'],'graph':{
|
||||
'expected_bindings':[{'person':'Eva Nová','year':2026}],
|
||||
'expected_evidence_documents':[{'any_of':[{'source_url':'https://example.test/a'}]}]}}
|
||||
assert grade_answer(case,answer,oracle,context=context)['strict']
|
||||
answer['answer']+=' https://invented.test/x'
|
||||
assert not grade_answer(case,answer,oracle,context=context)['strict']
|
||||
34
test/test_graph_answer_evaluation.py
Normal file
34
test/test_graph_answer_evaluation.py
Normal file
@ -0,0 +1,34 @@
|
||||
from tools.answer_evaluation.evaluate_graph_answers import grade_answer, graph_context
|
||||
|
||||
|
||||
def test_context_does_not_present_profile_title_or_kind_as_an_academic_fact():
|
||||
result = {'status': 'ok', 'reason': None, 'aggregation': None,
|
||||
'constraints': {'mentions_title': False, 'mentions_academic_year': False, 'years': [], 'mentions_start_year': False},
|
||||
'facts': [{'fact_type': 'person_category', 'person': 'Eva Nová', 'category': 'dp2026',
|
||||
'category_year': 2026, 'category_type': 'diploma_thesis'}],
|
||||
'documents': [{'document_path': 'p.md', 'source_url': 'https://example.org/p', 'title': 'Eva Nová', 'person_kind': 'student'}]}
|
||||
context = graph_context(result)
|
||||
assert context['facts'] == [{'person': 'Eva Nová', 'category': 'dp2026'}]
|
||||
assert context['sources'] == [{'document_path': 'p.md', 'source_url': 'https://example.org/p'}]
|
||||
|
||||
|
||||
def test_null_is_not_a_false_positive_assertion_but_wrong_year_is():
|
||||
oracle = {'people': {'Eva Nová': {'start_year': 2020, 'academics': [{'year': 2026, 'title': 'Vyhľadávanie informácií'}]}}}
|
||||
case = {'expected_answer_contains': ['Eva Nová', '2026'], 'graph': {
|
||||
'expected_bindings': [{'person': 'Eva Nová', 'year': 2026}], 'expected_evidence_documents': []}}
|
||||
answer = {'answer': 'Eva Nová má prácu z roku 2026.', 'status': 'ok', 'source_urls': [],
|
||||
'claims': [{'person': 'Eva Nová', 'year': 2026, 'start_year': None, 'title': None}]}
|
||||
assert grade_answer(case, answer, oracle)['strict']
|
||||
answer['claims'][0]['year'] = 2025
|
||||
assert not grade_answer(case, answer, oracle)['strict']
|
||||
|
||||
|
||||
def test_correct_structured_category_does_not_excuse_a_wrong_prose_explanation():
|
||||
oracle = {'people': {'Eva Nová': {'documents': ['p.md']}},
|
||||
'documents': {'p.md': {'tags': [], 'categories': ['dp2026'], 'author': None}}}
|
||||
case = {'expected_answer_contains': ['Eva Nová', 'dp2026'], 'graph': {
|
||||
'expected_bindings': [{'person': 'Eva Nová', 'category': 'dp2026'}], 'expected_evidence_documents': []}}
|
||||
answer = {'answer': 'Eva Nová má dp2026, čo je dizertačná práca.', 'status': 'ok', 'source_urls': [],
|
||||
'claims': [{'person': 'Eva Nová', 'category': 'dp2026'}]}
|
||||
grade = grade_answer(case, answer, oracle)
|
||||
assert not grade['strict'] and grade['contradictory_thesis_label']
|
||||
238
test/test_index_sync.py
Normal file
238
test/test_index_sync.py
Normal file
@ -0,0 +1,238 @@
|
||||
"""Failure-injection tests for coordinated publication, not only happy paths."""
|
||||
from __future__ import annotations
|
||||
|
||||
import hashlib
|
||||
import hmac
|
||||
import json
|
||||
import sqlite3
|
||||
from pathlib import Path
|
||||
|
||||
import pytest
|
||||
|
||||
from tools import index_state as state
|
||||
from tools import sync_indexes as sync
|
||||
|
||||
|
||||
class Result:
|
||||
def __init__(self, value):
|
||||
self.value = value
|
||||
def single(self):
|
||||
return self.value
|
||||
|
||||
|
||||
class Session:
|
||||
def __init__(self, version):
|
||||
self.version = version; self.fail_commit = None; self.unavailable = False
|
||||
def run(self, query, **params):
|
||||
if self.unavailable:
|
||||
raise ConnectionError('lost database connection')
|
||||
return Result({'metadata': json.dumps(self.version)} if self.version else None)
|
||||
def begin_transaction(self):
|
||||
return Transaction(self)
|
||||
|
||||
|
||||
class Transaction:
|
||||
def __init__(self, session):
|
||||
self.session = session; self.version = session.version
|
||||
def __enter__(self):
|
||||
return self
|
||||
def __exit__(self, *args):
|
||||
pass # Uncommitted local state is discarded, as in the Neo4j driver.
|
||||
def commit(self):
|
||||
if self.session.fail_commit == 'unknown':
|
||||
self.session.unavailable = True
|
||||
raise ConnectionError('commit outcome unknown')
|
||||
self.session.version = self.version
|
||||
if self.session.fail_commit == 'response_lost':
|
||||
raise ConnectionError('committed but response lost')
|
||||
|
||||
|
||||
def snapshot(directory: Path, version: dict):
|
||||
directory.mkdir(parents=True, exist_ok=True)
|
||||
(directory / 'documents.json').write_text(json.dumps([version]))
|
||||
(directory / 'chunks.json').write_text(json.dumps([version]))
|
||||
with sqlite3.connect(directory / 'zp_index.sqlite') as conn:
|
||||
conn.execute('CREATE TABLE index_state (id INTEGER PRIMARY KEY, metadata_json TEXT)')
|
||||
conn.execute('INSERT INTO index_state VALUES (1,?)', (json.dumps(version),))
|
||||
state.durable_json(directory / state.VERSION_FILE, version)
|
||||
|
||||
|
||||
@pytest.fixture
|
||||
def publication(tmp_path, monkeypatch):
|
||||
data = tmp_path / 'data'; stage = data / '.sync-stage-test'
|
||||
old = {'version': 'old', 'git_revision': 'commit-old'}
|
||||
new = {'version': 'new', 'git_revision': 'commit-new'}
|
||||
snapshot(data, old); snapshot(stage, new)
|
||||
monkeypatch.setattr(sync, 'write_graph_transaction', lambda tx, payload, version: setattr(tx, 'version', version))
|
||||
monkeypatch.setattr(sync, 'graph_counts', lambda tx: ([('Person', 1)], [('HAS_DOCUMENT', 1)]))
|
||||
return data, stage, old, new, Session(old)
|
||||
|
||||
|
||||
def test_publish_makes_all_versions_agree(publication):
|
||||
data, stage, old, new, session = publication
|
||||
result = sync.publish_snapshot(data, stage, new, {}, session)
|
||||
assert result == {'nodes': 1, 'relationships': 1}
|
||||
assert state.read_version(data) == state.sqlite_version(data / 'zp_index.sqlite') == session.version == new
|
||||
with state.index_snapshot(data, db_file=data / 'zp_index.sqlite') as version:
|
||||
assert version == new
|
||||
assert not (data / state.PENDING_FILE).exists()
|
||||
|
||||
|
||||
def test_graph_write_failure_keeps_original_files_and_graph(publication, monkeypatch):
|
||||
data, stage, old, new, session = publication
|
||||
before = {name: (data / name).read_bytes() for name in sync.FILES}
|
||||
def fail(tx, payload, version):
|
||||
tx.version = new
|
||||
raise RuntimeError('failure halfway through graph write')
|
||||
monkeypatch.setattr(sync, 'write_graph_transaction', fail)
|
||||
with pytest.raises(RuntimeError, match='halfway'):
|
||||
sync.publish_snapshot(data, stage, new, {}, session)
|
||||
assert session.version == old
|
||||
assert before == {name: (data / name).read_bytes() for name in sync.FILES}
|
||||
assert not (data / state.PENDING_FILE).exists()
|
||||
|
||||
|
||||
def test_partial_file_publication_rolls_back_files_and_graph(publication, monkeypatch):
|
||||
data, stage, old, new, session = publication
|
||||
before = {name: (data / name).read_bytes() for name in sync.FILES}
|
||||
replace = sync.replace_file
|
||||
def fail(source, target):
|
||||
if target.name == 'zp_index.sqlite':
|
||||
raise OSError('disk write failed')
|
||||
replace(source, target)
|
||||
monkeypatch.setattr(sync, 'replace_file', fail)
|
||||
with pytest.raises(OSError, match='disk write'):
|
||||
sync.publish_snapshot(data, stage, new, {}, session)
|
||||
assert session.version == old
|
||||
assert before == {name: (data / name).read_bytes() for name in sync.FILES}
|
||||
assert not (data / state.PENDING_FILE).exists()
|
||||
|
||||
|
||||
def test_lost_commit_response_is_verified_before_restoring_any_files(publication):
|
||||
data, stage, old, new, session = publication
|
||||
session.fail_commit = 'response_lost'
|
||||
sync.publish_snapshot(data, stage, new, {}, session)
|
||||
assert session.version == state.sqlite_version(data / 'zp_index.sqlite') == new
|
||||
assert not (data / state.PENDING_FILE).exists()
|
||||
|
||||
|
||||
def test_unknown_commit_blocks_reads_until_next_successful_sync(publication):
|
||||
data, stage, old, new, session = publication
|
||||
session.fail_commit = 'unknown'
|
||||
with pytest.raises(ConnectionError):
|
||||
sync.publish_snapshot(data, stage, new, {}, session)
|
||||
assert (stage / 'previous/zp_index.sqlite').exists()
|
||||
with pytest.raises(state.IndexUnavailableError, match='nebola dokončená'):
|
||||
with state.index_snapshot(data):
|
||||
pytest.fail('Mixed generation must never be readable')
|
||||
session.unavailable = False; session.fail_commit = None
|
||||
repaired = {'version': 'repaired'}; next_stage = data / '.sync-stage-repaired'
|
||||
snapshot(next_stage, repaired)
|
||||
sync.publish_snapshot(data, next_stage, repaired, {}, session)
|
||||
assert session.version == state.sqlite_version(data / 'zp_index.sqlite') == state.read_version(data) == repaired
|
||||
assert not (data / state.PENDING_FILE).exists()
|
||||
|
||||
|
||||
def test_read_during_publication_is_unavailable(publication):
|
||||
data, *_ = publication
|
||||
with state.publication_lock(data, exclusive=True):
|
||||
with pytest.raises(state.IndexUnavailableError, match='aktivácia'):
|
||||
with state.index_snapshot(data):
|
||||
pytest.fail('Publication barrier bypassed')
|
||||
|
||||
|
||||
def test_reader_rejects_a_replaced_sqlite_database(publication):
|
||||
data, stage, old, new, session = publication
|
||||
state.durable_json(data / state.VERSION_FILE, new)
|
||||
with pytest.raises(state.IndexUnavailableError, match='SQLite'):
|
||||
with state.index_snapshot(data, db_file=data / 'zp_index.sqlite'):
|
||||
pass
|
||||
|
||||
|
||||
def test_staging_failure_never_touches_live_indices(tmp_path, monkeypatch):
|
||||
data = tmp_path / 'data'; snapshot(data, {'version': 'old'})
|
||||
before = {name: (data / name).read_bytes() for name in sync.FILES}
|
||||
def fail(wiki, stage):
|
||||
(stage / 'documents.json').write_text('new incomplete data')
|
||||
raise RuntimeError('embedding failed')
|
||||
monkeypatch.setattr(sync, 'prepare_snapshot', fail)
|
||||
with pytest.raises(RuntimeError, match='embedding failed'):
|
||||
sync.synchronize_indexes(tmp_path / 'wiki', data)
|
||||
assert before == {name: (data / name).read_bytes() for name in sync.FILES}
|
||||
assert not list(data.glob('.sync-stage-*'))
|
||||
|
||||
|
||||
def test_prepare_uses_one_frozen_source_and_records_versions(tmp_path, monkeypatch):
|
||||
import numpy as np
|
||||
import tools.rag.build_sqlite_index as indexer
|
||||
wiki = tmp_path / 'wiki'; page = wiki / 'pages/students/2020/eva/README.md'
|
||||
page.parent.mkdir(parents=True)
|
||||
page.write_text('---\ntitle: Eva Nová\npublished: true\ntaxonomy:\n category: [bp2024]\n---\n# Bakalárska práca 2024\n\nNázov: Overovanie synchronizácie indexov\n')
|
||||
monkeypatch.setattr(indexer, 'embed_passages', lambda texts: np.ones((len(texts), 4), dtype=np.float32))
|
||||
stage = tmp_path / 'stage'; stage.mkdir()
|
||||
version, counts, payload = sync.prepare_snapshot(wiki, stage)
|
||||
assert counts['documents'] == 1 and counts['chunks'] > 0
|
||||
assert version == state.sqlite_version(stage / 'zp_index.sqlite') == state.read_version(stage)
|
||||
assert version['documents_sha256'] == sync.digest(stage / 'documents.json')
|
||||
assert version['chunks_sha256'] == sync.digest(stage / 'chunks.json')
|
||||
assert payload['people'][0]['name'] == 'Eva Nová'
|
||||
assert payload['theses'][0]['year'] == 2024
|
||||
assert payload['documents'][0]['path'] == 'pages/students/2020/eva/README.md'
|
||||
|
||||
|
||||
def test_changed_source_is_not_activated(tmp_path, monkeypatch):
|
||||
import numpy as np
|
||||
import tools.rag.build_sqlite_index as indexer
|
||||
wiki = tmp_path / 'wiki'; page = wiki / 'pages/example/README.md'
|
||||
page.parent.mkdir(parents=True); page.write_text('---\ntitle: Source\n---\nInitial source text.')
|
||||
def embed(texts):
|
||||
page.write_text('Source changed during indexing.')
|
||||
return np.ones((len(texts), 4), dtype=np.float32)
|
||||
monkeypatch.setattr(indexer, 'embed_passages', embed)
|
||||
stage = tmp_path / 'stage'; stage.mkdir()
|
||||
with pytest.raises(RuntimeError, match='počas indexovania'):
|
||||
sync.prepare_snapshot(wiki, stage)
|
||||
|
||||
|
||||
def test_api_returns_503_while_publication_is_unresolved(tmp_path, monkeypatch):
|
||||
from fastapi.testclient import TestClient
|
||||
import app.main as main
|
||||
import app.routes as routes
|
||||
monkeypatch.setattr(main, 'embed_query', lambda q: None)
|
||||
for name, value in [('WEBHOOK_SECRET', 'w'), ('SEARCH_API_KEY', 'a'), ('SYNC_API_KEY', 's')]:
|
||||
monkeypatch.setenv(name, value * 64)
|
||||
data = tmp_path / 'data'; snapshot(data, {'version': 'old'})
|
||||
state.durable_json(data / state.PENDING_FILE, {'target_version': 'new'})
|
||||
monkeypatch.setattr(routes, 'DB_FILE', data / 'zp_index.sqlite')
|
||||
with TestClient(main.app) as client:
|
||||
response = client.post('/rag', json={'query': 'Aká práca?'},
|
||||
headers={'Authorization': 'Bearer ' + 'a' * 64})
|
||||
assert response.status_code == 503
|
||||
assert client.get('/health').json()['ready'] is False
|
||||
|
||||
|
||||
@pytest.mark.parametrize('endpoint', ['sync', 'webhook/gitea'])
|
||||
def test_sync_api_exposes_common_version_and_graph_counts(monkeypatch, endpoint):
|
||||
from fastapi.testclient import TestClient
|
||||
import app.main as main
|
||||
import app.routes as routes
|
||||
monkeypatch.setattr(main, 'embed_query', lambda q: None)
|
||||
for name, value in [('WEBHOOK_SECRET', 'w'), ('SEARCH_API_KEY', 'a'), ('SYNC_API_KEY', 's')]:
|
||||
monkeypatch.setenv(name, value * 64)
|
||||
monkeypatch.setenv('EXPECTED_GITEA_REPOSITORY', 'KEMT/zpwiki')
|
||||
monkeypatch.setenv('WEBHOOK_PULL_GIT', 'false')
|
||||
version = {'version': 'new', 'git_revision': 'commit'}
|
||||
monkeypatch.setattr(routes, 'rebuild_index', lambda **kwargs: {
|
||||
'duration_seconds': 0.1, 'counts': {'documents': 1}, 'index_version': version,
|
||||
'graph_counts': {'nodes': 2, 'relationships': 1}})
|
||||
with TestClient(main.app) as client:
|
||||
if endpoint == 'sync':
|
||||
response = client.post('/sync', json={}, headers={'X-API-Key': 's' * 64})
|
||||
else:
|
||||
body = json.dumps({'repository': {'full_name': 'KEMT/zpwiki'}}).encode()
|
||||
signature = hmac.new(('w' * 64).encode(), body, hashlib.sha256).hexdigest()
|
||||
response = client.post('/webhook/gitea', content=body,
|
||||
headers={'X-Gitea-Event': 'push', 'X-Gitea-Signature': signature, 'Content-Type': 'application/json'})
|
||||
assert response.status_code == 200
|
||||
assert response.json()['index_version'] == version
|
||||
assert response.json()['graph_counts'] == {'nodes': 2, 'relationships': 1}
|
||||
166
test/test_publication_health.py
Normal file
166
test/test_publication_health.py
Normal file
@ -0,0 +1,166 @@
|
||||
import json
|
||||
import sqlite3
|
||||
from types import SimpleNamespace
|
||||
|
||||
import numpy as np
|
||||
import pytest
|
||||
from fastapi.testclient import TestClient
|
||||
|
||||
import app.main as main
|
||||
import app.routes as routes
|
||||
import tools.tool_health as health
|
||||
import tools.rag.build_sqlite_index as indexer
|
||||
import tools.rag.search_core as search_core
|
||||
from tools.index_state import durable_json, PENDING_FILE, VERSION_FILE
|
||||
from tools.publication import PUBLICATION_POLICY_VERSION, effective_published
|
||||
from tools.rag.search_utils import search_database
|
||||
from tools.rag.rag_utils import build_rag_context
|
||||
|
||||
|
||||
@pytest.fixture
|
||||
def corpus(tmp_path, monkeypatch):
|
||||
docs = []; chunks = []
|
||||
paths = ['pages/students/2020/eva/README.md', 'pages/topics/missing/README.md',
|
||||
'pages/topics/hidden/README.md', 'pages/students/2020/eva/private/README.md']
|
||||
for index, (path, published) in enumerate(zip(paths, [True, None, False, False])):
|
||||
title = ['Verejný profil', 'Chýbajúca značka', 'Skrytý dokument', 'Skrytá poznámka'][index]
|
||||
text = 'spoločný overovací výraz ' + ('SKRYTY_OVEROVACI_OBSAH' if published is False else title)
|
||||
docs.append({'path': path, 'title': title, 'published': published})
|
||||
chunks.append({'chunk_id': path+'::0', 'document_path': path, 'title': title,
|
||||
'published': published, 'chunk_index': 0, 'heading_paths': [['Úvod']],
|
||||
'text': text, 'text_length': len(text), 'token_count': 10,
|
||||
'content_hash': str(index), 'tags': [], 'categories': []})
|
||||
data = tmp_path / 'data'; data.mkdir()
|
||||
for name, rows in [('documents.json', docs), ('chunks.json', chunks)]:
|
||||
(data/name).write_text(json.dumps(rows))
|
||||
monkeypatch.setattr(indexer, 'embed_passages', lambda texts: np.ones((len(texts), 4), dtype=np.float32))
|
||||
monkeypatch.setattr(search_core, 'embed_query', lambda *args, **kwargs: np.ones(4, dtype=np.float32))
|
||||
db = data / 'zp_index.sqlite'
|
||||
indexer.build_database(documents_file=data/'documents.json', chunks_file=data/'chunks.json', db_file=db)
|
||||
version = {'version': 'test-generation', 'publication_policy': PUBLICATION_POLICY_VERSION}
|
||||
with sqlite3.connect(db) as conn:
|
||||
conn.execute('CREATE TABLE index_state (id INTEGER PRIMARY KEY, metadata_json TEXT)')
|
||||
conn.execute('INSERT INTO index_state VALUES (1,?)', (json.dumps(version),))
|
||||
durable_json(data/VERSION_FILE, version)
|
||||
monkeypatch.setattr(routes, 'DB_FILE', db)
|
||||
monkeypatch.setattr(main, 'embed_query', lambda *args: None)
|
||||
return db, version, paths
|
||||
|
||||
|
||||
@pytest.mark.parametrize('value,visible', [(True, True), (None, True), (False, False)])
|
||||
def test_publication_policy(value, visible):
|
||||
assert effective_published(value) is visible
|
||||
|
||||
|
||||
def test_rag_default_filters_both_fts_and_vectors_but_keeps_null(corpus):
|
||||
db, _, paths = corpus
|
||||
result = search_database(db, 'spoločný overovací výraz', limit=10)
|
||||
assert {r['document_path'] for r in result['results']} == set(paths[:2])
|
||||
assert any(r['published'] is None for r in result['results'])
|
||||
all_rows = search_database(db, 'spoločný overovací výraz', limit=10, published_only=False)
|
||||
assert {r['document_path'] for r in all_rows['results']} == set(paths)
|
||||
|
||||
|
||||
@pytest.mark.parametrize('query', ['spoločný overovací výraz', 'Skrytý dokument', 'Skrytá poznámka'])
|
||||
def test_rag_expansions_do_not_reintroduce_hidden_text(corpus, query):
|
||||
db, _, paths = corpus
|
||||
result = build_rag_context(db, query, limit=10)
|
||||
assert all(s['document_path'] not in paths[2:] for s in result['sources'])
|
||||
assert 'SKRYTY_OVEROVACI_OBSAH' not in result['context']
|
||||
all_rows = build_rag_context(db, query, limit=10, published_only=False)
|
||||
assert 'SKRYTY_OVEROVACI_OBSAH' in all_rows['context']
|
||||
|
||||
|
||||
def healthy_graph(version):
|
||||
return health.readiness(True), health.readiness(True, index_version=version, nodes=2)
|
||||
|
||||
|
||||
def test_neo4j_outage_does_not_disable_rag(corpus, monkeypatch):
|
||||
_, _, paths = corpus
|
||||
monkeypatch.setattr(health, 'neo4j_readiness', lambda v: (
|
||||
health.readiness(False, 'unreachable'), health.readiness(False, 'neo4j_unavailable')))
|
||||
with TestClient(main.app) as client:
|
||||
payload = client.get('/health').json()
|
||||
assert payload['tools']['rag']['ready'] is True
|
||||
assert payload['tools']['neo4j']['ready'] is False
|
||||
assert payload['tools']['graphrag']['ready'] is False
|
||||
assert payload['ready'] is False
|
||||
response = client.post('/rag', json={'query': 'spoločný overovací výraz'},
|
||||
headers={'Authorization': 'Bearer '+'a'*64})
|
||||
assert response.status_code == 200
|
||||
assert {s['document_path'] for s in response.json()['sources']} == set(paths[:2])
|
||||
|
||||
|
||||
def test_rag_index_outage_does_not_disable_graph(corpus, monkeypatch):
|
||||
db, version, _ = corpus
|
||||
monkeypatch.setattr(health, 'neo4j_readiness', healthy_graph)
|
||||
db.unlink()
|
||||
with TestClient(main.app) as client:
|
||||
payload = client.get('/health').json()
|
||||
assert payload['tools']['rag']['ready'] is False
|
||||
assert payload['tools']['neo4j']['ready'] is True
|
||||
assert payload['tools']['graphrag']['ready'] is True
|
||||
assert payload['ready'] is False
|
||||
|
||||
|
||||
def test_pending_sync_blocks_both_tools_but_reports_neo4j_service(corpus, monkeypatch):
|
||||
db, _, _ = corpus
|
||||
durable_json(db.parent/PENDING_FILE, {'target_version': 'next'})
|
||||
monkeypatch.setattr(health, 'neo4j_readiness', healthy_graph)
|
||||
with TestClient(main.app) as client:
|
||||
tools = client.get('/health').json()['tools']
|
||||
assert tools['rag']['reason'] == tools['graphrag']['reason'] == 'snapshot_unavailable'
|
||||
assert tools['neo4j']['ready'] is True
|
||||
|
||||
|
||||
def test_embedding_startup_failure_and_successful_query_recovery(corpus, monkeypatch):
|
||||
monkeypatch.setattr(health, 'neo4j_readiness', healthy_graph)
|
||||
def broken(*args):
|
||||
raise RuntimeError('transient warmup failure')
|
||||
monkeypatch.setattr(main, 'embed_query', broken)
|
||||
with TestClient(main.app) as client:
|
||||
tools = client.get('/health').json()['tools']
|
||||
assert tools['rag']['reason'] == 'embedding_not_ready'
|
||||
assert tools['graphrag']['ready'] is True
|
||||
response = client.post('/rag', json={'query': 'spoločný overovací výraz'},
|
||||
headers={'Authorization': 'Bearer '+'a'*64})
|
||||
assert response.status_code == 200
|
||||
assert client.get('/health').json()['tools']['rag']['ready'] is True
|
||||
|
||||
|
||||
def test_neo4j_probe_is_bounded_and_does_not_expose_errors(monkeypatch):
|
||||
monkeypatch.setattr(health, 'get_neo4j_settings', lambda: SimpleNamespace(database='neo4j'))
|
||||
captured = {}
|
||||
def fail(settings, **options):
|
||||
captured.update(options)
|
||||
raise RuntimeError('password=never-return-this')
|
||||
monkeypatch.setattr(health, 'create_neo4j_driver', fail)
|
||||
result = health.neo4j_readiness(None)
|
||||
assert not result[0]['ready'] and not result[1]['ready']
|
||||
assert captured['connection_timeout'] == captured['connection_acquisition_timeout'] == 2.0
|
||||
assert captured['max_transaction_retry_time'] == 0
|
||||
assert 'never-return-this' not in json.dumps(result)
|
||||
|
||||
|
||||
@pytest.mark.parametrize('actual,nodes,reason', [
|
||||
({'version': 'different'}, 2, 'version_mismatch'),
|
||||
(None, 0, 'graph_empty'),
|
||||
({'version': 'old'}, 2, 'publication_sync_required'),
|
||||
])
|
||||
def test_connection_readiness_is_distinct_from_graph_readiness(monkeypatch, actual, nodes, reason):
|
||||
class Result:
|
||||
def single(self):
|
||||
return {'nodes': nodes, 'metadata': json.dumps(actual) if actual else None}
|
||||
class Connection:
|
||||
def __enter__(self): return self
|
||||
def __exit__(self, *args): pass
|
||||
def verify_connectivity(self): pass
|
||||
def session(self, **kwargs): return self
|
||||
def run(self, query, **params):
|
||||
assert query.timeout == 2.0
|
||||
return Result()
|
||||
monkeypatch.setattr(health, 'get_neo4j_settings', lambda: SimpleNamespace(database='neo4j'))
|
||||
monkeypatch.setattr(health, 'create_neo4j_driver', lambda *args, **kwargs: Connection())
|
||||
expected = {'version': 'expected'} if reason=='version_mismatch' else actual
|
||||
neo, graph = health.neo4j_readiness(expected)
|
||||
assert neo['ready'] is True and graph['ready'] is False and graph['reason']==reason
|
||||
36
test/test_rag_delivery.py
Normal file
36
test/test_rag_delivery.py
Normal file
@ -0,0 +1,36 @@
|
||||
import copy
|
||||
import pytest
|
||||
|
||||
from tools.answer_evaluation.rag_delivery import finalize_rag_answer
|
||||
|
||||
|
||||
def test_notice_is_rendered_without_changing_facts_or_raw_answer():
|
||||
original = {'answer': 'Eva má prácu z roku 2026.', 'context_issues': ['missing_incompleteness_notice'],
|
||||
'citations_ok': True, 'accepted_for_delivery': False}
|
||||
before = copy.deepcopy(original)
|
||||
out = finalize_rag_answer(original)
|
||||
assert original == before
|
||||
assert out['model_answer'] == before['answer']
|
||||
assert out['answer'] == 'Výpis je neúplný.\n\n' + before['answer']
|
||||
assert out['accepted_for_delivery'] and out['display_notice_added']
|
||||
assert not out['first_pass_accepted_for_delivery']
|
||||
assert finalize_rag_answer(out) == out
|
||||
|
||||
|
||||
@pytest.mark.parametrize('issues,citations_ok', [
|
||||
(['unsupported_exhaustive_statement', 'missing_incompleteness_notice'], True),
|
||||
(['missing_incompleteness_notice'], False),
|
||||
([], False)])
|
||||
def test_notice_never_bypasses_other_rejections(issues, citations_ok):
|
||||
original = {'answer': 'Úplný zoznam.', 'context_issues': issues,
|
||||
'citations_ok': citations_ok, 'accepted_for_delivery': False}
|
||||
out = finalize_rag_answer(original)
|
||||
assert not out['accepted_for_delivery'] and not out['display_notice_added']
|
||||
assert out['answer'] == original['answer']
|
||||
|
||||
|
||||
def test_complete_valid_answer_does_not_get_a_notice():
|
||||
original = {'answer': 'Eva.', 'context_issues': [], 'citations_ok': True, 'accepted_for_delivery': True}
|
||||
out = finalize_rag_answer(original)
|
||||
assert out['answer'] == original['answer'] and not out['display_notice_added']
|
||||
assert out['accepted_for_delivery']
|
||||
134
test/test_retrieval_contract.py
Normal file
134
test/test_retrieval_contract.py
Normal file
@ -0,0 +1,134 @@
|
||||
"""Contract tests use real SQLite retrieval and API boundaries, not an LLM."""
|
||||
import json
|
||||
|
||||
import numpy as np
|
||||
import pytest
|
||||
from fastapi.testclient import TestClient
|
||||
|
||||
import app.main as main
|
||||
import app.routes as routes
|
||||
import tools.rag.build_sqlite_index as indexer
|
||||
import tools.rag.search_core as core
|
||||
import tools.rag.search_utils as search
|
||||
from tools.rag.rag_utils import build_rag_context
|
||||
from tools.retrieval_contract import RetrievalResponse, error_result
|
||||
|
||||
|
||||
@pytest.fixture
|
||||
def index(tmp_path, monkeypatch):
|
||||
documents = []; chunks = []
|
||||
for number in range(3):
|
||||
path = f'pages/topics/item{number}/README.md'
|
||||
doc = {'path': path, 'title': f'Contract {number}', 'published': True}
|
||||
documents.append(doc)
|
||||
for part in range(2):
|
||||
chunks.append({'chunk_id': path+f'::{part}', 'document_path': path,
|
||||
'title': doc['title'], 'published': True, 'chunk_index': part,
|
||||
'text': f'spoločný výraz {number} úsek {part}', 'heading_paths': [],
|
||||
'tags': [], 'categories': []})
|
||||
for name, rows in [('documents.json', documents), ('chunks.json', chunks)]:
|
||||
(tmp_path/name).write_text(json.dumps(rows))
|
||||
monkeypatch.setattr(indexer, 'embed_passages', lambda texts: np.ones((len(texts),4), dtype=np.float32))
|
||||
monkeypatch.setattr(core, 'embed_query', lambda *args, **kwargs: np.ones(4, dtype=np.float32))
|
||||
db = tmp_path/'zp_index.sqlite'
|
||||
indexer.build_database(documents_file=tmp_path/'documents.json', chunks_file=tmp_path/'chunks.json', db_file=db)
|
||||
monkeypatch.setattr(routes, 'DB_FILE', db)
|
||||
return db
|
||||
|
||||
|
||||
def test_rag_limits_are_reported_and_rich_sources_preserved(index):
|
||||
raw = search.search_database(index, 'spoločný výraz', limit=2, max_per_document=1)
|
||||
assert raw['status'] == 'ok' and raw['truncated'] and raw['complete'] is False
|
||||
assert set(raw['truncation_reasons']) == {'result_limit','per_document_limit'}
|
||||
assert len(raw['sources']) == len(raw['results']) == 2
|
||||
rag = build_rag_context(index, 'spoločný výraz', limit=2)
|
||||
RetrievalResponse.model_validate(rag)
|
||||
assert rag['truncated'] and rag['complete'] is False and rag['reason'] is None
|
||||
assert rag['index_version'] is None
|
||||
assert len(rag['sources']) == rag['source_count']
|
||||
assert 'retrieval' in rag['sources'][0] and 'text' in rag['sources'][0]
|
||||
|
||||
|
||||
def test_candidate_cap_detected_by_extra_row(index, monkeypatch):
|
||||
monkeypatch.setattr(search, 'MIN_CANDIDATES', 1)
|
||||
monkeypatch.setattr(search, 'DEFAULT_CANDIDATE_MULTIPLIER', 1)
|
||||
result = search.search_database(index, 'spoločný výraz', limit=1)
|
||||
assert result['truncation_reasons'] == ['candidate_limit']
|
||||
assert result['complete'] is False and len(result['results']) == 1
|
||||
|
||||
|
||||
def test_ranked_rag_never_promises_exhaustive_answer(index):
|
||||
result = build_rag_context(index, 'spoločný výraz', limit=20, max_per_document=0)
|
||||
assert result['status']=='ok' and not result['truncated']
|
||||
assert result['complete'] is None
|
||||
|
||||
|
||||
def test_empty_rag_result_has_reason_and_null_version(index):
|
||||
result = build_rag_context(index, ' ')
|
||||
assert result['status']=='no_answer' and result['sources']==[]
|
||||
assert result['reason']=='empty_query' and result['index_version'] is None
|
||||
|
||||
|
||||
@pytest.mark.parametrize('path', ['/rag','/search'])
|
||||
def test_api_success_contains_common_fields(index, path):
|
||||
with TestClient(main.app) as client:
|
||||
response = client.post(path, json={'query':'spoločný výraz','limit':2},
|
||||
headers={'X-API-Key':'a'*64})
|
||||
assert response.status_code==200
|
||||
body = response.json()
|
||||
assert set(RetrievalResponse.model_fields) <= body.keys()
|
||||
RetrievalResponse.model_validate(body)
|
||||
assert body['status']=='ok' and body['sources'] and body['complete'] is False
|
||||
|
||||
|
||||
@pytest.mark.parametrize('path', ['/rag','/search'])
|
||||
@pytest.mark.parametrize('code,reason,error', [
|
||||
(400,'invalid_query',ValueError('PRIVATE_ERROR')),
|
||||
(503,'retrieval_unavailable',RuntimeError('PRIVATE_ERROR')),
|
||||
(500,'internal_error',TypeError('PRIVATE_ERROR')),
|
||||
])
|
||||
def test_api_errors_have_contract_and_preserve_http_status(index, monkeypatch, path, code, reason, error):
|
||||
def fail(*args, **kwargs):
|
||||
raise error
|
||||
monkeypatch.setattr(routes, 'build_rag_context' if path=='/rag' else 'search_database', fail)
|
||||
with TestClient(main.app) as client:
|
||||
response = client.post(path, json={'query':'test'}, headers={'X-API-Key':'a'*64})
|
||||
assert response.status_code==code
|
||||
body = response.json()
|
||||
assert body['status']=='error' and body['reason']==reason and body['sources']==[]
|
||||
assert body['complete'] is False and body['index_version'] is None
|
||||
assert 'PRIVATE_ERROR' not in response.text
|
||||
assert 'detail' in body
|
||||
|
||||
|
||||
@pytest.mark.parametrize('path', ['/rag','/search'])
|
||||
def test_auth_and_validation_errors_use_same_envelope(index, path):
|
||||
with TestClient(main.app) as client:
|
||||
unauthorized = client.post(path, json={'query':'test'})
|
||||
invalid = client.post(path, json={'query':'test','unknown':'PRIVATE_INPUT'},
|
||||
headers={'X-API-Key':'a'*64})
|
||||
assert unauthorized.status_code==401 and unauthorized.json()['reason']=='unauthorized'
|
||||
assert invalid.status_code==422 and invalid.json()['reason']=='invalid_request'
|
||||
assert 'PRIVATE_INPUT' not in invalid.text
|
||||
for response in [unauthorized,invalid]:
|
||||
assert set(RetrievalResponse.model_fields) <= response.json().keys()
|
||||
|
||||
|
||||
def test_error_factory_does_not_invent_sources_or_active_version():
|
||||
result = error_result(RuntimeError('password=PRIVATE'))
|
||||
assert result['status']=='error' and result['sources']==[] and result['index_version'] is None
|
||||
assert not result['truncated'] and result['complete'] is False
|
||||
assert 'PRIVATE' not in json.dumps(result)
|
||||
|
||||
|
||||
@pytest.mark.parametrize('path', ['/rag','/search'])
|
||||
def test_malformed_backend_output_still_has_safe_error_contract(index, monkeypatch, path):
|
||||
monkeypatch.setattr(routes, 'build_rag_context' if path=='/rag' else 'search_database',
|
||||
lambda *args, **kwargs: {'unexpected':'PRIVATE_BACKEND_OUTPUT'})
|
||||
with TestClient(main.app) as client:
|
||||
response = client.post(path, json={'query':'test'}, headers={'X-API-Key':'a'*64})
|
||||
assert response.status_code==500
|
||||
assert set(RetrievalResponse.model_fields) <= response.json().keys()
|
||||
assert response.json()['reason']=='internal_error' and response.json()['status']=='error'
|
||||
assert 'PRIVATE_BACKEND_OUTPUT' not in response.text
|
||||
assert response.headers['Cache-Control']=='no-store'
|
||||
112
tools/answer_evaluation/README.md
Normal file
112
tools/answer_evaluation/README.md
Normal file
@ -0,0 +1,112 @@
|
||||
# Generovanie odpovedí nad zmrazeným grafom
|
||||
|
||||
Aktuálne meranie **v7** používa 46 známych DEV otázok, nový query-group TEST
|
||||
80 otázok a oddelenú historickú regresiu 320 otázok.
|
||||
Model vracia štruktúrované tvrdenia, `answer` je prázdne. Aplikácia overí
|
||||
fakty, väzby, počty a citácie a vykreslí prirodzený text deterministicky.
|
||||
Voľná próza modelu sa ako finálna odpoveď nedoručuje. Pôvodné HTTP odpovede,
|
||||
parsované aj vykreslené odpovede a každý opravný pokus sú uložené.
|
||||
|
||||
Nový TEST má prvý pokus **77/80 (96,25 %)** a finálny výsledok **80/80**;
|
||||
jednu opravu potrebovali tri otázky. Historická regresia má 319/320,
|
||||
s jedným odmietnutým nepodloženým akademickým názvom. Nejde o meranie voľnej jazykovej
|
||||
formulácie ani neznámeho korpusu. Modelový DEV má 46/46.
|
||||
[Správa v7](../graphrag/evaluation/results/final_v7_2026-10-26/REPORT.md).
|
||||
|
||||
Všetky evaluačné vstupy treba zvoliť explicitne. Nový TEST používa
|
||||
`--split test`; známa regresia `--split regression --regression-ids ...`.
|
||||
Oba potrebujú dokončený `--dev-results` s rovnakými hashmi a modelom.
|
||||
Príkazy sú v [pracovnom zázname v7](../../docs/graphrag_v7_2026-10-26_worklog.md).
|
||||
Budúci OpenWebUI agent musí dodržať `accepted_for_delivery` a odovzdať
|
||||
overený text; nekontrolované prepísanie rendererovej odpovede by tieto
|
||||
záruky obišlo. Natívny výber nástrojov ostáva ďalším blokom.
|
||||
|
||||
## Historická v6
|
||||
|
||||
Meranie **v6** je historická regresia 320 známych otázok vrátane
|
||||
42 DEV otázok. [Výsledná správa](../graphrag/evaluation/results/final_v6_2026-10-25/REPORT.md)
|
||||
uvádza samostatne prvý pokus, výsledok po jednom povolenom opravnom požiadavku,
|
||||
odmietnuté odpovede a JSON chyby. Žiadna chyba sa nevynecháva z menovateľa.
|
||||
Finálny strict výsledok je **316/320 (98,75 %)**: tri neplatné JSON/schema
|
||||
výstupy a jedno prísne odmietnutie skloňovaného mena pri správnych claims.
|
||||
|
||||
Spoločný adaptér prenáša úplnosť, orezanie, dôvody aj verziu dát. Guard používa
|
||||
iba skutočný kontext; kontroluje všetky citované URL, typy hodnôt, ich väzby
|
||||
a upozornenie pri neúplnom výpise. Môže vyžiadať najviac jednu opravu spolu
|
||||
pre formát alebo porušenie kontextu. Gold sa používa až pri hodnotení.
|
||||
Oba evaluačné grafové vstupy používajú tento istý adaptér a guard.
|
||||
|
||||
`accepted_for_delivery=false` zakazuje považovať výstup za overenú odpoveď.
|
||||
Integrácia tejto kontroly do budúceho natívneho OpenWebUI agenta je súčasťou
|
||||
bodu 4; dnešné meranie grafu dodáva kontext cez lokálny klient.
|
||||
Klasický RAG pred doručením používa `finalize_rag_answer()`: môže pridať iba
|
||||
chýbajúce upozornenie na neúplnosť, bez zmeny faktov. Zachová pôvodný text
|
||||
modelu a neobíde nepovolené URL ani tvrdenie o úplnom zozname.
|
||||
|
||||
[Podrobný postup a príkazy](../../docs/graphrag_v6_2026-10-25_worklog.md).
|
||||
Skripty `check_context_scenarios`, `check_rag_runtime`, `check_deployment`
|
||||
a `regrade_citations` oddeľujú syntetické funkčné kontroly, živý RAG smoke,
|
||||
overenie nasadenia a prepočet historických citácií od hlavnej presnosti.
|
||||
|
||||
## Historická v5.1
|
||||
|
||||
Meranie **v5.1** je historická regresia. Výsledky sú v
|
||||
[spoločnej správe](../graphrag/evaluation/results/final_v5_1_2026-10-25/REPORT.md).
|
||||
Používa 39 vopred vybraných DEV otázok (20 pôvodných a 19 historických zlyhaní)
|
||||
a 320 finálnych regresných otázok vrátane týchto 39. Nejde o nezávislý holdout.
|
||||
|
||||
Generovanie overí odtlačky kódu/promptu/dát voči kompletnému DEV. Parser prijíma
|
||||
platný typovaný JSON alebo jeden úplný JSON blok. Pri chybe formátu je povolený
|
||||
najviac jeden opravný požiadavok bez gold; pôvodné aj opravné odpovede sa ukladajú.
|
||||
Vecné zlyhanie hodnotenia neopakuje požiadavok. Report uvádza prvotnú aj konečnú
|
||||
úspešnosť a počet opráv. Natívny výber OpenWebUI nástrojov zostáva bodom 4.
|
||||
|
||||
Reprodukcia potrebuje zodpovedajúci release checkout a graf, načítanú konfiguráciu
|
||||
a nové výstupné adresáre. Najprv spustite `--split dev` s
|
||||
`--dev-ids tools/graphrag/evaluation/results/v5_1_preparation/generation_dev_ids.json`,
|
||||
`--audit tools/graphrag/evaluation/results/v5_1_preparation/source_audit.json`
|
||||
a `--freeze-manifest tools/graphrag/evaluation/frozen_v5_1.json`.
|
||||
Finálny beh používa rovnaké parametre, `--split regression` a povinné
|
||||
`--dev-results` smerujúce na tento dokončený DEV. Historické výsledky sa neprepisujú.
|
||||
|
||||
## Historický protokol v4
|
||||
|
||||
Nasledujúci text a pôvodný TEST 300 otázok opisujú v4; jej reprodukcia vyžaduje
|
||||
pôvodný kód aj graf. Týchto 300 otázok je pri ďalšom ladení historickou regresiou.
|
||||
|
||||
Tento experiment meria OpenWebUI chat API po dodaní skutočného grafového
|
||||
kontextu lokálnym skriptom. Neoveruje prehliadač ani automatický výber
|
||||
nainštalovaných nástrojov hlavným agentom. Klasický RAG sa nemení.
|
||||
|
||||
Pôvodná diagnostika použila 20 otázok. Všetkých 20 sa stalo DEV; zostávajúcich
|
||||
300 otázok zo zmrazeného grafového benchmarku tvorí nový TEST generovania.
|
||||
Predchádzajúce interné grafové meranie neposkytlo výstupy jazykového modelu.
|
||||
Žiadne očakávania, zdrojový oracle ani výsledky evaluatora sa modelu neposielajú.
|
||||
|
||||
`graph_answer_prompt.txt` určuje výstup. Kontext obsahuje iba skutočné relevantné
|
||||
fakty a zdroje, bez mien profilov vydávaných za názov akademickej práce či typu
|
||||
osoby zamieňaného za taxonomickú kategóriu. Štruktúrované tvrdenia musia spájať
|
||||
správne fakty pri tej istej osobe/práci/dokumente. Kontrolujú sa aj zdrojové
|
||||
odkazy, množiny, počty a povinné hodnoty v prirodzenom texte. Nepovinné `null`
|
||||
znamená neprítomnosť tvrdenia. Označenie diplomovej práce za dizertačnú sa odmieta.
|
||||
|
||||
Ide o prísne, ale stále pravidlové hodnotenie. Nejde o úplnú sémantickú kontrolu
|
||||
každej možnej vety. Zdrojový oracle je nezávislý od grafového buildera, nie od
|
||||
človeka, ktorý by nezávisle anotoval celý test. Osoby, korpus a šablóny sú známe.
|
||||
|
||||
Každý nový výstupný adresár obsahuje deklaráciu pred meraním, SHA kódu/promptu,
|
||||
presné DEV/TEST ID a výsledky všetkých otázok. Odpovede sa ukladajú priebežne;
|
||||
chyba ani prerušený beh sa nesmie zatajiť či premenovať na nezávislý nový TEST.
|
||||
Po odhalení TEST výsledkov patria tieto otázky pri ladení do DEV.
|
||||
|
||||
```bash
|
||||
set -a
|
||||
source .env
|
||||
set +a
|
||||
# Reprodukcia používa vždy nový adresár; nejde o nový nezávislý TEST.
|
||||
python -m tools.answer_evaluation.evaluate_graph_answers \
|
||||
--split test --output-dir /tmp/graphrag-answers-reproduction
|
||||
```
|
||||
|
||||
Model je `model120-fast`; presný názov modelu vrátený serverom, tokeny a pôvodné
|
||||
odpovede sú uložené vo výsledkoch. Prístupový kľúč zostáva iba v prostredí.
|
||||
1
tools/answer_evaluation/__init__.py
Normal file
1
tools/answer_evaluation/__init__.py
Normal file
@ -0,0 +1 @@
|
||||
"""Answer-generation evaluation kept separate from the frozen graph retriever."""
|
||||
41
tools/answer_evaluation/answer_format.py
Normal file
41
tools/answer_evaluation/answer_format.py
Normal file
@ -0,0 +1,41 @@
|
||||
"""Validate JSON without inventing facts or repairing values from benchmark gold."""
|
||||
import json
|
||||
import re
|
||||
from typing import Literal
|
||||
from pydantic import BaseModel, ConfigDict
|
||||
|
||||
|
||||
class Claim(BaseModel):
|
||||
model_config = ConfigDict(extra='forbid', strict=True)
|
||||
person: str
|
||||
title: str | None = None
|
||||
year: int | None = None
|
||||
start_year: int | None = None
|
||||
keyword: str | None = None
|
||||
category: str | None = None
|
||||
document_author: str | None = None
|
||||
|
||||
|
||||
class Answer(BaseModel):
|
||||
model_config = ConfigDict(extra='forbid', strict=True)
|
||||
answer: str
|
||||
status: Literal['ok','no_answer','ambiguous','error']
|
||||
claims: list[Claim]
|
||||
source_urls: list[str]
|
||||
count: int | None = None
|
||||
|
||||
|
||||
def parse_answer(text: str) -> tuple[dict, bool]:
|
||||
try:
|
||||
data=json.loads(text.strip())
|
||||
normalized=False
|
||||
except json.JSONDecodeError:
|
||||
# Exactly one complete JSON fence can be unwrapped. Never replace quotes,
|
||||
# append missing braces, extract fragments or silently alter assertions.
|
||||
blocks=re.findall(r'```(?:json)?\s*\n([\s\S]*?)```',text,flags=re.IGNORECASE)
|
||||
if len(blocks)!=1:
|
||||
raise
|
||||
data=json.loads(blocks[0].strip())
|
||||
normalized=True
|
||||
parsed=Answer.model_validate(data)
|
||||
return parsed.model_dump(exclude_none=True),normalized
|
||||
99
tools/answer_evaluation/check_context_scenarios.py
Normal file
99
tools/answer_evaluation/check_context_scenarios.py
Normal file
@ -0,0 +1,99 @@
|
||||
"""Live synthetic functional checks; separate from corpus accuracy metrics."""
|
||||
import argparse
|
||||
import concurrent.futures
|
||||
import copy
|
||||
import json
|
||||
import os
|
||||
from pathlib import Path
|
||||
|
||||
from tools.rag.evaluation.rag_runner import request_json, OPENWEBUI_URL, DEFAULT_MODEL
|
||||
from tools.graphrag.evaluation.reproducibility import sha256_file
|
||||
from .checked_generation import generate_checked_answer
|
||||
from .context_policy import joined_candidates
|
||||
|
||||
HERE = Path(__file__).parent
|
||||
|
||||
|
||||
def scenarios():
|
||||
base = {'status': 'ok', 'reason': None, 'complete': True, 'truncated': False,
|
||||
'truncation_reasons': [], 'index_version': {'version': 'synthetic-functional-fixture'},
|
||||
'sources': [{'source_id': 'S1', 'document_path': 'a.md', 'source_url': 'https://example.test/a'}],
|
||||
'facts': [{'person': 'Eva Vzorová', 'title': 'Vyhľadávanie informácií', 'year': 2026,
|
||||
'document_path': 'a.md', 'source_url': 'https://example.test/a'}],
|
||||
'aggregation': None, 'answer_candidates': []}
|
||||
query = 'Uveď názov práce osoby Eva Vzorová a rok práce.'
|
||||
result = []
|
||||
for name, fields in [
|
||||
('complete', {}), ('incomplete_without_truncated', {'complete': False}),
|
||||
('truncated', {'complete': False, 'truncated': True, 'truncation_reasons': ['limit']}),
|
||||
('unknown_completeness', {'complete': None})]:
|
||||
context = copy.deepcopy(base); context.update(fields)
|
||||
result.append({'id': name, 'question': query, 'context': context,
|
||||
'expected': {'status': 'ok', 'claims': [{'person': 'Eva Vzorová',
|
||||
'title': 'Vyhľadávanie informácií', 'year': 2026}]}})
|
||||
context = copy.deepcopy(base)
|
||||
context.update(complete=False, truncated=True, truncation_reasons=['evidence_limit'],
|
||||
aggregation={'count': 2, 'complete': True})
|
||||
result.append({'id': 'exact_count_partial_evidence', 'question': 'Aký je počet vyhovujúcich osôb?',
|
||||
'context': context, 'expected': {'status': 'ok', 'count': 2}})
|
||||
context = copy.deepcopy(base)
|
||||
context['sources'].append({'source_id': 'S2', 'document_path': 'child.md', 'source_url': 'https://example.test/child'})
|
||||
context['facts'].append({'person': 'Eva Vzorová', 'keyword': 'python',
|
||||
'document_path': 'child.md', 'source_url': 'https://example.test/child'})
|
||||
context['answer_candidates'] = joined_candidates(context['facts'], {'mentions_title': True, 'mentions_keyword': True})
|
||||
result.append({'id': 'same_person_child_tag',
|
||||
'question': 'Uveď názov práce osoby Eva Vzorová v roku 2026 s kľúčovým slovom python.',
|
||||
'context': context, 'expected': {'status': 'ok', 'claims': [
|
||||
{'person': 'Eva Vzorová', 'title': 'Vyhľadávanie informácií', 'year': 2026, 'keyword': 'python'}]}})
|
||||
context = copy.deepcopy(context)
|
||||
context['facts'][0].pop('title')
|
||||
context['answer_candidates'] = joined_candidates(context['facts'], {'years': [2026], 'mentions_keyword': True})
|
||||
result.append({'id': 'same_person_year_child_tag',
|
||||
'question': 'Ktorá osoba spĺňa kľúčové slovo python a rok práce 2026?',
|
||||
'context': context, 'expected': {'status': 'ok', 'claims': [
|
||||
{'person': 'Eva Vzorová', 'year': 2026, 'keyword': 'python'}]}})
|
||||
result.append({'id': 'type_is_not_keyword', 'question': 'Uveď názov diplomového projektu osoby Eva Vzorová a rok.',
|
||||
'context': copy.deepcopy(base), 'expected': {'status': 'ok', 'no_keyword': True}})
|
||||
context = copy.deepcopy(base)
|
||||
context.update(status='no_answer', reason='unknown_person', facts=[], sources=[])
|
||||
result.append({'id': 'no_answer', 'question': 'Akú prácu má Neexistujúca Osoba?',
|
||||
'context': context, 'expected': {'status': 'no_answer'}})
|
||||
return result
|
||||
|
||||
|
||||
def main():
|
||||
parser = argparse.ArgumentParser(description=__doc__)
|
||||
parser.add_argument('--output', type=Path, required=True)
|
||||
args = parser.parse_args()
|
||||
if args.output.exists():
|
||||
parser.error('Refusing to overwrite results.')
|
||||
files = [Path(__file__), HERE/'graph_answer_prompt.txt', HERE/'context_policy.py', HERE/'checked_generation.py', HERE/'answer_format.py', HERE/'render_answer.py']
|
||||
hashes = {str(p): sha256_file(p) for p in files}
|
||||
declared = scenarios()
|
||||
args.output.parent.mkdir(parents=True, exist_ok=True)
|
||||
args.output.with_suffix('.declaration.json').write_text(json.dumps(
|
||||
{'method': __doc__, 'model': DEFAULT_MODEL, 'hashes': hashes, 'scenarios': declared}, ensure_ascii=False, indent=2)+'\n')
|
||||
prompt = (HERE/'graph_answer_prompt.txt').read_text()
|
||||
def run(case):
|
||||
def complete(messages):
|
||||
return request_json(OPENWEBUI_URL, method='POST', timeout=90, max_attempts=2,
|
||||
headers={'Authorization': 'Bearer '+os.environ['OPENWEBUI_API_KEY'], 'Content-Type': 'application/json'},
|
||||
payload={'model': DEFAULT_MODEL, 'temperature': 0, 'stream': False,
|
||||
'response_format': {'type': 'json_object'}, 'messages': messages})
|
||||
out = generate_checked_answer(case['question'], case['context'], prompt, complete)
|
||||
answer = out.get('answer', {}); expected = case['expected']
|
||||
ok = answer.get('status') == expected['status']
|
||||
for binding in expected.get('claims', []):
|
||||
ok &= any(all(claim.get(k) == v for k, v in binding.items()) for claim in answer.get('claims', []))
|
||||
if 'count' in expected: ok &= answer.get('count') == expected['count']
|
||||
if expected.get('no_keyword'): ok &= not any(c.get('keyword') for c in answer.get('claims', []))
|
||||
return {'id': case['id'], **out, 'passed': bool(ok and out['accepted_for_delivery'])}
|
||||
with concurrent.futures.ThreadPoolExecutor(max_workers=3) as executor:
|
||||
rows = list(executor.map(run, declared))
|
||||
assert hashes == {str(p): sha256_file(p) for p in files}
|
||||
output = {'method': __doc__, 'questions': rows, 'summary': {'total': len(rows), 'passed': sum(r['passed'] for r in rows)}}
|
||||
args.output.write_text(json.dumps(output, ensure_ascii=False, indent=2)+'\n')
|
||||
print(json.dumps(output['summary']))
|
||||
|
||||
|
||||
if __name__ == '__main__': main()
|
||||
89
tools/answer_evaluation/check_deployment.py
Normal file
89
tools/answer_evaluation/check_deployment.py
Normal file
@ -0,0 +1,89 @@
|
||||
"""Verify the running API and graph library against a frozen release."""
|
||||
import argparse
|
||||
import json
|
||||
import os
|
||||
import platform
|
||||
from datetime import datetime, timezone
|
||||
from pathlib import Path
|
||||
from importlib.metadata import version as package_version
|
||||
|
||||
from tools.rag.evaluation.rag_runner import request_json
|
||||
from tools.graphrag.graph_db import create_neo4j_driver
|
||||
from tools.graphrag.graph_search import search_graph
|
||||
from tools.graphrag.build_graphrag import graph_version
|
||||
from tools.graphrag.evaluation.reproducibility import graph_fingerprint, run_metadata, verify_freeze, sha256_file
|
||||
from tools.index_state import read_version, sqlite_version
|
||||
from tools.rag.common import DB_FILE
|
||||
|
||||
|
||||
def main():
|
||||
parser = argparse.ArgumentParser(description=__doc__)
|
||||
parser.add_argument('--output', type=Path, required=True)
|
||||
parser.add_argument('--questions', type=Path, required=True)
|
||||
parser.add_argument('--audit', type=Path, required=True)
|
||||
parser.add_argument('--freeze-manifest', type=Path, required=True)
|
||||
parser.add_argument('--release-manifest', type=Path)
|
||||
args = parser.parse_args()
|
||||
if args.output.exists(): parser.error('Refusing to overwrite deployment verification.')
|
||||
base = Path('tools/graphrag/evaluation')
|
||||
release_path = args.release_manifest
|
||||
release_match = None
|
||||
if release_path is not None:
|
||||
release = json.loads(release_path.read_text())
|
||||
for path, digest in release['runtime_files'].items():
|
||||
assert sha256_file(Path(path)) == digest, f'Release code mismatch: {path}'
|
||||
assert sha256_file(args.freeze_manifest) == release['graph_freeze_sha256']
|
||||
release_match = True
|
||||
freeze = json.loads(args.freeze_manifest.read_text())
|
||||
health = request_json('http://localhost:8000/health')
|
||||
assert health['ready'] and all(v['ready'] for v in health['tools'].values())
|
||||
with create_neo4j_driver() as driver, driver.session() as session:
|
||||
graph = graph_fingerprint(session)
|
||||
verify_freeze(freeze, run_metadata(args.questions), graph,
|
||||
audit=args.audit, **freeze['parameters'])
|
||||
current = read_version(Path('data'))
|
||||
assert current == sqlite_version(DB_FILE) == graph_version(session) == health['index_version']
|
||||
documents = session.run('MATCH (d:Document {graph_scope:"zpwiki"}) RETURN d.path AS path, d.published AS published').data()
|
||||
headers = {'X-API-Key': os.environ['SEARCH_API_KEY'], 'Content-Type': 'application/json'}
|
||||
rag = request_json('http://localhost:8000/rag', method='POST', headers=headers,
|
||||
payload={'query': 'Aký je názov práce osoby Ján Holp a rok práce?', 'limit': 5}, timeout=120)
|
||||
assert rag['status'] == 'ok' and rag['sources'] and rag['index_version'] == current
|
||||
coverage = json.loads(rag['context'].splitlines()[1])
|
||||
assert coverage == {k: rag[k] for k in ['complete', 'truncated', 'truncation_reasons', 'index_version']}
|
||||
cases = {}
|
||||
for id, question, expected in [
|
||||
('known_title', 'Aký je názov práce osoby Ján Holp a rok práce?', 'ok'),
|
||||
('generic_label_not_title', 'Uveď názov práce osoby Dárius Lindvai v roku 2019 s kľúčovým slovom python.', 'no_answer'),
|
||||
('unknown_person', 'Akú prácu má osoba Jozef Neznámy Overovací?', 'no_answer'),
|
||||
('outside_century', 'Aký je názov práce osoby Ján Holp v roku 1999?', 'no_answer'),
|
||||
('unsupported_year', 'Aký je názov práce osoby Ján Holp v roku 10000?', 'no_answer'),
|
||||
('unknown_start', 'Aký je rok začiatku štúdia osoby Tomáš Kuchárik?', 'no_answer')]:
|
||||
result = search_graph(question)
|
||||
assert result['status'] == expected and result['index_version'] == current
|
||||
cases[id] = {'status': result['status'], 'reason': result['reason'], 'complete': result['complete']}
|
||||
hidden = {row['path'] for row in documents if row['published'] is False}
|
||||
raw_documents = json.loads(Path('data/documents.json').read_text())
|
||||
missing = sum(row['published'] is None for row in raw_documents)
|
||||
assert len(hidden) == 1 and missing == 16
|
||||
assert {row['path']: row['published'] for row in documents} == {
|
||||
row['path']: row['published'] is not False for row in raw_documents}
|
||||
hidden_rag = request_json('http://localhost:8000/rag', method='POST', headers=headers,
|
||||
payload={'query': 'Tvorba nezodpovedateľných otázok', 'limit': 5}, timeout=120)
|
||||
assert not hidden & {s['document_path'] for s in hidden_rag['sources']}
|
||||
result = {'checked_at_utc': datetime.now(timezone.utc).isoformat(), 'health': health,
|
||||
'index_version': current, 'frozen_implementation_inputs_and_graph_match': True,
|
||||
'graph': graph, 'graph_cases': cases, 'rag_live_query': 'ok',
|
||||
'release_code_match': release_match,
|
||||
'rag_context_metadata_matches_contract': True,
|
||||
'publication': {'documents': len(documents), 'explicit_false': len(hidden),
|
||||
'missing_included': missing, 'visible_by_policy': len(documents)-len(hidden),
|
||||
'hidden_document_absent_from_rag': True},
|
||||
'runtime': {'python': platform.python_version(), **{p: package_version(p) for p in
|
||||
['fastapi', 'pydantic', 'neo4j', 'sentence-transformers', 'torch']}},
|
||||
'scope': 'RAG HTTP API plus GraphRAG library/CLI; native OpenWebUI graph-tool routing is point 4.'}
|
||||
args.output.parent.mkdir(parents=True, exist_ok=True)
|
||||
args.output.write_text(json.dumps(result, ensure_ascii=False, indent=2)+'\n')
|
||||
print(json.dumps({'ready': True, 'version': current['version'], 'graph_cases': cases}))
|
||||
|
||||
|
||||
if __name__ == '__main__': main()
|
||||
49
tools/answer_evaluation/check_rag_runtime.py
Normal file
49
tools/answer_evaluation/check_rag_runtime.py
Normal file
@ -0,0 +1,49 @@
|
||||
"""Five preselected historical RAG smoke cases; not a new accuracy estimate."""
|
||||
import argparse
|
||||
import concurrent.futures
|
||||
import json
|
||||
import os
|
||||
from pathlib import Path
|
||||
|
||||
from tools.rag.evaluation.rag_runner import build_rag_tool, request_json, run_question, LOCAL_OPENAPI_URL, DEFAULT_MODEL
|
||||
from tools.rag.evaluation.rag_metrics import evaluate_answer
|
||||
from tools.graphrag.evaluation.reproducibility import sha256_file
|
||||
from .rag_delivery import finalize_rag_answer
|
||||
|
||||
|
||||
def main():
|
||||
parser = argparse.ArgumentParser(description=__doc__)
|
||||
parser.add_argument('--output', type=Path, required=True)
|
||||
args = parser.parse_args()
|
||||
if args.output.exists(): parser.error('Refusing to overwrite smoke results.')
|
||||
source = Path('tools/rag/evaluation/results/test_classic_rag_frozen/rag_answers_test.json')
|
||||
historic = json.loads(source.read_text())['results']
|
||||
selected = ['q0053', 'q0060', 'q0608', 'q1147', 'q0888']
|
||||
cases = [next(row for row in historic if row['id'] == id) for id in selected]
|
||||
operation, tool = build_rag_tool(request_json(LOCAL_OPENAPI_URL))
|
||||
metadata = {'method': __doc__, 'selected_ids': selected, 'model': DEFAULT_MODEL,
|
||||
'source_file': str(source), 'source_sha256': sha256_file(source),
|
||||
'generation_files': {str(p): sha256_file(p) for p in [Path(__file__),
|
||||
Path('tools/rag/evaluation/rag_runner.py'), Path('tools/rag/evaluation/rag_metrics.py'),
|
||||
Path('tools/answer_evaluation/context_policy.py'), Path('tools/answer_evaluation/rag_delivery.py')]}}
|
||||
args.output.parent.mkdir(parents=True, exist_ok=True)
|
||||
args.output.with_suffix('.declaration.json').write_text(json.dumps(metadata, ensure_ascii=False, indent=2)+'\n')
|
||||
def run(case):
|
||||
out = run_question(case['question'], model=DEFAULT_MODEL, operation_id=operation,
|
||||
rag_tool=tool, openwebui_api_key=os.environ['OPENWEBUI_API_KEY'],
|
||||
search_api_key=os.environ['SEARCH_API_KEY'], timeout=120, max_attempts=2)
|
||||
out = finalize_rag_answer(out)
|
||||
score = evaluate_answer(case, out['answer'], tool_called=out['tool_called'],
|
||||
allowed_source_urls=out['rag_source_urls'])
|
||||
return {'id': case['id'], 'question': case['question'], **out, **score,
|
||||
'strict_pass': bool(score['strict_pass'] and out['accepted_for_delivery'])}
|
||||
with concurrent.futures.ThreadPoolExecutor(max_workers=2) as executor:
|
||||
rows = list(executor.map(run, cases))
|
||||
assert metadata['generation_files'] == {p: sha256_file(Path(p)) for p in metadata['generation_files']}
|
||||
result = {'configuration': metadata, 'results': rows,
|
||||
'summary': {'questions': len(rows), 'strict_pass': sum(row['strict_pass'] for row in rows)}}
|
||||
args.output.write_text(json.dumps(result, ensure_ascii=False, indent=2)+'\n')
|
||||
print(json.dumps(result['summary']))
|
||||
|
||||
|
||||
if __name__ == '__main__': main()
|
||||
56
tools/answer_evaluation/checked_generation.py
Normal file
56
tools/answer_evaluation/checked_generation.py
Normal file
@ -0,0 +1,56 @@
|
||||
"""One bounded corrective request based solely on retrieval evidence."""
|
||||
import json
|
||||
from .answer_format import parse_answer, Answer
|
||||
from .context_policy import answer_context_issues
|
||||
from .render_answer import render_graph_answer
|
||||
|
||||
|
||||
def generate_checked_answer(question: str, context: dict, prompt: str, complete) -> dict:
|
||||
messages=[{'role':'system','content':prompt},{'role':'user','content':json.dumps(
|
||||
{'question':question,'graph_context':context},ensure_ascii=False)}]
|
||||
result={'attempts':[],'accepted_for_delivery':False}
|
||||
for number in range(2):
|
||||
record={};text=''
|
||||
try:
|
||||
response=complete(messages)
|
||||
result['response']=response;record['response']=response
|
||||
text=response['choices'][0]['message']['content'].strip()
|
||||
except Exception as error:
|
||||
result['error']=f'{type(error).__name__}: {str(error)[:500]}'
|
||||
result['attempts'].append(record)
|
||||
return result
|
||||
result['attempts'].append(record)
|
||||
try:
|
||||
answer,normalized=parse_answer(text)
|
||||
record['answer']=answer;record['format_normalized']=normalized
|
||||
except (ValueError,TypeError) as error:
|
||||
record['format_error']=type(error).__name__
|
||||
if number==1:
|
||||
result['error']='InvalidAnswerFormat: two invalid JSON/schema responses'
|
||||
return result
|
||||
feedback='Vráť jediný platný JSON objekt podľa schémy, bez zmeny faktov z pôvodného kontextu. Schéma: '+json.dumps(Answer.model_json_schema(),ensure_ascii=False)
|
||||
else:
|
||||
issues=answer_context_issues(answer,context,check_text=False)
|
||||
record['context_issues']=issues
|
||||
result['answer']=answer
|
||||
if not issues:
|
||||
rendered = render_graph_answer(answer, context)
|
||||
delivery_issues = answer_context_issues(rendered, context)
|
||||
if delivery_issues:
|
||||
issues = delivery_issues
|
||||
record['context_issues'] = issues
|
||||
else:
|
||||
record['rendered_answer'] = rendered
|
||||
result['model_answer'] = answer
|
||||
result['answer'] = rendered
|
||||
result['accepted_for_delivery']=True
|
||||
return result
|
||||
if number==1:
|
||||
result['context_rejected']=True
|
||||
return result
|
||||
feedback=('Odpoveď porušila pravidlá dodaného kontextu: '+', '.join(issues)+'. '
|
||||
'Oprav jediný JSON objekt výhradne z pôvodných podkladov. Použi iba source_urls zo sources. '
|
||||
'Typ práce nie je keyword. answer_candidates dokladajú spojenie požadovaného názvu alebo roku a tagu cez tú istú osobu. '
|
||||
'Answer ponechaj prázdny; text aj upozornenie zostaví aplikácia.')
|
||||
messages += [{'role':'assistant','content':text},{'role':'user','content':feedback}]
|
||||
return result
|
||||
189
tools/answer_evaluation/context_policy.py
Normal file
189
tools/answer_evaluation/context_policy.py
Normal file
@ -0,0 +1,189 @@
|
||||
"""Answer guards using only actual retrieval context; no benchmark or oracle."""
|
||||
from __future__ import annotations
|
||||
|
||||
import re
|
||||
from html import unescape
|
||||
from html.parser import HTMLParser
|
||||
import unicodedata
|
||||
|
||||
|
||||
def normalized(value) -> str:
|
||||
text=unicodedata.normalize('NFKD',str(value or ''))
|
||||
return ' '.join(re.findall(r'[a-z0-9]+',''.join(c for c in text if not unicodedata.combining(c)).casefold()))
|
||||
|
||||
|
||||
class _HTMLLinks(HTMLParser):
|
||||
def __init__(self):
|
||||
super().__init__(convert_charrefs=True)
|
||||
self.links = set()
|
||||
|
||||
def handle_starttag(self, tag, attrs):
|
||||
self.links.update(value for key, value in attrs if key in {'href', 'src'} and value)
|
||||
|
||||
|
||||
def text_urls(text: str) -> set[str]:
|
||||
"""Inspect absolute, inline, reference-style Markdown and HTML links."""
|
||||
text = unescape(text)
|
||||
urls = set()
|
||||
for url in re.findall(r'(?:[a-zA-Z][a-zA-Z0-9+.-]*://|www\.)[^\s<>"\x27`“”„«»‘’\]]+', text):
|
||||
url = url.rstrip('.,;:!?')
|
||||
while url.endswith(')') and url.count(')') > url.count('('):
|
||||
url = url[:-1]
|
||||
urls.add(url)
|
||||
for match in re.finditer(r'\]\(\s*', text):
|
||||
tail = text[match.end():]
|
||||
if tail.startswith('<'):
|
||||
urls.add(tail[1:].split('>', 1)[0]); continue
|
||||
level = 0; end = 0
|
||||
for end, char in enumerate(tail):
|
||||
if char.isspace() or (char == ')' and level == 0): break
|
||||
if char == '(': level += 1
|
||||
if char == ')': level -= 1
|
||||
else:
|
||||
end = len(tail)
|
||||
if tail[:end]: urls.add(tail[:end])
|
||||
for match in re.finditer(r'^\s{0,3}\[[^]\n]+\]:\s*(?:<([^>]+)>|(\S+))', text, flags=re.M):
|
||||
urls.add(match[1] or match[2])
|
||||
parser = _HTMLLinks(); parser.feed(text)
|
||||
return urls | parser.links
|
||||
|
||||
|
||||
def citation_check(answer: dict, allowed: set[str]) -> dict:
|
||||
declared=answer.get('source_urls',[])
|
||||
if not isinstance(declared,list) or any(not isinstance(url,str) for url in declared):
|
||||
return {'citations_ok':False,'unsupported_urls':[],'reason':'invalid_source_urls'}
|
||||
used=set(declared)|text_urls(str(answer.get('answer','')))
|
||||
unsupported=sorted(used-allowed)
|
||||
return {'citations_ok':not unsupported,'unsupported_urls':unsupported}
|
||||
|
||||
|
||||
def allowed_urls(context: dict) -> set[str]:
|
||||
return {row['source_url'] for row in context.get('sources',[]) if row.get('source_url')}
|
||||
|
||||
|
||||
def joined_candidates(facts: list[dict], intent: dict) -> list[dict]:
|
||||
"""Join requested academic fields and tag by person, retaining real sources."""
|
||||
needs_title = intent.get('mentions_title')
|
||||
needs_year = intent.get('mentions_academic_year') or intent.get('years')
|
||||
if not (needs_title or needs_year) or not (intent.get('mentions_keyword') or intent.get('keyword_phrase')):
|
||||
return []
|
||||
result=[]
|
||||
for record in facts:
|
||||
if (needs_title and not record.get('title')) or (not needs_title and record.get('year') is None):
|
||||
continue
|
||||
for tag in facts:
|
||||
if normalized(tag.get('person'))!=normalized(record.get('person')) or not tag.get('keyword'):
|
||||
continue
|
||||
fields = ['person', 'title', 'year'] if needs_title else ['person', 'year']
|
||||
candidate={k:record[k] for k in fields if record.get(k) is not None}
|
||||
candidate['keyword']=tag['keyword']
|
||||
candidate['evidence_documents']=sorted({p for p in [record.get('document_path'),tag.get('document_path')] if p})
|
||||
candidate['source_urls']=sorted({u for u in [record.get('source_url'),tag.get('source_url')] if u})
|
||||
if candidate not in result:result.append(candidate)
|
||||
return result
|
||||
|
||||
|
||||
def coverage_issues(answer: dict, context: dict) -> list[str]:
|
||||
incomplete = context.get('truncated') is True or context.get('complete') is False
|
||||
unknown = context.get('complete') is None
|
||||
clauses = [normalized(part) for part in re.split(r'[.!?;\n]+', answer.get('answer', ''))]
|
||||
caveat = any(re.search(r'(?:vypis|zoznam|vysled\w*|dokazy) (?:je |su |nie je |nie su )?(?:neupln\w*|orezan\w*)'
|
||||
r'|nie (?:je|su) (?:to )?upln\w*|nemozno zarucit uplnost|nemusi byt upln', clause)
|
||||
for clause in clauses)
|
||||
issues = []
|
||||
if incomplete and answer.get('status') == 'ok' and not caveat:
|
||||
issues.append('missing_incompleteness_notice')
|
||||
if incomplete or unknown:
|
||||
for clause in clauses:
|
||||
for match in re.finditer(r'(?:upln\w*|kompletn\w*) (?:zoznam|vypis|prehlad)'
|
||||
r'|vset(?:ci|ky|kych) (?:student\w*|osob\w*|prac\w*)', clause):
|
||||
prefix = clause[:match.start()]
|
||||
# Negation must qualify this particular assertion. A caveat in
|
||||
# another sentence never licenses a positive exhaustive claim.
|
||||
if not re.search(r'(?:nie (?:je|su)(?: to)?|nejde o|neuvadzam|'
|
||||
r'nemozno (?:zarucit|uviest)|nemozem (?:zarucit|poskytnut))\s*$', prefix):
|
||||
issues.append('unsupported_exhaustive_statement')
|
||||
return list(dict.fromkeys(issues))
|
||||
|
||||
|
||||
def prose_issues(answer: dict) -> list[str]:
|
||||
"""Conservative numeric consistency check; final prose is rendered from claims."""
|
||||
text = str(answer.get('answer', ''))
|
||||
for url in sorted(text_urls(text), key=len, reverse=True):
|
||||
text = text.replace(url, '')
|
||||
allowed_numbers = set()
|
||||
for claim in answer.get('claims', []):
|
||||
for key, value in claim.items():
|
||||
if value is None: continue
|
||||
if key in {'year', 'start_year'}: allowed_numbers.add(str(value))
|
||||
else: text = re.sub(re.escape(str(value)), '', text, flags=re.I)
|
||||
if answer.get('count') is not None: allowed_numbers.add(str(answer['count']))
|
||||
unsupported = set(re.findall(r'\b\d+\b', text)) - allowed_numbers
|
||||
return ['unsupported_prose_number'] if unsupported else []
|
||||
|
||||
|
||||
def text_contains_value(text: str, value: str, *, person: bool = False) -> bool:
|
||||
value = normalized(value); text = normalized(text)
|
||||
if not person: return value in text
|
||||
suffix = r'(?:a|u|ovi|om|e|ou|y|ovej|oveho|ym|emu)?'
|
||||
pattern = r'\b' + r'\s+'.join(re.escape(token) + (suffix if token.isalpha() else '')
|
||||
for token in value.split()) + r'\b'
|
||||
return bool(re.search(pattern, text))
|
||||
|
||||
|
||||
def answer_context_issues(answer: dict, context: dict, *, check_text: bool = True) -> list[str]:
|
||||
issues=[]
|
||||
if not citation_check(answer,allowed_urls(context))['citations_ok']:
|
||||
issues.append('unsupported_citation')
|
||||
facts=context.get('facts',[])
|
||||
aggregation=context.get('aggregation') or {}
|
||||
if answer.get('count') is not None:
|
||||
if aggregation.get('complete') is not True:
|
||||
issues.append('unsupported_total_count')
|
||||
elif answer['count']!=aggregation.get('count'):
|
||||
issues.append('incorrect_context_count')
|
||||
claims = answer.get('claims', [])
|
||||
cited = set(answer.get('source_urls', []))
|
||||
if answer.get('status') == 'ok' and facts and not claims:
|
||||
issues.append('missing_required_claims')
|
||||
if claims and not cited:
|
||||
issues.append('missing_required_citations')
|
||||
if answer.get('status') == 'no_answer' and claims:
|
||||
issues.append('claims_on_no_answer')
|
||||
if check_text and not str(answer.get('answer', '')).strip():
|
||||
issues.append('empty_answer_text')
|
||||
for claim in answer.get('claims',[]):
|
||||
person=normalized(claim.get('person'))
|
||||
rows=[f for f in facts if normalized(f.get('person'))==person]
|
||||
if not rows:
|
||||
issues.append('unsupported_person');continue
|
||||
for key in ['keyword','category','document_author','start_year']:
|
||||
if claim.get(key) is not None and not any(normalized(row.get(key))==normalized(claim[key]) for row in rows):
|
||||
issues.append('unsupported_'+key)
|
||||
for key in ['title', 'year', 'start_year', 'keyword', 'category', 'document_author']:
|
||||
if claim.get(key) is None: continue
|
||||
evidence = {row.get('source_url') for row in rows
|
||||
if normalized(row.get(key)) == normalized(claim[key]) and row.get('source_url')}
|
||||
if evidence and not evidence & cited:
|
||||
issues.append('missing_claim_source')
|
||||
academic={k:claim[k] for k in ['title','year'] if claim.get(k) is not None}
|
||||
if academic and not any(all(normalized(row.get(k))==normalized(v) for k,v in academic.items()) for row in rows):
|
||||
issues.append('unsupported_academic_binding')
|
||||
if claim.get('category') is not None and claim.get('document_author') is not None:
|
||||
if not any(a.get('document_path') and a.get('document_path')==b.get('document_path')
|
||||
for a in rows if normalized(a.get('category'))==normalized(claim['category'])
|
||||
for b in rows if normalized(b.get('document_author'))==normalized(claim['document_author'])):
|
||||
issues.append('disconnected_author_category')
|
||||
candidates=context.get('answer_candidates',[])
|
||||
if context.get('status')=='ok' and candidates:
|
||||
if answer.get('status')=='no_answer':
|
||||
issues.append('rejected_supported_person_join')
|
||||
elif not all(any(all(normalized(claim.get(k))==normalized(candidate[k]) for k in ['person','title','year','keyword'] if k in candidate)
|
||||
for claim in answer.get('claims',[])) for candidate in candidates):
|
||||
issues.append('split_or_missing_person_join')
|
||||
if context.get('status') in {'no_answer','ambiguous','error'} and answer.get('status')=='ok':
|
||||
issues.append('unsupported_positive_status')
|
||||
issues.extend(prose_issues(answer))
|
||||
if check_text or str(answer.get('answer', '')).strip():
|
||||
issues.extend(coverage_issues(answer,context))
|
||||
return list(dict.fromkeys(issues))
|
||||
253
tools/answer_evaluation/evaluate_graph_answers.py
Normal file
253
tools/answer_evaluation/evaluate_graph_answers.py
Normal file
@ -0,0 +1,253 @@
|
||||
"""Measure generated answers on a declared, frozen graph benchmark.
|
||||
|
||||
Regression mode repeats known questions; it is never a new independent TEST.
|
||||
The harness supplies retrieval context and does not test native tool routing.
|
||||
"""
|
||||
from __future__ import annotations
|
||||
|
||||
import argparse
|
||||
import concurrent.futures
|
||||
import csv
|
||||
import hashlib
|
||||
import json
|
||||
import os
|
||||
import time
|
||||
from collections import Counter
|
||||
from pathlib import Path
|
||||
|
||||
from tools.graphrag.graph_db import create_neo4j_driver, get_neo4j_settings
|
||||
from tools.graphrag.graph_search import search_graph_with_session
|
||||
from tools.graphrag.build_graphrag import graph_version
|
||||
from tools.graphrag.evaluation.benchmark_v2 import BASE
|
||||
from tools.graphrag.evaluation.check_openwebui import grade_claims
|
||||
from tools.graphrag.evaluation.reproducibility import graph_fingerprint, run_metadata, sha256_file, verify_freeze
|
||||
from tools.graphrag.evaluation.source_oracle import load_source_oracle, norm
|
||||
from tools.rag.evaluation.rag_runner import DEFAULT_MODEL, OPENWEBUI_URL, request_json
|
||||
from .checked_generation import generate_checked_answer
|
||||
from .context_policy import joined_candidates, citation_check, allowed_urls, answer_context_issues, prose_issues, text_contains_value
|
||||
|
||||
HERE = Path(__file__).resolve().parent
|
||||
|
||||
|
||||
def graph_context(result: dict) -> dict:
|
||||
"""Remove storage/profile metadata that cannot answer the actual question.
|
||||
|
||||
Uses only actual retrieval output and query intent, never gold annotations.
|
||||
Values/subjects/source paths are copied without inventing or rewriting facts.
|
||||
"""
|
||||
facts = []; intent = result['constraints']
|
||||
for row in result['facts']:
|
||||
kind = row.get('fact_type', '')
|
||||
if kind.startswith('shared_'):
|
||||
field = {'shared_keyword': 'keyword', 'shared_category': 'category',
|
||||
'shared_document_author': 'document_author'}.get(kind)
|
||||
if field:
|
||||
for side in ['left', 'right']:
|
||||
facts.append({'person': row[f'{side}_person'], field: row[field],
|
||||
'document_path': row.get(f'{side}_document_path'),
|
||||
'source_url': row.get(f'{side}_source_url')})
|
||||
continue
|
||||
if not row.get('person'):
|
||||
continue
|
||||
allowed = {'person', 'document_path', 'source_url', 'keyword', 'category', 'document_author'}
|
||||
if intent['mentions_title']:
|
||||
allowed.add('title')
|
||||
if intent['mentions_title'] or intent['mentions_academic_year'] or intent['years']:
|
||||
allowed.add('year')
|
||||
if intent['mentions_start_year']:
|
||||
allowed.add('start_year')
|
||||
fact = {k: v for k, v in row.items() if k in allowed and v is not None}
|
||||
if fact not in facts:
|
||||
facts.append(fact)
|
||||
sources=result.get('sources')
|
||||
if sources is None:
|
||||
sources=[{k:d[k] for k in ['document_path','source_url'] if d.get(k)} for d in result.get('documents',[])]
|
||||
context={'status':result['status'],'reason':result['reason'],'facts':facts,'sources':sources,
|
||||
'aggregation':result['aggregation'],'complete':result.get('complete'),
|
||||
'truncated':result.get('truncated',False),
|
||||
'truncation_reasons':result.get('truncation_reasons',[]),
|
||||
'index_version':result.get('index_version')}
|
||||
context['answer_candidates']=joined_candidates(facts,intent)
|
||||
return context
|
||||
|
||||
|
||||
def grade_answer(case: dict, answer: dict, oracle: dict, *, context: dict | None = None) -> dict:
|
||||
# JSON null is absence, not a positive factual assertion. The same rule is
|
||||
# applicable to all rounds, including the archived initial sample.
|
||||
normalized = dict(answer)
|
||||
if isinstance(answer.get('claims'), list):
|
||||
normalized['claims'] = [{k: v for k, v in claim.items() if v is not None}
|
||||
if isinstance(claim, dict) else claim for claim in answer['claims']]
|
||||
grade = grade_claims(case, normalized, oracle)
|
||||
urls=(allowed_urls(context) if context is not None else
|
||||
{d['source_url'] for d in oracle.get('documents',{}).values() if d.get('source_url')})
|
||||
citations=citation_check(answer,urls)
|
||||
grade.update(citations)
|
||||
policy_issues=answer_context_issues(normalized,context) if context is not None else []
|
||||
grade['context_issues']=policy_issues
|
||||
text = norm(answer.get('answer', ''))
|
||||
people = {str(b['person']) for b in case['graph']['expected_bindings'] if b.get('person')}
|
||||
missing = [v for v in case.get('expected_answer_contains', [])
|
||||
if not text_contains_value(answer.get('answer', ''), str(v), person=str(v) in people)]
|
||||
policy_issues.extend(prose_issues(normalized))
|
||||
# The initial sample exposed a real contradiction in otherwise correct
|
||||
# category claims. Check it explicitly rather than silently accepting prose.
|
||||
wrong_thesis_label = 'dizertac' in text and any(str(b.get('category', '')).startswith('dp')
|
||||
for b in case['graph']['expected_bindings']) and not any(
|
||||
str(b.get('category', '')).startswith('phd') for b in case['graph']['expected_bindings'])
|
||||
grade.update(text_values_ok=not missing, missing_text_values=missing,
|
||||
contradictory_thesis_label=wrong_thesis_label)
|
||||
grade['strict'] = bool(grade['strict'] and not missing and not wrong_thesis_label and citations['citations_ok'] and not policy_issues)
|
||||
return grade
|
||||
|
||||
|
||||
def main():
|
||||
parser = argparse.ArgumentParser(description=__doc__)
|
||||
parser.add_argument('--output-dir', type=Path, required=True)
|
||||
parser.add_argument('--workers', type=int, default=3)
|
||||
parser.add_argument('--model', default=DEFAULT_MODEL)
|
||||
parser.add_argument('--split', choices=['dev', 'test', 'regression'], default='test')
|
||||
parser.add_argument('--questions', type=Path, required=True)
|
||||
parser.add_argument('--audit', type=Path, required=True)
|
||||
parser.add_argument('--freeze-manifest', type=Path, required=True)
|
||||
parser.add_argument('--dev-ids', type=Path, required=True)
|
||||
parser.add_argument('--regression-ids', type=Path)
|
||||
parser.add_argument('--dev-results', type=Path, help='Required completed DEV before final regression.')
|
||||
args = parser.parse_args()
|
||||
if args.output_dir.exists():
|
||||
parser.error('Refusing to overwrite an answer-level TEST.')
|
||||
if not os.getenv('OPENWEBUI_API_KEY'):
|
||||
parser.error('OPENWEBUI_API_KEY missing.')
|
||||
if args.workers < 1:
|
||||
parser.error('--workers must be positive.')
|
||||
if args.split in {'regression', 'test'} and args.dev_results is None:
|
||||
parser.error('Final regression requires completed --dev-results.')
|
||||
dataset=args.questions; audit=args.audit; frozen=args.freeze_manifest
|
||||
manifest = json.loads(frozen.read_text())
|
||||
questions = json.loads(dataset.read_text()); oracle = load_source_oracle()
|
||||
development=set(json.loads(args.dev_ids.read_text()))
|
||||
test = [q for q in questions if q['split'] == 'test']
|
||||
if args.split == 'regression':
|
||||
if args.regression_ids is None: parser.error('Regression needs explicit --regression-ids.')
|
||||
regression_ids = set(json.loads(args.regression_ids.read_text()))
|
||||
selected = [q for q in questions if q['id'] in regression_ids]
|
||||
if len(selected) != len(regression_ids): parser.error('Unknown/duplicate regression IDs.')
|
||||
else:
|
||||
selected = test if args.split == 'test' else [q for q in questions if q['id'] in development]
|
||||
if not selected: parser.error('Empty selected split.')
|
||||
if args.split == 'test' and (manifest.get('evaluation_kind') != 'independent_holdout'
|
||||
or development & {q['id'] for q in selected}):
|
||||
parser.error('Fresh TEST requires independent freeze and zero DEV overlap.')
|
||||
if not development <= {q['id'] for q in questions if q['split'] == 'dev'}:
|
||||
parser.error('Generation DEV must be declared inside the dataset DEV split.')
|
||||
prompt_path = HERE / 'graph_answer_prompt.txt'; prompt = prompt_path.read_text()
|
||||
args.output_dir.mkdir(parents=True)
|
||||
metadata = run_metadata(dataset); settings = get_neo4j_settings(); contexts = {}
|
||||
with create_neo4j_driver(settings) as driver, driver.session(database=settings.database) as session:
|
||||
verify_freeze(manifest, metadata, graph_fingerprint(session), audit=audit, **manifest['parameters'])
|
||||
metadata['index_version']=graph_version(session)
|
||||
# Generate every context before making any external request.
|
||||
for case in selected:
|
||||
result=search_graph_with_session(session,case['question'],**manifest['parameters'])
|
||||
result['index_version']=metadata['index_version']
|
||||
contexts[case['id']]=graph_context(result)
|
||||
code_files = [Path(__file__), prompt_path, HERE/'answer_format.py',HERE/'context_policy.py',HERE/'checked_generation.py', HERE/'render_answer.py', Path('tools/rag/evaluation/rag_runner.py')]
|
||||
hashes = {str(p.resolve().relative_to(HERE.parents[1])): sha256_file(p) for p in code_files}
|
||||
if args.split in {'regression', 'test'}:
|
||||
dev=json.loads(args.dev_results.read_text())
|
||||
if (dev['configuration']['selected_split']!='dev'
|
||||
or set(dev['configuration']['selected_ids'])!=development
|
||||
or dev['summary']['questions']!=len(development)
|
||||
or {row['id'] for row in dev['questions']}!=development
|
||||
or len(dev['questions'])!=len(development)
|
||||
or dev['configuration']['generation_files']!=hashes
|
||||
or dev['run_metadata']['fingerprints']!=metadata['fingerprints']
|
||||
or dev['configuration']['graph_freeze_sha256']!=sha256_file(frozen)
|
||||
or dev['configuration']['model']!=args.model
|
||||
or dev['run_metadata'].get('index_version')!=metadata['index_version']):
|
||||
raise RuntimeError('Generation code, prompt, data or complete DEV differs; rerun DEV before final freeze.')
|
||||
declaration = {'method': ('Known-question development selection.' if args.split=='dev' else
|
||||
'Previously exposed LLM questions; regression, not independent TEST.'
|
||||
if args.split=='regression' else
|
||||
'Fresh query-group holdout over known sources and templates; zero DEV query-group overlap.'),
|
||||
'graph_freeze_sha256': sha256_file(frozen), 'audit_sha256': sha256_file(audit),
|
||||
'generation_files': hashes, 'model': args.model, 'temperature': 0, 'workers': args.workers,
|
||||
'dev_ids': sorted(development), 'test_ids': [q['id'] for q in test],
|
||||
'dev_count': len(development), 'test_count': len(test), 'target_accuracy': 0.92,
|
||||
'evaluation_kind': 'historical_regression' if args.split=='regression' else 'independent_query_group_holdout' if args.split=='test' else 'development',
|
||||
'rendering': 'Verified structured claims rendered deterministically; raw model outputs preserved.',
|
||||
'selected_split': args.split, 'selected_ids': [q['id'] for q in selected], 'selected_count':len(selected),
|
||||
'selected_dev_overlap': len(development & {q['id'] for q in selected}),
|
||||
'corrective_request_limit':1,'format_repair_limit':1,
|
||||
'repair_policy':'At most one total corrective request for format, citations or retrieval-context violations. Same question/context, no gold; retain all attempts.',
|
||||
'dev_results_sha256':sha256_file(args.dev_results) if args.dev_results else None,
|
||||
'policy': ('Evaluate every declared regression case, including DEV overlap; retain all failures and stop tuning after this freeze.'
|
||||
if args.split=='regression' else
|
||||
'Evaluate every declared fresh TEST case once; retain every failure; do not tune on this TEST.'),
|
||||
'selected_categories': dict(Counter(q['category'] for q in selected)),
|
||||
'limitations': [('Known development questions; not a holdout.' if args.split=='dev' else
|
||||
'All questions and previous model outputs are known; this is historical regression.'
|
||||
if args.split=='regression' else
|
||||
'Known corpus/profiles and templates; these query groups were not previously evaluated.'),
|
||||
'Harness supplies graph context; native OpenWebUI tool choice and browser UI are outside this experiment.',
|
||||
'Checks structured factual claims, their source support/citations and required prose values; not a general semantic judge of arbitrary prose.']}
|
||||
(args.output_dir / 'frozen_answers.json').write_text(json.dumps(declaration, ensure_ascii=False, indent=2) + '\n')
|
||||
results = {}
|
||||
def run(case):
|
||||
started = time.perf_counter(); context = contexts[case['id']]
|
||||
row = {'id': case['id'], 'category': case['category'], 'question': case['question'],
|
||||
'graph_context': context, 'strict': False}
|
||||
def complete(messages):
|
||||
return request_json(OPENWEBUI_URL, method='POST', timeout=90, max_attempts=2,
|
||||
headers={'Authorization':f'Bearer {os.environ["OPENWEBUI_API_KEY"]}','Content-Type':'application/json'},
|
||||
payload={'model':args.model,'temperature':0,'stream':False,
|
||||
'response_format':{'type':'json_object'},'messages':messages})
|
||||
generated=generate_checked_answer(case['question'],context,prompt,complete)
|
||||
row.update(generated)
|
||||
# Grading occurs after all generation/correction decisions, never inside
|
||||
# the generator. Gold cannot influence whether another request is sent.
|
||||
for attempt in row['attempts']:
|
||||
candidate = attempt.get('rendered_answer', attempt.get('answer'))
|
||||
attempt['strict']=(grade_answer(case,candidate,oracle,context=context)['strict']
|
||||
if candidate else False)
|
||||
if row.get('answer'):
|
||||
row.update(grade_answer(case,row['answer'],oracle,context=context))
|
||||
row['strict']=bool(row['strict'] and row['accepted_for_delivery'])
|
||||
row['latency_seconds'] = time.perf_counter() - started
|
||||
return row
|
||||
output = {'configuration': declaration, 'run_metadata': metadata, 'questions': []}
|
||||
with concurrent.futures.ThreadPoolExecutor(max_workers=args.workers) as executor:
|
||||
futures = [executor.submit(run, case) for case in selected]
|
||||
for future in concurrent.futures.as_completed(futures):
|
||||
row = future.result(); results[row['id']] = row
|
||||
output['questions'] = [results[q['id']] for q in selected if q['id'] in results]
|
||||
output['summary'] = {'questions': len(results), 'correct': sum(r['strict'] for r in results.values()),
|
||||
'accuracy': sum(r['strict'] for r in results.values()) / len(results),
|
||||
'errors': sum(bool(r.get('error')) for r in results.values()),
|
||||
'first_pass_correct':sum(bool(r.get('attempts') and r['attempts'][0].get('strict')) for r in results.values()),
|
||||
'format_repair_attempted':sum(bool(r.get('attempts') and r['attempts'][0].get('format_error') and len(r['attempts'])>1) for r in results.values()),
|
||||
'corrective_request_count':sum(len(r.get('attempts',[]))>1 for r in results.values()),
|
||||
'context_repair_attempted':sum(bool(r.get('attempts') and r['attempts'][0].get('context_issues') and len(r['attempts'])>1) for r in results.values()),
|
||||
'normalized_first_response':sum(bool(r.get('attempts') and r['attempts'][0].get('format_normalized')) for r in results.values())}
|
||||
(args.output_dir / f'answers_{args.split}.json').write_text(json.dumps(output, ensure_ascii=False, indent=2) + '\n')
|
||||
print(f'{len(results)}/{len(selected)} {row["id"]}: {"OK" if row["strict"] else "FAIL"} {row["latency_seconds"]:.1f}s', flush=True)
|
||||
with create_neo4j_driver(settings) as driver, driver.session(database=settings.database) as session:
|
||||
verify_freeze(manifest, run_metadata(dataset), graph_fingerprint(session), audit=audit, **manifest['parameters'])
|
||||
assert graph_version(session)==metadata['index_version'],'Index version changed during generation.'
|
||||
assert hashes == {str(p.resolve().relative_to(HERE.parents[1])): sha256_file(p) for p in code_files}, 'Generation code changed during TEST.'
|
||||
output['by_category'] = {category: {'questions': len(rows), 'correct': sum(r['strict'] for r in rows),
|
||||
'accuracy': sum(r['strict'] for r in rows) / len(rows)} for category in sorted({q['category'] for q in selected})
|
||||
for rows in [[r for r in output['questions'] if r['category'] == category]]}
|
||||
(args.output_dir / f'answers_{args.split}.json').write_text(json.dumps(output, ensure_ascii=False, indent=2) + '\n')
|
||||
fields=['id','category','strict','error','latency_seconds','attempts','first_pass_strict']
|
||||
with (args.output_dir/f'answers_{args.split}.csv').open('w',newline='',encoding='utf-8') as handle:
|
||||
writer=csv.DictWriter(handle,fieldnames=fields);writer.writeheader()
|
||||
for row in output['questions']:
|
||||
writer.writerow({**{k:row.get(k) for k in fields if k not in {'attempts','first_pass_strict'}},
|
||||
'attempts':len(row.get('attempts',[])),
|
||||
'first_pass_strict':bool(row.get('attempts') and row['attempts'][0].get('strict'))})
|
||||
print(json.dumps(output['summary']))
|
||||
|
||||
|
||||
if __name__ == '__main__':
|
||||
main()
|
||||
11
tools/answer_evaluation/graph_answer_prompt.txt
Normal file
11
tools/answer_evaluation/graph_answer_prompt.txt
Normal file
@ -0,0 +1,11 @@
|
||||
Vyber iba pravdivé štruktúrované tvrdenia z dodaného graph_context. Nepoužívaj vlastné vedomosti, zdrojový oracle ani údaje z otázky ako dôkaz.
|
||||
Vráť jediný platný JSON objekt: {"answer":"","status":"ok","claims":[],"source_urls":[],"count":null}. Answer MUSÍ zostať prázdny reťazec. Prirodzený text, citácie a upozornenie na úplnosť zostaví aplikácia z overených polí. Nepíš voľný text ani Markdown mimo JSON. Všetky reťazce ohraničuj ASCII dvojitými úvodzovkami; úvodzovky v hodnotách escapuj.
|
||||
Každá claim obsahuje person a len požadované polia, ktoré sú priamo doložené faktami: title, year, start_year, keyword, category, document_author. Nepovinné polia vynechaj. Roky a count sú celé čísla. Presne zachovaj mená, názvy, tagy a kódy kategórií. Nevytváraj nové osoby, hodnoty ani typy tvrdení.
|
||||
Title je názov akademickej práce/projektu, nikdy názov profilovej stránky alebo generický odkaz na rešerš. Year je rok tej istej práce ako title. Start_year je explicitne doložený začiatok štúdia; rok adresára nie je dôkaz. Keyword je skutočný tag osoby, nikdy typ práce ako diplomový projekt. Category je presný taxonomy.category kód. Document_author je autor dokumentu, nie automaticky študent.
|
||||
Všetky podmienky jednej claim patria tej istej osobe. Title a year patria rovnakému akademickému záznamu. Category a document_author musia byť doložené tým istým document_path.
|
||||
Tag patrí osobe cez jej profil aj dcérske dokumenty. Pre kombináciu názvu/roku a tagu nevyžaduj rovnaký dokument. Answer_candidates sú už doložené spojenia cez tú istú osobu; zachovaj ich person, year, keyword a prípadne title spolu v jednej claim. Neodmietaj toto spojenie len pre odlišné document_path.
|
||||
Claims musia pokryť všetky relevantné výsledky dotazu a požadované väzby. Pri porovnaní ľudí uveď každého v samostatnej claim. Pri výbere kandidátov vynechaj nevyhovujúce osoby. Pri názve práce uveď aj rok, ak je vo faktoch známy.
|
||||
Source_urls musí obsahovať konkrétne relevantné source_url zo sources pre všetky tvrdenia. Nevymýšľaj ani neupravuj URL. Ak názov/rok dokladá profil a tag dcérsky dokument, cituj oba potrebné zdroje. Nepoužívaj URL iných osôb ako náhradnú citáciu.
|
||||
Count môže byť číslo iba pri aggregation.complete=true a musí sa rovnať aggregation.count. Inak count=null, aj pri no_answer. Počet nie je počet zobrazených zdrojov. Presný agregovaný počet môže byť úplný aj pri orezanom výpise dôkazov.
|
||||
Pri status kontextu no_answer vráť status=no_answer, claims=[], count=null. Pri ambiguous alebo error zachovaj tento status a prázdne claims. Nevymýšľaj pozitívnu odpoveď. Nulová úplná agregácia so status=ok je platný výsledok s count=0.
|
||||
Complete, truncated, truncation_reasons a index_version nemenia pravdivosť faktov. Význam a obmedzenia výsledku oznámi aplikácia. Answer nechaj prázdne aj pri neúplnosti, nenájdení a chybe.
|
||||
65
tools/answer_evaluation/rag_delivery.py
Normal file
65
tools/answer_evaluation/rag_delivery.py
Normal file
@ -0,0 +1,65 @@
|
||||
"""Render a truthful coverage notice without altering the model's facts.
|
||||
|
||||
No gold or source oracle is accepted. Unsupported citations and unqualified
|
||||
exhaustive statements remain rejected. Keep the exact original model answer.
|
||||
"""
|
||||
import copy
|
||||
|
||||
|
||||
def finalize_rag_answer(result: dict) -> dict:
|
||||
out = copy.deepcopy(result)
|
||||
if out.get('display_notice_added'):
|
||||
return out
|
||||
issues = out.get('context_issues', [])
|
||||
out['model_answer'] = out['answer']
|
||||
out['first_pass_accepted_for_delivery'] = out.get('accepted_for_delivery')
|
||||
out['first_pass_context_issues'] = list(issues)
|
||||
out['display_notice_added'] = False
|
||||
# Only a missing notice can be rendered automatically. Adding a caveat to
|
||||
# a contradictory exhaustive statement would not repair that statement.
|
||||
if issues == ['missing_incompleteness_notice'] and out.get('citations_ok') is True:
|
||||
out['answer'] = 'Výpis je neúplný.\n\n' + out['model_answer']
|
||||
out['context_issues'] = []
|
||||
out['accepted_for_delivery'] = True
|
||||
out['display_notice_added'] = True
|
||||
return out
|
||||
|
||||
|
||||
def main():
|
||||
import argparse
|
||||
import json
|
||||
from pathlib import Path
|
||||
from tools.graphrag.evaluation.reproducibility import sha256_file
|
||||
from tools.rag.evaluation.rag_metrics import evaluate_answer
|
||||
|
||||
parser = argparse.ArgumentParser(description='Replay saved RAG outputs through the delivery layer; no model calls.')
|
||||
parser.add_argument('--input', type=Path, required=True)
|
||||
parser.add_argument('--output', type=Path, required=True)
|
||||
args = parser.parse_args()
|
||||
if args.output.exists(): parser.error('Refusing to overwrite a replay.')
|
||||
original = json.loads(args.input.read_text())
|
||||
source = Path(original['configuration']['source_file'])
|
||||
assert sha256_file(source) == original['configuration']['source_sha256']
|
||||
gold = {case['id']: case for case in json.loads(source.read_text())['results']}
|
||||
files = [Path(__file__), Path('tools/rag/evaluation/evaluate_rag_answers.py'),
|
||||
Path('tools/rag/evaluation/rag_metrics.py'), Path('tools/rag/evaluation/rag_runner.py'),
|
||||
Path('tools/answer_evaluation/context_policy.py')]
|
||||
rows = []
|
||||
for before in original['results']:
|
||||
after = finalize_rag_answer(before)
|
||||
score = evaluate_answer(gold[after['id']], after['answer'], tool_called=after['tool_called'],
|
||||
allowed_source_urls=after['rag_source_urls'])
|
||||
after.update(score)
|
||||
after['strict_pass'] = bool(score['strict_pass'] and after['accepted_for_delivery'])
|
||||
rows.append(after)
|
||||
result = {'configuration': {'method': 'Deterministic delivery replay on the same saved model responses, not new generation.',
|
||||
'input': str(args.input), 'input_sha256': sha256_file(args.input),
|
||||
'delivery_files': {str(p): sha256_file(p) for p in files}},
|
||||
'results': rows, 'summary': {'questions': len(rows), 'strict_pass': sum(r['strict_pass'] for r in rows),
|
||||
'display_notice_added': sum(r['display_notice_added'] for r in rows)}}
|
||||
args.output.parent.mkdir(parents=True, exist_ok=True)
|
||||
args.output.write_text(json.dumps(result, ensure_ascii=False, indent=2)+'\n')
|
||||
print(json.dumps(result['summary']))
|
||||
|
||||
|
||||
if __name__ == '__main__': main()
|
||||
46
tools/answer_evaluation/regrade_citations.py
Normal file
46
tools/answer_evaluation/regrade_citations.py
Normal file
@ -0,0 +1,46 @@
|
||||
"""Recheck archived citations against archived tool sources, without generation.
|
||||
|
||||
This changes only citation eligibility; it does not replace historical gold or
|
||||
claim a new full semantic evaluation. Missing archived context is unverifiable.
|
||||
"""
|
||||
import argparse
|
||||
import json
|
||||
from pathlib import Path
|
||||
|
||||
from tools.graphrag.evaluation.reproducibility import sha256_file
|
||||
from .context_policy import citation_check, allowed_urls
|
||||
|
||||
|
||||
def main():
|
||||
parser = argparse.ArgumentParser(description=__doc__)
|
||||
parser.add_argument('--input', type=Path, action='append', required=True)
|
||||
parser.add_argument('--output', type=Path, required=True)
|
||||
args = parser.parse_args()
|
||||
if args.output.exists(): parser.error('Refusing to overwrite regrading.')
|
||||
reports = []
|
||||
for path in args.input:
|
||||
data = json.loads(path.read_text()); rows = []
|
||||
for old in data.get('questions', data.get('results', [])):
|
||||
answer = old.get('answer') or ''
|
||||
if isinstance(answer, str): answer = {'answer': answer, 'source_urls': []}
|
||||
context = old.get('graph_context')
|
||||
legacy_sources = ({row['source_url'] for row in context.get('documents', []) if row.get('source_url')}
|
||||
if isinstance(context, dict) and 'documents' in context else None)
|
||||
urls = (allowed_urls(context) if isinstance(context, dict) and 'sources' in context else
|
||||
legacy_sources if legacy_sources is not None else
|
||||
set(old['rag_source_urls']) if isinstance(old.get('rag_source_urls'), list) else None)
|
||||
check = citation_check(answer, urls) if urls is not None else {'citations_ok': None, 'unsupported_urls': []}
|
||||
strict = bool(old.get('strict', old.get('strict_pass', False)))
|
||||
rows.append({'id': old['id'], 'previous_strict': strict, **check,
|
||||
'citation_adjusted_strict': (strict and check['citations_ok']) if urls is not None else None})
|
||||
reports.append({'file': str(path), 'sha256': sha256_file(path), 'rows': rows,
|
||||
'summary': {'questions': len(rows), 'checked': sum(r['citations_ok'] is not None for r in rows),
|
||||
'invalid_citations': sum(r['citations_ok'] is False for r in rows),
|
||||
'previous_strict': sum(r['previous_strict'] for r in rows),
|
||||
'strict_after_citation_check': sum(r['citation_adjusted_strict'] is True for r in rows)}})
|
||||
args.output.parent.mkdir(parents=True, exist_ok=True)
|
||||
args.output.write_text(json.dumps({'method': __doc__, 'files': reports}, ensure_ascii=False, indent=2)+'\n')
|
||||
print(json.dumps([{'file': r['file'], **r['summary']} for r in reports], ensure_ascii=False))
|
||||
|
||||
|
||||
if __name__ == '__main__': main()
|
||||
29
tools/answer_evaluation/render_answer.py
Normal file
29
tools/answer_evaluation/render_answer.py
Normal file
@ -0,0 +1,29 @@
|
||||
"""Render only validated structured facts; never infer facts or read gold."""
|
||||
from copy import deepcopy
|
||||
|
||||
|
||||
def render_graph_answer(answer: dict, context: dict) -> dict:
|
||||
out = deepcopy(answer)
|
||||
lines = []
|
||||
if out['status'] == 'ok':
|
||||
labels = {'title': 'názov práce', 'year': 'rok práce', 'start_year': 'začiatok štúdia',
|
||||
'keyword': 'kľúčové slovo', 'category': 'kategória', 'document_author': 'autor dokumentu'}
|
||||
for claim in out['claims']:
|
||||
values = [f'{label}: {claim[key]}' for key, label in labels.items() if claim.get(key) is not None]
|
||||
lines.append(claim['person'] + (' — ' + '; '.join(values) if values else '') + '.')
|
||||
if out.get('count') is not None:
|
||||
lines.append(f'Počet vyhovujúcich osôb: {out["count"]}.')
|
||||
if context.get('complete') is False or context.get('truncated'):
|
||||
lines.append('Výpis je neúplný.')
|
||||
elif context.get('complete') is None:
|
||||
lines.append('Úplnosť vyhľadania nemožno zaručiť.')
|
||||
elif out['status'] == 'ambiguous':
|
||||
lines.append('Požiadavka je nejednoznačná; údaje nemožno spoľahlivo určiť.')
|
||||
elif out['status'] == 'error':
|
||||
lines.append('Vyhľadanie zlyhalo; odpoveď nemožno pripraviť.')
|
||||
else:
|
||||
lines.append('Požadované údaje sa v dostupných podkladoch nenašli.')
|
||||
if out['source_urls']:
|
||||
lines.append('Zdroje: ' + ', '.join(out['source_urls']))
|
||||
out['answer'] = '\n'.join(lines)
|
||||
return out
|
||||
0
tools/graphrag/__init__.py
Normal file
0
tools/graphrag/__init__.py
Normal file
592
tools/graphrag/build_graphrag.py
Normal file
592
tools/graphrag/build_graphrag.py
Normal file
@ -0,0 +1,592 @@
|
||||
from __future__ import annotations
|
||||
|
||||
import argparse
|
||||
import json
|
||||
from pathlib import Path
|
||||
from typing import Any
|
||||
|
||||
from .graph_db import (
|
||||
create_neo4j_driver,
|
||||
get_neo4j_settings,
|
||||
)
|
||||
from .graphrag import (
|
||||
GRAPH_SCOPE,
|
||||
build_graph_payload,
|
||||
)
|
||||
from tools.index_state import DATA_DIR, PENDING_FILE, publication_lock, read_version
|
||||
|
||||
|
||||
PROJECT_ROOT = Path(
|
||||
__file__
|
||||
).resolve().parents[2]
|
||||
|
||||
DOCUMENTS_FILE = (
|
||||
PROJECT_ROOT
|
||||
/ "data"
|
||||
/ "documents.json"
|
||||
)
|
||||
|
||||
CHUNKS_FILE = (
|
||||
PROJECT_ROOT
|
||||
/ "data"
|
||||
/ "chunks.json"
|
||||
)
|
||||
|
||||
|
||||
CONSTRAINTS = (
|
||||
('zpwiki_index_state_unique', 'IndexState', 'id'),
|
||||
(
|
||||
"zpwiki_document_path_unique",
|
||||
"Document",
|
||||
"path",
|
||||
),
|
||||
(
|
||||
"zpwiki_person_id_unique",
|
||||
"Person",
|
||||
"id",
|
||||
),
|
||||
(
|
||||
"zpwiki_document_author_id_unique",
|
||||
"DocumentAuthor",
|
||||
"id",
|
||||
),
|
||||
(
|
||||
"zpwiki_category_name_unique",
|
||||
"Category",
|
||||
"name",
|
||||
),
|
||||
(
|
||||
"zpwiki_topic_id_unique",
|
||||
"Topic",
|
||||
"id",
|
||||
),
|
||||
(
|
||||
"zpwiki_keyword_id_unique",
|
||||
"Keyword",
|
||||
"id",
|
||||
),
|
||||
(
|
||||
"zpwiki_thesis_id_unique",
|
||||
"Thesis",
|
||||
"id",
|
||||
),
|
||||
(
|
||||
"zpwiki_work_id_unique",
|
||||
"Work",
|
||||
"id",
|
||||
),
|
||||
)
|
||||
|
||||
|
||||
LEGACY_CONSTRAINTS = (
|
||||
"zpwiki_author_id_unique",
|
||||
)
|
||||
|
||||
|
||||
def graph_version(session) -> dict | None:
|
||||
record = session.run('MATCH (s:IndexState {id:$scope}) RETURN s.metadata_json AS metadata',
|
||||
scope=GRAPH_SCOPE).single()
|
||||
return json.loads(record['metadata']) if record and record['metadata'] else None
|
||||
|
||||
|
||||
def write_graph_transaction(tx, payload: dict, *, replace: bool = True,
|
||||
version: dict | None = None) -> None:
|
||||
"""All destructive data changes belong to the caller's single transaction."""
|
||||
if replace:
|
||||
clear_managed_graph(tx)
|
||||
for key, query in NODE_QUERIES.items():
|
||||
write_rows(tx, query, payload[key])
|
||||
for key, query in RELATIONSHIP_QUERIES.items():
|
||||
write_rows(tx, query, payload[key])
|
||||
if replace:
|
||||
nodes, relationships = graph_counts(tx)
|
||||
labels = {'people': 'Person', 'document_authors': 'DocumentAuthor', 'documents': 'Document',
|
||||
'categories': 'Category', 'topics': 'Topic', 'keywords': 'Keyword',
|
||||
'theses': 'Thesis', 'works': 'Work'}
|
||||
types = {'person_documents': 'HAS_DOCUMENT', 'document_author_documents': 'AUTHORED_DOCUMENT',
|
||||
'document_categories': 'IN_CATEGORY', 'document_keywords': 'HAS_KEYWORD',
|
||||
'document_describes_topics': 'DESCRIBES', 'person_theses': 'AUTHORED',
|
||||
'person_works': 'HAS_WORK'}
|
||||
expected_nodes = {labels[key]: len(payload[key]) for key in labels if payload[key]}
|
||||
expected_relations = {types[key]: len(payload[key]) for key in types if payload[key]}
|
||||
evidenced = len(payload['thesis_documents']) + len(payload['work_documents'])
|
||||
if evidenced:
|
||||
expected_relations['EVIDENCED_BY'] = evidenced
|
||||
if dict(nodes) != expected_nodes or dict(relationships) != expected_relations:
|
||||
raise RuntimeError('Neo4j počty nezodpovedajú pripravenému grafu; transakcia sa zruší.')
|
||||
if version is None:
|
||||
tx.run('MATCH (s:IndexState {id:$scope}) DELETE s', scope=GRAPH_SCOPE).consume()
|
||||
else:
|
||||
# Operational state is deliberately outside the knowledge graph scope.
|
||||
tx.run('MERGE (s:IndexState {id:$scope}) SET s.metadata_json=$metadata',
|
||||
scope=GRAPH_SCOPE, metadata=json.dumps(version, sort_keys=True)).consume()
|
||||
|
||||
|
||||
NODE_QUERIES = {
|
||||
"people": """
|
||||
UNWIND $rows AS row
|
||||
MERGE (n:Person {id: row.id})
|
||||
SET n += row
|
||||
""",
|
||||
"document_authors": """
|
||||
UNWIND $rows AS row
|
||||
MERGE (n:DocumentAuthor {id: row.id})
|
||||
SET n += row
|
||||
""",
|
||||
"documents": """
|
||||
UNWIND $rows AS row
|
||||
MERGE (n:Document {path: row.path})
|
||||
SET n += row
|
||||
""",
|
||||
"categories": """
|
||||
UNWIND $rows AS row
|
||||
MERGE (n:Category {name: row.name})
|
||||
SET n += row
|
||||
""",
|
||||
"topics": """
|
||||
UNWIND $rows AS row
|
||||
MERGE (n:Topic {id: row.id})
|
||||
SET n += row
|
||||
""",
|
||||
"keywords": """
|
||||
UNWIND $rows AS row
|
||||
MERGE (n:Keyword {id: row.id})
|
||||
SET n += row
|
||||
""",
|
||||
"theses": """
|
||||
UNWIND $rows AS row
|
||||
MERGE (n:Thesis {id: row.id})
|
||||
SET n += row
|
||||
""",
|
||||
"works": """
|
||||
UNWIND $rows AS row
|
||||
MERGE (n:Work {id: row.id})
|
||||
SET n += row
|
||||
""",
|
||||
}
|
||||
|
||||
|
||||
RELATIONSHIP_QUERIES = {
|
||||
"person_documents": """
|
||||
UNWIND $rows AS row
|
||||
MATCH (a:Person {
|
||||
id: row.person_id
|
||||
})
|
||||
MATCH (b:Document {
|
||||
path: row.document_path
|
||||
})
|
||||
MERGE (a)-[:HAS_DOCUMENT]->(b)
|
||||
""",
|
||||
"document_author_documents": """
|
||||
UNWIND $rows AS row
|
||||
MATCH (a:DocumentAuthor {
|
||||
id: row.document_author_id
|
||||
})
|
||||
MATCH (b:Document {
|
||||
path: row.document_path
|
||||
})
|
||||
MERGE (a)-[:AUTHORED_DOCUMENT]->(b)
|
||||
""",
|
||||
"document_categories": """
|
||||
UNWIND $rows AS row
|
||||
MATCH (a:Document {
|
||||
path: row.document_path
|
||||
})
|
||||
MATCH (b:Category {
|
||||
name: row.category_name
|
||||
})
|
||||
MERGE (a)-[:IN_CATEGORY]->(b)
|
||||
""",
|
||||
"document_keywords": """
|
||||
UNWIND $rows AS row
|
||||
MATCH (a:Document {
|
||||
path: row.document_path
|
||||
})
|
||||
MATCH (b:Keyword {
|
||||
id: row.keyword_id
|
||||
})
|
||||
MERGE (a)-[:HAS_KEYWORD]->(b)
|
||||
""",
|
||||
"document_describes_topics": """
|
||||
UNWIND $rows AS row
|
||||
MATCH (a:Document {
|
||||
path: row.document_path
|
||||
})
|
||||
MATCH (b:Topic {
|
||||
id: row.topic_id
|
||||
})
|
||||
MERGE (a)-[:DESCRIBES]->(b)
|
||||
""",
|
||||
"person_theses": """
|
||||
UNWIND $rows AS row
|
||||
MATCH (a:Person {
|
||||
id: row.person_id
|
||||
})
|
||||
MATCH (b:Thesis {
|
||||
id: row.thesis_id
|
||||
})
|
||||
MERGE (a)-[:AUTHORED]->(b)
|
||||
""",
|
||||
"person_works": """
|
||||
UNWIND $rows AS row
|
||||
MATCH (a:Person {
|
||||
id: row.person_id
|
||||
})
|
||||
MATCH (b:Work {
|
||||
id: row.work_id
|
||||
})
|
||||
MERGE (a)-[:HAS_WORK]->(b)
|
||||
""",
|
||||
"thesis_documents": """
|
||||
UNWIND $rows AS row
|
||||
MATCH (a:Thesis {
|
||||
id: row.thesis_id
|
||||
})
|
||||
MATCH (b:Document {
|
||||
path: row.document_path
|
||||
})
|
||||
MERGE (a)-[:EVIDENCED_BY]->(b)
|
||||
""",
|
||||
"work_documents": """
|
||||
UNWIND $rows AS row
|
||||
MATCH (a:Work {
|
||||
id: row.work_id
|
||||
})
|
||||
MATCH (b:Document {
|
||||
path: row.document_path
|
||||
})
|
||||
MERGE (a)-[:EVIDENCED_BY]->(b)
|
||||
""",
|
||||
}
|
||||
|
||||
|
||||
def load_json(
|
||||
path: Path,
|
||||
) -> list[dict[str, Any]]:
|
||||
if not path.exists():
|
||||
raise FileNotFoundError(
|
||||
f"Missing file: {path}"
|
||||
)
|
||||
|
||||
data = json.loads(
|
||||
path.read_text(
|
||||
encoding="utf-8"
|
||||
)
|
||||
)
|
||||
|
||||
if not isinstance(
|
||||
data,
|
||||
list,
|
||||
):
|
||||
raise ValueError(
|
||||
f"Expected list in {path}"
|
||||
)
|
||||
|
||||
return data
|
||||
|
||||
|
||||
def create_constraints(
|
||||
session,
|
||||
) -> None:
|
||||
for (
|
||||
name,
|
||||
label,
|
||||
property_name,
|
||||
) in CONSTRAINTS:
|
||||
session.run(
|
||||
(
|
||||
f"CREATE CONSTRAINT "
|
||||
f"{name} IF NOT EXISTS "
|
||||
f"FOR (n:{label}) "
|
||||
f"REQUIRE n.{property_name} "
|
||||
f"IS UNIQUE"
|
||||
)
|
||||
).consume()
|
||||
|
||||
|
||||
def drop_legacy_constraints(
|
||||
session,
|
||||
) -> None:
|
||||
for name in LEGACY_CONSTRAINTS:
|
||||
session.run(
|
||||
(
|
||||
f"DROP CONSTRAINT "
|
||||
f"{name} IF EXISTS"
|
||||
)
|
||||
).consume()
|
||||
|
||||
|
||||
def clear_managed_graph(
|
||||
session,
|
||||
) -> None:
|
||||
session.run(
|
||||
"""
|
||||
MATCH (n)
|
||||
WHERE n.graph_scope = $scope
|
||||
DETACH DELETE n
|
||||
""",
|
||||
scope=GRAPH_SCOPE,
|
||||
).consume()
|
||||
|
||||
|
||||
def write_rows(
|
||||
session,
|
||||
query: str,
|
||||
rows: list[dict[str, Any]],
|
||||
) -> None:
|
||||
if not rows:
|
||||
return
|
||||
|
||||
session.run(
|
||||
query,
|
||||
rows=rows,
|
||||
).consume()
|
||||
|
||||
|
||||
def graph_counts(
|
||||
session,
|
||||
) -> tuple[
|
||||
list[tuple[str, int]],
|
||||
list[tuple[str, int]],
|
||||
]:
|
||||
node_rows = session.run(
|
||||
"""
|
||||
MATCH (n)
|
||||
WHERE n.graph_scope = $scope
|
||||
UNWIND labels(n) AS label
|
||||
RETURN
|
||||
label,
|
||||
count(*) AS count
|
||||
ORDER BY label
|
||||
""",
|
||||
scope=GRAPH_SCOPE,
|
||||
)
|
||||
|
||||
nodes = [
|
||||
(
|
||||
str(record["label"]),
|
||||
int(record["count"]),
|
||||
)
|
||||
for record in node_rows
|
||||
]
|
||||
|
||||
relationship_rows = session.run(
|
||||
"""
|
||||
MATCH (a)-[r]->(b)
|
||||
WHERE
|
||||
a.graph_scope = $scope
|
||||
AND b.graph_scope = $scope
|
||||
RETURN
|
||||
type(r) AS relationship,
|
||||
count(*) AS count
|
||||
ORDER BY relationship
|
||||
""",
|
||||
scope=GRAPH_SCOPE,
|
||||
)
|
||||
|
||||
relationships = [
|
||||
(
|
||||
str(
|
||||
record[
|
||||
"relationship"
|
||||
]
|
||||
),
|
||||
int(record["count"]),
|
||||
)
|
||||
for record in relationship_rows
|
||||
]
|
||||
|
||||
return nodes, relationships
|
||||
|
||||
|
||||
def titled_entity_counts(
|
||||
session,
|
||||
label: str,
|
||||
) -> tuple[int, int]:
|
||||
if label not in {
|
||||
"Thesis",
|
||||
"Work",
|
||||
}:
|
||||
raise ValueError(
|
||||
f"Unsupported label: {label}"
|
||||
)
|
||||
|
||||
record = session.run(
|
||||
f"""
|
||||
MATCH (n:{label})
|
||||
WHERE n.graph_scope = $scope
|
||||
RETURN
|
||||
count(n) AS total,
|
||||
count(n.title) AS with_title
|
||||
""",
|
||||
scope=GRAPH_SCOPE,
|
||||
).single()
|
||||
|
||||
if record is None:
|
||||
return 0, 0
|
||||
|
||||
return (
|
||||
int(record["total"]),
|
||||
int(record["with_title"]),
|
||||
)
|
||||
|
||||
|
||||
def print_payload_summary(
|
||||
payload: dict[
|
||||
str,
|
||||
list[dict[str, Any]],
|
||||
],
|
||||
) -> None:
|
||||
print()
|
||||
print("Prepared GraphRAG payload")
|
||||
print("=" * 60)
|
||||
|
||||
for key in (
|
||||
"people",
|
||||
"document_authors",
|
||||
"documents",
|
||||
"categories",
|
||||
"topics",
|
||||
"keywords",
|
||||
"theses",
|
||||
"works",
|
||||
):
|
||||
print(
|
||||
f"{key:<24}"
|
||||
f"{len(payload[key]):>6}"
|
||||
)
|
||||
|
||||
print()
|
||||
print("Relationships")
|
||||
|
||||
for key in (
|
||||
"person_documents",
|
||||
"document_author_documents",
|
||||
"document_categories",
|
||||
"document_keywords",
|
||||
"document_describes_topics",
|
||||
"person_theses",
|
||||
"person_works",
|
||||
"thesis_documents",
|
||||
"work_documents",
|
||||
):
|
||||
print(
|
||||
f"{key:<30}"
|
||||
f"{len(payload[key]):>6}"
|
||||
)
|
||||
|
||||
print("=" * 60)
|
||||
|
||||
|
||||
def print_database_summary(
|
||||
session,
|
||||
) -> None:
|
||||
nodes, relationships = (
|
||||
graph_counts(
|
||||
session
|
||||
)
|
||||
)
|
||||
|
||||
print()
|
||||
print("Neo4j GraphRAG knowledge graph")
|
||||
print("=" * 60)
|
||||
|
||||
print("Nodes")
|
||||
|
||||
for label, count in nodes:
|
||||
print(
|
||||
f" {label:<22}"
|
||||
f"{count:>6}"
|
||||
)
|
||||
|
||||
print()
|
||||
print("Relationships")
|
||||
|
||||
for relationship, count in relationships:
|
||||
print(
|
||||
f" {relationship:<22}"
|
||||
f"{count:>6}"
|
||||
)
|
||||
|
||||
thesis_total, thesis_with_title = (
|
||||
titled_entity_counts(
|
||||
session,
|
||||
"Thesis",
|
||||
)
|
||||
)
|
||||
|
||||
work_total, work_with_title = (
|
||||
titled_entity_counts(
|
||||
session,
|
||||
"Work",
|
||||
)
|
||||
)
|
||||
|
||||
print()
|
||||
print(
|
||||
"Theses with extracted title: "
|
||||
f"{thesis_with_title}/"
|
||||
f"{thesis_total}"
|
||||
)
|
||||
|
||||
print(
|
||||
"Works with extracted title: "
|
||||
f"{work_with_title}/"
|
||||
f"{work_total}"
|
||||
)
|
||||
|
||||
print("=" * 60)
|
||||
|
||||
|
||||
def main() -> None:
|
||||
parser = argparse.ArgumentParser()
|
||||
|
||||
parser.add_argument(
|
||||
"--replace",
|
||||
action=argparse.BooleanOptionalAction,
|
||||
default=True,
|
||||
)
|
||||
|
||||
args = parser.parse_args()
|
||||
|
||||
settings = get_neo4j_settings()
|
||||
|
||||
with create_neo4j_driver(
|
||||
settings
|
||||
) as driver:
|
||||
driver.verify_connectivity()
|
||||
|
||||
with driver.session(
|
||||
database=settings.database
|
||||
) as session:
|
||||
drop_legacy_constraints(
|
||||
session
|
||||
)
|
||||
|
||||
create_constraints(
|
||||
session
|
||||
)
|
||||
|
||||
import hashlib
|
||||
with publication_lock(DATA_DIR, exclusive=True):
|
||||
if (DATA_DIR / PENDING_FILE).exists():
|
||||
raise RuntimeError('Nedokončená spoločná synchronizácia; použite tools.rag.rebuild_index.')
|
||||
payload = build_graph_payload(load_json(DOCUMENTS_FILE), load_json(CHUNKS_FILE))
|
||||
print_payload_summary(payload)
|
||||
version = read_version(DATA_DIR)
|
||||
if not args.replace:
|
||||
version = None # An incremental merge cannot certify removed source records.
|
||||
if version and any(hashlib.sha256(path.read_bytes()).hexdigest() != version[key]
|
||||
for path, key in [(DOCUMENTS_FILE, 'documents_sha256'), (CHUNKS_FILE, 'chunks_sha256')]):
|
||||
version = None # A standalone rebuild must not claim stale provenance.
|
||||
with session.begin_transaction() as tx:
|
||||
write_graph_transaction(tx, payload, replace=args.replace, version=version)
|
||||
tx.commit()
|
||||
|
||||
print_database_summary(
|
||||
session
|
||||
)
|
||||
|
||||
|
||||
if __name__ == "__main__":
|
||||
main()
|
||||
136
tools/graphrag/evaluation/README.md
Normal file
136
tools/graphrag/evaluation/README.md
Normal file
@ -0,0 +1,136 @@
|
||||
# GraphRAG evaluácia
|
||||
|
||||
Aktuálna verzia je **v7**, tag `graphrag-v7-frozen`.
|
||||
[Správa v7](results/final_v7_2026-10-26/REPORT.md): graf DEV 1 046/1 046,
|
||||
nový query-group TEST 80/80, model DEV 46/46, finálne odpovede TEST 80/80
|
||||
(prvý pokus 77/80). Všetkých 591 testov prešlo. Stará regresia má 319/320;
|
||||
jeden nepodložený modelový názov sa nedoručil. TEST sa neprekrýva so žiadnou odhalenou query skupinou;
|
||||
korpus, ľudia a šablóny sú známe. Dve kategórie majú len 2 a 7 nových skupín.
|
||||
|
||||
CLI vyžaduje explicitné `--questions`, `--audit`, `--freeze-manifest`
|
||||
(pri TESTe) a nový výstupný adresár. Použite `graphrag_questions_v7.json`,
|
||||
`results/v7_preparation/source_audit.json`, `frozen_v7.json`.
|
||||
Generátor `benchmark_v7` vytvára otázky jednorazovo z raw zdrojov, bez
|
||||
predikcií. Odstránil sa odhad začiatku štúdia z adresára, nie nedokumentované
|
||||
otázky z merania. [Príkazy a postup](../../../docs/graphrag_v7_2026-10-26_worklog.md).
|
||||
|
||||
## Historická v6
|
||||
|
||||
Historická verzia je **v6**, tag `graphrag-v6-frozen`.
|
||||
[Finálna správa v6](results/final_v6_2026-10-25/REPORT.md) oddeľuje grafový
|
||||
DEV 722/722, regresiu 320/320 a generované odpovede modelu.
|
||||
Generovanie má strict **316/320 (98,75 %)**; všetkých **565 testov** prešlo.
|
||||
Benchmark v6 ponecháva všetkých 1 042 otázok, ich ID a rozdelenie. Opravuje
|
||||
15 očakávaní po priamom čítaní zdrojov; generický odkaz „rešerš“ nie je názov
|
||||
akademického projektu. Všetky staršie dáta a výsledky ostávajú zachované.
|
||||
Modelový DEV má 42 známych otázok; finálna regresia obsahuje všetkých 320.
|
||||
|
||||
Použite `--questions tools/graphrag/evaluation/graphrag_questions_v6.json`,
|
||||
`--audit tools/graphrag/evaluation/results/v6_preparation/source_audit.json`
|
||||
a `--freeze-manifest tools/graphrag/evaluation/frozen_v6.json`.
|
||||
[Postup, kontroly a zdrojová vzorka](../../../docs/graphrag_v6_2026-10-25_worklog.md).
|
||||
Kontrola vzorky je AI kontrola; ľudské posúdenie je pripravené v CSV, neprebehlo.
|
||||
Ročník adresára sa pri chýbajúcom explicitnom začiatku štúdia používa ako
|
||||
náhradná konvencia, nie ako nezávislý administratívny doklad.
|
||||
|
||||
## Historická v5.1
|
||||
|
||||
Historická verzia je **v5.1**, tag `graphrag-v5.1-frozen`.
|
||||
[Finálna správa](results/final_v5_1_2026-10-25/REPORT.md) a
|
||||
[strojový súhrn](results/final_v5_1_2026-10-25/summary.json) oddeľujú
|
||||
vyhľadávanie, zdrojovú kontrolu všetkých vrátených typovaných faktov a generovanie.
|
||||
|
||||
- Graf DEV: **722/722**.
|
||||
- Graf historická regresia: **320/320**, vrátane kontroly nadbytočných faktov.
|
||||
- Generovanie: 39 vopred deklarovaných DEV a finálna regresia všetkých 320
|
||||
historických otázok. Finálny výsledok: **317/320 (99,06 %)**, bez chýb JSON
|
||||
a bez opravného požiadavku. Všetky tri zlyhania zostávajú započítané.
|
||||
- Kompletné automatizované testy: **525 passed, 4 skipped**.
|
||||
|
||||
Všetky otázky sú už známe. V5.1 je regresia, nie nový nezávislý TEST; finálna
|
||||
regresia generovania obsahuje aj 39 DEV otázok. Pôvodné gold ani výsledky sa
|
||||
nemenili. Prvá iterácia v5 (319/320) zostáva uložená a má overený zdrojový patch.
|
||||
|
||||
Reprodukcia v5.1 vyžaduje zodpovedajúci release checkout, raw wiki, JSON vstupy
|
||||
aj graf podľa manifestu. Používajte vždy nový výstupný adresár:
|
||||
|
||||
```bash
|
||||
python -m tools.graphrag.evaluation.evaluate_graphrag \
|
||||
--split test \
|
||||
--audit tools/graphrag/evaluation/results/v5_1_preparation/source_audit.json \
|
||||
--freeze-manifest tools/graphrag/evaluation/frozen_v5_1.json \
|
||||
--output-dir /tmp/graphrag-v5-1-reproduction
|
||||
```
|
||||
|
||||
Nové zmrazenie po vývoji používa kompletný DEV a `--purpose historical_regression`.
|
||||
Odtlačky zahŕňajú spoločné moduly aj efektívnu publikačnú politiku. Každý reálny
|
||||
DEV výsledok musí prejsť nezávislou kontrolou všetkých vrátených typovaných faktov.
|
||||
Pri ďalšom nezávislom experimente treba nové, vopred zdrojovo overené otázky.
|
||||
|
||||
## Historický protokol v4
|
||||
|
||||
Nasledujúce merania a príkazy opisujú pôvodnú v4. Na reprodukciu použite jej
|
||||
pôvodný checkout/graf; aktuálny kód nezodpovedá odtlačkom frozen_v4.
|
||||
|
||||
Historická zmrazená verzia je **v4**. [Finálna správa](results/final_v4_2026-10-25/REPORT.md) obsahuje protokol, výsledky a obmedzenia.
|
||||
|
||||
| Meranie grafového vyhľadávania | Správne | Úspešnosť |
|
||||
|---|---:|---:|
|
||||
| DEV/regresia v4 | 722/722 | 100,00 % |
|
||||
| Širší TEST v4 | 320/320 | 100,00 % |
|
||||
|
||||
Cieľ ≥92 % grafového vyhľadávania bol splnený v prvom finálnom behu. TEST má desať kategórií, 288 kladných a 32 záporných otázok, bez runtime chýb. Osoby aj korpus sú známe; nové sú otázky a kombinácie faktov. Logické skupiny ani normalizované otázky sa medzi DEV a TEST neprekrývajú. Výsledok neznamená všeobecnú 100 % správnosť na ľubovoľnom vstupe.
|
||||
|
||||
Generovanie odpovedí dosiahlo **281/300 (93,67 %)** na novom externom TESTe; 20 DEV otázok malo 19/20. Všetkých 19 zlyhaní vrátane 7 neplatných JSON odpovedí ostáva započítaných. Doplnkový audit všetkých vrátených grafových kontextových faktov má **319/320 (99,69 %)**; strict 320/320 neznamená pravdivosť každej nadbytočnej hodnoty. Najslabšia LLM kategória je názov + tag (21/30).
|
||||
|
||||
Samostatne sa hodnotí generovanie odpovedí cez školské OpenWebUI API po dodaní skutočného grafového kontextu. [Protokol generovania](../../answer_evaluation/README.md) oddeľuje 20 DEV a 300 nových LLM TEST výstupov. Natívny výber nástrojov hlavným agentom je ďalší blok projektu.
|
||||
|
||||
## Reprodukcia zmrazeného grafu
|
||||
|
||||
Použi zodpovedajúci kód, rovnakú pôvodnú wiki, JSON vstupy a obsah Neo4j podľa manifestu. Súkromné kľúče ostávajú v `.env`.
|
||||
|
||||
```bash
|
||||
set -a
|
||||
source .env
|
||||
set +a
|
||||
python -m tools.graphrag.evaluation.evaluate_graphrag \
|
||||
--split test \
|
||||
--audit tools/graphrag/evaluation/results/v4_preparation/source_audit.json \
|
||||
--freeze-manifest tools/graphrag/evaluation/frozen_v4.json \
|
||||
--output-dir /tmp/graphrag-v4-reproduction
|
||||
```
|
||||
|
||||
Existujúce finálne výstupy a manifesty sa neprepisujú. Opakované spustenie rovnakého TESTu je reprodukcia, nie nové nezávislé overenie. Ak sa podľa odhalených TEST chýb ladí ďalšia verzia, tieto otázky sú od tej chvíle DEV.
|
||||
|
||||
## Zdrojový benchmark a história
|
||||
|
||||
- `graphrag_questions.json`: pôvodných 500 otázok. V2 opravila 137 nesúladov (128 tagových predpokladov a 9 neúplných množín kategórií). Zmeny sú v `results/v2_preparation/legacy_corrections.json`.
|
||||
- V2: 509 DEV a 80 profilovo oddelených TEST otázok; finálny TEST 67/80 (83,75 %). Po odhalení sa stal regresiou.
|
||||
- V3: 589 DEV a 13 **nových** doplnkových otázok vytvorených z pôvodných dokumentov posledných dvoch neodhalených profilov. Nešlo o výber trinástich z pôvodných 500. Meranie prebehlo interným skriptom nad Neo4j bez OpenWebUI či LLM. DEV 589/589, malý TEST 13/13; obmedzené pokrytie neumožňovalo tvrdiť všeobecnú 100 % presnosť.
|
||||
- V4: 722 DEV (602 historických + 120 nových), 320 nových TEST skupín nad všetkými známymi profilmi. `source_oracle.py` číta raw Markdown oddelene od buildera. `benchmark_v4.py` nepoužíva výsledky vyhľadávania pri tvorbe očakávaní ani výbere otázok. Kontrola surových zdrojov doplnila 45 zmien/rozšírení historických väzieb názvov; záznamy a mapovanie ID sú v `results/v4_preparation/`.
|
||||
|
||||
V1–v3 ostávajú v pôvodných adresároch s manifestmi a tagmi `graphrag-v1-frozen`, `graphrag-v2-frozen`, `graphrag-v3-frozen`. Na reprodukciu treba ich pôvodný kód a graf. Percentá rôznych verzií nie sú kontrolovaným porovnaním identických otázok. Klasický RAG a jeho referenčné experimenty ostávajú samostatné.
|
||||
|
||||
## Strict a zmrazenie
|
||||
|
||||
Správne hodnoty patria tej istej osobe/práci a majú prepojené typované dôkazy. Overuje sa význam roku, názov a typ práce, relácie, kategória a autor toho istého dokumentu, zdrojové alternatívy a URL, presné množiny a počet, explicitné no-answer a neorezaný výsledok. Rozpoznaná hodnota z otázky sama nie je dôkazom. Schema3 overuje strojové vzory ciest, nie iba textový zoznam očakávaných trás.
|
||||
|
||||
Freeze vyžaduje kompletný DEV, nulové runtime chyby, platný zdrojový audit a odtlačky kódu, otázok, pôvodných súborov, JSON vstupov, grafu a parametrov. V4 explicitne deklaruje prekryv 72 profilov a nulový prekryv logických skupín. Starší režim profilovo oddeleného holdoutu zostáva zachovaný.
|
||||
|
||||
Oracle aj evaluator sú pravidlové. Priama kontrola pôvodných riadkov a stratifikovaná kontrola anotácií nie sú náhradou nezávislej ľudskej anotácie celého datasetu.
|
||||
|
||||
## Vývoj ďalšej verzie
|
||||
|
||||
Generátory historických v1–v4 neregeneruj na pôvodných miestach. Nové dáta, manifesty a merania potrebujú nové cesty/verziu. `benchmark_v4 --extra-exposed` vie vyradiť ďalšie odhalené skupiny, ale množstvo nových zdrojových prípadov je konečné a kvóty sa nesmú meniť podľa úspechu vyhľadávania.
|
||||
|
||||
```bash
|
||||
python -m tools.graphrag.evaluation.evaluate_graphrag \
|
||||
--split dev --audit tools/graphrag/evaluation/results/v4_preparation/source_audit.json \
|
||||
--output-dir /tmp/graphrag-next
|
||||
python -m tools.graphrag.evaluation.freeze_graphrag \
|
||||
--dev-results /tmp/graphrag-next/graphrag_dev.json \
|
||||
--audit tools/graphrag/evaluation/results/v4_preparation/source_audit.json \
|
||||
--output /tmp/graphrag-next/frozen.json
|
||||
```
|
||||
|
||||
Záverečná kompletná automatizovaná sada: **448 passed, 4 skipped** (vrátane nových testov generovania). Neo4j integračné testy používajú izolovaný scope a rollback. Výsledky obsahujú úplné JSON/CSV a odtlačky pre reprodukciu.
|
||||
0
tools/graphrag/evaluation/__init__.py
Normal file
0
tools/graphrag/evaluation/__init__.py
Normal file
123
tools/graphrag/evaluation/audit_benchmark.py
Normal file
123
tools/graphrag/evaluation/audit_benchmark.py
Normal file
@ -0,0 +1,123 @@
|
||||
"""Check source consistency without changing questions or consulting search output."""
|
||||
from __future__ import annotations
|
||||
|
||||
import argparse
|
||||
import hashlib
|
||||
import json
|
||||
import re
|
||||
from collections import Counter, defaultdict
|
||||
from pathlib import Path
|
||||
from typing import Any
|
||||
|
||||
from ..graphrag import build_graph_payload
|
||||
from .graphrag_evaluator import normalize_text
|
||||
from .reproducibility import content_fingerprints
|
||||
|
||||
ROOT = Path(__file__).resolve().parents[3]
|
||||
|
||||
|
||||
def audit_questions(questions: list[dict], payload: dict) -> dict[str, Any]:
|
||||
people = {normalize_text(row['name']): row for row in payload['people']}
|
||||
documents = {row['path']: row for row in payload['documents']}
|
||||
person_docs: dict[str, set[str]] = defaultdict(set)
|
||||
for row in payload['person_documents']:
|
||||
person_docs[row['person_id']].add(row['document_path'])
|
||||
doc_keywords: dict[str, set[str]] = defaultdict(set)
|
||||
for row in payload['document_keywords']:
|
||||
doc_keywords[row['document_path']].add(row['keyword_id'])
|
||||
keywords = {normalize_text(row['name']): row['id'] for row in payload['keywords']}
|
||||
keywords.update({normalize_text(row['id']): row['id'] for row in payload['keywords']})
|
||||
academic: dict[str, list[dict]] = defaultdict(list)
|
||||
for row in payload['theses'] + payload['works']:
|
||||
academic[row['source_document']].append(row)
|
||||
rows = []
|
||||
for question in questions:
|
||||
graph = question['graph']
|
||||
issues = []
|
||||
starts = [people.get(normalize_text(item['value']))
|
||||
for item in graph.get('start_entities', []) if item['type'] == 'person']
|
||||
if any(person is None for person in starts):
|
||||
issues.append('unknown_start_person')
|
||||
starts = [person for person in starts if person]
|
||||
expected = graph.get('expected_entities', [])
|
||||
targets = [people.get(normalize_text(item['value'])) for item in expected if item['type'] == 'person']
|
||||
targets = [person for person in targets if person] or starts
|
||||
required_people = starts if question['category'] == 'shared_keyword_pair' else targets
|
||||
for entity in expected:
|
||||
if entity['type'] == 'keyword':
|
||||
key = keywords.get(normalize_text(entity['value']))
|
||||
if key is None:
|
||||
issues.append('keyword_not_in_frontmatter_catalog')
|
||||
elif any(not any(key in doc_keywords[path] for path in person_docs[person['id']])
|
||||
for person in required_people):
|
||||
issues.append('keyword_not_linked_to_expected_person')
|
||||
elif entity['type'] in {'thesis_title', 'work_title'}:
|
||||
records = payload['theses'] if entity['type'] == 'thesis_title' else payload['works']
|
||||
paths = {person['source_document'] for person in starts}
|
||||
if not any(row['source_document'] in paths
|
||||
and normalize_text(row.get('title')) == normalize_text(entity['value'])
|
||||
for row in records):
|
||||
issues.append('title_not_supported_by_source')
|
||||
category = question['category']
|
||||
if category == 'person_multiple_categories' and starts:
|
||||
actual = {normalize_text(cat) for path in person_docs[starts[0]['id']]
|
||||
for cat in documents[path]['categories']}
|
||||
expected_set = {normalize_text(value) for value in graph.get('expected_entity_set', [])}
|
||||
if graph.get('entity_set_mode') == 'exact' and actual != expected_set:
|
||||
issues.append('exact_categories_omit_or_add_source_categories')
|
||||
years = {int(value) for value in re.findall(r'\b20\d{2}\b', question['question'])}
|
||||
if category == 'same_academic_year_pair':
|
||||
expected_years = {int(item['value']) for item in expected if item['type'] == 'year'}
|
||||
if any(not expected_years <= {r['year'] for r in academic[p['source_document']]}
|
||||
for p in starts):
|
||||
issues.append('shared_year_not_supported_by_source')
|
||||
if category == 'person_title_year':
|
||||
expected_years = {int(item['value']) for item in expected if item['type'] == 'year'}
|
||||
titles = {normalize_text(item['value']) for item in expected
|
||||
if item['type'] in {'thesis_title', 'work_title'}}
|
||||
if starts and not any(normalize_text(r.get('title')) in titles and r['year'] in expected_years
|
||||
for p in starts for r in academic[p['source_document']]):
|
||||
issues.append('title_year_pair_not_supported_by_source')
|
||||
if category == 'candidate_set_aggregation':
|
||||
actual = {normalize_text(p['name']) for p in starts
|
||||
if any(r['year'] in years for r in academic[p['source_document']])}
|
||||
expected_set = {normalize_text(value) for value in graph.get('expected_entity_set', [])}
|
||||
if actual != expected_set or len(actual) != graph.get('expected_count'):
|
||||
issues.append('candidate_set_or_count_not_supported_by_source')
|
||||
for path in question.get('expected_documents', []):
|
||||
if path not in documents:
|
||||
issues.append('unknown_expected_document')
|
||||
rows.append({'id': question['id'], 'split': question['split'],
|
||||
'category': category, 'source_consistent': not issues,
|
||||
'issues': sorted(set(issues))})
|
||||
return {
|
||||
'method': 'Static source checks; no retrieval output, question rewriting or alias invention.',
|
||||
'questions': rows,
|
||||
'by_split': {
|
||||
split: {'questions': len(selected),
|
||||
'source_consistent': sum(row['source_consistent'] for row in selected),
|
||||
'issues': dict(Counter(issue for row in selected for issue in row['issues']))}
|
||||
for split in ['dev', 'test']
|
||||
for selected in [[row for row in rows if row['split'] == split]]
|
||||
},
|
||||
}
|
||||
|
||||
|
||||
def main() -> None:
|
||||
parser = argparse.ArgumentParser(description=__doc__)
|
||||
parser.add_argument('--questions', type=Path, default=Path(__file__).parent / 'graphrag_questions.json')
|
||||
parser.add_argument('--output', type=Path, required=True)
|
||||
args = parser.parse_args()
|
||||
questions = json.loads(args.questions.read_text())
|
||||
payload = build_graph_payload(json.loads((ROOT / 'data/documents.json').read_text()),
|
||||
json.loads((ROOT / 'data/chunks.json').read_text()))
|
||||
audit = audit_questions(questions, payload)
|
||||
audit['dataset_sha256'] = hashlib.sha256(args.questions.read_bytes()).hexdigest()
|
||||
audit['inputs'] = content_fingerprints(args.questions)['inputs']
|
||||
args.output.parent.mkdir(parents=True, exist_ok=True)
|
||||
args.output.write_text(json.dumps(audit, ensure_ascii=False, indent=2) + '\n')
|
||||
print(json.dumps(audit['by_split'], ensure_ascii=False, indent=2))
|
||||
|
||||
|
||||
if __name__ == '__main__':
|
||||
main()
|
||||
526
tools/graphrag/evaluation/benchmark_v2.py
Normal file
526
tools/graphrag/evaluation/benchmark_v2.py
Normal file
@ -0,0 +1,526 @@
|
||||
"""Build a source-grounded schema-v3 regression set and profile-disjoint holdout.
|
||||
|
||||
This module never imports graph construction/search code and never reads any
|
||||
retrieval output. Legacy cases remain development-only. New TEST subjects are
|
||||
student profiles absent from every legacy start entity. TEST is generated once
|
||||
from raw source facts, before the corrected implementation is evaluated.
|
||||
"""
|
||||
from __future__ import annotations
|
||||
|
||||
import argparse
|
||||
import copy
|
||||
import hashlib
|
||||
import itertools
|
||||
import json
|
||||
import random
|
||||
import re
|
||||
from collections import Counter
|
||||
from pathlib import Path
|
||||
from typing import Any
|
||||
|
||||
from .source_oracle import ROOT, DEFAULT_WIKI, load_source_oracle, norm, supporting_documents
|
||||
|
||||
BASE = Path(__file__).resolve().parent
|
||||
SEED = 20261024
|
||||
|
||||
|
||||
def fingerprint(value: Any) -> str:
|
||||
return hashlib.sha256(json.dumps(value, sort_keys=True, ensure_ascii=False, separators=(',', ':')).encode()).hexdigest()
|
||||
|
||||
|
||||
def people_for(question: dict, oracle: dict) -> list[str]:
|
||||
names = {norm(name): name for name in oracle['people']}
|
||||
return [names[norm(item['value'])] for item in question['graph'].get('start_entities', [])
|
||||
if item['type'] == 'person' and norm(item['value']) in names]
|
||||
|
||||
|
||||
def academics(oracle: dict, person: str, *, title: str | None = None, year: int | None = None,
|
||||
kind: str | None = None) -> list[dict]:
|
||||
rows = oracle['people'][person]['academics']
|
||||
return [row for row in rows if (title is None or norm(row['title']) == norm(title))
|
||||
and (year is None or row['year'] == year) and (kind is None or row['academic_kind'] == kind)]
|
||||
|
||||
|
||||
def has_tag(oracle: dict, person: str, keyword: str) -> bool:
|
||||
return norm(keyword) in {norm(tag) for tag in oracle['people'][person]['tags']}
|
||||
|
||||
|
||||
def academic_binding(person: str, record: dict, *, title: bool = False, keyword: str | None = None) -> dict:
|
||||
binding = {'person': person, 'academic_kind': record['academic_kind'],
|
||||
'academic_type': record['academic_type'], 'year': record['year']}
|
||||
if title:
|
||||
binding['title'] = record['title']
|
||||
if keyword is not None:
|
||||
binding['keyword'] = keyword
|
||||
return {key: value for key, value in binding.items() if value is not None}
|
||||
|
||||
|
||||
def path_patterns(bindings: list[dict]) -> list[dict]:
|
||||
patterns = []
|
||||
for index, binding in enumerate(bindings):
|
||||
if any(key in binding for key in ['year', 'title', 'academic_kind', 'academic_type']):
|
||||
kind = binding.get('academic_kind', 'Academic')
|
||||
relation = 'AUTHORED' if kind == 'Thesis' else 'HAS_WORK' if kind == 'Work' else 'AUTHORED|HAS_WORK'
|
||||
patterns.append({'binding_index': index, 'node_kinds': ['Person', kind, 'Document'],
|
||||
'relationships': [relation, 'EVIDENCED_BY']})
|
||||
for field, kind, relation in [('keyword', 'Keyword', 'HAS_KEYWORD'),
|
||||
('category', 'Category', 'IN_CATEGORY'),
|
||||
('document_author', 'DocumentAuthor', 'AUTHORED_DOCUMENT')]:
|
||||
if field in binding:
|
||||
patterns.append({'binding_index': index, 'node_kinds': ['Person', 'Document', kind],
|
||||
'relationships': ['HAS_DOCUMENT', relation]})
|
||||
return patterns
|
||||
|
||||
|
||||
def binding_source_evidence(binding: dict, oracle: dict) -> list[dict]:
|
||||
person = oracle['people'][binding['person']]
|
||||
evidence = []
|
||||
for field in ['keyword', 'category', 'document_author']:
|
||||
if field not in binding:
|
||||
continue
|
||||
docs = supporting_documents(oracle, binding['person'], **{field: binding[field]})
|
||||
if binding.get('document_path'):
|
||||
docs = [p for p in docs if p == binding['document_path']]
|
||||
for path in docs:
|
||||
evidence.append({'document_path': path, 'sha256': oracle['documents'][path]['sha256'],
|
||||
'field': {'keyword': 'taxonomy.tag', 'category': 'taxonomy.category',
|
||||
'document_author': 'taxonomy.author'}[field], 'value': binding[field]})
|
||||
if any(key in binding for key in ['year', 'title', 'academic_kind', 'academic_type']):
|
||||
rows = academics(oracle, binding['person'], title=binding.get('title'), year=binding.get('year'),
|
||||
kind=binding.get('academic_kind'))
|
||||
for row in rows:
|
||||
if binding.get('academic_type') and row['academic_type'] != binding['academic_type']:
|
||||
continue
|
||||
evidence.append({'document_path': row['document_path'],
|
||||
'sha256': oracle['documents'][row['document_path']]['sha256'],
|
||||
'field': 'academic_record', 'academic_kind': row['academic_kind'],
|
||||
'academic_type': row['academic_type'], 'title': row['title'], 'year': row['year'],
|
||||
'heading_line': row['heading_line'], 'title_line': row['title_line'],
|
||||
'year_basis': row['year_basis']})
|
||||
if 'start_year' in binding:
|
||||
evidence.append({'document_path': person['profile'], 'sha256': oracle['documents'][person['profile']]['sha256'],
|
||||
'field': 'start_year', 'value': binding['start_year'],
|
||||
'basis': person.get('start_year_basis', 'explicit_text'), 'confidence': 'documented'})
|
||||
return evidence
|
||||
|
||||
|
||||
def make_case(case_id: str, split: str, category: str, question: str, names: list[str], oracle: dict,
|
||||
bindings: list[dict], *, no_answer: bool = False, reason: str | None = None,
|
||||
expected_set: list[str] | None = None, set_field: str | None = None,
|
||||
count: int | None = None, context_documents: list[str] | None = None,
|
||||
negative_constraints: dict | None = None) -> dict:
|
||||
known = [name for name in names if name in oracle['people']]
|
||||
profiles = sorted({oracle['people'][name]['profile'] for name in known})
|
||||
paths = set(context_documents or profiles)
|
||||
evidence = [item for binding in bindings for item in binding_source_evidence(binding, oracle)]
|
||||
# Multiple documents can independently prove the same tag/category. Gold
|
||||
# sources are alternatives for each bound proof, not an obligation to cite
|
||||
# every duplicate occurrence. Context profiles still cover all candidates.
|
||||
evidence_choices = []
|
||||
roles = {'taxonomy.tag': 'keyword_document', 'taxonomy.category': 'category_document',
|
||||
'taxonomy.author': 'author_document', 'academic_record': 'academic_document',
|
||||
'start_year': 'person_document'}
|
||||
if not no_answer:
|
||||
for index, binding in enumerate(bindings):
|
||||
per_role: dict[str, set[str]] = {}
|
||||
for item in binding_source_evidence(binding, oracle):
|
||||
per_role.setdefault(roles[item['field']], set()).add(item['document_path'])
|
||||
for role, alternatives in per_role.items():
|
||||
evidence_choices.append({'binding_index': index, 'role': role, 'any_of': [
|
||||
{'document_path': path, 'source_url': oracle['documents'][path]['source_url']}
|
||||
for path in sorted(alternatives)]})
|
||||
expected_values = []
|
||||
expected_entities = []
|
||||
if not no_answer:
|
||||
for binding in bindings:
|
||||
for field in ['person', 'keyword', 'category', 'document_author', 'title', 'year', 'start_year']:
|
||||
if field in binding:
|
||||
value = str(binding[field])
|
||||
expected_values.append(value)
|
||||
kind = ('thesis_title' if binding.get('academic_kind') == 'Thesis' else 'work_title') if field == 'title' else field
|
||||
expected_entities.append({'type': kind, 'value': value})
|
||||
if count is not None:
|
||||
expected_values.append(str(count))
|
||||
graph = {'schema_version': 3, 'task': category, 'start_entities': [{'type': 'person', 'value': name} for name in names],
|
||||
'expected_bindings': bindings if not no_answer else [],
|
||||
'expected_evidence_documents': evidence_choices,
|
||||
'expected_path_patterns': path_patterns(bindings) if not no_answer else [],
|
||||
'expected_no_answer': no_answer, 'expected_status': 'no_answer' if no_answer else 'ok',
|
||||
'expected_entities': expected_entities, 'expected_relations': [], 'expected_properties': [],
|
||||
'source_profiles': profiles}
|
||||
if no_answer:
|
||||
graph['no_answer_basis'] = reason or 'No source record satisfies every requested condition.'
|
||||
graph['negative_constraints'] = negative_constraints or {}
|
||||
# Closed-world negative: retain all original metadata considered, not a fabricated positive fact.
|
||||
evidence = [{'document_path': path, 'sha256': oracle['documents'][path]['sha256'],
|
||||
'field': 'closed_world_metadata', 'tags': oracle['documents'][path]['tags'],
|
||||
'categories': oracle['documents'][path]['categories']}
|
||||
for name in known for path in oracle['people'][name]['documents']]
|
||||
if expected_set is not None:
|
||||
graph.update(expected_entity_set=sorted(expected_set, key=norm), entity_set_mode='exact', entity_set_field=set_field or 'person')
|
||||
if count is not None:
|
||||
graph['expected_count'] = count
|
||||
graph['partition_group'] = fingerprint({'category': category, 'people': sorted(names, key=norm),
|
||||
'bindings': bindings, 'negative': no_answer,
|
||||
'requested': question if no_answer else None})[:20]
|
||||
return {'id': case_id, 'split': split, 'category': category, 'difficulty': 'hard', 'question': question,
|
||||
'should_answer': not no_answer, 'expected_documents': sorted(paths),
|
||||
'expected_source_urls': sorted(oracle['documents'][path]['source_url'] for path in paths),
|
||||
'expected_answer_contains': list(dict.fromkeys(expected_values)), 'graph': graph,
|
||||
'source_evidence': evidence, 'evidence_basis': ['independent_raw_markdown_oracle_v2']}
|
||||
|
||||
|
||||
def correct_legacy(question: dict, oracle: dict) -> dict:
|
||||
names = people_for(question, oracle); cat = question['category']; old = question['graph']
|
||||
entities = old.get('expected_entities', [])
|
||||
keyword = next((item['value'] for item in entities if item['type'] == 'keyword'), None)
|
||||
years = [int(item['value']) for item in entities if item['type'] == 'year']
|
||||
bindings = []; expected_set = None; set_field = None; count = None; reason = None
|
||||
if cat == 'shared_keyword_pair':
|
||||
if keyword and all(has_tag(oracle, name, keyword) for name in names):
|
||||
bindings = [{'person': name, 'keyword': keyword} for name in names]
|
||||
else:
|
||||
reason = 'Requested shared keyword is absent from the raw frontmatter of at least one named person.'
|
||||
elif cat == 'same_start_year_pair':
|
||||
bindings = [{'person': name, 'start_year': oracle['people'][name]['start_year']} for name in names]
|
||||
elif cat == 'same_academic_year_pair':
|
||||
common = set.intersection(*[{row['year'] for row in academics(oracle, name) if row['year'] is not None} for name in names])
|
||||
bindings = [{'person': name, 'year': year} for year in sorted(common) for name in names]
|
||||
if not common:
|
||||
reason = 'No shared academic year is stated in the original sources.'
|
||||
elif cat in {'person_title_year', 'person_keyword_title'}:
|
||||
titles = [item for item in entities if item['type'] in {'thesis_title', 'work_title'}]
|
||||
for item in titles:
|
||||
kind = 'Thesis' if item['type'] == 'thesis_title' else 'Work'
|
||||
rows = academics(oracle, names[0], title=item['value'], kind=kind)
|
||||
if not rows and norm(item['value']) in norm(oracle['documents'][oracle['people'][names[0]]['profile']]['raw_text']):
|
||||
raise RuntimeError(f"Oracle extraction needs review for supported raw title: {question['id']}")
|
||||
if years:
|
||||
rows = [row for row in rows if row['year'] in years]
|
||||
if cat == 'person_keyword_title' and not has_tag(oracle, names[0], keyword or ''):
|
||||
reason = 'Requested keyword is not a raw frontmatter tag of this person.'
|
||||
break
|
||||
for row in rows:
|
||||
binding = academic_binding(names[0], row, title=True, keyword=keyword if cat == 'person_keyword_title' else None)
|
||||
if cat == 'person_keyword_title' and not years:
|
||||
binding.pop('year', None)
|
||||
bindings.append(binding)
|
||||
if not bindings and not reason:
|
||||
reason = 'Requested title/type/year combination is not independently supported by the source.'
|
||||
elif cat == 'document_author_category_multi_hop':
|
||||
category = next(item['value'] for item in entities if item['type'] == 'category')
|
||||
for path in supporting_documents(oracle, names[0], category=category):
|
||||
author = oracle['documents'][path]['author']
|
||||
if author:
|
||||
bindings.append({'person': names[0], 'category': category, 'document_author': author,
|
||||
'document_path': path, 'same_document': True})
|
||||
if not bindings:
|
||||
reason = 'No same document supports both the category and metadata author.'
|
||||
elif cat == 'person_multiple_categories':
|
||||
expected_set = oracle['people'][names[0]]['categories']; set_field = 'category'
|
||||
bindings = [{'person': names[0], 'category': category} for category in expected_set]
|
||||
elif cat == 'candidate_set_aggregation':
|
||||
query_years = [int(x) for x in re.findall(r'\b20\d{2}\b', question['question'])]
|
||||
year = query_years[-1]
|
||||
matches = [name for name in names if academics(oracle, name, year=year)]
|
||||
bindings = [{'person': name, 'year': year} for name in matches]
|
||||
expected_set = matches; set_field = 'person'; count = len(matches)
|
||||
elif cat == 'conjunctive_disambiguation':
|
||||
year = years[0]
|
||||
matches = [name for name in names if has_tag(oracle, name, keyword) and academics(oracle, name, year=year)]
|
||||
bindings = [{'person': name, 'keyword': keyword, 'year': year} for name in matches]
|
||||
if not matches:
|
||||
reason = 'No named person satisfies both raw frontmatter keyword and academic year.'
|
||||
else:
|
||||
raise ValueError(f'Unsupported legacy category: {cat}')
|
||||
case = make_case(question['id'], 'dev', cat, question['question'], names, oracle, bindings,
|
||||
no_answer=reason is not None, reason=reason, expected_set=expected_set,
|
||||
set_field=set_field, count=count,
|
||||
negative_constraints=({'keyword': keyword, 'require_all_people': True} if cat == 'shared_keyword_pair'
|
||||
else {'keyword': keyword} if cat == 'person_keyword_title'
|
||||
else {'keyword': keyword, 'year': years[0]} if cat == 'conjunctive_disambiguation'
|
||||
else {'shared_academic_year': True} if cat == 'same_academic_year_pair'
|
||||
else {}))
|
||||
case['legacy_split'] = question['split']
|
||||
case['legacy_role'] = 'previously_seen_regression_only'
|
||||
return case
|
||||
|
||||
|
||||
def independent_pool(oracle: dict, names: list[str]) -> dict[str, list[dict]]:
|
||||
pool: dict[str, list[dict]] = {category: [] for category in [
|
||||
'shared_keyword_pair', 'same_academic_year_pair', 'same_start_year_pair', 'person_title_year',
|
||||
'person_keyword_title', 'document_author_category_multi_hop', 'person_multiple_categories',
|
||||
'candidate_set_aggregation', 'conjunctive_disambiguation']}
|
||||
def add(category: str, text: str, people: list[str], bindings: list[dict], **kwargs):
|
||||
pool[category].append(make_case('', 'test', category, text, people, oracle, bindings, **kwargs))
|
||||
for left, right in itertools.combinations(names, 2):
|
||||
common_tags = sorted({norm(tag): tag for tag in oracle['people'][left]['tags']
|
||||
if has_tag(oracle, right, tag)}.values(), key=norm)
|
||||
for tag in common_tags:
|
||||
add('shared_keyword_pair', f'Over spoločné kľúčové slovo {tag} pri osobách {left} a {right}.',
|
||||
[left, right], [{'person': name, 'keyword': tag} for name in [left, right]])
|
||||
shared_years = {row['year'] for row in academics(oracle, left)} & {row['year'] for row in academics(oracle, right)} - {None}
|
||||
# A query for an unspecified shared year expects all supported intersections.
|
||||
if shared_years:
|
||||
add('same_academic_year_pair', f'Aké spoločné roky práce spájajú osoby {left} a {right}?',
|
||||
[left, right], [{'person': name, 'year': year} for year in sorted(shared_years) for name in [left, right]])
|
||||
start_l, start_r = oracle['people'][left]['start_year'], oracle['people'][right]['start_year']
|
||||
if start_l is not None and start_l == start_r:
|
||||
add('same_start_year_pair', f'Porovnaj rovnaký rok začiatku štúdia osôb {left} a {right}.',
|
||||
[left, right], [{'person': name, 'start_year': start_l} for name in [left, right]])
|
||||
for name in names:
|
||||
person = oracle['people'][name]
|
||||
if person['categories']:
|
||||
add('person_multiple_categories', f'Vypíš všetky kategórie dokumentov osoby {name}.', [name],
|
||||
[{'person': name, 'category': cat} for cat in person['categories']],
|
||||
expected_set=person['categories'], set_field='category')
|
||||
for category in person['categories']:
|
||||
for path in supporting_documents(oracle, name, category=category):
|
||||
author = oracle['documents'][path]['author']
|
||||
if author:
|
||||
add('document_author_category_multi_hop',
|
||||
f'Kto je autor dokumentu osoby {name}, ktorý patrí do kategórie {category}?', [name],
|
||||
[{'person': name, 'category': category, 'document_author': author,
|
||||
'document_path': path, 'same_document': True}])
|
||||
# Title-year cases use only explicit, nonconflicting title records.
|
||||
for record in person['academics']:
|
||||
if not record['title'] or record['year'] is None or record in person['year_conflicts']:
|
||||
continue
|
||||
year = record['year']
|
||||
kind_label = 'diplomového projektu' if record['academic_type'] == 'diploma_project' else 'práce'
|
||||
add('person_title_year', f'Aký názov {kind_label} a rok práce sú pri osobe {name} uvedené pre rok {year}?',
|
||||
[name], [academic_binding(name, record, title=True)])
|
||||
for tag in person['tags']:
|
||||
binding = academic_binding(name, record, title=True, keyword=tag)
|
||||
# Pin the academic year in the question as the independent source can contain several titles.
|
||||
add('person_keyword_title', f'Aký názov práce osoby {name} v roku {year} súvisí s kľúčovým slovom {tag}?',
|
||||
[name], [binding])
|
||||
# Candidate groups are source-derived; the query mentions every candidate.
|
||||
for year in sorted({row['year'] for name in names for row in academics(oracle, name) if row['year'] is not None}):
|
||||
matching = [name for name in names if academics(oracle, name, year=year)]
|
||||
other = [name for name in names if name not in matching]
|
||||
for selected in itertools.islice(itertools.combinations(matching, 2), 12):
|
||||
if other:
|
||||
candidates = list(selected) + [other[0]]
|
||||
add('candidate_set_aggregation',
|
||||
f'Z kandidátov {", ".join(candidates)} vyber osoby s prácou v roku {year}. Koľko ich je?',
|
||||
candidates, [{'person': name, 'year': year} for name in selected],
|
||||
expected_set=list(selected), set_field='person', count=len(selected))
|
||||
for name in names:
|
||||
person = oracle['people'][name]
|
||||
for year in sorted({record['year'] for record in person['academics'] if record['year'] is not None}):
|
||||
for tag in person['tags']:
|
||||
distractors = [other for other in names if other != name
|
||||
and (has_tag(oracle, other, tag) != bool(academics(oracle, other, year=year)))]
|
||||
for other in distractors[:2]:
|
||||
candidates = [name, other]
|
||||
add('conjunctive_disambiguation',
|
||||
f'Ktorá z osôb {name} a {other} má kľúčové slovo {tag} a jej práca je z roku {year}?',
|
||||
candidates, [{'person': name, 'keyword': tag, 'year': year}])
|
||||
return pool
|
||||
|
||||
|
||||
def necessary_negatives(oracle: dict, names: list[str], split: str) -> list[dict]:
|
||||
cases = []
|
||||
prefix = 'dev' if split == 'dev' else 'holdout'
|
||||
for i, name in enumerate(names[:4]):
|
||||
tag = next(iter(oracle['people'][name]['tags']), 'nlp')
|
||||
cases.append(make_case(f'{prefix}-negative-year-{i}', split, 'negative_lookup',
|
||||
f'Aký názov práce má osoba {name}, ak jej práca je z roku 2099 a jej dokument obsahuje kľúčové slovo {tag}?',
|
||||
[name], oracle, [], no_answer=True, reason='No source academic record has year 2099.',
|
||||
negative_constraints={'year': 2099, 'keyword': tag}))
|
||||
for i, name in enumerate(names[4:6]):
|
||||
cases.append(make_case(f'{prefix}-negative-tag-{i}', split, 'negative_lookup',
|
||||
f'Aký názov práce má osoba {name}, ak jej dokument obsahuje kľúčové slovo neexistujucitagvzor?',
|
||||
[name], oracle, [], no_answer=True, reason='Requested tag absent from complete raw frontmatter catalog.',
|
||||
negative_constraints={'keyword': 'neexistujucitagvzor'}))
|
||||
for i, unknown in enumerate(['Zuzana Neexistujúca Vzorová', 'Roman Neskutočný Testovací'] if split == 'dev'
|
||||
else ['Tibor Neexistujúci Skúšobný', 'Lenka Neskutočná Vzorová']):
|
||||
cases.append(make_case(f'{prefix}-negative-person-{i}', split, 'negative_lookup',
|
||||
f'Aký názov diplomovej práce má osoba {unknown}?', [unknown], oracle, [],
|
||||
no_answer=True, reason='Explicit full name absent from all raw profile frontmatter titles.',
|
||||
negative_constraints={'unknown_person': unknown}))
|
||||
candidates = names[:3]
|
||||
cases.append(make_case(f'{prefix}-zero-count', split, 'candidate_set_aggregation',
|
||||
f'Z kandidátov {", ".join(candidates)} vyber osoby s prácou v roku 2099. Koľko ich je?',
|
||||
candidates, oracle, [], expected_set=[], set_field='person', count=0))
|
||||
return cases
|
||||
|
||||
|
||||
def validate_case(case: dict, oracle: dict) -> list[str]:
|
||||
issues = []
|
||||
graph = case['graph']
|
||||
names = people_for(case, oracle)
|
||||
if set(graph.get('source_profiles', [])) != {oracle['people'][name]['profile'] for name in names}:
|
||||
issues.append('incorrect_source_profile_partition')
|
||||
for binding in graph.get('expected_bindings', []):
|
||||
person = binding['person']
|
||||
if person not in oracle['people']:
|
||||
issues.append('unknown_bound_person'); continue
|
||||
if 'start_year' in binding and oracle['people'][person]['start_year'] != binding['start_year']:
|
||||
issues.append('wrong_start_year')
|
||||
metadata = {key: binding[key] for key in ['keyword', 'category', 'document_author'] if key in binding}
|
||||
if binding.get('same_document') and not supporting_documents(oracle, person, **metadata):
|
||||
issues.append('metadata_not_connected_in_same_document')
|
||||
for key, value in metadata.items():
|
||||
if not supporting_documents(oracle, person, **{key: value}):
|
||||
issues.append('unsupported_' + key)
|
||||
if any(key in binding for key in ['title', 'year', 'academic_type', 'academic_kind']):
|
||||
records = academics(oracle, person, title=binding.get('title'), year=binding.get('year'), kind=binding.get('academic_kind'))
|
||||
if binding.get('academic_type'):
|
||||
records = [r for r in records if r['academic_type'] == binding['academic_type']]
|
||||
if not records:
|
||||
issues.append('unsupported_academic_binding')
|
||||
if graph.get('expected_no_answer'):
|
||||
if graph.get('expected_bindings') or case.get('expected_answer_contains') or graph.get('expected_entities'):
|
||||
issues.append('negative_contains_positive_expectations')
|
||||
constraints = graph.get('negative_constraints', {})
|
||||
names = people_for(case, oracle)
|
||||
if constraints.get('unknown_person'):
|
||||
if norm(constraints['unknown_person']) in {norm(name) for name in oracle['people']}:
|
||||
issues.append('negative_person_actually_exists')
|
||||
elif constraints.get('missing_start_year'):
|
||||
if names and all(oracle['people'][name]['start_year'] is not None for name in names):
|
||||
issues.append('negative_start_year_actually_documented')
|
||||
elif constraints.get('shared_academic_year'):
|
||||
year_sets = [{r['year'] for r in academics(oracle, name) if r['year'] is not None} for name in names]
|
||||
if year_sets and set.intersection(*year_sets):
|
||||
issues.append('negative_shared_year_actually_exists')
|
||||
elif constraints.get('require_all_people'):
|
||||
if not names or all(has_tag(oracle, name, constraints.get('keyword', '')) for name in names):
|
||||
issues.append('negative_shared_keyword_actually_exists')
|
||||
elif constraints:
|
||||
matching = []
|
||||
for name in names:
|
||||
valid = not constraints.get('keyword') or has_tag(oracle, name, constraints['keyword'])
|
||||
if any(key in constraints for key in ['year', 'title', 'academic_kind', 'title_required']):
|
||||
records = academics(oracle, name, year=constraints.get('year'),
|
||||
title=constraints.get('title'), kind=constraints.get('academic_kind'))
|
||||
if constraints.get('academic_type'):
|
||||
records = [r for r in records if r['academic_type'] == constraints['academic_type']]
|
||||
if constraints.get('title_required'):
|
||||
records = [r for r in records if r.get('title')]
|
||||
valid = valid and bool(records)
|
||||
if valid:
|
||||
matching.append(name)
|
||||
if matching:
|
||||
issues.append('negative_conjunction_actually_satisfied')
|
||||
else:
|
||||
issues.append('negative_without_machine_verifiable_false_premise')
|
||||
if graph.get('expected_entity_set') is not None and graph.get('entity_set_field') == 'category':
|
||||
names = people_for(case, oracle)
|
||||
if names and set(graph['expected_entity_set']) != set(oracle['people'][names[0]]['categories']):
|
||||
issues.append('incomplete_category_set')
|
||||
if graph.get('expected_count') is not None:
|
||||
years = re.findall(r'\b\d{4}\b', case['question'])
|
||||
if not years:
|
||||
issues.append('count_without_supported_year_constraint')
|
||||
else:
|
||||
matches = {name for name in names if academics(oracle, name, year=int(years[-1]))}
|
||||
if matches != set(graph.get('expected_entity_set', [])) or len(matches) != graph['expected_count']:
|
||||
issues.append('incorrect_candidate_set_or_count')
|
||||
return sorted(set(issues))
|
||||
|
||||
|
||||
def audit_dataset(questions: list[dict], oracle: dict, dataset_path: Path) -> dict:
|
||||
rows = [{'id': question['id'], 'split': question['split'], 'source_consistent': not (issues := validate_case(question, oracle)),
|
||||
'issues': issues, 'category': question['category']} for question in questions]
|
||||
inputs = {name: hashlib.sha256((ROOT / name).read_bytes()).hexdigest() for name in ['data/documents.json', 'data/chunks.json']}
|
||||
return {'method': 'Independent original Markdown frontmatter/heading/title oracle; no graph parser, chunks or retrieval results used for labels.',
|
||||
'dataset_sha256': hashlib.sha256(dataset_path.read_bytes()).hexdigest(),
|
||||
'inputs': inputs, 'source_corpus': oracle['source_corpus'], 'questions': rows,
|
||||
'by_split': {split: {'questions': len(selected), 'source_consistent': sum(row['source_consistent'] for row in selected),
|
||||
'issues': dict(Counter(issue for row in selected for issue in row['issues']))}
|
||||
for split in ['dev', 'test'] for selected in [[row for row in rows if row['split'] == split]]}}
|
||||
|
||||
|
||||
def write_json(path: Path, value: Any) -> None:
|
||||
path.parent.mkdir(parents=True, exist_ok=True)
|
||||
path.write_text(json.dumps(value, ensure_ascii=False, indent=2) + '\n')
|
||||
|
||||
|
||||
def main() -> None:
|
||||
parser = argparse.ArgumentParser(description=__doc__)
|
||||
parser.add_argument('--wiki-root', type=Path, default=DEFAULT_WIKI)
|
||||
parser.add_argument('--legacy', type=Path, default=BASE / 'graphrag_questions.json')
|
||||
parser.add_argument('--output', type=Path, default=BASE / 'graphrag_questions_v2.json')
|
||||
parser.add_argument('--artifacts', type=Path, default=BASE / 'results/v2_preparation')
|
||||
args = parser.parse_args()
|
||||
oracle = load_source_oracle(args.wiki_root)
|
||||
legacy = json.loads(args.legacy.read_text())
|
||||
corrected = [correct_legacy(question, oracle) for question in legacy]
|
||||
legacy_names = {name for question in legacy for name in people_for(question, oracle)}
|
||||
exposed_path = BASE / 'results/final_2026-10-24/holdout_failures.json'
|
||||
previously_exposed = set()
|
||||
if exposed_path.exists():
|
||||
for row in json.loads(exposed_path.read_text()).get('questions', []):
|
||||
previously_exposed.update(set(row.get('actual_documents', [])) - set(row.get('expected_documents', [])))
|
||||
reserved_names = sorted([name for name, person in oracle['people'].items()
|
||||
if name not in legacy_names and person['profile'] not in previously_exposed
|
||||
and person['profile'].startswith('pages/students/')], key=norm)
|
||||
dev_negatives = necessary_negatives(oracle, sorted(legacy_names, key=norm), 'dev')
|
||||
test_pool = independent_pool(oracle, reserved_names)
|
||||
rng = random.Random(SEED)
|
||||
holdout = []
|
||||
for category, cases in test_pool.items():
|
||||
unique = {case['graph']['partition_group']: case for case in cases}
|
||||
candidates = list(unique.values()); rng.shuffle(candidates)
|
||||
if len(candidates) < 8:
|
||||
raise RuntimeError(f'Insufficient independent source cases for {category}: {len(candidates)}')
|
||||
for case in candidates[:8]:
|
||||
case['id'] = f'h{len(holdout)+1:04d}'
|
||||
holdout.append(case)
|
||||
negative_cases = necessary_negatives(oracle, reserved_names, 'test')
|
||||
# A zero-result count is an answerable numeric result, not a no-answer.
|
||||
zero_count = negative_cases.pop()
|
||||
count_index = next(i for i, case in enumerate(holdout) if case['category'] == 'candidate_set_aggregation')
|
||||
zero_count['id'] = holdout[count_index]['id']
|
||||
holdout[count_index] = zero_count
|
||||
holdout.extend(negative_cases)
|
||||
dev = corrected + dev_negatives
|
||||
questions = dev + holdout
|
||||
all_issues = {case['id']: validate_case(case, oracle) for case in questions if validate_case(case, oracle)}
|
||||
if all_issues:
|
||||
raise RuntimeError(f'Source consistency issues: {all_issues}')
|
||||
dev_profiles = {p for case in dev for p in case['graph']['source_profiles']}
|
||||
test_profiles = {p for case in holdout for p in case['graph']['source_profiles']}
|
||||
assert not dev_profiles & test_profiles
|
||||
assert not ({case['graph']['partition_group'] for case in dev} & {case['graph']['partition_group'] for case in holdout})
|
||||
write_json(args.output, questions)
|
||||
corrections = []
|
||||
old_audit_path = BASE / 'results/final_2026-10-24/source_audit.json'
|
||||
old_issues = {row['id']: row['issues'] for row in json.loads(old_audit_path.read_text())['questions'] if row['issues']}
|
||||
for old, new in zip(legacy, corrected):
|
||||
corrections.append({'id': old['id'], 'legacy_split': old['split'], 'new_split': 'dev',
|
||||
'v1_source_audit_issues': old_issues.get(old['id'], []),
|
||||
'old_should_answer': old.get('should_answer', True), 'new_should_answer': new['should_answer'],
|
||||
'old_expected_values': old['expected_answer_contains'], 'new_expected_values': new['expected_answer_contains'],
|
||||
'new_expected_bindings': new['graph']['expected_bindings'],
|
||||
'no_answer_basis': new['graph'].get('no_answer_basis'),
|
||||
'source_evidence': new['source_evidence']})
|
||||
write_json(args.artifacts / 'legacy_corrections.json', {'legacy_count': len(legacy), 'v1_flagged_count': len(old_issues),
|
||||
'resolved_v1_flagged_count': sum(not validate_case(new, oracle) for new in corrected if new['id'] in old_issues),
|
||||
'negative_count': sum(not case['should_answer'] for case in corrected), 'questions': corrections})
|
||||
write_json(args.artifacts / 'source_audit.json', audit_dataset(questions, oracle, args.output))
|
||||
partition = {'seed': SEED, 'strategy': 'All previously seen 500 cases are DEV regression. TEST profiles never appeared in legacy start_entities; all real candidate profiles are disjoint.',
|
||||
'dev_count': len(dev), 'test_count': len(holdout), 'previously_exposed_profiles_excluded_from_test': sorted(previously_exposed),
|
||||
'dev_profiles': sorted(dev_profiles), 'test_profiles': sorted(test_profiles),
|
||||
'dev_groups': sorted({case['graph']['partition_group'] for case in dev}),
|
||||
'test_groups': sorted({case['graph']['partition_group'] for case in holdout}),
|
||||
'dev_categories': dict(Counter(case['category'] for case in dev)),
|
||||
'test_categories': dict(Counter(case['category'] for case in holdout)),
|
||||
'source_corpus': oracle['source_corpus'],
|
||||
'dataset_sha256': hashlib.sha256(args.output.read_bytes()).hexdigest(),
|
||||
'limitations': ['Same source corpus and shared tag/category/author vocabulary.',
|
||||
'Template families are known; TEST persons and their fact groups are withheld.',
|
||||
'Oracle is independent of graph extraction but still rule-based; provenance permits human review.']}
|
||||
write_json(args.artifacts / 'partition.json', partition)
|
||||
print(json.dumps({'dataset': str(args.output), 'dev': len(dev), 'test': len(holdout),
|
||||
'reserved_profile_count': len(test_profiles), 'source_issues': 0,
|
||||
'corrected_legacy_negatives': sum(not q['should_answer'] for q in corrected),
|
||||
'resolved_original_issues': len(old_issues),
|
||||
'test_categories': partition['test_categories']}, ensure_ascii=False, indent=2))
|
||||
|
||||
|
||||
if __name__ == '__main__':
|
||||
main()
|
||||
153
tools/graphrag/evaluation/benchmark_v3.py
Normal file
153
tools/graphrag/evaluation/benchmark_v3.py
Normal file
@ -0,0 +1,153 @@
|
||||
"""Continue after exposed v2: all old cases become DEV; reserve the last unseen profiles.
|
||||
|
||||
The small supplementary holdout cannot replace the broader independent v2
|
||||
measurement. It is kept profile-disjoint and must be reported with its size.
|
||||
"""
|
||||
from __future__ import annotations
|
||||
|
||||
import argparse
|
||||
import copy
|
||||
import hashlib
|
||||
import json
|
||||
import re
|
||||
from collections import Counter
|
||||
from pathlib import Path
|
||||
|
||||
from .benchmark_v2 import (BASE, make_case, correct_legacy, people_for, academics, has_tag,
|
||||
academic_binding, validate_case, audit_dataset, write_json)
|
||||
from .source_oracle import load_source_oracle, supporting_documents, norm
|
||||
|
||||
|
||||
def reannotate(case, oracle, original):
|
||||
if case['id'] in original:
|
||||
return correct_legacy(original[case['id']], oracle)
|
||||
category = case['category']; graph = case['graph']; names = people_for(case, oracle)
|
||||
bindings = []; negative = None; expected_set = None; field = None; count = None; constraints = {}
|
||||
old = graph.get('expected_bindings', [])
|
||||
years = [int(y) for y in re.findall(r'\b20\d{2}\b', case['question'])]
|
||||
keyword = next((row.get('keyword') for row in old if row.get('keyword')), None)
|
||||
if category == 'negative_lookup':
|
||||
corrected = copy.deepcopy(case); corrected['split'] = 'dev'
|
||||
return corrected
|
||||
if category == 'shared_keyword_pair':
|
||||
if all(has_tag(oracle, name, keyword) for name in names):
|
||||
bindings = [{'person': name, 'keyword': keyword} for name in names]
|
||||
else:
|
||||
negative = 'No common literal frontmatter tag.'; constraints = {'keyword': keyword, 'require_all_people': True}
|
||||
elif category == 'same_academic_year_pair':
|
||||
common = set.intersection(*[{r['year'] for r in academics(oracle, name) if r['year']} for name in names])
|
||||
bindings = [{'person': name, 'year': year} for year in sorted(common) for name in names]
|
||||
if not common:
|
||||
negative = 'No shared academic year in original sources.'; constraints = {'shared_academic_year': True}
|
||||
elif category == 'same_start_year_pair':
|
||||
bindings = [{'person': name, 'start_year': oracle['people'][name]['start_year']} for name in names]
|
||||
elif category in {'person_title_year', 'person_keyword_title'}:
|
||||
records = [r for r in academics(oracle, names[0], year=years[-1]) if r.get('title')]
|
||||
if 'diplomoveho projektu' in norm(case['question']):
|
||||
records = [r for r in records if r['academic_type'] == 'diploma_project']
|
||||
if category == 'person_keyword_title' and not has_tag(oracle, names[0], keyword):
|
||||
records = []
|
||||
bindings = [academic_binding(names[0], row, title=True, keyword=keyword) for row in records]
|
||||
if not bindings:
|
||||
negative = 'Requested year/type/title is absent; a project title is not a future thesis title.'
|
||||
constraints = {'year': years[-1], **({'keyword': keyword} if keyword else {})}
|
||||
elif category == 'document_author_category_multi_hop':
|
||||
for row in old:
|
||||
for path in supporting_documents(oracle, names[0], category=row['category']):
|
||||
author = oracle['documents'][path]['author']
|
||||
if author:
|
||||
bindings.append({'person': names[0], 'category': row['category'], 'document_author': author,
|
||||
'document_path': path, 'same_document': True})
|
||||
elif category == 'person_multiple_categories':
|
||||
expected_set = oracle['people'][names[0]]['categories']; field = 'category'
|
||||
bindings = [{'person': names[0], 'category': value} for value in expected_set]
|
||||
elif category == 'candidate_set_aggregation':
|
||||
expected_set = [name for name in names if academics(oracle, name, year=years[-1])]
|
||||
count = len(expected_set); field = 'person'
|
||||
bindings = [{'person': name, 'year': years[-1]} for name in expected_set]
|
||||
elif category == 'conjunctive_disambiguation':
|
||||
matches = [name for name in names if has_tag(oracle, name, keyword) and academics(oracle, name, year=years[-1])]
|
||||
bindings = [{'person': name, 'keyword': keyword, 'year': years[-1]} for name in matches]
|
||||
if not matches:
|
||||
negative = 'No candidate satisfies both source conditions.'
|
||||
constraints = {'keyword': keyword, 'year': years[-1]}
|
||||
else:
|
||||
raise ValueError(category)
|
||||
result = make_case(case['id'], 'dev', category, case['question'], names, oracle, bindings,
|
||||
no_answer=negative is not None, reason=negative, negative_constraints=constraints,
|
||||
expected_set=expected_set, set_field=field, count=count)
|
||||
result['legacy_role'] = 'exposed_v2_case_development_only'
|
||||
return result
|
||||
|
||||
|
||||
def main():
|
||||
parser = argparse.ArgumentParser(description=__doc__)
|
||||
parser.add_argument('--output', type=Path, default=BASE / 'graphrag_questions_v3.json')
|
||||
parser.add_argument('--artifacts', type=Path, default=BASE / 'results/v3_preparation')
|
||||
args = parser.parse_args()
|
||||
oracle = load_source_oracle()
|
||||
previous = json.loads((BASE / 'graphrag_questions_v2.json').read_text())
|
||||
original = {q['id']: q for q in json.loads((BASE / 'graphrag_questions.json').read_text())}
|
||||
dev = [reannotate(case, oracle, original) for case in previous]
|
||||
used = {p for case in previous for p in case['graph']['source_profiles']}
|
||||
used.update(json.loads((BASE / 'results/v2_preparation/partition.json').read_text())[
|
||||
'previously_exposed_profiles_excluded_from_test'])
|
||||
reserved = sorted([name for name, person in oracle['people'].items()
|
||||
if person['profile'].startswith('pages/students/') and person['profile'] not in used], key=norm)
|
||||
if len(reserved) != 2:
|
||||
raise RuntimeError('Unexpected remaining unseen profile population; review partition policy.')
|
||||
holdout = []
|
||||
def add(category, text, names, bindings, **kwargs):
|
||||
holdout.append(make_case(f'fresh-{len(holdout)+1:03d}', 'test', category, text, names,
|
||||
oracle, bindings, **kwargs))
|
||||
for name in reserved:
|
||||
person = oracle['people'][name]
|
||||
add('person_multiple_categories', f'Vypíš všetky kategórie dokumentov osoby {name}.', [name],
|
||||
[{'person': name, 'category': category} for category in person['categories']],
|
||||
expected_set=person['categories'], set_field='category')
|
||||
category = person['categories'][0]
|
||||
for path in supporting_documents(oracle, name, category=category)[:1]:
|
||||
author = oracle['documents'][path]['author']
|
||||
if author:
|
||||
add('document_author_category_multi_hop',
|
||||
f'Ktorý autor dokumentu je pri osobe {name} spojený s kategóriou {category}?', [name],
|
||||
[{'person': name, 'category': category, 'document_author': author,
|
||||
'document_path': path, 'same_document': True}])
|
||||
add('person_start_year', f'Aký rok začiatku štúdia je uvedený pri osobe {name}?', [name],
|
||||
[{'person': name, 'start_year': person['start_year']}])
|
||||
add('negative_lookup', f'Aký názov práce má osoba {name}, ak jej dokument obsahuje kľúčové slovo nenajdenyoverovacitag?',
|
||||
[name], [], no_answer=True, reason='Tag absent from raw frontmatter.',
|
||||
negative_constraints={'keyword': 'nenajdenyoverovacitag'})
|
||||
add('negative_lookup', f'Aký názov práce má osoba {name} v roku 2098?', [name], [],
|
||||
no_answer=True, reason='No academic record for requested year.', negative_constraints={'year': 2098})
|
||||
for name in ['Diana Neznáma Overovacia', 'Milan Neprítomný Vzorový']:
|
||||
add('negative_lookup', f'Aký názov diplomovej práce má osoba {name}?', [name], [],
|
||||
no_answer=True, reason='No profile with requested full name.', negative_constraints={'unknown_person': name})
|
||||
add('candidate_set_aggregation', f'Z kandidátov {", ".join(reserved)} vyber osoby s prácou v roku 2098. Koľko ich je?',
|
||||
reserved, [], expected_set=[], set_field='person', count=0)
|
||||
questions = dev + holdout
|
||||
issues = {q['id']: validate_case(q, oracle) for q in questions if validate_case(q, oracle)}
|
||||
if issues:
|
||||
raise RuntimeError(f'Independent source audit failed: {issues}')
|
||||
dev_profiles = {p for q in dev for p in q['graph']['source_profiles']}
|
||||
test_profiles = {p for q in holdout for p in q['graph']['source_profiles']}
|
||||
assert not dev_profiles & test_profiles
|
||||
write_json(args.output, questions)
|
||||
write_json(args.artifacts / 'source_audit.json', audit_dataset(questions, oracle, args.output))
|
||||
changes = [{'id': old['id'], 'old_bindings': old['graph']['expected_bindings'],
|
||||
'new_bindings': new['graph']['expected_bindings'], 'old_should_answer': old['should_answer'],
|
||||
'new_should_answer': new['should_answer'], 'source_evidence': new['source_evidence']}
|
||||
for old, new in zip(previous, dev) if old['graph']['expected_bindings'] != new['graph']['expected_bindings']
|
||||
or old['should_answer'] != new['should_answer']]
|
||||
write_json(args.artifacts / 'source_adjudications.json', {'method': 'Raw heading project/thesis distinction; no answer-output based relabeling.', 'changes': changes})
|
||||
partition = {'dev_count': len(dev), 'test_count': len(holdout), 'dev_profiles': sorted(dev_profiles),
|
||||
'test_profiles': sorted(test_profiles), 'source_profile_overlap': 0,
|
||||
'limitations': ['Only two entirely unseen profiles remain; supplementary holdout has limited category coverage.',
|
||||
'The broader v2 independent TEST remains 67/80; v2 cases are now DEV, never fresh TEST.']}
|
||||
write_json(args.artifacts / 'partition.json', partition)
|
||||
print(json.dumps({'dev': len(dev), 'test': len(holdout), 'unseen_profiles': len(reserved),
|
||||
'source_adjudications': len(changes), 'source_issues': 0}, indent=2))
|
||||
|
||||
|
||||
if __name__ == '__main__':
|
||||
main()
|
||||
217
tools/graphrag/evaluation/benchmark_v4.py
Normal file
217
tools/graphrag/evaluation/benchmark_v4.py
Normal file
@ -0,0 +1,217 @@
|
||||
"""Predeclare a broad source-grounded holdout, without reading retrieval outputs.
|
||||
|
||||
All profiles have already been exposed in v1-v3. This is a NEW QUERY-GROUP
|
||||
holdout over the same corpus, explicitly not an unseen-person experiment.
|
||||
Historic cases remain DEV; paraphrases of the same logical task stay together.
|
||||
"""
|
||||
from __future__ import annotations
|
||||
|
||||
import argparse
|
||||
import copy
|
||||
import json
|
||||
import random
|
||||
import re
|
||||
from collections import Counter
|
||||
from pathlib import Path
|
||||
|
||||
from .benchmark_v2 import BASE, academic_binding, academics, audit_dataset, fingerprint, independent_pool, make_case, validate_case, write_json
|
||||
from .source_oracle import load_source_oracle, norm
|
||||
|
||||
SEED = 20261025
|
||||
QUOTAS = {
|
||||
'shared_keyword_pair': 40, 'same_academic_year_pair': 40,
|
||||
'same_start_year_pair': 32, 'person_title_year': 24,
|
||||
'person_keyword_title': 32, 'document_author_category_multi_hop': 24,
|
||||
'person_multiple_categories': 24, 'candidate_set_aggregation': 32,
|
||||
'conjunctive_disambiguation': 40, 'negative_lookup': 32,
|
||||
}
|
||||
|
||||
|
||||
def logical_group(case: dict) -> str:
|
||||
"""Normalize task/subjects/constraints; never make paraphrases independent."""
|
||||
graph = case['graph']; category = case['category']
|
||||
names = sorted(norm(row['value']) for row in graph['start_entities'] if row['type'] == 'person')
|
||||
bindings = graph.get('expected_bindings', [])
|
||||
keywords = sorted({norm(row['keyword']) for row in bindings if row.get('keyword')})
|
||||
years = sorted({int(value) for value in re.findall(r'\b\d{4}\b', case['question'])})
|
||||
# A shared-year query has no requested year; its complete answer is derived.
|
||||
selectors = {'keywords': keywords, 'requested_years': years}
|
||||
if category == 'document_author_category_multi_hop':
|
||||
selectors['categories'] = sorted({norm(row['category']) for row in bindings if row.get('category')})
|
||||
if graph.get('expected_no_answer'):
|
||||
selectors['negative_constraints'] = {
|
||||
key: norm(value) if isinstance(value, str) else value
|
||||
for key, value in graph.get('negative_constraints', {}).items()}
|
||||
return fingerprint({'category': category, 'subjects': names, 'selectors': selectors})
|
||||
|
||||
|
||||
def paraphrase(case: dict, variant: int) -> str:
|
||||
names = [e['value'] for e in case['graph']['start_entities']]
|
||||
category = case['category']; rows = case['graph']['expected_bindings']
|
||||
year = next(iter(re.findall(r'\b20\d{2}\b', case['question'])), '')
|
||||
tag = next((r['keyword'] for r in rows if r.get('keyword')), '')
|
||||
if variant == 0 or category == 'negative_lookup':
|
||||
return case['question']
|
||||
if category == 'shared_keyword_pair':
|
||||
return (f'Majú osoby {names[0]} a {names[1]} spoločné kľúčové slovo {tag}?'
|
||||
if variant == 1 else f'Pre osoby {names[0]} a {names[1]} over rovnaké kľúčové slovo {tag}.')
|
||||
if category == 'same_academic_year_pair':
|
||||
return (f'Ktoré spoločné roky prác majú osoby {names[0]} a {names[1]}?'
|
||||
if variant == 1 else f'Porovnaj rovnaké roky práce pri osobách {names[0]} a {names[1]}.')
|
||||
if category == 'same_start_year_pair':
|
||||
return f'Aký spoločný rok začiatku štúdia majú osoby {names[0]} a {names[1]}?'
|
||||
if category == 'person_multiple_categories':
|
||||
return f'Aké všetky kategórie majú dokumenty osoby {names[0]}?'
|
||||
if category == 'document_author_category_multi_hop':
|
||||
return f'Ktorý autor dokumentu je pri osobe {names[0]} spojený s kategóriou {rows[0]["category"]}?'
|
||||
if category == 'person_title_year':
|
||||
# Preserve an explicit project selector, if present in the source query.
|
||||
label = 'diplomového projektu' if 'diplomoveho projektu' in norm(case['question']) else 'práce'
|
||||
return f'Uveď názov {label} osoby {names[0]} a rok práce pre rok {year}.'
|
||||
if category == 'person_keyword_title':
|
||||
return f'Uveď názov práce osoby {names[0]} v roku {year} s kľúčovým slovom {tag}.'
|
||||
if category == 'candidate_set_aggregation':
|
||||
return f'Z kandidátov {", ".join(names)} vyber osoby s prácou v roku {year}. Aký je ich počet?'
|
||||
if category == 'conjunctive_disambiguation':
|
||||
return f'Ktorá z osôb {names[0]} a {names[1]} spĺňa kľúčové slovo {tag} a rok práce {year}?'
|
||||
return case['question']
|
||||
|
||||
|
||||
def build_pool(oracle: dict) -> dict[str, list[dict]]:
|
||||
names = sorted(oracle['people'], key=norm)
|
||||
pool = independent_pool(oracle, names)
|
||||
negatives = []
|
||||
# Realistic absent combinations as well as unknown entities. Positive cases
|
||||
# make up 90% of TEST; no easy-negative inflation of the headline score.
|
||||
for index, name in enumerate(names):
|
||||
other_tags = sorted({tag for p in oracle['people'].values() for tag in p['tags']
|
||||
if norm(tag) not in {norm(t) for t in oracle['people'][name]['tags']}}, key=norm)
|
||||
if other_tags:
|
||||
tag = other_tags[index % len(other_tags)]
|
||||
negatives.append(make_case('', 'test', 'negative_lookup',
|
||||
f'Aký názov práce má osoba {name} s kľúčovým slovom {tag}?', [name], oracle, [],
|
||||
no_answer=True, reason='Requested literal tag is absent from this source document family.',
|
||||
negative_constraints={'keyword': tag}))
|
||||
observed = {r['year'] for r in academics(oracle, name)}
|
||||
absent_year = next(y for y in range(2018, 2027) if y not in observed)
|
||||
negatives.append(make_case('', 'test', 'negative_lookup',
|
||||
f'Aký názov práce má osoba {name} v roku {absent_year}?', [name], oracle, [],
|
||||
no_answer=True, reason='Requested academic year is absent from the original profile.',
|
||||
negative_constraints={'year': absent_year}))
|
||||
for first, last in [('Jozef', 'Neznámy Overovací'), ('Petra', 'Neznáma Overovacia'),
|
||||
('Juraj', 'Nevyskytujúci Skúšobný'), ('Lucia', 'Chýbajúca Vzorová'),
|
||||
('Adam', 'Nedostupný Kontrolný'), ('Eva', 'Neprítomná Kontrolná')]:
|
||||
name = f'{first} {last}'
|
||||
negatives.append(make_case('', 'test', 'negative_lookup', f'Aký názov práce má osoba {name}?',
|
||||
[name], oracle, [], no_answer=True, reason='Full name absent from all original profiles.',
|
||||
negative_constraints={'unknown_person': name}))
|
||||
pool['negative_lookup'] = negatives
|
||||
return pool
|
||||
|
||||
|
||||
def refresh_titles(case: dict, oracle: dict) -> dict:
|
||||
"""Adjudicate title gold from raw sources before looking at TEST predictions."""
|
||||
if case['category'] not in {'person_title_year', 'person_keyword_title'} or not case['should_answer']:
|
||||
return copy.deepcopy(case)
|
||||
name = case['graph']['start_entities'][0]['value']
|
||||
years = [int(v) for v in re.findall(r'\b20\d{2}\b', case['question'])]
|
||||
tag = next((b.get('keyword') for b in case['graph']['expected_bindings'] if b.get('keyword')), None)
|
||||
text = norm(case['question'])
|
||||
kind = next((kind for phrase, kind in [('diplomoveho projektu', 'diploma_project'),
|
||||
('diplomovej prace', 'diploma_thesis'), ('bakalarskej prace', 'bachelor_thesis')]
|
||||
if phrase in text), None)
|
||||
records = [r for r in academics(oracle, name) if r.get('title')
|
||||
and (not years or r['year'] in years) and (kind is None or r['academic_type'] == kind)]
|
||||
bindings = [academic_binding(name, r, title=True, keyword=tag) for r in records]
|
||||
return make_case(case['id'], case['split'], case['category'], case['question'], [name], oracle, bindings,
|
||||
no_answer=not bindings, reason='No explicit title for the requested academic record in original Markdown.',
|
||||
negative_constraints={'title_required': True, **({'year': years[-1]} if years else {}),
|
||||
**({'keyword': tag} if tag else {}), **({'academic_type': kind} if kind else {})})
|
||||
|
||||
|
||||
def main() -> None:
|
||||
parser = argparse.ArgumentParser(description=__doc__)
|
||||
parser.add_argument('--output', type=Path, default=BASE / 'graphrag_questions_v4.json')
|
||||
parser.add_argument('--artifacts', type=Path, default=BASE / 'results/v4_preparation')
|
||||
parser.add_argument('--seed', type=int, default=SEED)
|
||||
parser.add_argument('--extra-exposed', type=Path, action='append', default=[])
|
||||
args = parser.parse_args()
|
||||
if args.output.exists() or args.artifacts.exists():
|
||||
parser.error('Refusing to overwrite a declared benchmark or its preparation artifacts.')
|
||||
oracle = load_source_oracle()
|
||||
historic = json.loads((BASE / 'graphrag_questions_v3.json').read_text())
|
||||
for path in args.extra_exposed:
|
||||
historic.extend(json.loads(path.read_text()))
|
||||
old_questions = {norm(q['question']) for q in historic}
|
||||
exposed = {logical_group(q) for q in historic}
|
||||
adjudications = []
|
||||
for index, original in enumerate(historic):
|
||||
corrected = refresh_titles(original, oracle)
|
||||
if corrected['graph']['expected_bindings'] != original['graph']['expected_bindings']:
|
||||
adjudications.append({'id': original['id'], 'split': 'dev',
|
||||
'old_bindings': original['graph']['expected_bindings'], 'new_bindings': corrected['graph']['expected_bindings'],
|
||||
'source_evidence': corrected['source_evidence']})
|
||||
historic[index] = corrected
|
||||
exposed.update(logical_group(q) for q in historic)
|
||||
dev = []
|
||||
for index, original in enumerate(historic):
|
||||
case = copy.deepcopy(original); case['split'] = 'dev'
|
||||
case['id'] = f'regression-{index + 1:04d}'
|
||||
case['graph']['partition_group'] = logical_group(case)
|
||||
dev.append(case)
|
||||
rng = random.Random(args.seed); holdout = []; capacities = {}
|
||||
for category, cases in build_pool(oracle).items():
|
||||
unique = {logical_group(c): c for c in cases
|
||||
if logical_group(c) not in exposed and norm(c['question']) not in old_questions}
|
||||
candidates = sorted(unique.values(), key=lambda q: logical_group(q)); rng.shuffle(candidates)
|
||||
quota = QUOTAS[category]; capacities[category] = len(candidates)
|
||||
if len(candidates) < quota:
|
||||
raise RuntimeError(f'Insufficient unseen logical groups for {category}: {len(candidates)} < {quota}')
|
||||
# Random selection is committed before running either split. Never
|
||||
# select or remove a TEST question based on a retrieval outcome.
|
||||
for index, case in enumerate(candidates[:quota]):
|
||||
case = refresh_titles(case, oracle); case['split'] = 'test'
|
||||
case['id'] = f'wide-{len(holdout) + 1:03d}'
|
||||
case['question'] = paraphrase(case, index % 3)
|
||||
case['graph']['partition_group'] = logical_group(case)
|
||||
holdout.append(case)
|
||||
for index, case in enumerate(candidates[quota:quota + min(12, max(0, len(candidates) - quota))]):
|
||||
case = refresh_titles(case, oracle); case['split'] = 'dev'
|
||||
case['id'] = f'wide-dev-{len(dev) + 1:04d}'
|
||||
case['question'] = paraphrase(case, index % 3)
|
||||
case['graph']['partition_group'] = logical_group(case)
|
||||
dev.append(case)
|
||||
questions = dev + holdout
|
||||
problems = {q['id']: validate_case(q, oracle) for q in questions if validate_case(q, oracle)}
|
||||
if problems:
|
||||
raise RuntimeError(f'Source oracle rejected cases: {problems}')
|
||||
groups = {split: {q['graph']['partition_group'] for q in questions if q['split'] == split}
|
||||
for split in ['dev', 'test']}
|
||||
assert not groups['dev'] & groups['test']
|
||||
assert not {norm(q['question']) for q in dev} & {norm(q['question']) for q in holdout}
|
||||
write_json(args.output, questions)
|
||||
audit = audit_dataset(questions, oracle, args.output)
|
||||
audit['partition_policy'] = {'method': 'disjoint logical query groups',
|
||||
'shared_source_profiles': True, 'group_function': 'benchmark_v4.logical_group',
|
||||
'seed': args.seed, 'previously_exposed_groups': sorted(exposed),
|
||||
'limitations': ['Known source corpus, persons, vocabulary and template families.',
|
||||
'Fresh questions/fact combinations; not an unseen-person or LLM-answer benchmark.']}
|
||||
write_json(args.artifacts / 'source_audit.json', audit)
|
||||
write_json(args.artifacts / 'source_adjudications.json', {
|
||||
'reason': 'Raw-source review before any new TEST predictions; preserve historic datasets unchanged.',
|
||||
'questions': adjudications})
|
||||
write_json(args.artifacts / 'partition.json', {
|
||||
**audit['partition_policy'], 'dataset_sha256': audit['dataset_sha256'],
|
||||
'dev_count': len(dev), 'test_count': len(holdout), 'available_unseen_groups': capacities,
|
||||
'test_categories': dict(Counter(q['category'] for q in holdout)),
|
||||
'test_positive_count': sum(q['should_answer'] for q in holdout),
|
||||
'test_negative_count': sum(not q['should_answer'] for q in holdout),
|
||||
'dev_groups': sorted(groups['dev']), 'test_groups': sorted(groups['test']),
|
||||
'test_profile_count': len({p for q in holdout for p in q['graph']['source_profiles']}),
|
||||
'source_corpus': oracle['source_corpus']})
|
||||
print(json.dumps({'dev': len(dev), 'test': len(holdout), 'source_issues': 0,
|
||||
'available_unseen_groups': capacities}, ensure_ascii=False, indent=2))
|
||||
|
||||
|
||||
if __name__ == '__main__':
|
||||
main()
|
||||
52
tools/graphrag/evaluation/benchmark_v6.py
Normal file
52
tools/graphrag/evaluation/benchmark_v6.py
Normal file
@ -0,0 +1,52 @@
|
||||
"""Version known regression questions after independent source adjudication.
|
||||
|
||||
No retrieval output is used to choose, remove or relabel questions. Historical
|
||||
v4 remains immutable; all IDs, wording, categories and split membership remain.
|
||||
"""
|
||||
import copy
|
||||
import json
|
||||
from pathlib import Path
|
||||
|
||||
from .benchmark_v2 import BASE, audit_dataset, binding_source_evidence, validate_case, write_json
|
||||
from .benchmark_v4 import refresh_titles, logical_group
|
||||
from .source_oracle import load_source_oracle
|
||||
|
||||
|
||||
def main():
|
||||
output = BASE / 'graphrag_questions_v6.json'
|
||||
artifacts = BASE / 'results/v6_preparation'
|
||||
if output.exists():
|
||||
raise RuntimeError('Refusing to overwrite versioned questions.')
|
||||
original = json.loads((BASE / 'graphrag_questions_v4.json').read_text())
|
||||
oracle = load_source_oracle()
|
||||
cases = []; changes = []
|
||||
for before in original:
|
||||
after = refresh_titles(before, oracle)
|
||||
after['graph']['partition_group'] = logical_group(after)
|
||||
if after['should_answer']:
|
||||
after['source_evidence'] = [proof for binding in after['graph']['expected_bindings']
|
||||
for proof in binding_source_evidence(binding, oracle)]
|
||||
if (before['should_answer'], before['graph']['expected_bindings']) != (
|
||||
after['should_answer'], after['graph']['expected_bindings']):
|
||||
changes.append({'id': before['id'], 'split': before['split'],
|
||||
'before': copy.deepcopy(before), 'after': copy.deepcopy(after),
|
||||
'reason': 'Generic written-deliverable link label is not a supported academic title.'})
|
||||
assert before['question'] == after['question'] and before['category'] == after['category']
|
||||
issues = validate_case(after, oracle)
|
||||
if issues:
|
||||
raise RuntimeError(f'{after["id"]}: {issues}')
|
||||
cases.append(after)
|
||||
write_json(output, cases)
|
||||
write_json(artifacts / 'source_adjudications.json', {
|
||||
'reviewer': 'AI direct Markdown review; not a human adjudication',
|
||||
'policy': 'A bare artifact label (rešerš, tutoriál, projekt, dokument, repozitár) is not an academic title. '
|
||||
'Do not inherit a child-document title or category-year into its parent academic record.',
|
||||
'measurement': 'All questions are known historical regression; corrected gold prevents direct accuracy comparison.',
|
||||
'questions': changes})
|
||||
write_json(artifacts / 'source_audit.json', audit_dataset(cases, oracle, output))
|
||||
print(json.dumps({'questions': len(cases), 'source_issues': 0,
|
||||
'adjudicated_ids': [c['id'] for c in changes]}))
|
||||
|
||||
|
||||
if __name__ == '__main__':
|
||||
main()
|
||||
91
tools/graphrag/evaluation/benchmark_v7.py
Normal file
91
tools/graphrag/evaluation/benchmark_v7.py
Normal file
@ -0,0 +1,91 @@
|
||||
"""Declare a fresh query-group holdout using raw sources only, before retrieval.
|
||||
|
||||
All 1,042 previously exposed questions become DEV. No profile is new; this is
|
||||
a new-combination holdout over a known corpus, not an unseen-person experiment.
|
||||
"""
|
||||
import copy
|
||||
import json
|
||||
import random
|
||||
from collections import Counter
|
||||
|
||||
from .benchmark_v2 import BASE, audit_dataset, make_case, validate_case, write_json, binding_source_evidence
|
||||
from .benchmark_v4 import build_pool, logical_group, refresh_titles
|
||||
from .source_oracle import load_source_oracle, norm
|
||||
|
||||
QUOTAS = {'shared_keyword_pair': 10, 'same_academic_year_pair': 10,
|
||||
'same_start_year_pair': 10, 'person_title_year': 10, 'person_keyword_title': 10,
|
||||
'document_author_category_multi_hop': 2, 'person_multiple_categories': 7,
|
||||
'candidate_set_aggregation': 7, 'conjunctive_disambiguation': 6, 'negative_lookup': 8}
|
||||
SEED = 20261026
|
||||
|
||||
|
||||
def main():
|
||||
output = BASE/'graphrag_questions_v7.json'; artifacts = BASE/'results/v7_preparation'
|
||||
if output.exists(): raise RuntimeError('Refusing to overwrite declared questions.')
|
||||
oracle = load_source_oracle()
|
||||
old = json.loads((BASE/'graphrag_questions_v6.json').read_text())
|
||||
dev = []; changes = []
|
||||
exposed = {logical_group(q) for q in old}
|
||||
for original in old:
|
||||
case = copy.deepcopy(original); case['split'] = 'dev'
|
||||
names = [r['value'] for r in case['graph']['start_entities'] if r['type'] == 'person']
|
||||
if any(b.get('start_year') is not None and oracle['people'][b['person']]['start_year'] is None
|
||||
for b in case['graph']['expected_bindings']):
|
||||
case = make_case(case['id'], 'dev', case['category'], case['question'], names, oracle, [],
|
||||
no_answer=True, reason='The original Markdown does not explicitly document every requested study-start year.',
|
||||
negative_constraints={'missing_start_year': True})
|
||||
changes.append({'id': case['id'], 'old_bindings': original['graph']['expected_bindings'],
|
||||
'new_status': 'no_answer', 'reason': 'Directory cohort is not a documented study-start year.'})
|
||||
elif case['should_answer']:
|
||||
case['source_evidence'] = [e for b in case['graph']['expected_bindings'] for e in binding_source_evidence(b, oracle)]
|
||||
case['graph']['partition_group'] = logical_group(case); dev.append(case)
|
||||
# Fixed audit regressions; these are explicitly DEV, not extra easy TEST negatives.
|
||||
for year in [1999, 1899, 2100, 9999]:
|
||||
case = make_case(f'v7-dev-year-{year}', 'dev', 'negative_lookup',
|
||||
f'Aký je názov práce osoby Ján Holp v roku {year}?', ['Ján Holp'], oracle, [],
|
||||
no_answer=True, negative_constraints={'year': year})
|
||||
case['graph']['partition_group'] = logical_group(case); dev.append(case)
|
||||
exposed.update(logical_group(q) for q in dev)
|
||||
texts = {norm(q['question']) for q in dev}; rng = random.Random(SEED)
|
||||
holdout = []; capacity = {}
|
||||
for category, pool in build_pool(oracle).items():
|
||||
unique = {}
|
||||
for candidate in pool:
|
||||
case = refresh_titles(candidate, oracle); group = logical_group(case)
|
||||
if group not in exposed and norm(case['question']) not in texts:
|
||||
unique[group] = case
|
||||
capacity[category] = len(unique)
|
||||
candidates = [unique[key] for key in sorted(unique)]; rng.shuffle(candidates)
|
||||
quota = QUOTAS[category]
|
||||
if len(candidates) < quota: raise RuntimeError(f'Insufficient source capacity: {category}')
|
||||
for case in candidates[:quota]:
|
||||
case['id'] = f'fresh7-{len(holdout)+1:03d}'; case['split'] = 'test'
|
||||
case['graph']['partition_group'] = logical_group(case); holdout.append(case)
|
||||
questions = dev + holdout
|
||||
for case in questions:
|
||||
issues = validate_case(case, oracle)
|
||||
if issues: raise RuntimeError(f'{case["id"]}: {issues}')
|
||||
write_json(output, questions)
|
||||
audit = audit_dataset(questions, oracle, output)
|
||||
audit['partition_policy'] = {'method': 'disjoint logical query groups',
|
||||
'shared_source_profiles': True, 'seed': SEED, 'previously_exposed_groups': sorted(exposed),
|
||||
'limitations': ['Known corpus, persons and template families; only the query/fact combinations are fresh.',
|
||||
'Two remaining document-author/category groups and seven category-list groups constrain category coverage.',
|
||||
'AI source annotation, not human annotation. No tuning on this TEST.']}
|
||||
write_json(artifacts/'source_audit.json', audit)
|
||||
write_json(artifacts/'source_corrections.json', {'questions': changes,
|
||||
'policy': 'Only explicit study-start text is a fact. Cohort remains separate metadata; missing means unknown.'})
|
||||
write_json(artifacts/'regression_ids.json', [q['id'] for q in old if q['split'] == 'test'])
|
||||
ids = set(json.loads((BASE/'results/v6_preparation/generation_dev_ids.json').read_text()))
|
||||
ids.update(f'v7-dev-year-{year}' for year in [1999, 1899, 2100, 9999])
|
||||
write_json(artifacts/'generation_dev_ids.json', sorted(ids))
|
||||
write_json(artifacts/'protocol.json', {'seed': SEED, 'dev_count': len(dev), 'fresh_test_count': len(holdout),
|
||||
'test_categories': dict(Counter(q['category'] for q in holdout)), 'test_positives': sum(q['should_answer'] for q in holdout),
|
||||
'test_negatives': sum(not q['should_answer'] for q in holdout), 'available_groups': capacity,
|
||||
'old_gold_corrections': len(changes), 'regression_count': 320, 'llm_dev_count': len(ids),
|
||||
'target': .92, 'policy': 'Freeze after complete DEV; run fresh TEST once, retain every failure. Regression remains separate.',
|
||||
'annotation': 'Independent raw-source oracle plus AI source review; not human review.'})
|
||||
print(json.dumps({'dev': len(dev), 'test': len(holdout), 'source_corrections': len(changes), 'quotas': QUOTAS}))
|
||||
|
||||
|
||||
if __name__ == '__main__': main()
|
||||
152
tools/graphrag/evaluation/check_openwebui.py
Normal file
152
tools/graphrag/evaluation/check_openwebui.py
Normal file
@ -0,0 +1,152 @@
|
||||
"""Supplementary LLM check with graph context supplied by the local harness.
|
||||
|
||||
This exercises the school's OpenWebUI chat API and generated claims, NOT the
|
||||
WebUI browser, installed tools, or autonomous routing. Gold never enters a
|
||||
request. The primary experiment remains the complete frozen retrieval TEST.
|
||||
"""
|
||||
from __future__ import annotations
|
||||
|
||||
import argparse
|
||||
import json
|
||||
import os
|
||||
import time
|
||||
from collections import defaultdict
|
||||
from pathlib import Path
|
||||
|
||||
from tools.rag.evaluation.rag_runner import DEFAULT_MODEL, OPENWEBUI_URL, request_json
|
||||
from ..graph_db import create_neo4j_driver, get_neo4j_settings
|
||||
from ..graph_search import search_graph_with_session
|
||||
from .benchmark_v2 import BASE, academics, supporting_documents
|
||||
from .reproducibility import graph_fingerprint, run_metadata, verify_freeze
|
||||
from .source_oracle import load_source_oracle, norm
|
||||
from .source_validation import claim_issues
|
||||
from tools.answer_evaluation.context_policy import citation_check
|
||||
|
||||
SYSTEM = '''Odpovedaj po slovensky výhradne podľa dodaného výsledku grafového vyhľadávania.
|
||||
Nedoplňuj vedomosti ani údaje z otázky bez potvrdenia v kontexte. Pri no_answer oznám,
|
||||
že údaj nebol nájdený; nevymýšľaj názov. Zachovaj presné znenie mien, názvov, tagov a kategórií.
|
||||
Rozlišuj rok práce (year) od začiatku štúdia (start_year), autora dokumentu od študenta.
|
||||
Vráť JSON objekt s poľami answer (stručný prirodzený text), status (ok/no_answer/ambiguous),
|
||||
claims (zoznam objektov s person a len relevantnými faktami: title, year, start_year,
|
||||
keyword, category, document_author), source_urls (zoznam citovaných URL), count (číslo alebo null).
|
||||
Každá claim musí patriť jednej osobe; nespoj podmienky z rôznych osôb. Pri porovnaní
|
||||
uveď samostatné claims pre každú osobu; pri počte iba zodpovedajúcich kandidátov.
|
||||
Pri otázke na názov uveď aj rok, ak je známy. Pri no_answer vráť prázdne claims.
|
||||
V odpovedi aj source_urls cituj skutočné relevantné zdroje z kontextu.'''
|
||||
|
||||
|
||||
def grade_claims(case: dict, answer: dict, oracle: dict) -> dict:
|
||||
graph = case['graph']; claims = answer.get('claims', [])
|
||||
if not isinstance(claims, list) or any(not isinstance(c, dict) for c in claims):
|
||||
return {'strict': False, 'reason': 'invalid_claim_schema'}
|
||||
fields = ['person', 'title', 'year', 'start_year', 'keyword', 'category', 'document_author']
|
||||
def matches(binding, claim):
|
||||
return all(norm(claim.get(k, '')) == norm(binding[k]) for k in fields if k in binding)
|
||||
covered = all(any(matches(b, c) for c in claims) for b in graph['expected_bindings'])
|
||||
names = {norm(name): name for name in oracle['people']}
|
||||
unsupported = []
|
||||
for claim in claims:
|
||||
person = names.get(norm(claim.get('person')))
|
||||
valid = person is not None
|
||||
if valid and 'start_year' in claim:
|
||||
valid = norm(claim['start_year']) == norm(oracle['people'][person]['start_year'])
|
||||
metadata = {k: claim[k] for k in ['keyword', 'category', 'document_author'] if claim.get(k) is not None}
|
||||
if valid and metadata:
|
||||
valid = all(supporting_documents(oracle, person, **{k: v}) for k, v in metadata.items())
|
||||
if 'category' in metadata and 'document_author' in metadata:
|
||||
valid = valid and bool(supporting_documents(oracle, person, **metadata))
|
||||
if valid and any(claim.get(k) is not None for k in ['title', 'year']):
|
||||
records = academics(oracle, person)
|
||||
valid = any(all(norm(r.get(k)) == norm(claim[k]) for k in ['title', 'year']
|
||||
if claim.get(k) is not None) for r in records)
|
||||
if not valid:
|
||||
unsupported.append(claim)
|
||||
elif claim_issues(claim, oracle):
|
||||
unsupported.append(claim)
|
||||
urls = answer.get('source_urls', [])
|
||||
sources_ok = isinstance(urls, list) and all(any(a['source_url'] in urls for a in proof['any_of'])
|
||||
for proof in graph.get('expected_evidence_documents', []))
|
||||
sources_ok = sources_ok and citation_check(answer,{
|
||||
doc['source_url'] for doc in oracle.get('documents',{}).values() if doc.get('source_url')})['citations_ok']
|
||||
negative = graph.get('expected_no_answer', False)
|
||||
status_ok = (answer.get('status') == 'no_answer' and not claims) if negative else answer.get('status') == 'ok'
|
||||
count_ok = 'expected_count' not in graph or answer.get('count') == graph['expected_count']
|
||||
set_ok = True
|
||||
if graph.get('expected_entity_set') is not None:
|
||||
field = graph['entity_set_field']
|
||||
actual = {norm(c[field]) for c in claims if c.get(field) is not None}
|
||||
set_ok = actual == {norm(v) for v in graph['expected_entity_set']}
|
||||
return {'strict': bool(covered and not unsupported and sources_ok and status_ok and count_ok and set_ok),
|
||||
'bindings_ok': covered, 'unsupported_claims': unsupported, 'sources_ok': sources_ok,
|
||||
'status_ok': status_ok, 'count_ok': count_ok, 'set_ok': set_ok}
|
||||
|
||||
|
||||
def main():
|
||||
# Import the common adapter here: it imports grade_claims from this module.
|
||||
from tools.answer_evaluation.evaluate_graph_answers import graph_context, grade_answer, HERE
|
||||
from tools.answer_evaluation.checked_generation import generate_checked_answer
|
||||
from tools.graphrag.build_graphrag import graph_version
|
||||
|
||||
parser = argparse.ArgumentParser(description=__doc__)
|
||||
parser.add_argument('--questions', type=Path, required=True)
|
||||
parser.add_argument('--freeze-manifest', type=Path, required=True)
|
||||
parser.add_argument('--audit', type=Path, required=True)
|
||||
parser.add_argument('--output', type=Path, required=True)
|
||||
parser.add_argument('--per-category', type=int, default=2)
|
||||
parser.add_argument('--model', default=DEFAULT_MODEL)
|
||||
args = parser.parse_args()
|
||||
if args.output.exists():
|
||||
parser.error('Refusing to overwrite a previous external measurement.')
|
||||
if not os.getenv('OPENWEBUI_API_KEY'):
|
||||
parser.error('OPENWEBUI_API_KEY is not configured.')
|
||||
questions = json.loads(args.questions.read_text()); selected = []; counts = defaultdict(int)
|
||||
for case in questions:
|
||||
if case['split'] == 'test' and counts[case['category']] < args.per_category:
|
||||
selected.append(case); counts[case['category']] += 1
|
||||
oracle = load_source_oracle(); manifest = json.loads(args.freeze_manifest.read_text())
|
||||
settings = get_neo4j_settings(); rows = []
|
||||
prompt = (HERE / 'graph_answer_prompt.txt').read_text()
|
||||
payload = {'method': 'Supplementary known-query check with common context guards; no autonomous tool routing.',
|
||||
'model': args.model, 'selected_ids': [q['id'] for q in selected], 'system_prompt': prompt,
|
||||
'corrective_request_limit': 1,
|
||||
'limitations': ['Small stratified supplementary sample; not the primary 320-case accuracy.',
|
||||
'Structured claims, source citations and binding checks; free prose requires separate review.'],
|
||||
'questions': rows}
|
||||
args.output.parent.mkdir(parents=True, exist_ok=True)
|
||||
with create_neo4j_driver(settings) as driver, driver.session(database=settings.database) as session:
|
||||
metadata = run_metadata(args.questions)
|
||||
verify_freeze(manifest, metadata, graph_fingerprint(session), audit=args.audit, **manifest['parameters'])
|
||||
payload['run_metadata'] = metadata
|
||||
version = graph_version(session)
|
||||
for case in selected:
|
||||
started = time.perf_counter()
|
||||
result = search_graph_with_session(session, case['question'], **manifest['parameters'])
|
||||
result['index_version'] = version
|
||||
context = graph_context(result)
|
||||
row = {'id': case['id'], 'category': case['category'], 'question': case['question'],
|
||||
'graph_context': context, 'strict': False}
|
||||
try:
|
||||
def complete(messages):
|
||||
return request_json(OPENWEBUI_URL, method='POST', timeout=90, max_attempts=1,
|
||||
headers={'Authorization': f'Bearer {os.environ["OPENWEBUI_API_KEY"]}', 'Content-Type': 'application/json'},
|
||||
payload={'model': args.model, 'stream': False, 'response_format': {'type': 'json_object'},
|
||||
'messages': messages})
|
||||
row.update(generate_checked_answer(case['question'], context, prompt, complete))
|
||||
if row.get('answer'):
|
||||
row.update(grade_answer(case, row['answer'], oracle, context=context))
|
||||
row['strict'] = bool(row['strict'] and row['accepted_for_delivery'])
|
||||
except Exception as error:
|
||||
row['error'] = f'{type(error).__name__}: {str(error)[:500]}'
|
||||
row['latency_seconds'] = time.perf_counter() - started
|
||||
rows.append(row)
|
||||
payload['summary'] = {'questions': len(rows), 'correct': sum(r['strict'] for r in rows),
|
||||
'accuracy': sum(r['strict'] for r in rows) / len(rows)}
|
||||
args.output.write_text(json.dumps(payload, ensure_ascii=False, indent=2) + '\n')
|
||||
print(f'{case["id"]}: {"OK" if row["strict"] else "FAIL"} ({row["latency_seconds"]:.1f}s)', flush=True)
|
||||
verify_freeze(manifest, run_metadata(args.questions), graph_fingerprint(session), audit=args.audit, **manifest['parameters'])
|
||||
assert graph_version(session) == version, 'Index version changed during generation.'
|
||||
print(json.dumps(payload['summary']))
|
||||
|
||||
|
||||
if __name__ == '__main__':
|
||||
main()
|
||||
680
tools/graphrag/evaluation/evaluate_graphrag.py
Normal file
680
tools/graphrag/evaluation/evaluate_graphrag.py
Normal file
@ -0,0 +1,680 @@
|
||||
from __future__ import annotations
|
||||
|
||||
import argparse
|
||||
import csv
|
||||
import json
|
||||
import time
|
||||
from datetime import datetime, timezone
|
||||
from pathlib import Path
|
||||
from typing import Any
|
||||
|
||||
from ..graph_db import (
|
||||
create_neo4j_driver,
|
||||
get_neo4j_settings,
|
||||
)
|
||||
from ..graph_search import (
|
||||
DEFAULT_LIMIT,
|
||||
DEFAULT_MAX_ENTITIES,
|
||||
search_graph_with_session,
|
||||
)
|
||||
from .graphrag_evaluator import (
|
||||
aggregate_by_field,
|
||||
aggregate_rows,
|
||||
evaluate_result,
|
||||
filter_questions,
|
||||
load_questions,
|
||||
)
|
||||
from .reproducibility import graph_fingerprint, run_metadata, sha256_file, verify_freeze
|
||||
from .source_oracle import load_source_oracle
|
||||
|
||||
|
||||
EVALUATION_DIR = Path(
|
||||
__file__
|
||||
).resolve().parent
|
||||
|
||||
QUESTIONS_PATH = (
|
||||
EVALUATION_DIR
|
||||
/ "graphrag_questions_v4.json"
|
||||
)
|
||||
|
||||
RESULTS_DIR = (
|
||||
EVALUATION_DIR
|
||||
/ "results"
|
||||
)
|
||||
|
||||
|
||||
def parse_args() -> argparse.Namespace:
|
||||
parser = argparse.ArgumentParser(
|
||||
description=(
|
||||
"Vyhodnotenie GraphRAG vyhľadávania "
|
||||
"proti graphrag_questions.json."
|
||||
)
|
||||
)
|
||||
|
||||
parser.add_argument(
|
||||
"--questions",
|
||||
type=Path,
|
||||
required=True,
|
||||
)
|
||||
|
||||
parser.add_argument(
|
||||
"--output-dir",
|
||||
type=Path,
|
||||
required=True,
|
||||
)
|
||||
|
||||
parser.add_argument(
|
||||
"--split",
|
||||
choices=(
|
||||
"dev",
|
||||
"test",
|
||||
"all",
|
||||
),
|
||||
default="dev",
|
||||
help=(
|
||||
"Predvolene sa vyhodnocuje iba DEV. "
|
||||
"TEST používaj až po zmrazení GraphRAG."
|
||||
),
|
||||
)
|
||||
|
||||
parser.add_argument(
|
||||
"--limit",
|
||||
type=int,
|
||||
default=DEFAULT_LIMIT,
|
||||
)
|
||||
|
||||
parser.add_argument(
|
||||
"--max-entities",
|
||||
type=int,
|
||||
default=DEFAULT_MAX_ENTITIES,
|
||||
)
|
||||
|
||||
parser.add_argument(
|
||||
"--ids",
|
||||
type=str,
|
||||
default="",
|
||||
help=(
|
||||
"Voliteľný zoznam ID oddelených čiarkou."
|
||||
),
|
||||
)
|
||||
|
||||
parser.add_argument(
|
||||
"--max-questions",
|
||||
type=int,
|
||||
default=None,
|
||||
help=(
|
||||
"Voliteľne vyhodnotí iba prvých N "
|
||||
"otázok z vybraného splitu."
|
||||
),
|
||||
)
|
||||
|
||||
parser.add_argument('--audit', type=Path, help='Predeclared source-consistency audit.')
|
||||
parser.add_argument('--freeze-manifest', type=Path,
|
||||
help='Required for TEST/all; verifies code, data, graph and parameters.')
|
||||
parser.add_argument('--overwrite', action='store_true',
|
||||
help='Replace a previous DEV output; frozen TEST outputs are immutable.')
|
||||
args = parser.parse_args()
|
||||
if args.split in {'test', 'all'} and args.freeze_manifest is None:
|
||||
parser.error('TEST/all requires --freeze-manifest after complete DEV evaluation.')
|
||||
if args.split in {'test', 'all'} and (args.ids or args.max_questions):
|
||||
parser.error('Frozen holdout evaluation must cover the complete selected split.')
|
||||
if args.split in {'test', 'all'} and args.overwrite:
|
||||
parser.error('Use a fresh output directory to reproduce a frozen holdout.')
|
||||
|
||||
if args.limit < 1:
|
||||
parser.error(
|
||||
"--limit musí byť aspoň 1."
|
||||
)
|
||||
|
||||
if args.max_entities < 1:
|
||||
parser.error(
|
||||
"--max-entities musí byť aspoň 1."
|
||||
)
|
||||
|
||||
if (
|
||||
args.max_questions
|
||||
is not None
|
||||
and args.max_questions < 1
|
||||
):
|
||||
parser.error(
|
||||
"--max-questions musí byť aspoň 1."
|
||||
)
|
||||
|
||||
return args
|
||||
|
||||
|
||||
def save_json(
|
||||
path: Path,
|
||||
payload: dict[str, Any],
|
||||
) -> None:
|
||||
path.parent.mkdir(
|
||||
parents=True,
|
||||
exist_ok=True,
|
||||
)
|
||||
|
||||
path.write_text(
|
||||
json.dumps(
|
||||
payload,
|
||||
ensure_ascii=False,
|
||||
indent=2,
|
||||
)
|
||||
+ "\n",
|
||||
encoding="utf-8",
|
||||
)
|
||||
|
||||
|
||||
def save_csv(
|
||||
path: Path,
|
||||
rows: list[
|
||||
dict[str, Any]
|
||||
],
|
||||
) -> None:
|
||||
path.parent.mkdir(
|
||||
parents=True,
|
||||
exist_ok=True,
|
||||
)
|
||||
|
||||
fieldnames = [
|
||||
"complete",
|
||||
"answerability_ok",
|
||||
"bindings_ok",
|
||||
"binding_score",
|
||||
"paths_ok",
|
||||
"path_score",
|
||||
"count_ok",
|
||||
"expected_count",
|
||||
"actual_count",
|
||||
"id",
|
||||
"split",
|
||||
"category",
|
||||
"difficulty",
|
||||
"strict",
|
||||
"value_score",
|
||||
"entity_score",
|
||||
"relation_score",
|
||||
"property_score",
|
||||
"relation_choice_score",
|
||||
"document_recall",
|
||||
"source_recall",
|
||||
"entity_set_ok",
|
||||
"latency_seconds",
|
||||
"error",
|
||||
"question",
|
||||
"expected_values",
|
||||
"matched_values",
|
||||
"expected_relations",
|
||||
"actual_relations",
|
||||
"expected_documents",
|
||||
"actual_documents",
|
||||
"expected_source_urls",
|
||||
"actual_source_urls",
|
||||
"fact_types",
|
||||
"strategies",
|
||||
"binding_results",
|
||||
"path_results",
|
||||
]
|
||||
|
||||
with path.open(
|
||||
"w",
|
||||
encoding="utf-8",
|
||||
newline="",
|
||||
) as file:
|
||||
writer = csv.DictWriter(
|
||||
file,
|
||||
fieldnames=fieldnames,
|
||||
lineterminator='\n',
|
||||
)
|
||||
|
||||
writer.writeheader()
|
||||
|
||||
for row in rows:
|
||||
output = {}
|
||||
|
||||
for field in fieldnames:
|
||||
value = row.get(
|
||||
field
|
||||
)
|
||||
|
||||
if isinstance(
|
||||
value,
|
||||
(
|
||||
list,
|
||||
dict,
|
||||
),
|
||||
):
|
||||
value = json.dumps(
|
||||
value,
|
||||
ensure_ascii=False,
|
||||
)
|
||||
|
||||
output[
|
||||
field
|
||||
] = value
|
||||
|
||||
writer.writerow(
|
||||
output
|
||||
)
|
||||
|
||||
|
||||
def print_summary(
|
||||
summary: dict[str, Any],
|
||||
*,
|
||||
split: str,
|
||||
) -> None:
|
||||
print()
|
||||
print(
|
||||
"=" * 78
|
||||
)
|
||||
|
||||
print(
|
||||
"GRAPHRAG EVALUATION"
|
||||
)
|
||||
|
||||
print(
|
||||
"=" * 78
|
||||
)
|
||||
|
||||
print(
|
||||
f"Split: {split}"
|
||||
)
|
||||
|
||||
print(
|
||||
f"Questions: "
|
||||
f"{summary['questions']}"
|
||||
)
|
||||
|
||||
print(
|
||||
f"Strict: "
|
||||
f"{summary['strict_count']}/"
|
||||
f"{summary['questions']} "
|
||||
f"({summary['strict_accuracy']:.3%})"
|
||||
)
|
||||
|
||||
print(
|
||||
f"Errors: "
|
||||
f"{summary['error_count']}"
|
||||
)
|
||||
|
||||
print(
|
||||
f"Value score: "
|
||||
f"{summary['value_score']:.3f}"
|
||||
)
|
||||
|
||||
print(
|
||||
f"Entity score: "
|
||||
f"{summary['entity_score']:.3f}"
|
||||
)
|
||||
|
||||
print(
|
||||
f"Relation score: "
|
||||
f"{summary['relation_score']:.3f}"
|
||||
)
|
||||
|
||||
print(
|
||||
f"Property score: "
|
||||
f"{summary['property_score']:.3f}"
|
||||
)
|
||||
|
||||
print(
|
||||
f"Relation choices: "
|
||||
f"{summary['relation_choice_score']:.3f}"
|
||||
)
|
||||
|
||||
print(
|
||||
f"Document recall: "
|
||||
f"{summary['document_recall']:.3f}"
|
||||
)
|
||||
|
||||
print(
|
||||
f"Source recall: "
|
||||
f"{summary['source_recall']:.3f}"
|
||||
)
|
||||
|
||||
print(
|
||||
f"Latency mean: "
|
||||
f"{summary['latency_mean_seconds']:.4f} s"
|
||||
)
|
||||
|
||||
print(
|
||||
f"Latency median: "
|
||||
f"{summary['latency_median_seconds']:.4f} s"
|
||||
)
|
||||
|
||||
print(
|
||||
f"Latency p95: "
|
||||
f"{summary['latency_p95_seconds']:.4f} s"
|
||||
)
|
||||
|
||||
print(
|
||||
"=" * 78
|
||||
)
|
||||
|
||||
|
||||
def validate_output_destination(args: argparse.Namespace) -> None:
|
||||
suffix = args.split
|
||||
if args.ids:
|
||||
suffix += '_selected'
|
||||
elif args.max_questions:
|
||||
suffix += f'_first{args.max_questions}'
|
||||
if not args.overwrite:
|
||||
for extension in ('json', 'csv'):
|
||||
path = args.output_dir / f'graphrag_{suffix}.{extension}'
|
||||
if path.exists():
|
||||
raise RuntimeError(f'Results already exist; use a fresh output directory: {path}')
|
||||
elif (any(part.startswith(('final_', 'archive_')) for part in args.output_dir.parts)
|
||||
or any((args.output_dir / name).exists() for name in ('REPORT.md', 'summary.json', 'freeze.json'))):
|
||||
raise RuntimeError('Archived/final results are immutable; choose a fresh DEV directory.')
|
||||
|
||||
|
||||
def main() -> None:
|
||||
args = parse_args()
|
||||
validate_output_destination(args)
|
||||
metadata = run_metadata(args.questions)
|
||||
audit = json.loads(args.audit.read_text()) if args.audit else None
|
||||
if audit and (audit['dataset_sha256'] != metadata['fingerprints']['dataset_sha256']
|
||||
or audit['inputs'] != metadata['fingerprints']['inputs']):
|
||||
raise RuntimeError('Source audit does not match current benchmark and inputs.')
|
||||
if audit and audit.get('source_corpus') is not None and (
|
||||
audit['source_corpus'] != metadata['fingerprints']['source_corpus']):
|
||||
raise RuntimeError('Independent source audit does not match original Markdown.')
|
||||
|
||||
all_questions = load_questions(
|
||||
args.questions
|
||||
)
|
||||
source_oracle = load_source_oracle()
|
||||
|
||||
ids = {
|
||||
value.strip()
|
||||
for value in args.ids.split(
|
||||
","
|
||||
)
|
||||
if value.strip()
|
||||
}
|
||||
|
||||
questions = filter_questions(
|
||||
all_questions,
|
||||
split=args.split,
|
||||
ids=(
|
||||
ids
|
||||
if ids
|
||||
else None
|
||||
),
|
||||
max_questions=(
|
||||
args.max_questions
|
||||
),
|
||||
)
|
||||
|
||||
if not questions:
|
||||
raise RuntimeError(
|
||||
"Pre zadaný výber sa nenašli otázky."
|
||||
)
|
||||
|
||||
print()
|
||||
print(
|
||||
"GraphRAG dataset"
|
||||
)
|
||||
|
||||
print(
|
||||
"=" * 60
|
||||
)
|
||||
|
||||
print(
|
||||
f"File: {args.questions}"
|
||||
)
|
||||
|
||||
print(
|
||||
f"Total: {len(all_questions)}"
|
||||
)
|
||||
|
||||
print(
|
||||
f"Split: {args.split}"
|
||||
)
|
||||
|
||||
print(
|
||||
f"Selected: {len(questions)}"
|
||||
)
|
||||
|
||||
print(
|
||||
f"Limit: {args.limit}"
|
||||
)
|
||||
|
||||
print(
|
||||
f"Entities: {args.max_entities}"
|
||||
)
|
||||
|
||||
print(
|
||||
"=" * 60
|
||||
)
|
||||
|
||||
settings = (
|
||||
get_neo4j_settings()
|
||||
)
|
||||
|
||||
rows: list[
|
||||
dict[str, Any]
|
||||
] = []
|
||||
|
||||
with create_neo4j_driver(
|
||||
settings
|
||||
) as driver:
|
||||
driver.verify_connectivity()
|
||||
|
||||
with driver.session(
|
||||
database=settings.database
|
||||
) as session:
|
||||
metadata['graph'] = graph_fingerprint(session)
|
||||
if args.freeze_manifest:
|
||||
verify_freeze(json.loads(args.freeze_manifest.read_text()), metadata, metadata['graph'],
|
||||
limit=args.limit, max_entities=args.max_entities, audit=args.audit)
|
||||
total = len(
|
||||
questions
|
||||
)
|
||||
|
||||
for index, question in enumerate(
|
||||
questions,
|
||||
start=1,
|
||||
):
|
||||
question_id = str(
|
||||
question[
|
||||
"id"
|
||||
]
|
||||
)
|
||||
|
||||
print(
|
||||
f"[{index:04d}/{total:04d}] "
|
||||
f"{question_id}: "
|
||||
f"{question['question']}"
|
||||
)
|
||||
|
||||
started = (
|
||||
time.perf_counter()
|
||||
)
|
||||
|
||||
error = None
|
||||
|
||||
try:
|
||||
result = (
|
||||
search_graph_with_session(
|
||||
session,
|
||||
str(
|
||||
question[
|
||||
"question"
|
||||
]
|
||||
),
|
||||
limit=args.limit,
|
||||
max_entities=(
|
||||
args.max_entities
|
||||
),
|
||||
)
|
||||
)
|
||||
|
||||
except Exception as exc:
|
||||
result = {
|
||||
"strategies": [],
|
||||
"resolved_entities": [],
|
||||
"paths": [],
|
||||
"facts": [],
|
||||
"documents": [],
|
||||
}
|
||||
|
||||
error = (
|
||||
f"{type(exc).__name__}: "
|
||||
f"{exc}"
|
||||
)
|
||||
|
||||
latency = (
|
||||
time.perf_counter()
|
||||
- started
|
||||
)
|
||||
|
||||
row = evaluate_result(
|
||||
question,
|
||||
result,
|
||||
latency_seconds=(
|
||||
latency
|
||||
),
|
||||
error=error,
|
||||
source_oracle=source_oracle,
|
||||
)
|
||||
|
||||
rows.append(
|
||||
row
|
||||
)
|
||||
|
||||
state = (
|
||||
"OK"
|
||||
if row["strict"]
|
||||
else "FAIL"
|
||||
)
|
||||
|
||||
print(
|
||||
f" {state} | "
|
||||
f"value={row['value_score']:.2f} "
|
||||
f"entity={row['entity_score']:.2f} "
|
||||
f"rel={row['relation_score']:.2f} "
|
||||
f"doc={row['document_recall']:.2f} "
|
||||
f"{row['latency_seconds']:.4f}s"
|
||||
)
|
||||
|
||||
if graph_fingerprint(session) != metadata['graph']:
|
||||
raise RuntimeError('Graph changed during evaluation; results discarded.')
|
||||
|
||||
if run_metadata(args.questions)['fingerprints'] != metadata['fingerprints']:
|
||||
raise RuntimeError('Code or input data changed during evaluation; results discarded.')
|
||||
metadata['completed_at_utc'] = datetime.now(timezone.utc).isoformat()
|
||||
if args.freeze_manifest:
|
||||
metadata['freeze_sha256'] = sha256_file(args.freeze_manifest)
|
||||
if args.audit:
|
||||
metadata['audit_sha256'] = sha256_file(args.audit)
|
||||
|
||||
summary = aggregate_rows(
|
||||
rows
|
||||
)
|
||||
|
||||
by_category = aggregate_by_field(
|
||||
rows,
|
||||
"category",
|
||||
)
|
||||
|
||||
by_difficulty = (
|
||||
aggregate_by_field(
|
||||
rows,
|
||||
"difficulty",
|
||||
)
|
||||
)
|
||||
|
||||
payload = {
|
||||
'evaluation_schema_version': 4,
|
||||
'run_metadata': metadata,
|
||||
"configuration": {
|
||||
'evaluation_kind': (json.loads(args.freeze_manifest.read_text()).get('evaluation_kind', 'independent_holdout')
|
||||
if args.freeze_manifest else 'development_regression'),
|
||||
'published_only': True,
|
||||
"questions_file": str(
|
||||
args.questions
|
||||
),
|
||||
"split": args.split,
|
||||
"dataset_question_count": len(
|
||||
all_questions
|
||||
),
|
||||
"selected_question_count": len(
|
||||
questions
|
||||
),
|
||||
"limit": args.limit,
|
||||
"max_entities": (
|
||||
args.max_entities
|
||||
),
|
||||
"ids": sorted(
|
||||
ids
|
||||
),
|
||||
"max_questions": (
|
||||
args.max_questions
|
||||
),
|
||||
},
|
||||
"summary": summary,
|
||||
"by_category": by_category,
|
||||
"by_difficulty": (
|
||||
by_difficulty
|
||||
),
|
||||
"questions": rows,
|
||||
}
|
||||
if audit:
|
||||
consistent_ids = {row['id'] for row in audit['questions'] if row['source_consistent']}
|
||||
consistent = [row for row in rows if row['id'] in consistent_ids]
|
||||
payload['source_consistent_summary'] = aggregate_rows(consistent)
|
||||
payload['source_consistent_by_category'] = aggregate_by_field(consistent, 'category')
|
||||
payload['source_inconsistent_ids'] = [row['id'] for row in rows if row['id'] not in consistent_ids]
|
||||
|
||||
suffix = args.split
|
||||
|
||||
if ids:
|
||||
suffix += "_selected"
|
||||
|
||||
elif args.max_questions:
|
||||
suffix += (
|
||||
f"_first"
|
||||
f"{args.max_questions}"
|
||||
)
|
||||
|
||||
json_path = (
|
||||
args.output_dir
|
||||
/ f"graphrag_{suffix}.json"
|
||||
)
|
||||
|
||||
csv_path = (
|
||||
args.output_dir
|
||||
/ f"graphrag_{suffix}.csv"
|
||||
)
|
||||
|
||||
save_json(
|
||||
json_path,
|
||||
payload,
|
||||
)
|
||||
|
||||
save_csv(
|
||||
csv_path,
|
||||
rows,
|
||||
)
|
||||
|
||||
print_summary(
|
||||
summary,
|
||||
split=args.split,
|
||||
)
|
||||
if audit:
|
||||
print_summary(payload['source_consistent_summary'],
|
||||
split=f'{args.split} — source-consistent subset (supplementary)')
|
||||
print(f"Source-inconsistent annotations: {len(payload['source_inconsistent_ids'])}; "
|
||||
'included in the primary score above.')
|
||||
|
||||
print()
|
||||
print(
|
||||
f"JSON: {json_path}"
|
||||
)
|
||||
|
||||
print(
|
||||
f"CSV: {csv_path}"
|
||||
)
|
||||
|
||||
|
||||
if __name__ == "__main__":
|
||||
main()
|
||||
370
tools/graphrag/evaluation/evidence_contract.py
Normal file
370
tools/graphrag/evaluation/evidence_contract.py
Normal file
@ -0,0 +1,370 @@
|
||||
"""Connected, typed evidence checks shared by GraphRAG evaluation versions.
|
||||
|
||||
Facts are structured records emitted by fixed Cypher queries. They are expanded
|
||||
into the very paths those query contracts establish; query text, resolved aliases
|
||||
and context-only documents never create edges. Ordered paths must have compatible
|
||||
endpoint types. Bindings are satisfied by one connected witness, not a bag of
|
||||
independently occurring values.
|
||||
"""
|
||||
from __future__ import annotations
|
||||
|
||||
import itertools
|
||||
import re
|
||||
import unicodedata
|
||||
from collections import defaultdict
|
||||
from typing import Any
|
||||
|
||||
|
||||
RELATION_ENDPOINTS = {
|
||||
'AUTHORED': ('Person', 'Thesis'),
|
||||
'HAS_WORK': ('Person', 'Work'),
|
||||
'HAS_DOCUMENT': ('Person', 'Document'),
|
||||
'EVIDENCED_BY': ('Academic', 'Document'),
|
||||
'HAS_KEYWORD': ('Document', 'Keyword'),
|
||||
'IN_CATEGORY': ('Document', 'Category'),
|
||||
'AUTHORED_DOCUMENT': ('DocumentAuthor', 'Document'),
|
||||
'DESCRIBES': ('Document', 'Topic'),
|
||||
}
|
||||
|
||||
|
||||
def canonical(value: Any) -> str:
|
||||
raw = unicodedata.normalize('NFKD', str(value if value is not None else ''))
|
||||
return re.sub(r'\s+', ' ', re.sub(r'[^a-z0-9]+', ' ', ''.join(
|
||||
character for character in raw.casefold() if not unicodedata.combining(character)))).strip()
|
||||
|
||||
|
||||
def kind_matches(actual: str, expected: str) -> bool:
|
||||
return actual in {'Thesis', 'Work'} if expected in {'Academic', 'Thesis|Work'} else actual in expected.split('|')
|
||||
|
||||
|
||||
class EvidenceGraph:
|
||||
def __init__(self, result: dict[str, Any]):
|
||||
self.nodes: dict[tuple[str, str], dict] = {}
|
||||
self.conflicts: set[tuple[str, str]] = set()
|
||||
self.adjacency: dict[tuple[str, str], set[tuple[str, tuple[str, str]]]] = defaultdict(set)
|
||||
for path in result.get('paths', []):
|
||||
if not isinstance(path, dict):
|
||||
continue
|
||||
nodes, relationships = path.get('nodes', []), path.get('relationships', [])
|
||||
if not isinstance(nodes, list) or len(relationships) != max(0, len(nodes) - 1):
|
||||
continue
|
||||
keys = [self.node(row.get('kind', ''), row) for row in nodes if isinstance(row, dict)]
|
||||
if len(keys) != len(nodes):
|
||||
continue
|
||||
for left, relation, right in zip(keys, relationships, keys[1:]):
|
||||
self.edge(left, relation, right)
|
||||
for fact in result.get('facts', []):
|
||||
if isinstance(fact, dict):
|
||||
self.add_fact(fact)
|
||||
|
||||
def node(self, kind: str, properties: dict) -> tuple[str, str]:
|
||||
properties = {key: value for key, value in properties.items() if value is not None}
|
||||
if kind == 'Document':
|
||||
identity = properties.get('path') or properties.get('document_path')
|
||||
else:
|
||||
identity = properties.get('element_id') or properties.get('id')
|
||||
if not identity:
|
||||
if kind in {'Thesis', 'Work'}:
|
||||
identity = repr((properties.get('person'), properties.get('title'),
|
||||
properties.get('year'), properties.get('document_path')))
|
||||
else:
|
||||
identity = canonical(properties.get('name'))
|
||||
key = (kind, str(identity))
|
||||
current = self.nodes.setdefault(key, {'kind': kind})
|
||||
for field in {'name', 'title', 'year', 'start_year', 'thesis_type', 'work_type', 'path', 'source_url'}:
|
||||
if field in current and field in properties and canonical(current[field]) != canonical(properties[field]):
|
||||
self.conflicts.add(key)
|
||||
for field, value in properties.items():
|
||||
current.setdefault(field, value)
|
||||
return key
|
||||
|
||||
def edge(self, left: tuple[str, str], relation: str, right: tuple[str, str]) -> None:
|
||||
expected = RELATION_ENDPOINTS.get(relation)
|
||||
if expected is None:
|
||||
return
|
||||
if kind_matches(left[0], expected[0]) and kind_matches(right[0], expected[1]):
|
||||
pass
|
||||
elif kind_matches(right[0], expected[0]) and kind_matches(left[0], expected[1]):
|
||||
left, right = right, left
|
||||
else:
|
||||
return
|
||||
self.adjacency[left].add((relation, right))
|
||||
self.adjacency[right].add((relation, left))
|
||||
|
||||
def neighbors(self, key: tuple[str, str], relation: str, kind: str) -> list[tuple[str, str]]:
|
||||
return [target for edge, target in self.adjacency.get(key, ())
|
||||
if key not in self.conflicts and target not in self.conflicts
|
||||
and edge in relation.split('|') and kind_matches(target[0], kind)]
|
||||
|
||||
def add_fact(self, fact: dict) -> None:
|
||||
kind = fact.get('fact_type')
|
||||
if kind in {'shared_keyword', 'shared_category', 'shared_document_author'}:
|
||||
singular = {'shared_keyword': 'person_keyword', 'shared_category': 'person_category',
|
||||
'shared_document_author': 'person_document_author'}[kind]
|
||||
for side in ('left', 'right'):
|
||||
self.add_fact({**fact, 'fact_type': singular, 'person': fact.get(side + '_person'),
|
||||
'person_element_id': fact.get(side + '_person_element_id'),
|
||||
'document_path': fact.get(side + '_document_path'),
|
||||
'source_url': fact.get(side + '_source_url')})
|
||||
return
|
||||
if kind not in {'person_thesis', 'person_work', 'person_start_year', 'person_keyword',
|
||||
'person_category', 'person_document_author'} or not fact.get('person'):
|
||||
return
|
||||
person = self.node('Person', {'name': fact['person'], 'element_id': fact.get('person_element_id'),
|
||||
'start_year': fact.get('start_year') if kind == 'person_start_year' else None})
|
||||
path = fact.get('document_path')
|
||||
document = self.node('Document', {'path': path, 'source_url': fact.get('source_url')}) if path else None
|
||||
if kind in {'person_thesis', 'person_work'}:
|
||||
academic_kind = 'Thesis' if kind == 'person_thesis' else 'Work'
|
||||
prefix = 'thesis' if academic_kind == 'Thesis' else 'work'
|
||||
academic = self.node(academic_kind, {
|
||||
'element_id': fact.get(prefix + '_element_id'), 'id': fact.get(prefix + '_id'),
|
||||
'person': fact['person'], 'document_path': path, 'title': fact.get('title'),
|
||||
'year': fact.get('year'), prefix + '_type': fact.get(prefix + '_type')})
|
||||
self.edge(person, 'AUTHORED' if academic_kind == 'Thesis' else 'HAS_WORK', academic)
|
||||
if document:
|
||||
self.edge(academic, 'EVIDENCED_BY', document)
|
||||
elif document:
|
||||
self.edge(person, 'HAS_DOCUMENT', document)
|
||||
if kind == 'person_keyword' and fact.get('keyword'):
|
||||
target = self.node('Keyword', {'name': fact['keyword'], 'id': fact.get('keyword_id'),
|
||||
'element_id': fact.get('keyword_element_id')})
|
||||
self.edge(document, 'HAS_KEYWORD', target)
|
||||
elif kind == 'person_category' and fact.get('category'):
|
||||
target = self.node('Category', {'name': fact['category'],
|
||||
'element_id': fact.get('category_element_id')})
|
||||
self.edge(document, 'IN_CATEGORY', target)
|
||||
elif kind == 'person_document_author' and fact.get('document_author'):
|
||||
target = self.node('DocumentAuthor', {'name': fact['document_author'],
|
||||
'id': fact.get('document_author_id'), 'element_id': fact.get('document_author_element_id')})
|
||||
self.edge(target, 'AUTHORED_DOCUMENT', document)
|
||||
if fact.get('category'):
|
||||
category = self.node('Category', {'name': fact['category'],
|
||||
'element_id': fact.get('category_element_id')})
|
||||
self.edge(document, 'IN_CATEGORY', category)
|
||||
|
||||
def metadata_choices(self, person: tuple[str, str], binding: dict, field: str,
|
||||
relation: str, kind: str) -> list[tuple[Any, Any]]:
|
||||
if field not in binding:
|
||||
return [(None, None)]
|
||||
return [(document, node)
|
||||
for document in self.neighbors(person, 'HAS_DOCUMENT', 'Document')
|
||||
for node in self.neighbors(document, relation, kind)
|
||||
if canonical(self.nodes[node].get('name')) == canonical(binding[field])]
|
||||
|
||||
def witnesses(self, binding: dict, *, require_provenance: bool) -> list[dict]:
|
||||
people = [key for key, row in self.nodes.items() if key[0] == 'Person' and key not in self.conflicts
|
||||
and ('person' not in binding or canonical(row.get('name')) == canonical(binding['person']))]
|
||||
academic_required = any(field in binding for field in ['academic_kind', 'academic_type', 'title', 'year'])
|
||||
witnesses = []
|
||||
for person in people:
|
||||
if 'start_year' in binding and canonical(self.nodes[person].get('start_year')) != canonical(binding['start_year']):
|
||||
continue
|
||||
academics = []
|
||||
if academic_required:
|
||||
for relation, kind in [('AUTHORED', 'Thesis'), ('HAS_WORK', 'Work')]:
|
||||
for academic in self.neighbors(person, relation, kind):
|
||||
row = self.nodes[academic]
|
||||
if 'academic_kind' in binding and not kind_matches(kind, binding['academic_kind']):
|
||||
continue
|
||||
if any(canonical(row.get(field)) != canonical(binding[field])
|
||||
for field in ['title', 'year'] if field in binding):
|
||||
continue
|
||||
type_field = 'thesis_type' if kind == 'Thesis' else 'work_type'
|
||||
if 'academic_type' in binding and canonical(row.get(type_field)) != canonical(binding['academic_type']):
|
||||
continue
|
||||
docs = self.neighbors(academic, 'EVIDENCED_BY', 'Document')
|
||||
academics.extend((academic, doc) for doc in docs)
|
||||
if not docs and not require_provenance:
|
||||
academics.append((academic, None))
|
||||
else:
|
||||
academics = [(None, None)]
|
||||
choices = [self.metadata_choices(person, binding, *arguments) for arguments in [
|
||||
('keyword', 'HAS_KEYWORD', 'Keyword'), ('category', 'IN_CATEGORY', 'Category'),
|
||||
('document_author', 'AUTHORED_DOCUMENT', 'DocumentAuthor')]]
|
||||
person_docs = self.neighbors(person, 'HAS_DOCUMENT', 'Document') if (
|
||||
require_provenance and ('start_year' in binding or not academic_required
|
||||
and not any(field in binding for field in ['keyword', 'category', 'document_author']))
|
||||
) else [None]
|
||||
for (academic, academic_document), keyword, category, author, person_document in itertools.product(academics, *choices, person_docs):
|
||||
docs = [doc for doc in [academic_document, keyword[0], category[0], author[0], person_document] if doc]
|
||||
if binding.get('same_document') and len(set(docs)) > 1:
|
||||
continue
|
||||
if category[0] and author[0] and category[0] != author[0]:
|
||||
continue
|
||||
if 'document_path' in binding and any(
|
||||
self.nodes[doc].get('path') != binding['document_path'] for doc in docs
|
||||
):
|
||||
continue
|
||||
witnesses.append({'person': person, 'academic': academic, 'academic_document': academic_document,
|
||||
'person_document': person_document,
|
||||
'keyword': keyword[1], 'keyword_document': keyword[0],
|
||||
'category': category[1], 'category_document': category[0],
|
||||
'document_author': author[1], 'author_document': author[0]})
|
||||
return witnesses
|
||||
|
||||
def pattern_path(self, witness: dict, pattern: dict) -> list[dict] | None:
|
||||
kinds, relations = pattern.get('node_kinds', []), pattern.get('relationships', [])
|
||||
if not kinds or len(relations) != len(kinds) - 1 or not kind_matches('Person', kinds[0]):
|
||||
return None
|
||||
target_roles = {'Keyword': 'keyword', 'Category': 'category', 'DocumentAuthor': 'document_author',
|
||||
'Thesis': 'academic', 'Work': 'academic', 'Academic': 'academic', 'Thesis|Work': 'academic'}
|
||||
allowed = {key for key in witness.values() if key is not None}
|
||||
required_target = witness.get(target_roles.get(kinds[-1], ''))
|
||||
|
||||
def visit(key, index, path):
|
||||
if index == len(relations):
|
||||
return path if required_target is None or key == required_target else None
|
||||
for next_key in self.neighbors(key, relations[index], kinds[index + 1]):
|
||||
if next_key not in allowed:
|
||||
continue
|
||||
result = visit(next_key, index + 1, path + [next_key])
|
||||
if result:
|
||||
return result
|
||||
return None
|
||||
|
||||
found = visit(witness['person'], 0, [witness['person']])
|
||||
return [self.nodes[key] for key in found] if found else None
|
||||
|
||||
|
||||
def implicit_patterns(binding: dict, index: int) -> list[dict]:
|
||||
patterns = []
|
||||
if 'start_year' in binding or not any(field in binding for field in [
|
||||
'academic_kind', 'academic_type', 'title', 'year', 'keyword', 'category', 'document_author'
|
||||
]):
|
||||
patterns.append({'binding_index': index, 'node_kinds': ['Person', 'Document'],
|
||||
'relationships': ['HAS_DOCUMENT']})
|
||||
if any(field in binding for field in ['academic_kind', 'academic_type', 'title', 'year']):
|
||||
kind = binding.get('academic_kind', 'Academic')
|
||||
relationships = ['AUTHORED'] if kind == 'Thesis' else ['HAS_WORK'] if kind == 'Work' else ['AUTHORED|HAS_WORK']
|
||||
patterns.append({'binding_index': index, 'node_kinds': ['Person', kind, 'Document'],
|
||||
'relationships': relationships + ['EVIDENCED_BY']})
|
||||
for field, kind, relation in [('keyword', 'Keyword', 'HAS_KEYWORD'),
|
||||
('category', 'Category', 'IN_CATEGORY'),
|
||||
('document_author', 'DocumentAuthor', 'AUTHORED_DOCUMENT')]:
|
||||
if field in binding:
|
||||
patterns.append({'binding_index': index, 'node_kinds': ['Person', 'Document', kind],
|
||||
'relationships': ['HAS_DOCUMENT', relation]})
|
||||
return patterns
|
||||
|
||||
|
||||
def legacy_bindings(question: dict) -> list[dict]:
|
||||
"""Best-effort semantic conversion of schema2 annotations, never result data."""
|
||||
graph = question.get('graph', {})
|
||||
entities = defaultdict(list)
|
||||
for row in graph.get('expected_entities', []):
|
||||
entities[row.get('type')].append(row.get('value'))
|
||||
people = entities['person'] or [row['value'] for row in graph.get('start_entities', []) if row['type'] == 'person']
|
||||
people = people or [None]
|
||||
years = entities['year']
|
||||
properties = graph.get('expected_properties', [])
|
||||
start_year = any(prop == 'Person.start_year' for prop in properties)
|
||||
if not years and any('.year' in prop for prop in properties) and not start_year:
|
||||
years = re.findall(r'\b20\d{2}\b', question.get('question', ''))
|
||||
bindings = []
|
||||
for person in people:
|
||||
common = {'person': person} if person else {}
|
||||
if len(years) == 1:
|
||||
common['start_year' if start_year else 'year'] = years[0]
|
||||
for field, entity_type in [('keyword', 'keyword'), ('category', 'category'), ('document_author', 'document_author')]:
|
||||
if len(entities[entity_type]) == 1:
|
||||
common[field] = entities[entity_type][0]
|
||||
titles = [('Thesis', value) for value in entities['thesis_title']] + [('Work', value) for value in entities['work_title']]
|
||||
if titles:
|
||||
bindings.extend({**common, 'academic_kind': kind, 'title': title} for kind, title in titles)
|
||||
elif len(entities['category']) > 1:
|
||||
bindings.extend({**common, 'category': value} for value in entities['category'])
|
||||
elif any(key != 'person' for key in common):
|
||||
bindings.append(common)
|
||||
return bindings
|
||||
|
||||
|
||||
def positive_answer_facts(result: dict) -> list[dict]:
|
||||
facts = []
|
||||
for row in result.get('facts', []):
|
||||
if not isinstance(row, dict):
|
||||
facts.append(row)
|
||||
continue
|
||||
kind = row.get('fact_type', '')
|
||||
if kind == 'academic_year_comparison' and row.get('same_academic_year') is False and not row.get('shared_years'):
|
||||
continue
|
||||
if kind == 'start_year_comparison' and row.get('same_start_year') is False and row.get('shared_start_year') is None:
|
||||
continue
|
||||
facts.append(row)
|
||||
return facts
|
||||
|
||||
|
||||
def evaluate_contract(question: dict, result: dict) -> dict:
|
||||
graph = question.get('graph', {})
|
||||
schema = graph.get('schema_version', 2)
|
||||
negative = bool(graph.get('expected_no_answer') or question.get('should_answer') is False)
|
||||
expected_status = graph.get('expected_status')
|
||||
if negative:
|
||||
status = result.get('status')
|
||||
no_positive = not positive_answer_facts(result) and not result.get('paths')
|
||||
aggregation = result.get('aggregation') or {}
|
||||
if schema >= 3 and expected_status is None:
|
||||
expected_status = 'no_answer'
|
||||
status_ok = status == expected_status if expected_status else status in {'no_answer', 'ambiguous'}
|
||||
reason = result.get('reason')
|
||||
ok = bool(status_ok and isinstance(reason, str) and reason.strip()
|
||||
and no_positive and not aggregation.get('count'))
|
||||
return {'answerability_ok': ok, 'bindings_ok': True, 'binding_score': 1.0,
|
||||
'paths_ok': True, 'path_score': 1.0, 'binding_results': [], 'path_results': [],
|
||||
'expected_no_answer': True, 'actual_status': status}
|
||||
status_ok = (result.get('status') == 'ok' if schema >= 3
|
||||
else result.get('status') not in {'no_answer', 'ambiguous', 'error'})
|
||||
bindings = graph.get('expected_bindings')
|
||||
if bindings is None:
|
||||
bindings = legacy_bindings(question)
|
||||
empty_count_answer = (graph.get('expected_count') == 0 and graph.get('expected_entity_set') == []
|
||||
and (result.get('aggregation') or {}).get('count') == 0
|
||||
and (result.get('aggregation') or {}).get('complete') is True)
|
||||
if schema >= 3 and not bindings and not empty_count_answer:
|
||||
status_ok = False
|
||||
evidence = EvidenceGraph(result)
|
||||
explicit_patterns = graph.get('expected_path_patterns', [])
|
||||
source_choices = graph.get('expected_evidence_documents', [])
|
||||
binding_results, path_results = [], []
|
||||
for index, binding in enumerate(bindings):
|
||||
candidates = evidence.witnesses(binding, require_provenance=schema >= 3)
|
||||
patterns = [p for p in explicit_patterns if p.get('binding_index') == index]
|
||||
if not patterns and schema >= 3:
|
||||
patterns = implicit_patterns(binding, index)
|
||||
winner = None
|
||||
for candidate in candidates:
|
||||
checks = [evidence.pattern_path(candidate, pattern) for pattern in patterns]
|
||||
source_ok = True
|
||||
for choice in source_choices:
|
||||
if choice.get('binding_index') != index:
|
||||
continue
|
||||
document = evidence.nodes.get(candidate.get(choice.get('role')), {})
|
||||
if not any(document.get('path') == option.get('document_path')
|
||||
and document.get('source_url') == option.get('source_url')
|
||||
for option in choice.get('any_of', [])):
|
||||
source_ok = False
|
||||
break
|
||||
if source_ok and all(check is not None for check in checks):
|
||||
winner = checks
|
||||
break
|
||||
binding_results.append({'binding': binding, 'matched': bool(candidates) and winner is not None})
|
||||
for pattern_index, pattern in enumerate(patterns):
|
||||
path_results.append({'pattern': pattern, 'matched': winner is not None,
|
||||
'witness': winner[pattern_index] if winner is not None else []})
|
||||
bindings_ok = all(row['matched'] for row in binding_results)
|
||||
paths_ok = all(row['matched'] for row in path_results)
|
||||
# A malformed pattern referencing a nonexistent binding must not vanish.
|
||||
if any(not isinstance(p.get('binding_index'), int) or p['binding_index'] not in range(len(bindings))
|
||||
for p in explicit_patterns):
|
||||
paths_ok = False
|
||||
if any(not isinstance(p.get('binding_index'), int) or p['binding_index'] not in range(len(bindings))
|
||||
or p.get('role') not in {'academic_document', 'keyword_document', 'category_document',
|
||||
'author_document', 'person_document'} or not p.get('any_of')
|
||||
for p in source_choices):
|
||||
bindings_ok = False
|
||||
return {'answerability_ok': status_ok, 'bindings_ok': bindings_ok,
|
||||
'binding_score': sum(row['matched'] for row in binding_results) / len(binding_results) if binding_results else 1.0,
|
||||
'paths_ok': paths_ok,
|
||||
'path_score': sum(row['matched'] for row in path_results) / len(path_results) if path_results else float(paths_ok),
|
||||
'binding_results': binding_results, 'path_results': path_results,
|
||||
'expected_no_answer': False, 'actual_status': result.get('status', 'ok')}
|
||||
110
tools/graphrag/evaluation/freeze_graphrag.py
Normal file
110
tools/graphrag/evaluation/freeze_graphrag.py
Normal file
@ -0,0 +1,110 @@
|
||||
"""Freeze the exact code, data, graph and parameters after complete DEV evaluation."""
|
||||
from __future__ import annotations
|
||||
|
||||
import argparse
|
||||
import json
|
||||
from datetime import datetime, timezone
|
||||
from pathlib import Path
|
||||
|
||||
from .reproducibility import content_fingerprints, sha256_file
|
||||
|
||||
|
||||
def make_freeze(dev: dict, questions: list[dict], fingerprints: dict, audit: dict,
|
||||
*, purpose: str = 'independent_holdout') -> dict:
|
||||
if purpose not in {'independent_holdout','historical_regression'}:
|
||||
raise ValueError('Unknown evaluation purpose.')
|
||||
expected_ids = {q['id'] for q in questions if q['split'] == 'dev'}
|
||||
actual_ids = [row['id'] for row in dev['questions']]
|
||||
if dev['configuration']['split'] != 'dev' or set(actual_ids) != expected_ids or len(actual_ids) != len(expected_ids):
|
||||
raise RuntimeError('Freeze requires the complete DEV split, without duplicates.')
|
||||
if dev['summary']['error_count'] or any(row.get('error') for row in dev['questions']):
|
||||
raise RuntimeError('Freeze requires DEV without runtime errors.')
|
||||
if dev['run_metadata']['fingerprints'] != fingerprints:
|
||||
raise RuntimeError('Code or data changed after DEV; rerun DEV before freezing.')
|
||||
if fingerprints.get('retrieval_policy') and any(
|
||||
row.get('source_checked') is not True or row.get('all_facts_supported') is not True
|
||||
for row in dev['questions']):
|
||||
raise RuntimeError('Every DEV result must pass independent validation of all returned facts.')
|
||||
if audit['dataset_sha256'] != fingerprints['dataset_sha256'] or audit['inputs'] != fingerprints['inputs']:
|
||||
raise RuntimeError('Source audit does not match the benchmark and inputs.')
|
||||
if len(audit['questions']) != len(questions) or {r['id'] for r in audit['questions']} != {q['id'] for q in questions}:
|
||||
raise RuntimeError('Source audit must cover every question exactly once.')
|
||||
schema3 = any(question.get('graph', {}).get('schema_version') == 3 for question in questions)
|
||||
partition = None
|
||||
if schema3:
|
||||
if audit.get('source_corpus') != fingerprints.get('source_corpus'):
|
||||
raise RuntimeError('Independent audit does not match original Markdown sources.')
|
||||
if any(not row.get('source_consistent') for row in audit['questions']):
|
||||
raise RuntimeError('Resolve source-inconsistent annotations before freezing v2.')
|
||||
profiles = {split: {profile for question in questions if question['split'] == split
|
||||
for profile in question.get('graph', {}).get('source_profiles', [])}
|
||||
for split in ('dev', 'test')}
|
||||
policy = audit.get('partition_policy', {})
|
||||
if purpose == 'historical_regression':
|
||||
partition = {'method': 'Previously exposed questions; regression, not independent TEST',
|
||||
'dev_profile_count': len(profiles['dev']),
|
||||
'test_profile_count': len(profiles['test']),
|
||||
'source_profile_overlap': len(profiles['dev'] & profiles['test'])}
|
||||
elif policy.get('method') == 'disjoint logical query groups':
|
||||
# This mode explicitly reports known profiles. It must never be
|
||||
# presented as the stronger, historic unseen-profile experiment.
|
||||
from .benchmark_v4 import logical_group
|
||||
from .source_oracle import norm
|
||||
groups = {split: {logical_group(q) for q in questions if q['split'] == split}
|
||||
for split in ('dev', 'test')}
|
||||
if any(q['graph'].get('partition_group') != logical_group(q) for q in questions):
|
||||
raise RuntimeError('Declared logical group does not match the question constraints.')
|
||||
if not groups['dev'] or not groups['test'] or groups['dev'] & groups['test']:
|
||||
raise RuntimeError('DEV/TEST logical groups overlap or are missing.')
|
||||
exposed = set(policy.get('previously_exposed_groups', []))
|
||||
if not exposed or groups['test'] & exposed:
|
||||
raise RuntimeError('TEST contains previously exposed logical groups.')
|
||||
texts = {split: {norm(q['question']) for q in questions if q['split'] == split}
|
||||
for split in ('dev', 'test')}
|
||||
if texts['dev'] & texts['test']:
|
||||
raise RuntimeError('DEV/TEST question texts overlap.')
|
||||
partition = {'method': policy['method'], 'logical_group_overlap': 0,
|
||||
'previously_exposed_test_groups': 0,
|
||||
'dev_group_count': len(groups['dev']), 'test_group_count': len(groups['test']),
|
||||
'dev_profile_count': len(profiles['dev']), 'test_profile_count': len(profiles['test']),
|
||||
'source_profile_overlap': len(profiles['dev'] & profiles['test']),
|
||||
'limitations': policy['limitations']}
|
||||
elif profiles['dev'] & profiles['test']:
|
||||
raise RuntimeError('DEV/TEST source profiles overlap; independent holdout refused.')
|
||||
if not profiles['dev'] or not profiles['test']:
|
||||
raise RuntimeError('Primary v2 freeze requires declared DEV and TEST source profiles.')
|
||||
if partition is None:
|
||||
partition = {'method': 'disjoint source profiles',
|
||||
'dev_profile_count': len(profiles['dev']),
|
||||
'test_profile_count': len(profiles['test']), 'overlap': 0}
|
||||
return {'schema_version': 2 if schema3 else 1, 'evaluation_kind':purpose,
|
||||
'partition': partition, 'frozen_at_utc': datetime.now(timezone.utc).isoformat(),
|
||||
'fingerprints': fingerprints, 'graph': dev['run_metadata']['graph'],
|
||||
'parameters': {key: dev['configuration'][key] for key in ['limit', 'max_entities']},
|
||||
'dev_summary': dev['summary'], 'source_audit_summary': audit['by_split'],
|
||||
'policy': 'Report all questions including negatives. No exclusions or holdout tuning.'}
|
||||
|
||||
|
||||
def main() -> None:
|
||||
parser = argparse.ArgumentParser(description=__doc__)
|
||||
parser.add_argument('--dev-results', type=Path, required=True)
|
||||
parser.add_argument('--questions', type=Path, required=True)
|
||||
parser.add_argument('--audit', type=Path, required=True)
|
||||
parser.add_argument('--output', type=Path, required=True)
|
||||
parser.add_argument('--purpose', choices=['independent_holdout','historical_regression'],
|
||||
default='independent_holdout')
|
||||
args = parser.parse_args()
|
||||
if args.output.exists():
|
||||
parser.error('Freeze manifest already exists; choose a new version/output path.')
|
||||
manifest = make_freeze(json.loads(args.dev_results.read_text()), json.loads(args.questions.read_text()),
|
||||
content_fingerprints(args.questions), json.loads(args.audit.read_text()), purpose=args.purpose)
|
||||
manifest.update({'dev_results_sha256': sha256_file(args.dev_results),
|
||||
'audit_sha256': sha256_file(args.audit)})
|
||||
args.output.parent.mkdir(parents=True, exist_ok=True)
|
||||
with args.output.open('x', encoding='utf-8') as output:
|
||||
output.write(json.dumps(manifest, ensure_ascii=False, indent=2) + '\n')
|
||||
print(f'Frozen GraphRAG: {args.output}')
|
||||
|
||||
|
||||
if __name__ == '__main__':
|
||||
main()
|
||||
134
tools/graphrag/evaluation/frozen_release_v6.json
Normal file
134
tools/graphrag/evaluation/frozen_release_v6.json
Normal file
@ -0,0 +1,134 @@
|
||||
{
|
||||
"release": "graphrag-v6-frozen",
|
||||
"evaluation_kind": "historical_regression",
|
||||
"graph_freeze_sha256": "54946b476fd713f551414b00cf2b843627566f6a333e3b59ce3efbbdf2328629",
|
||||
"runtime_files": {
|
||||
"app/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"app/main.py": "ff1adeff8b770047139fe3f632ad837517c95ec04649849c4315d6f892f9eef3",
|
||||
"app/routes.py": "dfb82171fea33d33b6e48cb238d2c19a29254b47a9a87308f4864cdbac53fa7b",
|
||||
"app/security.py": "24f437aff6642477049f02fdccfb3429c15e610d044bbb66128903771510055f",
|
||||
"requirements.txt": "26a6d097727eba03c1b6c71cd02b06373ef01ce03e567dd2bc4357ae330e5a1a",
|
||||
"tools/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/answer_evaluation/__init__.py": "795be75bf60e4aa9209e5b820207e52e8420c41a4dc2e37d0b6018cd2934a51a",
|
||||
"tools/answer_evaluation/answer_format.py": "86a27b4aebc6a5077e13794b81957a1cf063a1f3e070c583120ba53c1788d2f8",
|
||||
"tools/answer_evaluation/check_context_scenarios.py": "cbb2edf8fdcba61b9e5cc50e28cb1a1dcc25b0e0ab990177b41f40031223ca63",
|
||||
"tools/answer_evaluation/check_deployment.py": "803c5a42ab61ff6529b830a4e1ab2f1401b59565b56086db65d449f0f9c1dfb5",
|
||||
"tools/answer_evaluation/check_rag_runtime.py": "1e1b8bd48ac4d668ec057fee162ef30d34ae20ae026361bc8cc296bc455d4067",
|
||||
"tools/answer_evaluation/checked_generation.py": "7e017471e6281db62b79f270210db3ab14c7e31a4623bbfa3d9a5fd8911b1c20",
|
||||
"tools/answer_evaluation/context_policy.py": "e7b7c511e5e9cafdef04969eb4007a6a61ac4b99bcc60e9e722945a15bec1f26",
|
||||
"tools/answer_evaluation/evaluate_graph_answers.py": "2553a0d17e164922b02046416fdf0d5df4496dc443466d8d9a1f4be86415b318",
|
||||
"tools/answer_evaluation/graph_answer_prompt.txt": "8c8274a22bf5b44364d8fc8226a8f659b31c232f5a2aba5916d693b559e9f341",
|
||||
"tools/answer_evaluation/rag_delivery.py": "b83f93d446f44fdd7d41c12eeeaae69c0b02908076624f4eb3f4f72b9b88dbc8",
|
||||
"tools/answer_evaluation/regrade_citations.py": "330f437aec12927fd8c99b0aa601373f6ab26cb111971a6fb06098931d1e4aab",
|
||||
"tools/graphrag/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/build_graphrag.py": "256292101d6d7d1946e926e2717ac45465b169f4091c51ecfed4f1a779dfd700",
|
||||
"tools/graphrag/evaluation/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/evaluation/audit_benchmark.py": "6619c818a52fc284e87ed6c48a503a54a3c9dd95447463ed78f075b7c58bad80",
|
||||
"tools/graphrag/evaluation/benchmark_v2.py": "129dd774faa414f06733e1ee6333e7b411b1c75b5601b895c405778df478a563",
|
||||
"tools/graphrag/evaluation/benchmark_v3.py": "30bae6c605ed26f4b49973acec799087c4e2b97a883ccedcafb965dd909c4c4d",
|
||||
"tools/graphrag/evaluation/benchmark_v4.py": "70a8b08f7c2b2cb3e2bdc77be9efedd23ea24ac564ec1c1eb224a9f6388b3a67",
|
||||
"tools/graphrag/evaluation/benchmark_v6.py": "f955e600d17358fafcb33bab772aef09d787452f6b33352e299fdd42669aaf34",
|
||||
"tools/graphrag/evaluation/check_openwebui.py": "e2a81b52f7431b27a5e2a7d2bd0801029a782ea3620c0b7a289c57bdebb994d7",
|
||||
"tools/graphrag/evaluation/evaluate_graphrag.py": "89c364d15b70c9cb55df39d5970b4d0d79b681ba70eed7530a4e3fe64167812e",
|
||||
"tools/graphrag/evaluation/evidence_contract.py": "78e24264c176e163e1782fef1634b6c45c7f31bd4692726d02a30ab45a06648e",
|
||||
"tools/graphrag/evaluation/freeze_graphrag.py": "793c6d04a13c3217347283c609f647cd0d69b020e44bbde458bdc7ebbab8ec7e",
|
||||
"tools/graphrag/evaluation/graphrag_evaluator.py": "7f99bf0f97974058650b619ea49a8ee32284cb4b324f1ffab9baf54f5c4495f4",
|
||||
"tools/graphrag/evaluation/reproducibility.py": "8db9a0e0f86236b56239f41da11803538dfaa6745bbf74dbd7618e0a73bda0ae",
|
||||
"tools/graphrag/evaluation/source_oracle.py": "f2265d0919a4019f10d2b4a986bd772684fe59c598d7ae2f5cd0daa41f81b87b",
|
||||
"tools/graphrag/evaluation/source_validation.py": "9671b8978623888dbed8b8b2d1b6b01c1ce73cb0a512b03919e48873990f15ed",
|
||||
"tools/graphrag/graph_db.py": "c4b1a2edb765856b807398e4c243a8d17753529a5d2dfdb51791e28bc8de17f7",
|
||||
"tools/graphrag/graph_search.py": "8cc3668b4ad7beabf849e6978ea1d5defc818b142ee8b157b19c319998fb7541",
|
||||
"tools/graphrag/graphrag.py": "a718efbd001301c4a809aa449a2f175ae7aca8f6f3248f539d6f0597faeb3187",
|
||||
"tools/graphrag/neo4j_smoke.py": "fb5244c72c29ef2acf96d1e7f54335ff168eed4119db1692025eb1b99194b7bb",
|
||||
"tools/graphrag/publication.py": "fba1fa0d0bed325fd87f8d3593baae9271de1766b772d7214c7f63fd3f1c37b6",
|
||||
"tools/graphrag/tests/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/tests/test_evaluation_pipeline_v2.py": "63d1b3e80ae3c7b563374fd7ab4aa5ffad3c614eafbd15142c577abd7f756bf9",
|
||||
"tools/graphrag/tests/test_evaluation_v5.py": "9387e9d1418ebab87530986b0e29dac31cf33d762777a29a31cff24cc72e552a",
|
||||
"tools/graphrag/tests/test_evaluation_wide.py": "1b28bb74fd6b9457c869186b88606f1f7863d573aa3ab5226162e878f236d99e",
|
||||
"tools/graphrag/tests/test_evaluator_connected_v2.py": "29d7c9838ed1ff37ea3276df6feb1b6142158c43a0525712f490b648181882de",
|
||||
"tools/graphrag/tests/test_graph_publication.py": "96e53c1ae28e36c7a4290e1e60c8b398bf095ceaf883e819e1a477e2672b11c0",
|
||||
"tools/graphrag/tests/test_graph_rebuild_atomic.py": "fe37d4fff0b1f0fb1d565f0a96152b9b4e336837bc78b5977cf3b4879d7fbaf3",
|
||||
"tools/graphrag/tests/test_graph_search.py": "eb58661aef9dafe6bf7188fcdc2d79cef6652d57c64d1b81ae81a52e8e0204d7",
|
||||
"tools/graphrag/tests/test_graph_search_entity_v2.py": "0ef1a8ebd513c5a4507eb38fcf5ae6137c69e9901b5a2975ba513be5902ac693",
|
||||
"tools/graphrag/tests/test_graph_search_neo4j.py": "fec2bf72de8f752f17c9164fee5754bdb2e153828855e47efbf0000dbe82cf3b",
|
||||
"tools/graphrag/tests/test_graph_search_regressions.py": "9db7779aeb8ed9e8c0f92c1657011a81080aff3c928649e811358e3009a18c48",
|
||||
"tools/graphrag/tests/test_graphrag.py": "9ee8629d6b528dd78c2ddfc25cee95e17613f45b454fc0a38d4c591862637a9f",
|
||||
"tools/graphrag/tests/test_graphrag_evaluator.py": "1c6d08aeec9ae56ac4123239a5aed12a0081d66cc3f34b2047d95764579d7298",
|
||||
"tools/graphrag/tests/test_graphrag_freeze.py": "c4b760baf4c7ebf13b16bd4cd3c51874f5512eef3b4c61470dc4d428b0303d9f",
|
||||
"tools/graphrag/tests/test_graphrag_research_v2.py": "711008a91ab8a58ae0854e7f90329bcd42e5189fde2e2001589e97b0c22c5198",
|
||||
"tools/graphrag/tests/test_graphrag_root_title.py": "085651fe6e6081521a5dde9554abfee93456250108cf15978df25378d886a46c",
|
||||
"tools/graphrag/tests/test_source_oracle_v2.py": "0afdbe235e185ffe9f38aa667f90f5a6c20504fe29e9ac572642b39a8eb7faca",
|
||||
"tools/graphrag/tests/test_title_labels.py": "2983ead68ad6e2e346d24af0fc96dc6771c163e9c2a351af426a1e0383998e6f",
|
||||
"tools/index_state.py": "c33920a63d04009f11ef23ca9e9eee9bf86453b7d0586d027bf3b39156afea0d",
|
||||
"tools/publication.py": "f99d445073390a733afc8d849b9fcd4b4b0890bb54d136db67d4015b78436e1a",
|
||||
"tools/rag/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/rag/build_chunks.py": "fe060e25b138abcb689a6eb1b1e993d7017a4b3c5dd63e7cd275e1279da6053b",
|
||||
"tools/rag/build_sqlite_index.py": "107c0987e9ec4086ff41f9e7ae30195a67be34616875635e705dc79236e79416",
|
||||
"tools/rag/common.py": "8497c46d5c6c27a7c76df1568360ad5e9d00d5e5a7ef186e758960cc79d81d1c",
|
||||
"tools/rag/embedding_utils.py": "a2ea0b5be1a1782efff1c85c0eabfedba043e0e8bf7eb8b6617eab60eb4559c3",
|
||||
"tools/rag/evaluation/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/rag/evaluation/evaluate_rag_answers.py": "945c2da655537fb37fe82a08e10dc3ed66a2d90980921f61f61efb171a4a26a2",
|
||||
"tools/rag/evaluation/evaluate_retrieval.py": "aba865751ab74d9c2b962548b1e476508dbe6cf7bf811bda79e25f853061cbd7",
|
||||
"tools/rag/evaluation/metrics.py": "40b7d16f7729599c1d2fa2370f7cb40dfa04a968cdadef3c4fae83a168202c28",
|
||||
"tools/rag/evaluation/rag_answer_data.py": "9a369e9ced254cf723a5d3006877959c6f144f4c770e382835af776f7f569762",
|
||||
"tools/rag/evaluation/rag_answer_state.py": "da4ab19f22378899d5c13e93e803a978518f8edcdd62e4990a06aae12d8eb469",
|
||||
"tools/rag/evaluation/rag_metrics.py": "3e95922df90dd1b757a550040a2d9bd4f857e17d179f60170d7cc881a08f94b6",
|
||||
"tools/rag/evaluation/rag_runner.py": "031abf7d5b1a026eb199aa2a579bfb8baaa01175279d0018a364bfe50b76c3c1",
|
||||
"tools/rag/evaluation/retrieval_runner.py": "fe3dd05459f825d72252b7a0841f28004fc81537096a7de487807e4d5f0c4c45",
|
||||
"tools/rag/rag_document_expansion.py": "d565b9794e30bc0f387c791a0557d5d03f2c1fa2fe5db53e49a9b19b1158f48e",
|
||||
"tools/rag/rag_query_evidence.py": "90fced0fecd8ef976a1537506d2e7e8e9d3ba22a6371131f978fb91df5cc0b19",
|
||||
"tools/rag/rag_supplemental_expansion.py": "a593579e543149633e3146c3886536a9196aff43f4df6f3d7ade94ca16dd243a",
|
||||
"tools/rag/rag_utils.py": "4f898cf0facc2ae9f2ea28a36f48d4ed37bd7fc716e097b319bcf4d36a4a4f03",
|
||||
"tools/rag/rebuild_index.py": "6a4d86a551d1141c403a0f6570c568896af37faeaa8c67cac170d2e6a393ca06",
|
||||
"tools/rag/scan_zpwiki.py": "ef770ce4edb6352ff0690af5783766c95062a0e56f638cca6e3d929973728273",
|
||||
"tools/rag/search_core.py": "624c8ddfe3edf78d06014579b747a59b2e33c0191a7cf90cdfd624b52ed5e96b",
|
||||
"tools/rag/search_db.py": "cc63aeaf2854e87b7448c3978959569b097074cdb16a9b2c16b2c37a4677fdbb",
|
||||
"tools/rag/search_utils.py": "69597bf5785f7852b1131a0648d9d2c65b6babba9ad279581f08b40d185ee646",
|
||||
"tools/rag/tests/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/rag/tests/conftest.py": "0c94402d5ca971233d9802ded81cdb39ae7dfddda5eb9126e2035f7599a8f1c7",
|
||||
"tools/rag/tests/test_chunking.py": "94904a20cfed0512d508017eaadbb43ef45ca74a5e96631241f6ca481222c498",
|
||||
"tools/rag/tests/test_common.py": "86f0aecb79b7a3764112c833ea3b732073c073a5d570ef8c99900fb2a3f04430",
|
||||
"tools/rag/tests/test_database.py": "31fc3553d76127c2d7e2c113b9053e537a72bb92f57a9c24cad6a579a1ffc589",
|
||||
"tools/rag/tests/test_e5_1_remaining.py": "a8a52d5204e7376f33bb1aef96aad20990126a0b92266596b7cf8dd0dcbea4bc",
|
||||
"tools/rag/tests/test_evaluate_rag_answers.py": "2143f3c9efbacf7b9119eeb9ae69e6cd7ea3f428ff5076d8e9973d0943675296",
|
||||
"tools/rag/tests/test_live_data.py": "3c5e04d4a29ec8360d89881be980dacacccf0e12594fe51a22ec23c32c98b3e3",
|
||||
"tools/rag/tests/test_rag.py": "13e97c88bf4afe45a8d633b269d110890f0f646887cee861bbf55ada0be7ad24",
|
||||
"tools/rag/tests/test_rag_document_expansion.py": "9adf39c7a9b683b1d40c36fce576272e71869b7c1236c371c1b077820874eb7e",
|
||||
"tools/rag/tests/test_rag_metrics_morphology.py": "070ee314d326e4c7218e7c19959a94076a2b241c4f19b9ecd9ca1fb3cc2639d4",
|
||||
"tools/rag/tests/test_rag_metrics_semantic.py": "3642394d2636edd7420589348fb75bf1d214b539983b7e620008d626deffabf0",
|
||||
"tools/rag/tests/test_rag_query_evidence.py": "c3fb5115306171010759b0cfd0cd05d1439d6a57de049efea02330ae7c553bfc",
|
||||
"tools/rag/tests/test_rag_query_evidence_topn.py": "ebf01ad57a52f030b908b7fb0312d8d32cf9f60ea2953c5a3fb8849c1f2dceaf",
|
||||
"tools/rag/tests/test_rag_runner.py": "1813086999d1e9826b42c2ac7978ea77d29e1c4b12f5e606f1fba572829e24ea",
|
||||
"tools/rag/tests/test_rag_runner_routing.py": "c9454e5dddfdb7afc013567811efec15545daf20733b7167f78f2dd9ff0380d6",
|
||||
"tools/rag/tests/test_rag_runner_tool_prompt.py": "073403907717d8d388c28ea92d1d1f9426edab2e8bd320c8f6329bcbff082e6c",
|
||||
"tools/rag/tests/test_rag_supplemental_expansion.py": "65449054e2d94396def0dc8d505a9573306adbf184820ddd6c9b5ea92e165f8b",
|
||||
"tools/rag/tests/test_rebuild_index.py": "aa0688b81e4b699ce99e97a4b8c1a6d4a49c5c153caa02301ebd5a5d8be764a4",
|
||||
"tools/rag/tests/test_scan_zpwiki.py": "324510ca504dff11ecf39b28aff26b44a358e14084b3b015c0c410690d8aa129",
|
||||
"tools/rag/tests/test_search.py": "82c96d35719d2233e4636b6f25d89b22f004848d8bae46a9705ee384d4abe9a8",
|
||||
"tools/retrieval_contract.py": "b8fa272c3babf924a3ce8b937fe7ae437cd959ba9f7667193ac67c18d2c5b58d",
|
||||
"tools/sync_indexes.py": "5b909b4394c24e5ce22848594b16d9aea45fb06418f5cd92bb6aa6381a0ccf10",
|
||||
"tools/tool_health.py": "8ad37345889ad58a737edac5960b5b6c5002af2397d60248f434e03fb4eddd89"
|
||||
},
|
||||
"deployment_configuration": {
|
||||
"Dockerfile": "fc7aefe4a99222daedc321acf8359773dc24eff82be04e688507e135956a92a6",
|
||||
"docker-compose.yml": "e33b65c58f155ac057b01be272bc323fab3ff7eb4f51c9e4ca1b53904cc17af4"
|
||||
},
|
||||
"measured_artifacts": {
|
||||
"tools/graphrag/evaluation/results/final_v6_2026-10-25/graphrag_dev.json": "d4ac47c21aed4be149a3f1aec1f7658c862da2ee24e41cc680128d013a071707",
|
||||
"tools/graphrag/evaluation/results/final_v6_2026-10-25/graphrag_test.json": "2d569267ada3eecb81cd793cc2c7e8f7715b3c9b931799d4ef0663ac3f11f1d5",
|
||||
"tools/graphrag/evaluation/graphrag_questions_v6.json": "a7bb38be01e03603cf2fa2c7137817094dff0a0cbb3f801263609e55b28e9edc",
|
||||
"tools/graphrag/evaluation/results/v6_preparation/source_audit.json": "d5922db25b6d40cb7e5dc7df7990e93a3caee263a6e747ae910ab340da340023",
|
||||
"tools/graphrag/evaluation/results/v6_preparation/protocol.json": "3f33834c78d35586d8bd8eb2cd48d7db184df5a1d683806d40f0d743aec6c21e",
|
||||
"tools/graphrag/evaluation/results/v6_preparation/source_review.csv": "ecf420330a6bb9a4a11fafa99ab617886d069d5c7e34f8045467794145f33cf9",
|
||||
"tools/graphrag/evaluation/results/v6_preparation/rag_delivery_replay.json": "3ecb0ba20b515f968df5cd070e2b470d58d69f3fb7bfb2546b1bd01e8e308a83",
|
||||
"tools/graphrag/evaluation/results/v6_preparation/citation_regrade.json": "238015f0f36010cb7f53570188a7e65e4a40e1ad778c9bab6bd37d2b4a697bc6",
|
||||
"tools/graphrag/evaluation/results/answers_v6_final_dev_2026-10-25/answers_dev.json": "f70834bf4ee1fe106c0849ab56e0758dd50e07dfa9bbc25b05ae4d4e811a4edd",
|
||||
"tools/graphrag/evaluation/results/answers_v6_regression_2026-10-25/answers_regression.json": "17a675405a79e3309602d0ac6f5b4ef447edde88a2c4c950aeb675d2de9aa4a4"
|
||||
},
|
||||
"policy": "Graph-generation files remained frozen during all 320 cases. RAG-only delivery notice verified separately and included in this full-runtime release freeze.",
|
||||
"secrets_excluded": [
|
||||
".env",
|
||||
"credentials",
|
||||
"private keys"
|
||||
]
|
||||
}
|
||||
137
tools/graphrag/evaluation/frozen_release_v7.json
Normal file
137
tools/graphrag/evaluation/frozen_release_v7.json
Normal file
@ -0,0 +1,137 @@
|
||||
{
|
||||
"release": "graphrag-v7-frozen",
|
||||
"evaluation_kind": "fresh_query_group_holdout_plus_historical_regression",
|
||||
"graph_freeze_sha256": "9e97794200520d0f2288e452c9e186c0291a54c63d2c1382f693a9753e4081cf",
|
||||
"runtime_files": {
|
||||
"app/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"app/main.py": "ff1adeff8b770047139fe3f632ad837517c95ec04649849c4315d6f892f9eef3",
|
||||
"app/routes.py": "dfb82171fea33d33b6e48cb238d2c19a29254b47a9a87308f4864cdbac53fa7b",
|
||||
"app/security.py": "24f437aff6642477049f02fdccfb3429c15e610d044bbb66128903771510055f",
|
||||
"requirements.txt": "26a6d097727eba03c1b6c71cd02b06373ef01ce03e567dd2bc4357ae330e5a1a",
|
||||
"tools/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/answer_evaluation/__init__.py": "795be75bf60e4aa9209e5b820207e52e8420c41a4dc2e37d0b6018cd2934a51a",
|
||||
"tools/answer_evaluation/answer_format.py": "86a27b4aebc6a5077e13794b81957a1cf063a1f3e070c583120ba53c1788d2f8",
|
||||
"tools/answer_evaluation/check_context_scenarios.py": "99dbae2747183622e0823cd8f6536f4ff38ef56d0e41dd7855096d47af3b1c37",
|
||||
"tools/answer_evaluation/check_deployment.py": "14618b102c0ade954dc73cbc5036a628166f0eb703d435b679d1a000d045ab5a",
|
||||
"tools/answer_evaluation/check_rag_runtime.py": "1e1b8bd48ac4d668ec057fee162ef30d34ae20ae026361bc8cc296bc455d4067",
|
||||
"tools/answer_evaluation/checked_generation.py": "cb821a65327424c19cbd996190b14e6aa30d9b909493f11716552f71249a0529",
|
||||
"tools/answer_evaluation/context_policy.py": "0dc2a056ca0d886d7cc8248ed4632c910c5e35bebd03ef94573df41802297f47",
|
||||
"tools/answer_evaluation/evaluate_graph_answers.py": "d81504e8fe51598c6bd1b0d482f61b9b6f51f87ba3f38b03ae1bc584675a3b76",
|
||||
"tools/answer_evaluation/graph_answer_prompt.txt": "fc9f2f8d52e70a8d67b9f4814b3f15e6be64bf88afe53ce4db4f037bde00e064",
|
||||
"tools/answer_evaluation/rag_delivery.py": "b83f93d446f44fdd7d41c12eeeaae69c0b02908076624f4eb3f4f72b9b88dbc8",
|
||||
"tools/answer_evaluation/regrade_citations.py": "330f437aec12927fd8c99b0aa601373f6ab26cb111971a6fb06098931d1e4aab",
|
||||
"tools/answer_evaluation/render_answer.py": "609c534a37899b3febcea32d983da4b806c287de8f2ddf9bc0675e3280859002",
|
||||
"tools/graphrag/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/build_graphrag.py": "256292101d6d7d1946e926e2717ac45465b169f4091c51ecfed4f1a779dfd700",
|
||||
"tools/graphrag/evaluation/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/evaluation/audit_benchmark.py": "6619c818a52fc284e87ed6c48a503a54a3c9dd95447463ed78f075b7c58bad80",
|
||||
"tools/graphrag/evaluation/benchmark_v2.py": "62a0b6af852d5ae8060c06db3f983ef4b797d74443f9df25a6b8bd77bf133330",
|
||||
"tools/graphrag/evaluation/benchmark_v3.py": "30bae6c605ed26f4b49973acec799087c4e2b97a883ccedcafb965dd909c4c4d",
|
||||
"tools/graphrag/evaluation/benchmark_v4.py": "7a731fe649d3d5170045b8bbcabf31ad527e5d26a934d434a4be3a4c94dc5c38",
|
||||
"tools/graphrag/evaluation/benchmark_v6.py": "f955e600d17358fafcb33bab772aef09d787452f6b33352e299fdd42669aaf34",
|
||||
"tools/graphrag/evaluation/benchmark_v7.py": "9477cd6e9a6dd0558837cf044535de75a8f101b17115e28e57a82d96d1aa01cb",
|
||||
"tools/graphrag/evaluation/check_openwebui.py": "863801048231d474ba82930cf6bf6853b4410f8295b3f97fd3d5934852431fbe",
|
||||
"tools/graphrag/evaluation/evaluate_graphrag.py": "22f48e9ac6dfae92d79ad648ca173547c6a37f98aa8199f7c37595f1b0b186f9",
|
||||
"tools/graphrag/evaluation/evidence_contract.py": "78e24264c176e163e1782fef1634b6c45c7f31bd4692726d02a30ab45a06648e",
|
||||
"tools/graphrag/evaluation/freeze_graphrag.py": "d8764d1aeb72208de55604785acff880002da1f818d8a8ad9477cf39e1f29efb",
|
||||
"tools/graphrag/evaluation/graphrag_evaluator.py": "7f99bf0f97974058650b619ea49a8ee32284cb4b324f1ffab9baf54f5c4495f4",
|
||||
"tools/graphrag/evaluation/reproducibility.py": "0e2dab6ffb17691f05f9d81dbec12ffc0f2e4e0b1a2114a75b66a5165cf7b4d2",
|
||||
"tools/graphrag/evaluation/source_oracle.py": "aed0309435fd21bc274fde7905a0720f68f359b3c30bb0b912e3371ebf0d8072",
|
||||
"tools/graphrag/evaluation/source_validation.py": "9671b8978623888dbed8b8b2d1b6b01c1ce73cb0a512b03919e48873990f15ed",
|
||||
"tools/graphrag/graph_db.py": "c4b1a2edb765856b807398e4c243a8d17753529a5d2dfdb51791e28bc8de17f7",
|
||||
"tools/graphrag/graph_search.py": "c41cbfbac0d5daa1d0b51f5f4b798a15688bbd2e0498d2cbe93c6584a99f6b7d",
|
||||
"tools/graphrag/graphrag.py": "dbc75403aa038e4021b5a70d1f17c62784b478252a94bac8db682bf38dcb39b3",
|
||||
"tools/graphrag/neo4j_smoke.py": "fb5244c72c29ef2acf96d1e7f54335ff168eed4119db1692025eb1b99194b7bb",
|
||||
"tools/graphrag/publication.py": "fba1fa0d0bed325fd87f8d3593baae9271de1766b772d7214c7f63fd3f1c37b6",
|
||||
"tools/graphrag/tests/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/tests/test_evaluation_pipeline_v2.py": "63d1b3e80ae3c7b563374fd7ab4aa5ffad3c614eafbd15142c577abd7f756bf9",
|
||||
"tools/graphrag/tests/test_evaluation_v5.py": "9387e9d1418ebab87530986b0e29dac31cf33d762777a29a31cff24cc72e552a",
|
||||
"tools/graphrag/tests/test_evaluation_wide.py": "1b28bb74fd6b9457c869186b88606f1f7863d573aa3ab5226162e878f236d99e",
|
||||
"tools/graphrag/tests/test_evaluator_connected_v2.py": "29d7c9838ed1ff37ea3276df6feb1b6142158c43a0525712f490b648181882de",
|
||||
"tools/graphrag/tests/test_graph_publication.py": "96e53c1ae28e36c7a4290e1e60c8b398bf095ceaf883e819e1a477e2672b11c0",
|
||||
"tools/graphrag/tests/test_graph_rebuild_atomic.py": "fe37d4fff0b1f0fb1d565f0a96152b9b4e336837bc78b5977cf3b4879d7fbaf3",
|
||||
"tools/graphrag/tests/test_graph_search.py": "eb58661aef9dafe6bf7188fcdc2d79cef6652d57c64d1b81ae81a52e8e0204d7",
|
||||
"tools/graphrag/tests/test_graph_search_entity_v2.py": "0ef1a8ebd513c5a4507eb38fcf5ae6137c69e9901b5a2975ba513be5902ac693",
|
||||
"tools/graphrag/tests/test_graph_search_neo4j.py": "fec2bf72de8f752f17c9164fee5754bdb2e153828855e47efbf0000dbe82cf3b",
|
||||
"tools/graphrag/tests/test_graph_search_regressions.py": "9db7779aeb8ed9e8c0f92c1657011a81080aff3c928649e811358e3009a18c48",
|
||||
"tools/graphrag/tests/test_graphrag.py": "9ee8629d6b528dd78c2ddfc25cee95e17613f45b454fc0a38d4c591862637a9f",
|
||||
"tools/graphrag/tests/test_graphrag_evaluator.py": "1c6d08aeec9ae56ac4123239a5aed12a0081d66cc3f34b2047d95764579d7298",
|
||||
"tools/graphrag/tests/test_graphrag_freeze.py": "c4b760baf4c7ebf13b16bd4cd3c51874f5512eef3b4c61470dc4d428b0303d9f",
|
||||
"tools/graphrag/tests/test_graphrag_research_v2.py": "711008a91ab8a58ae0854e7f90329bcd42e5189fde2e2001589e97b0c22c5198",
|
||||
"tools/graphrag/tests/test_graphrag_root_title.py": "085651fe6e6081521a5dde9554abfee93456250108cf15978df25378d886a46c",
|
||||
"tools/graphrag/tests/test_source_oracle_v2.py": "0afdbe235e185ffe9f38aa667f90f5a6c20504fe29e9ac572642b39a8eb7faca",
|
||||
"tools/graphrag/tests/test_title_labels.py": "2983ead68ad6e2e346d24af0fc96dc6771c163e9c2a351af426a1e0383998e6f",
|
||||
"tools/index_state.py": "c33920a63d04009f11ef23ca9e9eee9bf86453b7d0586d027bf3b39156afea0d",
|
||||
"tools/publication.py": "f99d445073390a733afc8d849b9fcd4b4b0890bb54d136db67d4015b78436e1a",
|
||||
"tools/rag/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/rag/build_chunks.py": "fe060e25b138abcb689a6eb1b1e993d7017a4b3c5dd63e7cd275e1279da6053b",
|
||||
"tools/rag/build_sqlite_index.py": "107c0987e9ec4086ff41f9e7ae30195a67be34616875635e705dc79236e79416",
|
||||
"tools/rag/common.py": "8497c46d5c6c27a7c76df1568360ad5e9d00d5e5a7ef186e758960cc79d81d1c",
|
||||
"tools/rag/embedding_utils.py": "a2ea0b5be1a1782efff1c85c0eabfedba043e0e8bf7eb8b6617eab60eb4559c3",
|
||||
"tools/rag/evaluation/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/rag/evaluation/evaluate_rag_answers.py": "945c2da655537fb37fe82a08e10dc3ed66a2d90980921f61f61efb171a4a26a2",
|
||||
"tools/rag/evaluation/evaluate_retrieval.py": "aba865751ab74d9c2b962548b1e476508dbe6cf7bf811bda79e25f853061cbd7",
|
||||
"tools/rag/evaluation/metrics.py": "40b7d16f7729599c1d2fa2370f7cb40dfa04a968cdadef3c4fae83a168202c28",
|
||||
"tools/rag/evaluation/rag_answer_data.py": "9a369e9ced254cf723a5d3006877959c6f144f4c770e382835af776f7f569762",
|
||||
"tools/rag/evaluation/rag_answer_state.py": "da4ab19f22378899d5c13e93e803a978518f8edcdd62e4990a06aae12d8eb469",
|
||||
"tools/rag/evaluation/rag_metrics.py": "3e95922df90dd1b757a550040a2d9bd4f857e17d179f60170d7cc881a08f94b6",
|
||||
"tools/rag/evaluation/rag_runner.py": "031abf7d5b1a026eb199aa2a579bfb8baaa01175279d0018a364bfe50b76c3c1",
|
||||
"tools/rag/evaluation/retrieval_runner.py": "fe3dd05459f825d72252b7a0841f28004fc81537096a7de487807e4d5f0c4c45",
|
||||
"tools/rag/rag_document_expansion.py": "d565b9794e30bc0f387c791a0557d5d03f2c1fa2fe5db53e49a9b19b1158f48e",
|
||||
"tools/rag/rag_query_evidence.py": "90fced0fecd8ef976a1537506d2e7e8e9d3ba22a6371131f978fb91df5cc0b19",
|
||||
"tools/rag/rag_supplemental_expansion.py": "a593579e543149633e3146c3886536a9196aff43f4df6f3d7ade94ca16dd243a",
|
||||
"tools/rag/rag_utils.py": "4f898cf0facc2ae9f2ea28a36f48d4ed37bd7fc716e097b319bcf4d36a4a4f03",
|
||||
"tools/rag/rebuild_index.py": "6a4d86a551d1141c403a0f6570c568896af37faeaa8c67cac170d2e6a393ca06",
|
||||
"tools/rag/scan_zpwiki.py": "ef770ce4edb6352ff0690af5783766c95062a0e56f638cca6e3d929973728273",
|
||||
"tools/rag/search_core.py": "624c8ddfe3edf78d06014579b747a59b2e33c0191a7cf90cdfd624b52ed5e96b",
|
||||
"tools/rag/search_db.py": "cc63aeaf2854e87b7448c3978959569b097074cdb16a9b2c16b2c37a4677fdbb",
|
||||
"tools/rag/search_utils.py": "69597bf5785f7852b1131a0648d9d2c65b6babba9ad279581f08b40d185ee646",
|
||||
"tools/rag/tests/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/rag/tests/conftest.py": "0c94402d5ca971233d9802ded81cdb39ae7dfddda5eb9126e2035f7599a8f1c7",
|
||||
"tools/rag/tests/test_chunking.py": "94904a20cfed0512d508017eaadbb43ef45ca74a5e96631241f6ca481222c498",
|
||||
"tools/rag/tests/test_common.py": "86f0aecb79b7a3764112c833ea3b732073c073a5d570ef8c99900fb2a3f04430",
|
||||
"tools/rag/tests/test_database.py": "31fc3553d76127c2d7e2c113b9053e537a72bb92f57a9c24cad6a579a1ffc589",
|
||||
"tools/rag/tests/test_e5_1_remaining.py": "a8a52d5204e7376f33bb1aef96aad20990126a0b92266596b7cf8dd0dcbea4bc",
|
||||
"tools/rag/tests/test_evaluate_rag_answers.py": "2143f3c9efbacf7b9119eeb9ae69e6cd7ea3f428ff5076d8e9973d0943675296",
|
||||
"tools/rag/tests/test_live_data.py": "3c5e04d4a29ec8360d89881be980dacacccf0e12594fe51a22ec23c32c98b3e3",
|
||||
"tools/rag/tests/test_rag.py": "13e97c88bf4afe45a8d633b269d110890f0f646887cee861bbf55ada0be7ad24",
|
||||
"tools/rag/tests/test_rag_document_expansion.py": "9adf39c7a9b683b1d40c36fce576272e71869b7c1236c371c1b077820874eb7e",
|
||||
"tools/rag/tests/test_rag_metrics_morphology.py": "070ee314d326e4c7218e7c19959a94076a2b241c4f19b9ecd9ca1fb3cc2639d4",
|
||||
"tools/rag/tests/test_rag_metrics_semantic.py": "3642394d2636edd7420589348fb75bf1d214b539983b7e620008d626deffabf0",
|
||||
"tools/rag/tests/test_rag_query_evidence.py": "c3fb5115306171010759b0cfd0cd05d1439d6a57de049efea02330ae7c553bfc",
|
||||
"tools/rag/tests/test_rag_query_evidence_topn.py": "ebf01ad57a52f030b908b7fb0312d8d32cf9f60ea2953c5a3fb8849c1f2dceaf",
|
||||
"tools/rag/tests/test_rag_runner.py": "1813086999d1e9826b42c2ac7978ea77d29e1c4b12f5e606f1fba572829e24ea",
|
||||
"tools/rag/tests/test_rag_runner_routing.py": "c9454e5dddfdb7afc013567811efec15545daf20733b7167f78f2dd9ff0380d6",
|
||||
"tools/rag/tests/test_rag_runner_tool_prompt.py": "073403907717d8d388c28ea92d1d1f9426edab2e8bd320c8f6329bcbff082e6c",
|
||||
"tools/rag/tests/test_rag_supplemental_expansion.py": "65449054e2d94396def0dc8d505a9573306adbf184820ddd6c9b5ea92e165f8b",
|
||||
"tools/rag/tests/test_rebuild_index.py": "aa0688b81e4b699ce99e97a4b8c1a6d4a49c5c153caa02301ebd5a5d8be764a4",
|
||||
"tools/rag/tests/test_scan_zpwiki.py": "324510ca504dff11ecf39b28aff26b44a358e14084b3b015c0c410690d8aa129",
|
||||
"tools/rag/tests/test_search.py": "82c96d35719d2233e4636b6f25d89b22f004848d8bae46a9705ee384d4abe9a8",
|
||||
"tools/retrieval_contract.py": "b8fa272c3babf924a3ce8b937fe7ae437cd959ba9f7667193ac67c18d2c5b58d",
|
||||
"tools/sync_indexes.py": "5b909b4394c24e5ce22848594b16d9aea45fb06418f5cd92bb6aa6381a0ccf10",
|
||||
"tools/tool_health.py": "8ad37345889ad58a737edac5960b5b6c5002af2397d60248f434e03fb4eddd89"
|
||||
},
|
||||
"deployment_configuration": {
|
||||
"Dockerfile": "fc7aefe4a99222daedc321acf8359773dc24eff82be04e688507e135956a92a6",
|
||||
"docker-compose.yml": "e33b65c58f155ac057b01be272bc323fab3ff7eb4f51c9e4ca1b53904cc17af4"
|
||||
},
|
||||
"measured_artifacts": {
|
||||
"tools/graphrag/evaluation/graphrag_questions_v7.json": "0f78e9749de369d752b6e1079f174cf3f6b390f4718a672119dfd43fa5d9dfac",
|
||||
"tools/graphrag/evaluation/results/final_v7_2026-10-26/graphrag_dev.json": "d1a5d7b6d5aff3c0002f36a60cebc07627a79ec6d57de119dd587e8ab70143b0",
|
||||
"tools/graphrag/evaluation/results/final_v7_2026-10-26/graphrag_test.json": "07d3d73c1b7ab0805549d2d3ebea0c02d1c00eacf3d6092911e34e9787cd9612",
|
||||
"tools/graphrag/evaluation/results/final_v7_2026-10-26/historical_graph_summary.json": "f0386fde85ed1779d1262264614d4d93faf90cca9a3671cd7591ff6b57759a9b",
|
||||
"tools/graphrag/evaluation/results/final_v7_2026-10-26/summary.json": "cdc7809eb1033bdf27569ea80deb53b3e82cc2beb0141e64d6251756737a396c",
|
||||
"tools/graphrag/evaluation/results/v7_preparation/source_audit.json": "7825d4f3e4e535eb5f49e975dfef363b9b813f1de5c97e2387e5c2f3e578e6a5",
|
||||
"tools/graphrag/evaluation/results/v7_preparation/protocol.json": "7ae343bba36fe25e8603f00325fe2dec1f5753616db9ef9c54f74ccffc1a7d83",
|
||||
"tools/graphrag/evaluation/results/v7_preparation/source_review.csv": "7ee21230e5dda7be9dc847b8ada6111d14d38f7b075a9c64d38f3ff69950b5c0",
|
||||
"tools/graphrag/evaluation/results/answers_v7_dev_2026-10-26/answers_dev.json": "4af9b52c250c837707c0690d892ec833347b3d3ee71d338ec631f6450eef8045",
|
||||
"tools/graphrag/evaluation/results/answers_v7_test_2026-10-26/answers_test.json": "19d5e6ef484495a0acc1402b2d8f6ba91b3b63b8229d1118cd75d763082c148a",
|
||||
"tools/graphrag/evaluation/results/answers_v7_regression_2026-10-26/answers_regression.json": "4bad6d54955b7645d861ea1ae2b412625b1ea032297caa57984f3b0cf21e3a25"
|
||||
},
|
||||
"policy": "Runtime code, prompt and gold remained unchanged throughout the final TEST and historical regression. All failures retained.",
|
||||
"secrets_excluded": [
|
||||
".env",
|
||||
"credentials",
|
||||
"private keys"
|
||||
]
|
||||
}
|
||||
82
tools/graphrag/evaluation/frozen_v1.json
Normal file
82
tools/graphrag/evaluation/frozen_v1.json
Normal file
@ -0,0 +1,82 @@
|
||||
{
|
||||
"schema_version": 1,
|
||||
"frozen_at_utc": "2026-10-24T19:03:18.603604+00:00",
|
||||
"fingerprints": {
|
||||
"implementation": {
|
||||
"tools/graphrag/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/build_graphrag.py": "81f6e9f5c9e71b588f8bed1968c1e900e29e484ba81d23b6a3a68e7220ad75a5",
|
||||
"tools/graphrag/evaluation/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/evaluation/audit_benchmark.py": "6619c818a52fc284e87ed6c48a503a54a3c9dd95447463ed78f075b7c58bad80",
|
||||
"tools/graphrag/evaluation/evaluate_graphrag.py": "6bdf68307b6bb90731fe09a89955e96eee76fec13bdf82281a96715dd168680e",
|
||||
"tools/graphrag/evaluation/freeze_graphrag.py": "32198eca7642f39a8ad33deefe0eea396d38fcc0f5bc5814cbb64ab6d3443b9e",
|
||||
"tools/graphrag/evaluation/graphrag_evaluator.py": "267d4e9942b7767a78a3689e8f7c9d6ed49f025389b043b69449b2d225651160",
|
||||
"tools/graphrag/evaluation/reproducibility.py": "5c28d8aa37ec6a973fa494f7e528c19af2f1326422ea7fd05912e01aa1af6725",
|
||||
"tools/graphrag/graph_db.py": "a6fce68000065d328139829c5ca894623f6ed5828c74a869663366c2ad7b5ea2",
|
||||
"tools/graphrag/graph_search.py": "20f466e8d9eef6a38e41860e9be9ebc719c93f38bcfa6f60aca0e1b56c7d6bca",
|
||||
"tools/graphrag/graphrag.py": "bee2eb1f86d8df8e978495a61107edf723df2dc2e0468e3ecf844719ec635e1d",
|
||||
"tools/graphrag/neo4j_smoke.py": "fb5244c72c29ef2acf96d1e7f54335ff168eed4119db1692025eb1b99194b7bb",
|
||||
"tools/graphrag/tests/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/tests/test_graph_search.py": "d5c95b5de2a0962857331929522764aa46a1222e550a3eb1aaca2148f9d58748",
|
||||
"tools/graphrag/tests/test_graph_search_neo4j.py": "fec2bf72de8f752f17c9164fee5754bdb2e153828855e47efbf0000dbe82cf3b",
|
||||
"tools/graphrag/tests/test_graph_search_regressions.py": "9db7779aeb8ed9e8c0f92c1657011a81080aff3c928649e811358e3009a18c48",
|
||||
"tools/graphrag/tests/test_graphrag.py": "6379335110f05668beca87ca7e486442071b2f666dbd651408d5f3a8d5723f0e",
|
||||
"tools/graphrag/tests/test_graphrag_evaluator.py": "1c6d08aeec9ae56ac4123239a5aed12a0081d66cc3f34b2047d95764579d7298",
|
||||
"tools/graphrag/tests/test_graphrag_freeze.py": "c4b760baf4c7ebf13b16bd4cd3c51874f5512eef3b4c61470dc4d428b0303d9f",
|
||||
"tools/graphrag/tests/test_graphrag_root_title.py": "085651fe6e6081521a5dde9554abfee93456250108cf15978df25378d886a46c",
|
||||
"requirements.txt": "26a6d097727eba03c1b6c71cd02b06373ef01ce03e567dd2bc4357ae330e5a1a"
|
||||
},
|
||||
"dataset_sha256": "b5c96e423fc9a5bcee0dcca38fdeac86b2f7cd1efebfcb0d7cd4cfb7fed0620e",
|
||||
"inputs": {
|
||||
"data/documents.json": "0542af2a373771cf7c4a95f93d14f4f687f6a0187846892c959aa6efc4bade52",
|
||||
"data/chunks.json": "437dde589be46e0c30842dd330de22d96a0173d2dbaff9c5f129568cb2bca4c9"
|
||||
}
|
||||
},
|
||||
"graph": {
|
||||
"sha256": "0637d9ebb106c65d9aaa73d0634b28db81135e6a6c7503ea6b06c4a922e7e1e3",
|
||||
"nodes": 422,
|
||||
"relationships": 829
|
||||
},
|
||||
"parameters": {
|
||||
"limit": 40,
|
||||
"max_entities": 8
|
||||
},
|
||||
"dev_summary": {
|
||||
"questions": 286,
|
||||
"strict_count": 209,
|
||||
"strict_accuracy": 0.730769,
|
||||
"error_count": 0,
|
||||
"value_score": 0.751748,
|
||||
"entity_score": 0.751748,
|
||||
"relation_score": 0.751748,
|
||||
"property_score": 0.835664,
|
||||
"relation_choice_score": 0.968531,
|
||||
"document_recall": 1.0,
|
||||
"source_recall": 1.0,
|
||||
"latency_mean_seconds": 0.032786,
|
||||
"latency_median_seconds": 0.03221,
|
||||
"latency_p95_seconds": 0.041831
|
||||
},
|
||||
"source_audit_summary": {
|
||||
"dev": {
|
||||
"questions": 286,
|
||||
"source_consistent": 209,
|
||||
"issues": {
|
||||
"keyword_not_in_frontmatter_catalog": 66,
|
||||
"keyword_not_linked_to_expected_person": 5,
|
||||
"exact_categories_omit_or_add_source_categories": 6
|
||||
}
|
||||
},
|
||||
"test": {
|
||||
"questions": 214,
|
||||
"source_consistent": 154,
|
||||
"issues": {
|
||||
"keyword_not_in_frontmatter_catalog": 46,
|
||||
"keyword_not_linked_to_expected_person": 11,
|
||||
"exact_categories_omit_or_add_source_categories": 3
|
||||
}
|
||||
}
|
||||
},
|
||||
"policy": "Report all questions. Source-consistent subset is supplementary. No holdout tuning.",
|
||||
"dev_results_sha256": "768d6795cf49b59a59a405276950afd4c48b22357cb682b9820f747d2a9e2be9",
|
||||
"audit_sha256": "4fbc8ea8090caaf275cac384e3c3c8ed7c3743b49523086bee3f0970e11d9276"
|
||||
}
|
||||
211
tools/graphrag/evaluation/frozen_v2.json
Normal file
211
tools/graphrag/evaluation/frozen_v2.json
Normal file
@ -0,0 +1,211 @@
|
||||
{
|
||||
"schema_version": 2,
|
||||
"partition": {
|
||||
"method": "disjoint source profiles",
|
||||
"dev_profile_count": 45,
|
||||
"test_profile_count": 24,
|
||||
"overlap": 0
|
||||
},
|
||||
"frozen_at_utc": "2026-10-25T01:03:09.186759+00:00",
|
||||
"fingerprints": {
|
||||
"implementation": {
|
||||
"tools/graphrag/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/build_graphrag.py": "81f6e9f5c9e71b588f8bed1968c1e900e29e484ba81d23b6a3a68e7220ad75a5",
|
||||
"tools/graphrag/evaluation/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/evaluation/audit_benchmark.py": "6619c818a52fc284e87ed6c48a503a54a3c9dd95447463ed78f075b7c58bad80",
|
||||
"tools/graphrag/evaluation/benchmark_v2.py": "3e66d8e20d049758ac6df393355c0b5038f09c6ba97c96acc2087d61cfb4ad26",
|
||||
"tools/graphrag/evaluation/evaluate_graphrag.py": "f9ef7e2fc681033cf1cb164581589f6f01acecf3d28e0cbfaba5c9ba72f24b23",
|
||||
"tools/graphrag/evaluation/evidence_contract.py": "78e24264c176e163e1782fef1634b6c45c7f31bd4692726d02a30ab45a06648e",
|
||||
"tools/graphrag/evaluation/freeze_graphrag.py": "0c330358beae2c5409e2dcd26be718c6b9534d5db9f2340f0390fe3be45cb60c",
|
||||
"tools/graphrag/evaluation/graphrag_evaluator.py": "3afe014e126b6ad90c8e408284d2c1979f54d6cf5dd19fd67f9249708fbed2d3",
|
||||
"tools/graphrag/evaluation/reproducibility.py": "b707d4c410cbf7d6769a6afdadfe79ef3bbd699a0323f0e0d2ab180ef7498680",
|
||||
"tools/graphrag/evaluation/source_oracle.py": "02a44584bf4fa0e8e9faa7e13b85873a1b00671e0abe556abec8a274621d666c",
|
||||
"tools/graphrag/graph_db.py": "a6fce68000065d328139829c5ca894623f6ed5828c74a869663366c2ad7b5ea2",
|
||||
"tools/graphrag/graph_search.py": "d08eaaa8c395e993cf6416f90226b16ea1fcefca4719304be4b64c61a174b98b",
|
||||
"tools/graphrag/graphrag.py": "71a13cb5aeef0e1b8247840d76f845af46b9c58b6bd9ba1b9ef210b468ad6805",
|
||||
"tools/graphrag/neo4j_smoke.py": "fb5244c72c29ef2acf96d1e7f54335ff168eed4119db1692025eb1b99194b7bb",
|
||||
"tools/graphrag/tests/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/tests/test_evaluation_pipeline_v2.py": "63d1b3e80ae3c7b563374fd7ab4aa5ffad3c614eafbd15142c577abd7f756bf9",
|
||||
"tools/graphrag/tests/test_evaluator_connected_v2.py": "29d7c9838ed1ff37ea3276df6feb1b6142158c43a0525712f490b648181882de",
|
||||
"tools/graphrag/tests/test_graph_search.py": "d5c95b5de2a0962857331929522764aa46a1222e550a3eb1aaca2148f9d58748",
|
||||
"tools/graphrag/tests/test_graph_search_entity_v2.py": "639d9ac307589de6788ef8145a4e7f73d97a1531445294424e0fc8ba83f99a1c",
|
||||
"tools/graphrag/tests/test_graph_search_neo4j.py": "fec2bf72de8f752f17c9164fee5754bdb2e153828855e47efbf0000dbe82cf3b",
|
||||
"tools/graphrag/tests/test_graph_search_regressions.py": "9db7779aeb8ed9e8c0f92c1657011a81080aff3c928649e811358e3009a18c48",
|
||||
"tools/graphrag/tests/test_graphrag.py": "6379335110f05668beca87ca7e486442071b2f666dbd651408d5f3a8d5723f0e",
|
||||
"tools/graphrag/tests/test_graphrag_evaluator.py": "1c6d08aeec9ae56ac4123239a5aed12a0081d66cc3f34b2047d95764579d7298",
|
||||
"tools/graphrag/tests/test_graphrag_freeze.py": "c4b760baf4c7ebf13b16bd4cd3c51874f5512eef3b4c61470dc4d428b0303d9f",
|
||||
"tools/graphrag/tests/test_graphrag_research_v2.py": "19ebf4a6fd622aaebc8f8b7e17c2aeda83ba17e7f04f155ee70817fa3c14fe03",
|
||||
"tools/graphrag/tests/test_graphrag_root_title.py": "085651fe6e6081521a5dde9554abfee93456250108cf15978df25378d886a46c",
|
||||
"tools/graphrag/tests/test_source_oracle_v2.py": "eea11c98f477764fd0826b0c26396d3617a21ffec76ef15809e74ed27e53ff3b",
|
||||
"requirements.txt": "26a6d097727eba03c1b6c71cd02b06373ef01ce03e567dd2bc4357ae330e5a1a"
|
||||
},
|
||||
"dataset_sha256": "fd9835adee93cacf2c45806dfe93463c2e9a58ccedb5f073876ad176039ad734",
|
||||
"inputs": {
|
||||
"data/documents.json": "0542af2a373771cf7c4a95f93d14f4f687f6a0187846892c959aa6efc4bade52",
|
||||
"data/chunks.json": "437dde589be46e0c30842dd330de22d96a0173d2dbaff9c5f129568cb2bca4c9"
|
||||
},
|
||||
"source_corpus": {
|
||||
"sha256": "440da12a7a991824e923f70cada7c616c3fb3b0f12767ec7d75039a6a3231b10",
|
||||
"document_count": 114,
|
||||
"documents": {
|
||||
"pages/interns/bogdan_paul_chis/README.md": "3b4b946eb3c10e9f9a4092e6cffa01c5080e7579aded2f6ed3120c41ed62b647",
|
||||
"pages/interns/cesar_gutierrez/README.md": "b0be60576eed28d4b1920e9acf198684519373dfc13171567247c853b3ed699e",
|
||||
"pages/interns/oliver_pejic/README.md": "0470f3c8465be8f02204b08e4c75ef47f68c7e4ad1038faa5641cdf1811f33d5",
|
||||
"pages/interns/sevval_bulburu/README.md": "ff2a9d66253802f1af0fdfd74832e40fae41b6df23c5e61dc266f6cd0cc16c4d",
|
||||
"pages/interns/yussef_ressaissi/README.md": "f997a65699da0db3222ef7a3c37652d05dfc3419ad4ec74683bafc2c897bb987",
|
||||
"pages/students/2016/darius_lindvai/README.md": "fcaa47bb9708a6439eec5c4b7f7b4ed6c7359e423e1d940e1aed9f44957e6d62",
|
||||
"pages/students/2016/darius_lindvai/dp2021/README.md": "be3d0fea2a6d592b225eecabd9b19445c2fce62b8289c07ab6af93835db12970",
|
||||
"pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md": "352162de1b1e192228fa5d26506c028ac47e567e90df53b1bbaa6ad736ec4766",
|
||||
"pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md": "b4a81ff457624b089d618e4479afb1e3d748f6724f72104ef5518e535ae02fe5",
|
||||
"pages/students/2016/dominik_nagy/README.md": "1c4037a158d84c45fa705a0c38e47142a9d46e226f0c138bc2d56d7c38f6d74d",
|
||||
"pages/students/2016/dominik_nagy/timovy_projekt/README.md": "b81a4dab7316f7b846dcf36515f6aa9d44035c86f46f0e07b7a43308bcd31458",
|
||||
"pages/students/2016/ediz_morochovic/README.md": "045e5eb9a3df2b84140808fbca0c3163266ad0efa144bc42d9d5c597881c6ac6",
|
||||
"pages/students/2016/jakub_maruniak/README.md": "6734c41a95b9d0c1e3d226b393ad109ee4a7b82ebfffa73df2d7e0a743fefa14",
|
||||
"pages/students/2016/jakub_maruniak/dp2021/README.md": "9cd884aec70705cdb2aaa0f514b513f16de263c37b749ced7f92916cd2f91c39",
|
||||
"pages/students/2016/jakub_maruniak/dp2021/annotation/README.md": "debae0c50aea1accef0840912b9b1f37b2138f856002bb50e91d7ea2dbbe7963",
|
||||
"pages/students/2016/jakub_maruniak/dp2021/train_experiments/README.md": "01dff38b37043414fa1db204394ddbe7aade00e14d02d495572b65c85d09b194",
|
||||
"pages/students/2016/jakub_maruniak/timovy_projekt/README.md": "04114b1f3d84664aad5bdba5a0b614c5a6f23392be3c31fd9123d63db1be0a35",
|
||||
"pages/students/2016/jan_holp/README.md": "80d6a8492766e5bfa61673a372e5f059d30c8e335de39842866c51485960e4d3",
|
||||
"pages/students/2016/jan_holp/dp2021/README.md": "a62acb74009376766c7e2f9856ee01d21f84593eb9b3ce85cf2e6032aa412476",
|
||||
"pages/students/2016/jan_holp/dp2021/zdrojove_subory/README.md": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"pages/students/2016/jan_holp/timovy_projekt/README.md": "79eebdfd3af7e8d5c279077e285a580731b1cf8cc9b4454f6596796e9915f70c",
|
||||
"pages/students/2016/lukas_pokryvka/README.md": "f279456c5c277ff1ee0dd89a3464ed9f9f67b44bc185a5da9811ef5cfb675002",
|
||||
"pages/students/2016/lukas_pokryvka/dp2021/README.md": "39b61376ce108e4a930f926ab2d6a997207457121bccfcf617129a3b210a15cf",
|
||||
"pages/students/2016/lukas_pokryvka/timovy_projekt/README.md": "4de4b6c8cfed17b6c60090f82df1d55a66be70a79d3013850689b2baebdd801b",
|
||||
"pages/students/2016/mark_feher/README.md": "bec37c0319fe0869a0377d771db23d090dbda93c27328f5697cdaeb3bbccfe9b",
|
||||
"pages/students/2016/maros_harahus/README.md": "0da150e91918632c9e8cd1443f04da403595a372517e254928ce9f76c9d5033d",
|
||||
"pages/students/2016/maros_harahus/timovy_projekt/README.md": "75af19f7c68f4b646fa1dbae75f3f3dfc52633a9f9da1400d21808bb20be0d83",
|
||||
"pages/students/2016/patrik_pavlisin/README.md": "dc1c648d7cd9b0f0e021c57f9b98189e37c100871439e7e304390715913f2763",
|
||||
"pages/students/2016/patrik_pavlisin/dp21/README.md": "ac1eb0fd0360ad34aa21b7c8da5bb010a6edf10be5721f28dedc3986cd1d8c54",
|
||||
"pages/students/2016/patrik_pavlisin/dp22/README.md": "f2a8c619a812b99abab618ae388eb672407950e1f33fb8d7da7a528c4de81d50",
|
||||
"pages/students/2016/patrik_pavlisin/tp20/README.md": "ae9c771f27e7e093bc29c6888c8d0b27ed61fb41519fd0d7e7f4f6cbb4626edc",
|
||||
"pages/students/2016/tomas_kucharik/README.md": "6a1a215433eb1857660177b4cb2ecec03c6a86743d3a04cd6d5c9d9682c9e63b",
|
||||
"pages/students/2017/dmytro_ushatenko/README.md": "65f4ac177d492162b08ca5da3d9eb048bd088a3c117a28a662113b7e4bc3a4ec",
|
||||
"pages/students/2017/martin_jancura/README.md": "6a0a18d5095dcfb12abfdd72c9cfd8025d714fb5e29a7858cd2b285e4cb986b9",
|
||||
"pages/students/2017/stanislav_matsunych/README.md": "90ffa11eff4a4360b0252dbc53a116c3a5777b3d5dd86ce5c89c02bdd2051c73",
|
||||
"pages/students/2017/than_trung_thanh/README.md": "2150519b8580e7337520db4de64d2d1c82d2634380537d019f41c506dbf2979d",
|
||||
"pages/students/2018/NaN1name_buday/README.md": "23c8c58090bdc954347e36f141bea91f43c8d5b1d777e346864a2ebe84c0bcce",
|
||||
"pages/students/2018/adrian_remias/README.md": "e5bfe1d5d4e626beaa636a02d34ec58cf2cff9b0e57833905af35b80bf1465a2",
|
||||
"pages/students/2018/david_ilas/README.md": "96c45ff9c5a821ddcb1a2fc86d487bd8f4729d1b76887914b0f5fbf99af45af0",
|
||||
"pages/students/2018/david_omasta/README.md": "4164051870e1e1cf8949ed18a74196e9ea789dfbe4fee24bdeb736ca42848327",
|
||||
"pages/students/2018/martin_wencel/README.md": "0e6a7a981689f22304f8baa5de97d4315c0695c94c9277de7851943eb012253b",
|
||||
"pages/students/2018/oleh_bilykh/README.md": "4072c62dd8ee753a0c8fa43fdfbbdf566e394c2df13e6a79d08a302e332710b1",
|
||||
"pages/students/2018/ondrej_megela/README.md": "969ff2e1a436b8f957e7168cf5eb678196b99aeda17701c502b016441f644065",
|
||||
"pages/students/2018/samuel_sirotnik/README.md": "cc230ede67b6e8632511c92a5ed6d1e9deb42e70819280222bdfd369ee77fc70",
|
||||
"pages/students/2019/alina_vitko/README.md": "9b071fe2aff470c275ae027be236fe836f741f774cabb9cbbb55304a8d5102cd",
|
||||
"pages/students/2019/artem_yatsenko/README.md": "328b101e46c51c959e792cf7ca226942f81d2ab8fe9648ad6d0ecd07016429e2",
|
||||
"pages/students/2019/david_stromp/README.md": "e46ca8691d5ec894128f6f6f2ed33e2c7bd141f80719bb0449b20f10f30cca09",
|
||||
"pages/students/2019/dmytro_mural/README.md": "e881a47d847c3ef8d680844113fdbfbb87553b28982bf9eef4936f6d30923e93",
|
||||
"pages/students/2019/filip_tomas/README.md": "75a1fe7b921e4bff0fdf9e2a957b4adad4b4a57aa7ebdffbb73dd82c02123f94",
|
||||
"pages/students/2019/kristian_sopkovic/README.md": "3286960fb30f584df35455f9b6dfae81ca4827a1d711d2bcd6e48c3f150c9279",
|
||||
"pages/students/2019/michal_stromko/README.md": "3ae1dd9b6638a6a249a94be3f3846286555666aefa225bb3a2c7288b35900ce7",
|
||||
"pages/students/2019/michal_stromko/vp2021/README.md": "feb2e093fdd6461239e79b1e1f96e65a1c8cd96e8a2b70535ae556a9c198046a",
|
||||
"pages/students/2019/michal_stromko/vp2021/tutorials/README.md": "40e3fa448c7329ef863e705435e23fe6b4788de440710f066fe0eed92d132bad",
|
||||
"pages/students/2019/michal_stromko/vp2021/tutorials/img/README.md": "e8d3ac160b17dfdee2c3e996bf6a03af7a6f16f9140bf5cf7ee343a82dd1865f",
|
||||
"pages/students/2019/patrik_pokrivcak/README.md": "3e3957ad0f7aca59d6eb64c38a3f5e21d8fd953200825d0d0e5cacabfbc35a7d",
|
||||
"pages/students/2019/samuel_horani/README.md": "86e6959ccc612b069687b57996fa3f61660075d6a0d65bfec64f423d39a0a999",
|
||||
"pages/students/2020/david_kostilnik/README.md": "2927524b75da59a64120fc364a0fc374986fa4d364d54e52c36800762c203264",
|
||||
"pages/students/2020/jakub_kristian_lukas/README.md": "f139d9b1ebf5a3f45612f3df5703ecdd935b90701763c27c7c529044c0b0455a",
|
||||
"pages/students/2020/kamil_tomcufcik/README.md": "9d865adf538bc6d7992ee4f4882713447da5c936fca17c43ca0f576072537048",
|
||||
"pages/students/2020/matej_kobylan/README.md": "3d7b289e17b8f25678a07e9ee0e6741688485a0ccb1e50940a6a6acc6312a547",
|
||||
"pages/students/2020/matus_suchanic/README.md": "770ca49538cca22df35f8e7ba736ee97483e4fe5788c221496553592b4e78dc6",
|
||||
"pages/students/2020/pavol_hudak/README.md": "33d06fccc6451e5f19b27b0cad001a34e81635b4ea294a01dec7771c823abc40",
|
||||
"pages/students/2020/vladyslav_krupko/README.md": "4c28e6d38651bb2cafcbf4a18e35210cd369aef2caff6c5b0aa52fac38f0fe7d",
|
||||
"pages/students/2021/artur_hyrenko/README.md": "0568261f4ade4de5472edcfeb1ffed9abae18dc67e4050f4ce2ad088839a2bb3",
|
||||
"pages/students/2021/eduard_matovka/README.md": "de2a7ae38ec87110e347956b37d0605a298ed2847f972961cc9b977da8221d43",
|
||||
"pages/students/2021/manohar_gowdru_shridharu/README.md": "c00ceb620ed7087ead5d9448d476bbb98d273d1d9e7bf1bc4355c367b26c7a6b",
|
||||
"pages/students/2021/martin_sarissky/README.md": "8e97b45a253745faa55f63c844e0b5dfe680aeaf6eb01fb8f9d06ac6e8ee8bcf",
|
||||
"pages/students/2021/matej_novotny/README.md": "b083a7cadde532e3428dc9a57bc61456fcc5905bda91e011b96033d42bf5d9cb",
|
||||
"pages/students/2021/matej_scislak/README.md": "b9a32cce8605e044a4f2828ff2d91a2995a62ef3a841e62f0a225c97221f0cc8",
|
||||
"pages/students/2021/nikita_bodnar/README.md": "2016c0dd923c0f8e561d5cea42ac81da3610fdcc54a4527f56d078e34e53ce90",
|
||||
"pages/students/2021/oleksandr_hryshchenko/README.md": "4b073992b715b6c75b79fd2c8f850a69f940966e3a61a82c625c32c945a93036",
|
||||
"pages/students/2021/vladimir_ferko/README.md": "68e7d311896eda2171e5eec1ec3a8da90d326ed91acaace8058f68664a50d271",
|
||||
"pages/students/2022/andrii_pervashov/README.md": "319dcaa1cc2e29dd7e3a710bab26cb3ac6944ab71b0b97e1de076b1199122334",
|
||||
"pages/students/2022/daniil_huzenko/README.md": "390782fbff6220a9462060ce1a62959f2a2b88f42d06e2c51d1f406b75d73f2c",
|
||||
"pages/students/2022/jakub_schwarc/README.md": "f541a8852c2b0f6f9d7182e01a34c4e3beee9bfa55427a06b331638b11eb8be6",
|
||||
"pages/students/2022/jan_malinovsky/README.md": "8af021bfb131fa005a7aec3e2f2f12fc17fa5dc14e2675311adbbfc445a4bcab",
|
||||
"pages/students/2022/jan_ptak/README.md": "131cf053764fd5423541ebe672c3b4f5da875cfb8e4b821f1335ddb967282282",
|
||||
"pages/students/2022/oleh_poiasnik/README.md": "c2f7dc3f61f8b4a5b43ded1e3ae4c7d3e7f874439ee6b17dd9c8d45dabc25bc8",
|
||||
"pages/students/2022/samuel_vasil/README.md": "67c807049147aacd04f3050f4ff0233a8b3f0a239ab173b430e13dfe113ad0a5",
|
||||
"pages/students/2022/serhii_yemets/README.md": "ffbeac893947acafe855d576322a8826f9d4f87ac344cb31f8ceeefa244b9133",
|
||||
"pages/students/2022/tetiana_mohorian/README.md": "c9efdc632bf1ca89a0bfde0dc00be7aaac8a85da3d92e2ce8506236c73e93cfb",
|
||||
"pages/students/2022/valerii_kutsenko/README.md": "dc764c609ad3c1df59cfea997d4db82a591b1b1e0764453e319d841115507e4f",
|
||||
"pages/students/2022/vladyslav_yanchenko/README.md": "4d1ce216e3b526ee437ddbc658e51d7bb83530087e43628c096a569a3854a47f",
|
||||
"pages/students/2022/yevhenii_leonov/README.md": "b90e41db0cec2451027020a9102d32a24d777e8a38b604ccca87b36cd6b3a292",
|
||||
"pages/students/2023/denis_le_thanh/README.md": "2cb83f942d86a02712b0c58778e46dc2211346d1a6eba606471dfa832245db61",
|
||||
"pages/students/2023/maksym_zatirka/README.md": "7a7d2cbe276c352dacfbc6ba6de5f15303d30ecf34845ff8da8d085f3d67c3dd",
|
||||
"pages/students/2023/oleksandr_dorybohov/README.md": "c24d6f941de0dafb4459cea8259cf147821cafc86ba65be5b528f419f734bc18",
|
||||
"pages/students/2023/ronald_zalacko/README.md": "724b0f8e6e641236dba9bddbd77f4546e09514076c7dfb151807aaf4b882c96f",
|
||||
"pages/students/2023/rostyslav_rodzhuk/README.md": "de356dd7427c8a0716c165a0f88ae47b691a86ee7a388f60e2d2e9306298415c",
|
||||
"pages/students/2023/samuel_dzurina/README.md": "4818191d044b91219c796a35010c95da5cf2093e050d494f30b219b91e13fa0e",
|
||||
"pages/students/2023/simona_bobrovcanova/README.md": "e473a1911dae10ab40e2cf6696a8be616a58c22aaf09af5953fbac475791a35e",
|
||||
"pages/students/2023/yevhenii_medushivskyi/README.md": "5710ebf91c893a12fe6d19f5372311938d1e7c7bbdf203f2dc8ed2fe7c4f5a24",
|
||||
"pages/topics/akopisat/README.md": "c7245e1fbfa4160618502c0baf8cc6bc47cd9a82b8a85bc1c645314829a7b76a",
|
||||
"pages/topics/bert/README.md": "35e507f7ec2ad1d3526e2a15f94ea085ee25f680a02daf6df62fd429bd9c25c9",
|
||||
"pages/topics/chatbot/README.md": "6f2f83ffb80109be47f9750cca9d3036ec3645abef9f2b590bd6825780c7c48a",
|
||||
"pages/topics/faq/README.md": "15cfbd9c2a1649c80a7a58922e2b66dadab5c86a5ef33ef16c82bebd4d2dbf06",
|
||||
"pages/topics/hatespeech/README.md": "364df94e70dd740c63544e2586ba7b957780f714fc0c941d1b04b02233e6cbc5",
|
||||
"pages/topics/legal/README.md": "003bb9bfe1e0ca21652091c2d11496312eb04e0689fe459e14c2d5a738e8eeea",
|
||||
"pages/topics/morphology/README.md": "e242cc5ff1a4cc98e227566c0ead999bbc95937b7c20be62cb2afb773d0d35c0",
|
||||
"pages/topics/named-entity/README.md": "66b2e25f70211d432d596e377d552b3b8f0c525b14c31e3bc9c956c3aeadca84",
|
||||
"pages/topics/named-entity/navod/README.md": "1ff87079a98411de0414754c60241e08d2214ddcd63ddf974e4340cce2ce5b02",
|
||||
"pages/topics/nlp/README.md": "6f90abf9dc3f0ff33475283c13b4a08561abf631425ec2daacb076155a9e02c2",
|
||||
"pages/topics/otvorene/README.md": "cd5544925553fe3840c0ea6f8ef60ab756e26ab6757bf810025c948d8d4f98fc",
|
||||
"pages/topics/prodigy/README.md": "5e4f691f2754c2ec4afbaab2f41e6db77feb5b322dd9344465eb40c35f116499",
|
||||
"pages/topics/python/README.md": "2ef073adba672142c39e9a59fa2e00a98ab52bda54233d46fbe6940ee23f9fcc",
|
||||
"pages/topics/question/README.md": "408078a2a67cea2699e12359e85ab641136231e6104c2afdf874a705879525df",
|
||||
"pages/topics/question/navod/README.md": "061e737c69184b2bd244316ca7ba841f7186fe01ee80ee993742a733dcad3ecd",
|
||||
"pages/topics/question/nezodpovedatelne/README.md": "b6703d9690f4599b973efb27595ce157773ae0fc0d55cf2c0a09d9f50e8e4c92",
|
||||
"pages/topics/question/validacie/README.md": "3216a7127abdfc6da50ed116f44ff2d6785e7da4af70d23aceda774e745ad562",
|
||||
"pages/topics/resources/README.md": "09405397387f00cbcc5680f7d655f2d861e4d92e5df792a62d9dfd04f3534f48",
|
||||
"pages/topics/seq2seq/README.md": "969d15c03a63a3f8d5edc9017fe5a0fb7311fdf4de4a3473a08266241f92c1e2",
|
||||
"pages/topics/spacy/README.md": "f504e5db77cb8694f08a57fb8636e522d59a0e669216f4bc8273bc3c5f375f87",
|
||||
"pages/topics/steel/README.md": "b4068cef2ed197711467ac47630d5b2064fdc8828f898f7af99664e94d833330",
|
||||
"pages/topics/translation/README.md": "a7d4289e72199b307dc5ad8fc69cda39c1a33c27a6c7447af70aa9c3cc6b8635"
|
||||
}
|
||||
}
|
||||
},
|
||||
"graph": {
|
||||
"sha256": "a7b95c647eb9a4eff6060f6e7e8be2b74a8246095f3c8c98d4611f4be545f51a",
|
||||
"nodes": 429,
|
||||
"relationships": 843
|
||||
},
|
||||
"parameters": {
|
||||
"limit": 40,
|
||||
"max_entities": 8
|
||||
},
|
||||
"dev_summary": {
|
||||
"questions": 509,
|
||||
"strict_count": 509,
|
||||
"strict_accuracy": 1.0,
|
||||
"error_count": 0,
|
||||
"value_score": 1.0,
|
||||
"entity_score": 1.0,
|
||||
"relation_score": 1.0,
|
||||
"property_score": 1.0,
|
||||
"relation_choice_score": 1.0,
|
||||
"document_recall": 1.0,
|
||||
"source_recall": 1.0,
|
||||
"binding_score": 1.0,
|
||||
"path_score": 1.0,
|
||||
"answerability_accuracy": 1.0,
|
||||
"latency_mean_seconds": 0.042799,
|
||||
"latency_median_seconds": 0.040359,
|
||||
"latency_p95_seconds": 0.061584
|
||||
},
|
||||
"source_audit_summary": {
|
||||
"dev": {
|
||||
"questions": 509,
|
||||
"source_consistent": 509,
|
||||
"issues": {}
|
||||
},
|
||||
"test": {
|
||||
"questions": 80,
|
||||
"source_consistent": 80,
|
||||
"issues": {}
|
||||
}
|
||||
},
|
||||
"policy": "Report all questions including negatives. No exclusions or holdout tuning.",
|
||||
"dev_results_sha256": "3bcb4bed1370975c47de2d34ea00f80c87d4832eee395cfde0d69130d5716be6",
|
||||
"audit_sha256": "6000c6a14cedaa31dd8c1b35b7f95c142a4233cd8508542f84235bceaf6c6cdf"
|
||||
}
|
||||
212
tools/graphrag/evaluation/frozen_v3.json
Normal file
212
tools/graphrag/evaluation/frozen_v3.json
Normal file
@ -0,0 +1,212 @@
|
||||
{
|
||||
"schema_version": 2,
|
||||
"partition": {
|
||||
"method": "disjoint source profiles",
|
||||
"dev_profile_count": 69,
|
||||
"test_profile_count": 2,
|
||||
"overlap": 0
|
||||
},
|
||||
"frozen_at_utc": "2026-10-25T01:13:16.783627+00:00",
|
||||
"fingerprints": {
|
||||
"implementation": {
|
||||
"tools/graphrag/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/build_graphrag.py": "81f6e9f5c9e71b588f8bed1968c1e900e29e484ba81d23b6a3a68e7220ad75a5",
|
||||
"tools/graphrag/evaluation/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/evaluation/audit_benchmark.py": "6619c818a52fc284e87ed6c48a503a54a3c9dd95447463ed78f075b7c58bad80",
|
||||
"tools/graphrag/evaluation/benchmark_v2.py": "3e66d8e20d049758ac6df393355c0b5038f09c6ba97c96acc2087d61cfb4ad26",
|
||||
"tools/graphrag/evaluation/benchmark_v3.py": "30bae6c605ed26f4b49973acec799087c4e2b97a883ccedcafb965dd909c4c4d",
|
||||
"tools/graphrag/evaluation/evaluate_graphrag.py": "313882233f5e62f700b512091e8166fc072f42add7a53e2a17af42f785d1fa6b",
|
||||
"tools/graphrag/evaluation/evidence_contract.py": "78e24264c176e163e1782fef1634b6c45c7f31bd4692726d02a30ab45a06648e",
|
||||
"tools/graphrag/evaluation/freeze_graphrag.py": "b850483db6e8dc94f2c8729d1e40b3e9363628a1181a47863f137a3390c69166",
|
||||
"tools/graphrag/evaluation/graphrag_evaluator.py": "3afe014e126b6ad90c8e408284d2c1979f54d6cf5dd19fd67f9249708fbed2d3",
|
||||
"tools/graphrag/evaluation/reproducibility.py": "b707d4c410cbf7d6769a6afdadfe79ef3bbd699a0323f0e0d2ab180ef7498680",
|
||||
"tools/graphrag/evaluation/source_oracle.py": "d9d1b5a2a5811b18fe579528c0bdacba46bddda8a196c4dfa000288033937094",
|
||||
"tools/graphrag/graph_db.py": "a6fce68000065d328139829c5ca894623f6ed5828c74a869663366c2ad7b5ea2",
|
||||
"tools/graphrag/graph_search.py": "296560e77a5c4cefe23430bb8197cc86b5680a7539508a6f63285ddd099a94ed",
|
||||
"tools/graphrag/graphrag.py": "61597bbc76d47dc6e4c3a4517eabb462f803aea450c85b42c1c823a34d4f1397",
|
||||
"tools/graphrag/neo4j_smoke.py": "fb5244c72c29ef2acf96d1e7f54335ff168eed4119db1692025eb1b99194b7bb",
|
||||
"tools/graphrag/tests/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/tests/test_evaluation_pipeline_v2.py": "63d1b3e80ae3c7b563374fd7ab4aa5ffad3c614eafbd15142c577abd7f756bf9",
|
||||
"tools/graphrag/tests/test_evaluator_connected_v2.py": "29d7c9838ed1ff37ea3276df6feb1b6142158c43a0525712f490b648181882de",
|
||||
"tools/graphrag/tests/test_graph_search.py": "d5c95b5de2a0962857331929522764aa46a1222e550a3eb1aaca2148f9d58748",
|
||||
"tools/graphrag/tests/test_graph_search_entity_v2.py": "0ef1a8ebd513c5a4507eb38fcf5ae6137c69e9901b5a2975ba513be5902ac693",
|
||||
"tools/graphrag/tests/test_graph_search_neo4j.py": "fec2bf72de8f752f17c9164fee5754bdb2e153828855e47efbf0000dbe82cf3b",
|
||||
"tools/graphrag/tests/test_graph_search_regressions.py": "9db7779aeb8ed9e8c0f92c1657011a81080aff3c928649e811358e3009a18c48",
|
||||
"tools/graphrag/tests/test_graphrag.py": "6379335110f05668beca87ca7e486442071b2f666dbd651408d5f3a8d5723f0e",
|
||||
"tools/graphrag/tests/test_graphrag_evaluator.py": "1c6d08aeec9ae56ac4123239a5aed12a0081d66cc3f34b2047d95764579d7298",
|
||||
"tools/graphrag/tests/test_graphrag_freeze.py": "c4b760baf4c7ebf13b16bd4cd3c51874f5512eef3b4c61470dc4d428b0303d9f",
|
||||
"tools/graphrag/tests/test_graphrag_research_v2.py": "711008a91ab8a58ae0854e7f90329bcd42e5189fde2e2001589e97b0c22c5198",
|
||||
"tools/graphrag/tests/test_graphrag_root_title.py": "085651fe6e6081521a5dde9554abfee93456250108cf15978df25378d886a46c",
|
||||
"tools/graphrag/tests/test_source_oracle_v2.py": "0afdbe235e185ffe9f38aa667f90f5a6c20504fe29e9ac572642b39a8eb7faca",
|
||||
"requirements.txt": "26a6d097727eba03c1b6c71cd02b06373ef01ce03e567dd2bc4357ae330e5a1a"
|
||||
},
|
||||
"dataset_sha256": "3094100b9b6cfe4bb04f7479bddce07f392812ce7bdad97703d74db54b6a54ad",
|
||||
"inputs": {
|
||||
"data/documents.json": "0542af2a373771cf7c4a95f93d14f4f687f6a0187846892c959aa6efc4bade52",
|
||||
"data/chunks.json": "437dde589be46e0c30842dd330de22d96a0173d2dbaff9c5f129568cb2bca4c9"
|
||||
},
|
||||
"source_corpus": {
|
||||
"sha256": "440da12a7a991824e923f70cada7c616c3fb3b0f12767ec7d75039a6a3231b10",
|
||||
"document_count": 114,
|
||||
"documents": {
|
||||
"pages/interns/bogdan_paul_chis/README.md": "3b4b946eb3c10e9f9a4092e6cffa01c5080e7579aded2f6ed3120c41ed62b647",
|
||||
"pages/interns/cesar_gutierrez/README.md": "b0be60576eed28d4b1920e9acf198684519373dfc13171567247c853b3ed699e",
|
||||
"pages/interns/oliver_pejic/README.md": "0470f3c8465be8f02204b08e4c75ef47f68c7e4ad1038faa5641cdf1811f33d5",
|
||||
"pages/interns/sevval_bulburu/README.md": "ff2a9d66253802f1af0fdfd74832e40fae41b6df23c5e61dc266f6cd0cc16c4d",
|
||||
"pages/interns/yussef_ressaissi/README.md": "f997a65699da0db3222ef7a3c37652d05dfc3419ad4ec74683bafc2c897bb987",
|
||||
"pages/students/2016/darius_lindvai/README.md": "fcaa47bb9708a6439eec5c4b7f7b4ed6c7359e423e1d940e1aed9f44957e6d62",
|
||||
"pages/students/2016/darius_lindvai/dp2021/README.md": "be3d0fea2a6d592b225eecabd9b19445c2fce62b8289c07ab6af93835db12970",
|
||||
"pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md": "352162de1b1e192228fa5d26506c028ac47e567e90df53b1bbaa6ad736ec4766",
|
||||
"pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md": "b4a81ff457624b089d618e4479afb1e3d748f6724f72104ef5518e535ae02fe5",
|
||||
"pages/students/2016/dominik_nagy/README.md": "1c4037a158d84c45fa705a0c38e47142a9d46e226f0c138bc2d56d7c38f6d74d",
|
||||
"pages/students/2016/dominik_nagy/timovy_projekt/README.md": "b81a4dab7316f7b846dcf36515f6aa9d44035c86f46f0e07b7a43308bcd31458",
|
||||
"pages/students/2016/ediz_morochovic/README.md": "045e5eb9a3df2b84140808fbca0c3163266ad0efa144bc42d9d5c597881c6ac6",
|
||||
"pages/students/2016/jakub_maruniak/README.md": "6734c41a95b9d0c1e3d226b393ad109ee4a7b82ebfffa73df2d7e0a743fefa14",
|
||||
"pages/students/2016/jakub_maruniak/dp2021/README.md": "9cd884aec70705cdb2aaa0f514b513f16de263c37b749ced7f92916cd2f91c39",
|
||||
"pages/students/2016/jakub_maruniak/dp2021/annotation/README.md": "debae0c50aea1accef0840912b9b1f37b2138f856002bb50e91d7ea2dbbe7963",
|
||||
"pages/students/2016/jakub_maruniak/dp2021/train_experiments/README.md": "01dff38b37043414fa1db204394ddbe7aade00e14d02d495572b65c85d09b194",
|
||||
"pages/students/2016/jakub_maruniak/timovy_projekt/README.md": "04114b1f3d84664aad5bdba5a0b614c5a6f23392be3c31fd9123d63db1be0a35",
|
||||
"pages/students/2016/jan_holp/README.md": "80d6a8492766e5bfa61673a372e5f059d30c8e335de39842866c51485960e4d3",
|
||||
"pages/students/2016/jan_holp/dp2021/README.md": "a62acb74009376766c7e2f9856ee01d21f84593eb9b3ce85cf2e6032aa412476",
|
||||
"pages/students/2016/jan_holp/dp2021/zdrojove_subory/README.md": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"pages/students/2016/jan_holp/timovy_projekt/README.md": "79eebdfd3af7e8d5c279077e285a580731b1cf8cc9b4454f6596796e9915f70c",
|
||||
"pages/students/2016/lukas_pokryvka/README.md": "f279456c5c277ff1ee0dd89a3464ed9f9f67b44bc185a5da9811ef5cfb675002",
|
||||
"pages/students/2016/lukas_pokryvka/dp2021/README.md": "39b61376ce108e4a930f926ab2d6a997207457121bccfcf617129a3b210a15cf",
|
||||
"pages/students/2016/lukas_pokryvka/timovy_projekt/README.md": "4de4b6c8cfed17b6c60090f82df1d55a66be70a79d3013850689b2baebdd801b",
|
||||
"pages/students/2016/mark_feher/README.md": "bec37c0319fe0869a0377d771db23d090dbda93c27328f5697cdaeb3bbccfe9b",
|
||||
"pages/students/2016/maros_harahus/README.md": "0da150e91918632c9e8cd1443f04da403595a372517e254928ce9f76c9d5033d",
|
||||
"pages/students/2016/maros_harahus/timovy_projekt/README.md": "75af19f7c68f4b646fa1dbae75f3f3dfc52633a9f9da1400d21808bb20be0d83",
|
||||
"pages/students/2016/patrik_pavlisin/README.md": "dc1c648d7cd9b0f0e021c57f9b98189e37c100871439e7e304390715913f2763",
|
||||
"pages/students/2016/patrik_pavlisin/dp21/README.md": "ac1eb0fd0360ad34aa21b7c8da5bb010a6edf10be5721f28dedc3986cd1d8c54",
|
||||
"pages/students/2016/patrik_pavlisin/dp22/README.md": "f2a8c619a812b99abab618ae388eb672407950e1f33fb8d7da7a528c4de81d50",
|
||||
"pages/students/2016/patrik_pavlisin/tp20/README.md": "ae9c771f27e7e093bc29c6888c8d0b27ed61fb41519fd0d7e7f4f6cbb4626edc",
|
||||
"pages/students/2016/tomas_kucharik/README.md": "6a1a215433eb1857660177b4cb2ecec03c6a86743d3a04cd6d5c9d9682c9e63b",
|
||||
"pages/students/2017/dmytro_ushatenko/README.md": "65f4ac177d492162b08ca5da3d9eb048bd088a3c117a28a662113b7e4bc3a4ec",
|
||||
"pages/students/2017/martin_jancura/README.md": "6a0a18d5095dcfb12abfdd72c9cfd8025d714fb5e29a7858cd2b285e4cb986b9",
|
||||
"pages/students/2017/stanislav_matsunych/README.md": "90ffa11eff4a4360b0252dbc53a116c3a5777b3d5dd86ce5c89c02bdd2051c73",
|
||||
"pages/students/2017/than_trung_thanh/README.md": "2150519b8580e7337520db4de64d2d1c82d2634380537d019f41c506dbf2979d",
|
||||
"pages/students/2018/NaN1name_buday/README.md": "23c8c58090bdc954347e36f141bea91f43c8d5b1d777e346864a2ebe84c0bcce",
|
||||
"pages/students/2018/adrian_remias/README.md": "e5bfe1d5d4e626beaa636a02d34ec58cf2cff9b0e57833905af35b80bf1465a2",
|
||||
"pages/students/2018/david_ilas/README.md": "96c45ff9c5a821ddcb1a2fc86d487bd8f4729d1b76887914b0f5fbf99af45af0",
|
||||
"pages/students/2018/david_omasta/README.md": "4164051870e1e1cf8949ed18a74196e9ea789dfbe4fee24bdeb736ca42848327",
|
||||
"pages/students/2018/martin_wencel/README.md": "0e6a7a981689f22304f8baa5de97d4315c0695c94c9277de7851943eb012253b",
|
||||
"pages/students/2018/oleh_bilykh/README.md": "4072c62dd8ee753a0c8fa43fdfbbdf566e394c2df13e6a79d08a302e332710b1",
|
||||
"pages/students/2018/ondrej_megela/README.md": "969ff2e1a436b8f957e7168cf5eb678196b99aeda17701c502b016441f644065",
|
||||
"pages/students/2018/samuel_sirotnik/README.md": "cc230ede67b6e8632511c92a5ed6d1e9deb42e70819280222bdfd369ee77fc70",
|
||||
"pages/students/2019/alina_vitko/README.md": "9b071fe2aff470c275ae027be236fe836f741f774cabb9cbbb55304a8d5102cd",
|
||||
"pages/students/2019/artem_yatsenko/README.md": "328b101e46c51c959e792cf7ca226942f81d2ab8fe9648ad6d0ecd07016429e2",
|
||||
"pages/students/2019/david_stromp/README.md": "e46ca8691d5ec894128f6f6f2ed33e2c7bd141f80719bb0449b20f10f30cca09",
|
||||
"pages/students/2019/dmytro_mural/README.md": "e881a47d847c3ef8d680844113fdbfbb87553b28982bf9eef4936f6d30923e93",
|
||||
"pages/students/2019/filip_tomas/README.md": "75a1fe7b921e4bff0fdf9e2a957b4adad4b4a57aa7ebdffbb73dd82c02123f94",
|
||||
"pages/students/2019/kristian_sopkovic/README.md": "3286960fb30f584df35455f9b6dfae81ca4827a1d711d2bcd6e48c3f150c9279",
|
||||
"pages/students/2019/michal_stromko/README.md": "3ae1dd9b6638a6a249a94be3f3846286555666aefa225bb3a2c7288b35900ce7",
|
||||
"pages/students/2019/michal_stromko/vp2021/README.md": "feb2e093fdd6461239e79b1e1f96e65a1c8cd96e8a2b70535ae556a9c198046a",
|
||||
"pages/students/2019/michal_stromko/vp2021/tutorials/README.md": "40e3fa448c7329ef863e705435e23fe6b4788de440710f066fe0eed92d132bad",
|
||||
"pages/students/2019/michal_stromko/vp2021/tutorials/img/README.md": "e8d3ac160b17dfdee2c3e996bf6a03af7a6f16f9140bf5cf7ee343a82dd1865f",
|
||||
"pages/students/2019/patrik_pokrivcak/README.md": "3e3957ad0f7aca59d6eb64c38a3f5e21d8fd953200825d0d0e5cacabfbc35a7d",
|
||||
"pages/students/2019/samuel_horani/README.md": "86e6959ccc612b069687b57996fa3f61660075d6a0d65bfec64f423d39a0a999",
|
||||
"pages/students/2020/david_kostilnik/README.md": "2927524b75da59a64120fc364a0fc374986fa4d364d54e52c36800762c203264",
|
||||
"pages/students/2020/jakub_kristian_lukas/README.md": "f139d9b1ebf5a3f45612f3df5703ecdd935b90701763c27c7c529044c0b0455a",
|
||||
"pages/students/2020/kamil_tomcufcik/README.md": "9d865adf538bc6d7992ee4f4882713447da5c936fca17c43ca0f576072537048",
|
||||
"pages/students/2020/matej_kobylan/README.md": "3d7b289e17b8f25678a07e9ee0e6741688485a0ccb1e50940a6a6acc6312a547",
|
||||
"pages/students/2020/matus_suchanic/README.md": "770ca49538cca22df35f8e7ba736ee97483e4fe5788c221496553592b4e78dc6",
|
||||
"pages/students/2020/pavol_hudak/README.md": "33d06fccc6451e5f19b27b0cad001a34e81635b4ea294a01dec7771c823abc40",
|
||||
"pages/students/2020/vladyslav_krupko/README.md": "4c28e6d38651bb2cafcbf4a18e35210cd369aef2caff6c5b0aa52fac38f0fe7d",
|
||||
"pages/students/2021/artur_hyrenko/README.md": "0568261f4ade4de5472edcfeb1ffed9abae18dc67e4050f4ce2ad088839a2bb3",
|
||||
"pages/students/2021/eduard_matovka/README.md": "de2a7ae38ec87110e347956b37d0605a298ed2847f972961cc9b977da8221d43",
|
||||
"pages/students/2021/manohar_gowdru_shridharu/README.md": "c00ceb620ed7087ead5d9448d476bbb98d273d1d9e7bf1bc4355c367b26c7a6b",
|
||||
"pages/students/2021/martin_sarissky/README.md": "8e97b45a253745faa55f63c844e0b5dfe680aeaf6eb01fb8f9d06ac6e8ee8bcf",
|
||||
"pages/students/2021/matej_novotny/README.md": "b083a7cadde532e3428dc9a57bc61456fcc5905bda91e011b96033d42bf5d9cb",
|
||||
"pages/students/2021/matej_scislak/README.md": "b9a32cce8605e044a4f2828ff2d91a2995a62ef3a841e62f0a225c97221f0cc8",
|
||||
"pages/students/2021/nikita_bodnar/README.md": "2016c0dd923c0f8e561d5cea42ac81da3610fdcc54a4527f56d078e34e53ce90",
|
||||
"pages/students/2021/oleksandr_hryshchenko/README.md": "4b073992b715b6c75b79fd2c8f850a69f940966e3a61a82c625c32c945a93036",
|
||||
"pages/students/2021/vladimir_ferko/README.md": "68e7d311896eda2171e5eec1ec3a8da90d326ed91acaace8058f68664a50d271",
|
||||
"pages/students/2022/andrii_pervashov/README.md": "319dcaa1cc2e29dd7e3a710bab26cb3ac6944ab71b0b97e1de076b1199122334",
|
||||
"pages/students/2022/daniil_huzenko/README.md": "390782fbff6220a9462060ce1a62959f2a2b88f42d06e2c51d1f406b75d73f2c",
|
||||
"pages/students/2022/jakub_schwarc/README.md": "f541a8852c2b0f6f9d7182e01a34c4e3beee9bfa55427a06b331638b11eb8be6",
|
||||
"pages/students/2022/jan_malinovsky/README.md": "8af021bfb131fa005a7aec3e2f2f12fc17fa5dc14e2675311adbbfc445a4bcab",
|
||||
"pages/students/2022/jan_ptak/README.md": "131cf053764fd5423541ebe672c3b4f5da875cfb8e4b821f1335ddb967282282",
|
||||
"pages/students/2022/oleh_poiasnik/README.md": "c2f7dc3f61f8b4a5b43ded1e3ae4c7d3e7f874439ee6b17dd9c8d45dabc25bc8",
|
||||
"pages/students/2022/samuel_vasil/README.md": "67c807049147aacd04f3050f4ff0233a8b3f0a239ab173b430e13dfe113ad0a5",
|
||||
"pages/students/2022/serhii_yemets/README.md": "ffbeac893947acafe855d576322a8826f9d4f87ac344cb31f8ceeefa244b9133",
|
||||
"pages/students/2022/tetiana_mohorian/README.md": "c9efdc632bf1ca89a0bfde0dc00be7aaac8a85da3d92e2ce8506236c73e93cfb",
|
||||
"pages/students/2022/valerii_kutsenko/README.md": "dc764c609ad3c1df59cfea997d4db82a591b1b1e0764453e319d841115507e4f",
|
||||
"pages/students/2022/vladyslav_yanchenko/README.md": "4d1ce216e3b526ee437ddbc658e51d7bb83530087e43628c096a569a3854a47f",
|
||||
"pages/students/2022/yevhenii_leonov/README.md": "b90e41db0cec2451027020a9102d32a24d777e8a38b604ccca87b36cd6b3a292",
|
||||
"pages/students/2023/denis_le_thanh/README.md": "2cb83f942d86a02712b0c58778e46dc2211346d1a6eba606471dfa832245db61",
|
||||
"pages/students/2023/maksym_zatirka/README.md": "7a7d2cbe276c352dacfbc6ba6de5f15303d30ecf34845ff8da8d085f3d67c3dd",
|
||||
"pages/students/2023/oleksandr_dorybohov/README.md": "c24d6f941de0dafb4459cea8259cf147821cafc86ba65be5b528f419f734bc18",
|
||||
"pages/students/2023/ronald_zalacko/README.md": "724b0f8e6e641236dba9bddbd77f4546e09514076c7dfb151807aaf4b882c96f",
|
||||
"pages/students/2023/rostyslav_rodzhuk/README.md": "de356dd7427c8a0716c165a0f88ae47b691a86ee7a388f60e2d2e9306298415c",
|
||||
"pages/students/2023/samuel_dzurina/README.md": "4818191d044b91219c796a35010c95da5cf2093e050d494f30b219b91e13fa0e",
|
||||
"pages/students/2023/simona_bobrovcanova/README.md": "e473a1911dae10ab40e2cf6696a8be616a58c22aaf09af5953fbac475791a35e",
|
||||
"pages/students/2023/yevhenii_medushivskyi/README.md": "5710ebf91c893a12fe6d19f5372311938d1e7c7bbdf203f2dc8ed2fe7c4f5a24",
|
||||
"pages/topics/akopisat/README.md": "c7245e1fbfa4160618502c0baf8cc6bc47cd9a82b8a85bc1c645314829a7b76a",
|
||||
"pages/topics/bert/README.md": "35e507f7ec2ad1d3526e2a15f94ea085ee25f680a02daf6df62fd429bd9c25c9",
|
||||
"pages/topics/chatbot/README.md": "6f2f83ffb80109be47f9750cca9d3036ec3645abef9f2b590bd6825780c7c48a",
|
||||
"pages/topics/faq/README.md": "15cfbd9c2a1649c80a7a58922e2b66dadab5c86a5ef33ef16c82bebd4d2dbf06",
|
||||
"pages/topics/hatespeech/README.md": "364df94e70dd740c63544e2586ba7b957780f714fc0c941d1b04b02233e6cbc5",
|
||||
"pages/topics/legal/README.md": "003bb9bfe1e0ca21652091c2d11496312eb04e0689fe459e14c2d5a738e8eeea",
|
||||
"pages/topics/morphology/README.md": "e242cc5ff1a4cc98e227566c0ead999bbc95937b7c20be62cb2afb773d0d35c0",
|
||||
"pages/topics/named-entity/README.md": "66b2e25f70211d432d596e377d552b3b8f0c525b14c31e3bc9c956c3aeadca84",
|
||||
"pages/topics/named-entity/navod/README.md": "1ff87079a98411de0414754c60241e08d2214ddcd63ddf974e4340cce2ce5b02",
|
||||
"pages/topics/nlp/README.md": "6f90abf9dc3f0ff33475283c13b4a08561abf631425ec2daacb076155a9e02c2",
|
||||
"pages/topics/otvorene/README.md": "cd5544925553fe3840c0ea6f8ef60ab756e26ab6757bf810025c948d8d4f98fc",
|
||||
"pages/topics/prodigy/README.md": "5e4f691f2754c2ec4afbaab2f41e6db77feb5b322dd9344465eb40c35f116499",
|
||||
"pages/topics/python/README.md": "2ef073adba672142c39e9a59fa2e00a98ab52bda54233d46fbe6940ee23f9fcc",
|
||||
"pages/topics/question/README.md": "408078a2a67cea2699e12359e85ab641136231e6104c2afdf874a705879525df",
|
||||
"pages/topics/question/navod/README.md": "061e737c69184b2bd244316ca7ba841f7186fe01ee80ee993742a733dcad3ecd",
|
||||
"pages/topics/question/nezodpovedatelne/README.md": "b6703d9690f4599b973efb27595ce157773ae0fc0d55cf2c0a09d9f50e8e4c92",
|
||||
"pages/topics/question/validacie/README.md": "3216a7127abdfc6da50ed116f44ff2d6785e7da4af70d23aceda774e745ad562",
|
||||
"pages/topics/resources/README.md": "09405397387f00cbcc5680f7d655f2d861e4d92e5df792a62d9dfd04f3534f48",
|
||||
"pages/topics/seq2seq/README.md": "969d15c03a63a3f8d5edc9017fe5a0fb7311fdf4de4a3473a08266241f92c1e2",
|
||||
"pages/topics/spacy/README.md": "f504e5db77cb8694f08a57fb8636e522d59a0e669216f4bc8273bc3c5f375f87",
|
||||
"pages/topics/steel/README.md": "b4068cef2ed197711467ac47630d5b2064fdc8828f898f7af99664e94d833330",
|
||||
"pages/topics/translation/README.md": "a7d4289e72199b307dc5ad8fc69cda39c1a33c27a6c7447af70aa9c3cc6b8635"
|
||||
}
|
||||
}
|
||||
},
|
||||
"graph": {
|
||||
"sha256": "3f799a1ff8cd86cca24515d742430a111734ad3c65425587b64ae4ffe891701f",
|
||||
"nodes": 447,
|
||||
"relationships": 879
|
||||
},
|
||||
"parameters": {
|
||||
"limit": 40,
|
||||
"max_entities": 8
|
||||
},
|
||||
"dev_summary": {
|
||||
"questions": 589,
|
||||
"strict_count": 589,
|
||||
"strict_accuracy": 1.0,
|
||||
"error_count": 0,
|
||||
"value_score": 1.0,
|
||||
"entity_score": 1.0,
|
||||
"relation_score": 1.0,
|
||||
"property_score": 1.0,
|
||||
"relation_choice_score": 1.0,
|
||||
"document_recall": 1.0,
|
||||
"source_recall": 1.0,
|
||||
"binding_score": 1.0,
|
||||
"path_score": 1.0,
|
||||
"answerability_accuracy": 1.0,
|
||||
"latency_mean_seconds": 0.041531,
|
||||
"latency_median_seconds": 0.040416,
|
||||
"latency_p95_seconds": 0.056271
|
||||
},
|
||||
"source_audit_summary": {
|
||||
"dev": {
|
||||
"questions": 589,
|
||||
"source_consistent": 589,
|
||||
"issues": {}
|
||||
},
|
||||
"test": {
|
||||
"questions": 13,
|
||||
"source_consistent": 13,
|
||||
"issues": {}
|
||||
}
|
||||
},
|
||||
"policy": "Report all questions including negatives. No exclusions or holdout tuning.",
|
||||
"dev_results_sha256": "9334783e76158987f538f103a3ea90691a4c4115c4f2e6cb6327b5d9eda9f478",
|
||||
"audit_sha256": "9b03a6c5914133bb5c1ce056ce0f570f3c43243968a6f8cbbfbbee584461e5ac"
|
||||
}
|
||||
223
tools/graphrag/evaluation/frozen_v4.json
Normal file
223
tools/graphrag/evaluation/frozen_v4.json
Normal file
@ -0,0 +1,223 @@
|
||||
{
|
||||
"schema_version": 2,
|
||||
"partition": {
|
||||
"method": "disjoint logical query groups",
|
||||
"logical_group_overlap": 0,
|
||||
"previously_exposed_test_groups": 0,
|
||||
"dev_group_count": 577,
|
||||
"test_group_count": 320,
|
||||
"dev_profile_count": 72,
|
||||
"test_profile_count": 72,
|
||||
"source_profile_overlap": 72,
|
||||
"limitations": [
|
||||
"Known source corpus, persons, vocabulary and template families.",
|
||||
"Fresh questions/fact combinations; not an unseen-person or LLM-answer benchmark."
|
||||
]
|
||||
},
|
||||
"frozen_at_utc": "2026-10-25T01:43:37.727824+00:00",
|
||||
"fingerprints": {
|
||||
"implementation": {
|
||||
"tools/graphrag/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/build_graphrag.py": "81f6e9f5c9e71b588f8bed1968c1e900e29e484ba81d23b6a3a68e7220ad75a5",
|
||||
"tools/graphrag/evaluation/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/evaluation/audit_benchmark.py": "6619c818a52fc284e87ed6c48a503a54a3c9dd95447463ed78f075b7c58bad80",
|
||||
"tools/graphrag/evaluation/benchmark_v2.py": "129dd774faa414f06733e1ee6333e7b411b1c75b5601b895c405778df478a563",
|
||||
"tools/graphrag/evaluation/benchmark_v3.py": "30bae6c605ed26f4b49973acec799087c4e2b97a883ccedcafb965dd909c4c4d",
|
||||
"tools/graphrag/evaluation/benchmark_v4.py": "70a8b08f7c2b2cb3e2bdc77be9efedd23ea24ac564ec1c1eb224a9f6388b3a67",
|
||||
"tools/graphrag/evaluation/check_openwebui.py": "585490c89b8d178d3e5723336f4ac02bd3f6c2a0bec51acf2b7483a742847f16",
|
||||
"tools/graphrag/evaluation/evaluate_graphrag.py": "2d336cf9bdd8072e6f4d4ad3e58fc51cbcd81124b6e6ef703e6d1fb282128fbc",
|
||||
"tools/graphrag/evaluation/evidence_contract.py": "78e24264c176e163e1782fef1634b6c45c7f31bd4692726d02a30ab45a06648e",
|
||||
"tools/graphrag/evaluation/freeze_graphrag.py": "9a11a3cae83b3660d53d8fb51eff8f83ca5cb45858e327f394b2efdc35d6189d",
|
||||
"tools/graphrag/evaluation/graphrag_evaluator.py": "3afe014e126b6ad90c8e408284d2c1979f54d6cf5dd19fd67f9249708fbed2d3",
|
||||
"tools/graphrag/evaluation/reproducibility.py": "b707d4c410cbf7d6769a6afdadfe79ef3bbd699a0323f0e0d2ab180ef7498680",
|
||||
"tools/graphrag/evaluation/source_oracle.py": "8bac1ef0fd2ebe826a1b0686012c9fea3108d1c827ced46d977c9518fe55d67c",
|
||||
"tools/graphrag/graph_db.py": "a6fce68000065d328139829c5ca894623f6ed5828c74a869663366c2ad7b5ea2",
|
||||
"tools/graphrag/graph_search.py": "5ee39051073caea09f2bdc446359404dbd3a79bce9b80002788bfe250ffc87a0",
|
||||
"tools/graphrag/graphrag.py": "31e0f87fa973abc16a8aff2735a99e8a4dd9c76d0b889674a7204210c90d8b1d",
|
||||
"tools/graphrag/neo4j_smoke.py": "fb5244c72c29ef2acf96d1e7f54335ff168eed4119db1692025eb1b99194b7bb",
|
||||
"tools/graphrag/tests/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/tests/test_evaluation_pipeline_v2.py": "63d1b3e80ae3c7b563374fd7ab4aa5ffad3c614eafbd15142c577abd7f756bf9",
|
||||
"tools/graphrag/tests/test_evaluation_wide.py": "1b28bb74fd6b9457c869186b88606f1f7863d573aa3ab5226162e878f236d99e",
|
||||
"tools/graphrag/tests/test_evaluator_connected_v2.py": "29d7c9838ed1ff37ea3276df6feb1b6142158c43a0525712f490b648181882de",
|
||||
"tools/graphrag/tests/test_graph_search.py": "d5c95b5de2a0962857331929522764aa46a1222e550a3eb1aaca2148f9d58748",
|
||||
"tools/graphrag/tests/test_graph_search_entity_v2.py": "0ef1a8ebd513c5a4507eb38fcf5ae6137c69e9901b5a2975ba513be5902ac693",
|
||||
"tools/graphrag/tests/test_graph_search_neo4j.py": "fec2bf72de8f752f17c9164fee5754bdb2e153828855e47efbf0000dbe82cf3b",
|
||||
"tools/graphrag/tests/test_graph_search_regressions.py": "9db7779aeb8ed9e8c0f92c1657011a81080aff3c928649e811358e3009a18c48",
|
||||
"tools/graphrag/tests/test_graphrag.py": "6379335110f05668beca87ca7e486442071b2f666dbd651408d5f3a8d5723f0e",
|
||||
"tools/graphrag/tests/test_graphrag_evaluator.py": "1c6d08aeec9ae56ac4123239a5aed12a0081d66cc3f34b2047d95764579d7298",
|
||||
"tools/graphrag/tests/test_graphrag_freeze.py": "c4b760baf4c7ebf13b16bd4cd3c51874f5512eef3b4c61470dc4d428b0303d9f",
|
||||
"tools/graphrag/tests/test_graphrag_research_v2.py": "711008a91ab8a58ae0854e7f90329bcd42e5189fde2e2001589e97b0c22c5198",
|
||||
"tools/graphrag/tests/test_graphrag_root_title.py": "085651fe6e6081521a5dde9554abfee93456250108cf15978df25378d886a46c",
|
||||
"tools/graphrag/tests/test_source_oracle_v2.py": "0afdbe235e185ffe9f38aa667f90f5a6c20504fe29e9ac572642b39a8eb7faca",
|
||||
"requirements.txt": "26a6d097727eba03c1b6c71cd02b06373ef01ce03e567dd2bc4357ae330e5a1a"
|
||||
},
|
||||
"dataset_sha256": "9a3b873882bbf29b905d79c9448c3c287fda30323f93a6533b88dbd59b19f558",
|
||||
"inputs": {
|
||||
"data/documents.json": "0542af2a373771cf7c4a95f93d14f4f687f6a0187846892c959aa6efc4bade52",
|
||||
"data/chunks.json": "437dde589be46e0c30842dd330de22d96a0173d2dbaff9c5f129568cb2bca4c9"
|
||||
},
|
||||
"source_corpus": {
|
||||
"sha256": "440da12a7a991824e923f70cada7c616c3fb3b0f12767ec7d75039a6a3231b10",
|
||||
"document_count": 114,
|
||||
"documents": {
|
||||
"pages/interns/bogdan_paul_chis/README.md": "3b4b946eb3c10e9f9a4092e6cffa01c5080e7579aded2f6ed3120c41ed62b647",
|
||||
"pages/interns/cesar_gutierrez/README.md": "b0be60576eed28d4b1920e9acf198684519373dfc13171567247c853b3ed699e",
|
||||
"pages/interns/oliver_pejic/README.md": "0470f3c8465be8f02204b08e4c75ef47f68c7e4ad1038faa5641cdf1811f33d5",
|
||||
"pages/interns/sevval_bulburu/README.md": "ff2a9d66253802f1af0fdfd74832e40fae41b6df23c5e61dc266f6cd0cc16c4d",
|
||||
"pages/interns/yussef_ressaissi/README.md": "f997a65699da0db3222ef7a3c37652d05dfc3419ad4ec74683bafc2c897bb987",
|
||||
"pages/students/2016/darius_lindvai/README.md": "fcaa47bb9708a6439eec5c4b7f7b4ed6c7359e423e1d940e1aed9f44957e6d62",
|
||||
"pages/students/2016/darius_lindvai/dp2021/README.md": "be3d0fea2a6d592b225eecabd9b19445c2fce62b8289c07ab6af93835db12970",
|
||||
"pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md": "352162de1b1e192228fa5d26506c028ac47e567e90df53b1bbaa6ad736ec4766",
|
||||
"pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md": "b4a81ff457624b089d618e4479afb1e3d748f6724f72104ef5518e535ae02fe5",
|
||||
"pages/students/2016/dominik_nagy/README.md": "1c4037a158d84c45fa705a0c38e47142a9d46e226f0c138bc2d56d7c38f6d74d",
|
||||
"pages/students/2016/dominik_nagy/timovy_projekt/README.md": "b81a4dab7316f7b846dcf36515f6aa9d44035c86f46f0e07b7a43308bcd31458",
|
||||
"pages/students/2016/ediz_morochovic/README.md": "045e5eb9a3df2b84140808fbca0c3163266ad0efa144bc42d9d5c597881c6ac6",
|
||||
"pages/students/2016/jakub_maruniak/README.md": "6734c41a95b9d0c1e3d226b393ad109ee4a7b82ebfffa73df2d7e0a743fefa14",
|
||||
"pages/students/2016/jakub_maruniak/dp2021/README.md": "9cd884aec70705cdb2aaa0f514b513f16de263c37b749ced7f92916cd2f91c39",
|
||||
"pages/students/2016/jakub_maruniak/dp2021/annotation/README.md": "debae0c50aea1accef0840912b9b1f37b2138f856002bb50e91d7ea2dbbe7963",
|
||||
"pages/students/2016/jakub_maruniak/dp2021/train_experiments/README.md": "01dff38b37043414fa1db204394ddbe7aade00e14d02d495572b65c85d09b194",
|
||||
"pages/students/2016/jakub_maruniak/timovy_projekt/README.md": "04114b1f3d84664aad5bdba5a0b614c5a6f23392be3c31fd9123d63db1be0a35",
|
||||
"pages/students/2016/jan_holp/README.md": "80d6a8492766e5bfa61673a372e5f059d30c8e335de39842866c51485960e4d3",
|
||||
"pages/students/2016/jan_holp/dp2021/README.md": "a62acb74009376766c7e2f9856ee01d21f84593eb9b3ce85cf2e6032aa412476",
|
||||
"pages/students/2016/jan_holp/dp2021/zdrojove_subory/README.md": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"pages/students/2016/jan_holp/timovy_projekt/README.md": "79eebdfd3af7e8d5c279077e285a580731b1cf8cc9b4454f6596796e9915f70c",
|
||||
"pages/students/2016/lukas_pokryvka/README.md": "f279456c5c277ff1ee0dd89a3464ed9f9f67b44bc185a5da9811ef5cfb675002",
|
||||
"pages/students/2016/lukas_pokryvka/dp2021/README.md": "39b61376ce108e4a930f926ab2d6a997207457121bccfcf617129a3b210a15cf",
|
||||
"pages/students/2016/lukas_pokryvka/timovy_projekt/README.md": "4de4b6c8cfed17b6c60090f82df1d55a66be70a79d3013850689b2baebdd801b",
|
||||
"pages/students/2016/mark_feher/README.md": "bec37c0319fe0869a0377d771db23d090dbda93c27328f5697cdaeb3bbccfe9b",
|
||||
"pages/students/2016/maros_harahus/README.md": "0da150e91918632c9e8cd1443f04da403595a372517e254928ce9f76c9d5033d",
|
||||
"pages/students/2016/maros_harahus/timovy_projekt/README.md": "75af19f7c68f4b646fa1dbae75f3f3dfc52633a9f9da1400d21808bb20be0d83",
|
||||
"pages/students/2016/patrik_pavlisin/README.md": "dc1c648d7cd9b0f0e021c57f9b98189e37c100871439e7e304390715913f2763",
|
||||
"pages/students/2016/patrik_pavlisin/dp21/README.md": "ac1eb0fd0360ad34aa21b7c8da5bb010a6edf10be5721f28dedc3986cd1d8c54",
|
||||
"pages/students/2016/patrik_pavlisin/dp22/README.md": "f2a8c619a812b99abab618ae388eb672407950e1f33fb8d7da7a528c4de81d50",
|
||||
"pages/students/2016/patrik_pavlisin/tp20/README.md": "ae9c771f27e7e093bc29c6888c8d0b27ed61fb41519fd0d7e7f4f6cbb4626edc",
|
||||
"pages/students/2016/tomas_kucharik/README.md": "6a1a215433eb1857660177b4cb2ecec03c6a86743d3a04cd6d5c9d9682c9e63b",
|
||||
"pages/students/2017/dmytro_ushatenko/README.md": "65f4ac177d492162b08ca5da3d9eb048bd088a3c117a28a662113b7e4bc3a4ec",
|
||||
"pages/students/2017/martin_jancura/README.md": "6a0a18d5095dcfb12abfdd72c9cfd8025d714fb5e29a7858cd2b285e4cb986b9",
|
||||
"pages/students/2017/stanislav_matsunych/README.md": "90ffa11eff4a4360b0252dbc53a116c3a5777b3d5dd86ce5c89c02bdd2051c73",
|
||||
"pages/students/2017/than_trung_thanh/README.md": "2150519b8580e7337520db4de64d2d1c82d2634380537d019f41c506dbf2979d",
|
||||
"pages/students/2018/NaN1name_buday/README.md": "23c8c58090bdc954347e36f141bea91f43c8d5b1d777e346864a2ebe84c0bcce",
|
||||
"pages/students/2018/adrian_remias/README.md": "e5bfe1d5d4e626beaa636a02d34ec58cf2cff9b0e57833905af35b80bf1465a2",
|
||||
"pages/students/2018/david_ilas/README.md": "96c45ff9c5a821ddcb1a2fc86d487bd8f4729d1b76887914b0f5fbf99af45af0",
|
||||
"pages/students/2018/david_omasta/README.md": "4164051870e1e1cf8949ed18a74196e9ea789dfbe4fee24bdeb736ca42848327",
|
||||
"pages/students/2018/martin_wencel/README.md": "0e6a7a981689f22304f8baa5de97d4315c0695c94c9277de7851943eb012253b",
|
||||
"pages/students/2018/oleh_bilykh/README.md": "4072c62dd8ee753a0c8fa43fdfbbdf566e394c2df13e6a79d08a302e332710b1",
|
||||
"pages/students/2018/ondrej_megela/README.md": "969ff2e1a436b8f957e7168cf5eb678196b99aeda17701c502b016441f644065",
|
||||
"pages/students/2018/samuel_sirotnik/README.md": "cc230ede67b6e8632511c92a5ed6d1e9deb42e70819280222bdfd369ee77fc70",
|
||||
"pages/students/2019/alina_vitko/README.md": "9b071fe2aff470c275ae027be236fe836f741f774cabb9cbbb55304a8d5102cd",
|
||||
"pages/students/2019/artem_yatsenko/README.md": "328b101e46c51c959e792cf7ca226942f81d2ab8fe9648ad6d0ecd07016429e2",
|
||||
"pages/students/2019/david_stromp/README.md": "e46ca8691d5ec894128f6f6f2ed33e2c7bd141f80719bb0449b20f10f30cca09",
|
||||
"pages/students/2019/dmytro_mural/README.md": "e881a47d847c3ef8d680844113fdbfbb87553b28982bf9eef4936f6d30923e93",
|
||||
"pages/students/2019/filip_tomas/README.md": "75a1fe7b921e4bff0fdf9e2a957b4adad4b4a57aa7ebdffbb73dd82c02123f94",
|
||||
"pages/students/2019/kristian_sopkovic/README.md": "3286960fb30f584df35455f9b6dfae81ca4827a1d711d2bcd6e48c3f150c9279",
|
||||
"pages/students/2019/michal_stromko/README.md": "3ae1dd9b6638a6a249a94be3f3846286555666aefa225bb3a2c7288b35900ce7",
|
||||
"pages/students/2019/michal_stromko/vp2021/README.md": "feb2e093fdd6461239e79b1e1f96e65a1c8cd96e8a2b70535ae556a9c198046a",
|
||||
"pages/students/2019/michal_stromko/vp2021/tutorials/README.md": "40e3fa448c7329ef863e705435e23fe6b4788de440710f066fe0eed92d132bad",
|
||||
"pages/students/2019/michal_stromko/vp2021/tutorials/img/README.md": "e8d3ac160b17dfdee2c3e996bf6a03af7a6f16f9140bf5cf7ee343a82dd1865f",
|
||||
"pages/students/2019/patrik_pokrivcak/README.md": "3e3957ad0f7aca59d6eb64c38a3f5e21d8fd953200825d0d0e5cacabfbc35a7d",
|
||||
"pages/students/2019/samuel_horani/README.md": "86e6959ccc612b069687b57996fa3f61660075d6a0d65bfec64f423d39a0a999",
|
||||
"pages/students/2020/david_kostilnik/README.md": "2927524b75da59a64120fc364a0fc374986fa4d364d54e52c36800762c203264",
|
||||
"pages/students/2020/jakub_kristian_lukas/README.md": "f139d9b1ebf5a3f45612f3df5703ecdd935b90701763c27c7c529044c0b0455a",
|
||||
"pages/students/2020/kamil_tomcufcik/README.md": "9d865adf538bc6d7992ee4f4882713447da5c936fca17c43ca0f576072537048",
|
||||
"pages/students/2020/matej_kobylan/README.md": "3d7b289e17b8f25678a07e9ee0e6741688485a0ccb1e50940a6a6acc6312a547",
|
||||
"pages/students/2020/matus_suchanic/README.md": "770ca49538cca22df35f8e7ba736ee97483e4fe5788c221496553592b4e78dc6",
|
||||
"pages/students/2020/pavol_hudak/README.md": "33d06fccc6451e5f19b27b0cad001a34e81635b4ea294a01dec7771c823abc40",
|
||||
"pages/students/2020/vladyslav_krupko/README.md": "4c28e6d38651bb2cafcbf4a18e35210cd369aef2caff6c5b0aa52fac38f0fe7d",
|
||||
"pages/students/2021/artur_hyrenko/README.md": "0568261f4ade4de5472edcfeb1ffed9abae18dc67e4050f4ce2ad088839a2bb3",
|
||||
"pages/students/2021/eduard_matovka/README.md": "de2a7ae38ec87110e347956b37d0605a298ed2847f972961cc9b977da8221d43",
|
||||
"pages/students/2021/manohar_gowdru_shridharu/README.md": "c00ceb620ed7087ead5d9448d476bbb98d273d1d9e7bf1bc4355c367b26c7a6b",
|
||||
"pages/students/2021/martin_sarissky/README.md": "8e97b45a253745faa55f63c844e0b5dfe680aeaf6eb01fb8f9d06ac6e8ee8bcf",
|
||||
"pages/students/2021/matej_novotny/README.md": "b083a7cadde532e3428dc9a57bc61456fcc5905bda91e011b96033d42bf5d9cb",
|
||||
"pages/students/2021/matej_scislak/README.md": "b9a32cce8605e044a4f2828ff2d91a2995a62ef3a841e62f0a225c97221f0cc8",
|
||||
"pages/students/2021/nikita_bodnar/README.md": "2016c0dd923c0f8e561d5cea42ac81da3610fdcc54a4527f56d078e34e53ce90",
|
||||
"pages/students/2021/oleksandr_hryshchenko/README.md": "4b073992b715b6c75b79fd2c8f850a69f940966e3a61a82c625c32c945a93036",
|
||||
"pages/students/2021/vladimir_ferko/README.md": "68e7d311896eda2171e5eec1ec3a8da90d326ed91acaace8058f68664a50d271",
|
||||
"pages/students/2022/andrii_pervashov/README.md": "319dcaa1cc2e29dd7e3a710bab26cb3ac6944ab71b0b97e1de076b1199122334",
|
||||
"pages/students/2022/daniil_huzenko/README.md": "390782fbff6220a9462060ce1a62959f2a2b88f42d06e2c51d1f406b75d73f2c",
|
||||
"pages/students/2022/jakub_schwarc/README.md": "f541a8852c2b0f6f9d7182e01a34c4e3beee9bfa55427a06b331638b11eb8be6",
|
||||
"pages/students/2022/jan_malinovsky/README.md": "8af021bfb131fa005a7aec3e2f2f12fc17fa5dc14e2675311adbbfc445a4bcab",
|
||||
"pages/students/2022/jan_ptak/README.md": "131cf053764fd5423541ebe672c3b4f5da875cfb8e4b821f1335ddb967282282",
|
||||
"pages/students/2022/oleh_poiasnik/README.md": "c2f7dc3f61f8b4a5b43ded1e3ae4c7d3e7f874439ee6b17dd9c8d45dabc25bc8",
|
||||
"pages/students/2022/samuel_vasil/README.md": "67c807049147aacd04f3050f4ff0233a8b3f0a239ab173b430e13dfe113ad0a5",
|
||||
"pages/students/2022/serhii_yemets/README.md": "ffbeac893947acafe855d576322a8826f9d4f87ac344cb31f8ceeefa244b9133",
|
||||
"pages/students/2022/tetiana_mohorian/README.md": "c9efdc632bf1ca89a0bfde0dc00be7aaac8a85da3d92e2ce8506236c73e93cfb",
|
||||
"pages/students/2022/valerii_kutsenko/README.md": "dc764c609ad3c1df59cfea997d4db82a591b1b1e0764453e319d841115507e4f",
|
||||
"pages/students/2022/vladyslav_yanchenko/README.md": "4d1ce216e3b526ee437ddbc658e51d7bb83530087e43628c096a569a3854a47f",
|
||||
"pages/students/2022/yevhenii_leonov/README.md": "b90e41db0cec2451027020a9102d32a24d777e8a38b604ccca87b36cd6b3a292",
|
||||
"pages/students/2023/denis_le_thanh/README.md": "2cb83f942d86a02712b0c58778e46dc2211346d1a6eba606471dfa832245db61",
|
||||
"pages/students/2023/maksym_zatirka/README.md": "7a7d2cbe276c352dacfbc6ba6de5f15303d30ecf34845ff8da8d085f3d67c3dd",
|
||||
"pages/students/2023/oleksandr_dorybohov/README.md": "c24d6f941de0dafb4459cea8259cf147821cafc86ba65be5b528f419f734bc18",
|
||||
"pages/students/2023/ronald_zalacko/README.md": "724b0f8e6e641236dba9bddbd77f4546e09514076c7dfb151807aaf4b882c96f",
|
||||
"pages/students/2023/rostyslav_rodzhuk/README.md": "de356dd7427c8a0716c165a0f88ae47b691a86ee7a388f60e2d2e9306298415c",
|
||||
"pages/students/2023/samuel_dzurina/README.md": "4818191d044b91219c796a35010c95da5cf2093e050d494f30b219b91e13fa0e",
|
||||
"pages/students/2023/simona_bobrovcanova/README.md": "e473a1911dae10ab40e2cf6696a8be616a58c22aaf09af5953fbac475791a35e",
|
||||
"pages/students/2023/yevhenii_medushivskyi/README.md": "5710ebf91c893a12fe6d19f5372311938d1e7c7bbdf203f2dc8ed2fe7c4f5a24",
|
||||
"pages/topics/akopisat/README.md": "c7245e1fbfa4160618502c0baf8cc6bc47cd9a82b8a85bc1c645314829a7b76a",
|
||||
"pages/topics/bert/README.md": "35e507f7ec2ad1d3526e2a15f94ea085ee25f680a02daf6df62fd429bd9c25c9",
|
||||
"pages/topics/chatbot/README.md": "6f2f83ffb80109be47f9750cca9d3036ec3645abef9f2b590bd6825780c7c48a",
|
||||
"pages/topics/faq/README.md": "15cfbd9c2a1649c80a7a58922e2b66dadab5c86a5ef33ef16c82bebd4d2dbf06",
|
||||
"pages/topics/hatespeech/README.md": "364df94e70dd740c63544e2586ba7b957780f714fc0c941d1b04b02233e6cbc5",
|
||||
"pages/topics/legal/README.md": "003bb9bfe1e0ca21652091c2d11496312eb04e0689fe459e14c2d5a738e8eeea",
|
||||
"pages/topics/morphology/README.md": "e242cc5ff1a4cc98e227566c0ead999bbc95937b7c20be62cb2afb773d0d35c0",
|
||||
"pages/topics/named-entity/README.md": "66b2e25f70211d432d596e377d552b3b8f0c525b14c31e3bc9c956c3aeadca84",
|
||||
"pages/topics/named-entity/navod/README.md": "1ff87079a98411de0414754c60241e08d2214ddcd63ddf974e4340cce2ce5b02",
|
||||
"pages/topics/nlp/README.md": "6f90abf9dc3f0ff33475283c13b4a08561abf631425ec2daacb076155a9e02c2",
|
||||
"pages/topics/otvorene/README.md": "cd5544925553fe3840c0ea6f8ef60ab756e26ab6757bf810025c948d8d4f98fc",
|
||||
"pages/topics/prodigy/README.md": "5e4f691f2754c2ec4afbaab2f41e6db77feb5b322dd9344465eb40c35f116499",
|
||||
"pages/topics/python/README.md": "2ef073adba672142c39e9a59fa2e00a98ab52bda54233d46fbe6940ee23f9fcc",
|
||||
"pages/topics/question/README.md": "408078a2a67cea2699e12359e85ab641136231e6104c2afdf874a705879525df",
|
||||
"pages/topics/question/navod/README.md": "061e737c69184b2bd244316ca7ba841f7186fe01ee80ee993742a733dcad3ecd",
|
||||
"pages/topics/question/nezodpovedatelne/README.md": "b6703d9690f4599b973efb27595ce157773ae0fc0d55cf2c0a09d9f50e8e4c92",
|
||||
"pages/topics/question/validacie/README.md": "3216a7127abdfc6da50ed116f44ff2d6785e7da4af70d23aceda774e745ad562",
|
||||
"pages/topics/resources/README.md": "09405397387f00cbcc5680f7d655f2d861e4d92e5df792a62d9dfd04f3534f48",
|
||||
"pages/topics/seq2seq/README.md": "969d15c03a63a3f8d5edc9017fe5a0fb7311fdf4de4a3473a08266241f92c1e2",
|
||||
"pages/topics/spacy/README.md": "f504e5db77cb8694f08a57fb8636e522d59a0e669216f4bc8273bc3c5f375f87",
|
||||
"pages/topics/steel/README.md": "b4068cef2ed197711467ac47630d5b2064fdc8828f898f7af99664e94d833330",
|
||||
"pages/topics/translation/README.md": "a7d4289e72199b307dc5ad8fc69cda39c1a33c27a6c7447af70aa9c3cc6b8635"
|
||||
}
|
||||
}
|
||||
},
|
||||
"graph": {
|
||||
"sha256": "2aede9d603e7f09b5fa0e52abbf0de29a8b24f814bb17119aa44e1673c47b206",
|
||||
"nodes": 447,
|
||||
"relationships": 879
|
||||
},
|
||||
"parameters": {
|
||||
"limit": 40,
|
||||
"max_entities": 8
|
||||
},
|
||||
"dev_summary": {
|
||||
"questions": 722,
|
||||
"strict_count": 722,
|
||||
"strict_accuracy": 1.0,
|
||||
"error_count": 0,
|
||||
"value_score": 1.0,
|
||||
"entity_score": 1.0,
|
||||
"relation_score": 1.0,
|
||||
"property_score": 1.0,
|
||||
"relation_choice_score": 1.0,
|
||||
"document_recall": 1.0,
|
||||
"source_recall": 1.0,
|
||||
"binding_score": 1.0,
|
||||
"path_score": 1.0,
|
||||
"answerability_accuracy": 1.0,
|
||||
"latency_mean_seconds": 0.042119,
|
||||
"latency_median_seconds": 0.040648,
|
||||
"latency_p95_seconds": 0.054136
|
||||
},
|
||||
"source_audit_summary": {
|
||||
"dev": {
|
||||
"questions": 722,
|
||||
"source_consistent": 722,
|
||||
"issues": {}
|
||||
},
|
||||
"test": {
|
||||
"questions": 320,
|
||||
"source_consistent": 320,
|
||||
"issues": {}
|
||||
}
|
||||
},
|
||||
"policy": "Report all questions including negatives. No exclusions or holdout tuning.",
|
||||
"dev_results_sha256": "d89a76998ce7360906ea0daa2e865853a92aa8796e0f5bb7030f16e6459b29e9",
|
||||
"audit_sha256": "220fd00ab08cceee6d5141ca5c1a02ec2877d1eee83b36ea707c6a076ba69e15"
|
||||
}
|
||||
233
tools/graphrag/evaluation/frozen_v5.json
Normal file
233
tools/graphrag/evaluation/frozen_v5.json
Normal file
@ -0,0 +1,233 @@
|
||||
{
|
||||
"schema_version": 2,
|
||||
"evaluation_kind": "historical_regression",
|
||||
"partition": {
|
||||
"method": "Previously exposed questions; regression, not independent TEST",
|
||||
"dev_profile_count": 72,
|
||||
"test_profile_count": 72,
|
||||
"source_profile_overlap": 72
|
||||
},
|
||||
"frozen_at_utc": "2026-10-25T16:08:00.798503+00:00",
|
||||
"fingerprints": {
|
||||
"implementation": {
|
||||
"tools/graphrag/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/build_graphrag.py": "256292101d6d7d1946e926e2717ac45465b169f4091c51ecfed4f1a779dfd700",
|
||||
"tools/graphrag/evaluation/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/evaluation/audit_benchmark.py": "6619c818a52fc284e87ed6c48a503a54a3c9dd95447463ed78f075b7c58bad80",
|
||||
"tools/graphrag/evaluation/benchmark_v2.py": "129dd774faa414f06733e1ee6333e7b411b1c75b5601b895c405778df478a563",
|
||||
"tools/graphrag/evaluation/benchmark_v3.py": "30bae6c605ed26f4b49973acec799087c4e2b97a883ccedcafb965dd909c4c4d",
|
||||
"tools/graphrag/evaluation/benchmark_v4.py": "70a8b08f7c2b2cb3e2bdc77be9efedd23ea24ac564ec1c1eb224a9f6388b3a67",
|
||||
"tools/graphrag/evaluation/check_openwebui.py": "d6b5d9947679aeabf4ec9599a7ad70b5ee917dd7c6ad747ddbf54579d8de475b",
|
||||
"tools/graphrag/evaluation/evaluate_graphrag.py": "89c364d15b70c9cb55df39d5970b4d0d79b681ba70eed7530a4e3fe64167812e",
|
||||
"tools/graphrag/evaluation/evidence_contract.py": "78e24264c176e163e1782fef1634b6c45c7f31bd4692726d02a30ab45a06648e",
|
||||
"tools/graphrag/evaluation/freeze_graphrag.py": "793c6d04a13c3217347283c609f647cd0d69b020e44bbde458bdc7ebbab8ec7e",
|
||||
"tools/graphrag/evaluation/graphrag_evaluator.py": "7f99bf0f97974058650b619ea49a8ee32284cb4b324f1ffab9baf54f5c4495f4",
|
||||
"tools/graphrag/evaluation/reproducibility.py": "f6dde1a2a6f68abd0e916dfb38d5eb756a7f8621a66b7c11e43e7580b347134a",
|
||||
"tools/graphrag/evaluation/source_oracle.py": "bfe8375556d64975433ff098e8d227aecbe59afd4e4fbe5745054524e913f3da",
|
||||
"tools/graphrag/evaluation/source_validation.py": "042a3f99b18c028d88d1ecb6bf2430b8979be3d7414c19ee506bd245082bff46",
|
||||
"tools/graphrag/graph_db.py": "c4b1a2edb765856b807398e4c243a8d17753529a5d2dfdb51791e28bc8de17f7",
|
||||
"tools/graphrag/graph_search.py": "8cc3668b4ad7beabf849e6978ea1d5defc818b142ee8b157b19c319998fb7541",
|
||||
"tools/graphrag/graphrag.py": "128f888a0c76d06457af8c1dd1cf56fc1955e25b976f367613f0829f7e990ee6",
|
||||
"tools/graphrag/neo4j_smoke.py": "fb5244c72c29ef2acf96d1e7f54335ff168eed4119db1692025eb1b99194b7bb",
|
||||
"tools/graphrag/publication.py": "fba1fa0d0bed325fd87f8d3593baae9271de1766b772d7214c7f63fd3f1c37b6",
|
||||
"tools/graphrag/tests/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/tests/test_evaluation_pipeline_v2.py": "63d1b3e80ae3c7b563374fd7ab4aa5ffad3c614eafbd15142c577abd7f756bf9",
|
||||
"tools/graphrag/tests/test_evaluation_v5.py": "0475ebd4dc28d3e940ab499a7bc4ef713dc4c679d25b650161b78d1886f3bc0b",
|
||||
"tools/graphrag/tests/test_evaluation_wide.py": "1b28bb74fd6b9457c869186b88606f1f7863d573aa3ab5226162e878f236d99e",
|
||||
"tools/graphrag/tests/test_evaluator_connected_v2.py": "29d7c9838ed1ff37ea3276df6feb1b6142158c43a0525712f490b648181882de",
|
||||
"tools/graphrag/tests/test_graph_publication.py": "96e53c1ae28e36c7a4290e1e60c8b398bf095ceaf883e819e1a477e2672b11c0",
|
||||
"tools/graphrag/tests/test_graph_rebuild_atomic.py": "fe37d4fff0b1f0fb1d565f0a96152b9b4e336837bc78b5977cf3b4879d7fbaf3",
|
||||
"tools/graphrag/tests/test_graph_search.py": "eb58661aef9dafe6bf7188fcdc2d79cef6652d57c64d1b81ae81a52e8e0204d7",
|
||||
"tools/graphrag/tests/test_graph_search_entity_v2.py": "0ef1a8ebd513c5a4507eb38fcf5ae6137c69e9901b5a2975ba513be5902ac693",
|
||||
"tools/graphrag/tests/test_graph_search_neo4j.py": "fec2bf72de8f752f17c9164fee5754bdb2e153828855e47efbf0000dbe82cf3b",
|
||||
"tools/graphrag/tests/test_graph_search_regressions.py": "9db7779aeb8ed9e8c0f92c1657011a81080aff3c928649e811358e3009a18c48",
|
||||
"tools/graphrag/tests/test_graphrag.py": "9ee8629d6b528dd78c2ddfc25cee95e17613f45b454fc0a38d4c591862637a9f",
|
||||
"tools/graphrag/tests/test_graphrag_evaluator.py": "1c6d08aeec9ae56ac4123239a5aed12a0081d66cc3f34b2047d95764579d7298",
|
||||
"tools/graphrag/tests/test_graphrag_freeze.py": "c4b760baf4c7ebf13b16bd4cd3c51874f5512eef3b4c61470dc4d428b0303d9f",
|
||||
"tools/graphrag/tests/test_graphrag_research_v2.py": "711008a91ab8a58ae0854e7f90329bcd42e5189fde2e2001589e97b0c22c5198",
|
||||
"tools/graphrag/tests/test_graphrag_root_title.py": "085651fe6e6081521a5dde9554abfee93456250108cf15978df25378d886a46c",
|
||||
"tools/graphrag/tests/test_source_oracle_v2.py": "0afdbe235e185ffe9f38aa667f90f5a6c20504fe29e9ac572642b39a8eb7faca",
|
||||
"requirements.txt": "26a6d097727eba03c1b6c71cd02b06373ef01ce03e567dd2bc4357ae330e5a1a",
|
||||
"tools/publication.py": "f99d445073390a733afc8d849b9fcd4b4b0890bb54d136db67d4015b78436e1a",
|
||||
"tools/retrieval_contract.py": "b8fa272c3babf924a3ce8b937fe7ae437cd959ba9f7667193ac67c18d2c5b58d",
|
||||
"tools/index_state.py": "c33920a63d04009f11ef23ca9e9eee9bf86453b7d0586d027bf3b39156afea0d",
|
||||
"tools/rag/common.py": "8497c46d5c6c27a7c76df1568360ad5e9d00d5e5a7ef186e758960cc79d81d1c",
|
||||
"tools/sync_indexes.py": "5b909b4394c24e5ce22848594b16d9aea45fb06418f5cd92bb6aa6381a0ccf10"
|
||||
},
|
||||
"dataset_sha256": "9a3b873882bbf29b905d79c9448c3c287fda30323f93a6533b88dbd59b19f558",
|
||||
"inputs": {
|
||||
"data/documents.json": "0542af2a373771cf7c4a95f93d14f4f687f6a0187846892c959aa6efc4bade52",
|
||||
"data/chunks.json": "437dde589be46e0c30842dd330de22d96a0173d2dbaff9c5f129568cb2bca4c9"
|
||||
},
|
||||
"source_corpus": {
|
||||
"sha256": "440da12a7a991824e923f70cada7c616c3fb3b0f12767ec7d75039a6a3231b10",
|
||||
"document_count": 114,
|
||||
"documents": {
|
||||
"pages/interns/bogdan_paul_chis/README.md": "3b4b946eb3c10e9f9a4092e6cffa01c5080e7579aded2f6ed3120c41ed62b647",
|
||||
"pages/interns/cesar_gutierrez/README.md": "b0be60576eed28d4b1920e9acf198684519373dfc13171567247c853b3ed699e",
|
||||
"pages/interns/oliver_pejic/README.md": "0470f3c8465be8f02204b08e4c75ef47f68c7e4ad1038faa5641cdf1811f33d5",
|
||||
"pages/interns/sevval_bulburu/README.md": "ff2a9d66253802f1af0fdfd74832e40fae41b6df23c5e61dc266f6cd0cc16c4d",
|
||||
"pages/interns/yussef_ressaissi/README.md": "f997a65699da0db3222ef7a3c37652d05dfc3419ad4ec74683bafc2c897bb987",
|
||||
"pages/students/2016/darius_lindvai/README.md": "fcaa47bb9708a6439eec5c4b7f7b4ed6c7359e423e1d940e1aed9f44957e6d62",
|
||||
"pages/students/2016/darius_lindvai/dp2021/README.md": "be3d0fea2a6d592b225eecabd9b19445c2fce62b8289c07ab6af93835db12970",
|
||||
"pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md": "352162de1b1e192228fa5d26506c028ac47e567e90df53b1bbaa6ad736ec4766",
|
||||
"pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md": "b4a81ff457624b089d618e4479afb1e3d748f6724f72104ef5518e535ae02fe5",
|
||||
"pages/students/2016/dominik_nagy/README.md": "1c4037a158d84c45fa705a0c38e47142a9d46e226f0c138bc2d56d7c38f6d74d",
|
||||
"pages/students/2016/dominik_nagy/timovy_projekt/README.md": "b81a4dab7316f7b846dcf36515f6aa9d44035c86f46f0e07b7a43308bcd31458",
|
||||
"pages/students/2016/ediz_morochovic/README.md": "045e5eb9a3df2b84140808fbca0c3163266ad0efa144bc42d9d5c597881c6ac6",
|
||||
"pages/students/2016/jakub_maruniak/README.md": "6734c41a95b9d0c1e3d226b393ad109ee4a7b82ebfffa73df2d7e0a743fefa14",
|
||||
"pages/students/2016/jakub_maruniak/dp2021/README.md": "9cd884aec70705cdb2aaa0f514b513f16de263c37b749ced7f92916cd2f91c39",
|
||||
"pages/students/2016/jakub_maruniak/dp2021/annotation/README.md": "debae0c50aea1accef0840912b9b1f37b2138f856002bb50e91d7ea2dbbe7963",
|
||||
"pages/students/2016/jakub_maruniak/dp2021/train_experiments/README.md": "01dff38b37043414fa1db204394ddbe7aade00e14d02d495572b65c85d09b194",
|
||||
"pages/students/2016/jakub_maruniak/timovy_projekt/README.md": "04114b1f3d84664aad5bdba5a0b614c5a6f23392be3c31fd9123d63db1be0a35",
|
||||
"pages/students/2016/jan_holp/README.md": "80d6a8492766e5bfa61673a372e5f059d30c8e335de39842866c51485960e4d3",
|
||||
"pages/students/2016/jan_holp/dp2021/README.md": "a62acb74009376766c7e2f9856ee01d21f84593eb9b3ce85cf2e6032aa412476",
|
||||
"pages/students/2016/jan_holp/dp2021/zdrojove_subory/README.md": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"pages/students/2016/jan_holp/timovy_projekt/README.md": "79eebdfd3af7e8d5c279077e285a580731b1cf8cc9b4454f6596796e9915f70c",
|
||||
"pages/students/2016/lukas_pokryvka/README.md": "f279456c5c277ff1ee0dd89a3464ed9f9f67b44bc185a5da9811ef5cfb675002",
|
||||
"pages/students/2016/lukas_pokryvka/dp2021/README.md": "39b61376ce108e4a930f926ab2d6a997207457121bccfcf617129a3b210a15cf",
|
||||
"pages/students/2016/lukas_pokryvka/timovy_projekt/README.md": "4de4b6c8cfed17b6c60090f82df1d55a66be70a79d3013850689b2baebdd801b",
|
||||
"pages/students/2016/mark_feher/README.md": "bec37c0319fe0869a0377d771db23d090dbda93c27328f5697cdaeb3bbccfe9b",
|
||||
"pages/students/2016/maros_harahus/README.md": "0da150e91918632c9e8cd1443f04da403595a372517e254928ce9f76c9d5033d",
|
||||
"pages/students/2016/maros_harahus/timovy_projekt/README.md": "75af19f7c68f4b646fa1dbae75f3f3dfc52633a9f9da1400d21808bb20be0d83",
|
||||
"pages/students/2016/patrik_pavlisin/README.md": "dc1c648d7cd9b0f0e021c57f9b98189e37c100871439e7e304390715913f2763",
|
||||
"pages/students/2016/patrik_pavlisin/dp21/README.md": "ac1eb0fd0360ad34aa21b7c8da5bb010a6edf10be5721f28dedc3986cd1d8c54",
|
||||
"pages/students/2016/patrik_pavlisin/dp22/README.md": "f2a8c619a812b99abab618ae388eb672407950e1f33fb8d7da7a528c4de81d50",
|
||||
"pages/students/2016/patrik_pavlisin/tp20/README.md": "ae9c771f27e7e093bc29c6888c8d0b27ed61fb41519fd0d7e7f4f6cbb4626edc",
|
||||
"pages/students/2016/tomas_kucharik/README.md": "6a1a215433eb1857660177b4cb2ecec03c6a86743d3a04cd6d5c9d9682c9e63b",
|
||||
"pages/students/2017/dmytro_ushatenko/README.md": "65f4ac177d492162b08ca5da3d9eb048bd088a3c117a28a662113b7e4bc3a4ec",
|
||||
"pages/students/2017/martin_jancura/README.md": "6a0a18d5095dcfb12abfdd72c9cfd8025d714fb5e29a7858cd2b285e4cb986b9",
|
||||
"pages/students/2017/stanislav_matsunych/README.md": "90ffa11eff4a4360b0252dbc53a116c3a5777b3d5dd86ce5c89c02bdd2051c73",
|
||||
"pages/students/2017/than_trung_thanh/README.md": "2150519b8580e7337520db4de64d2d1c82d2634380537d019f41c506dbf2979d",
|
||||
"pages/students/2018/NaN1name_buday/README.md": "23c8c58090bdc954347e36f141bea91f43c8d5b1d777e346864a2ebe84c0bcce",
|
||||
"pages/students/2018/adrian_remias/README.md": "e5bfe1d5d4e626beaa636a02d34ec58cf2cff9b0e57833905af35b80bf1465a2",
|
||||
"pages/students/2018/david_ilas/README.md": "96c45ff9c5a821ddcb1a2fc86d487bd8f4729d1b76887914b0f5fbf99af45af0",
|
||||
"pages/students/2018/david_omasta/README.md": "4164051870e1e1cf8949ed18a74196e9ea789dfbe4fee24bdeb736ca42848327",
|
||||
"pages/students/2018/martin_wencel/README.md": "0e6a7a981689f22304f8baa5de97d4315c0695c94c9277de7851943eb012253b",
|
||||
"pages/students/2018/oleh_bilykh/README.md": "4072c62dd8ee753a0c8fa43fdfbbdf566e394c2df13e6a79d08a302e332710b1",
|
||||
"pages/students/2018/ondrej_megela/README.md": "969ff2e1a436b8f957e7168cf5eb678196b99aeda17701c502b016441f644065",
|
||||
"pages/students/2018/samuel_sirotnik/README.md": "cc230ede67b6e8632511c92a5ed6d1e9deb42e70819280222bdfd369ee77fc70",
|
||||
"pages/students/2019/alina_vitko/README.md": "9b071fe2aff470c275ae027be236fe836f741f774cabb9cbbb55304a8d5102cd",
|
||||
"pages/students/2019/artem_yatsenko/README.md": "328b101e46c51c959e792cf7ca226942f81d2ab8fe9648ad6d0ecd07016429e2",
|
||||
"pages/students/2019/david_stromp/README.md": "e46ca8691d5ec894128f6f6f2ed33e2c7bd141f80719bb0449b20f10f30cca09",
|
||||
"pages/students/2019/dmytro_mural/README.md": "e881a47d847c3ef8d680844113fdbfbb87553b28982bf9eef4936f6d30923e93",
|
||||
"pages/students/2019/filip_tomas/README.md": "75a1fe7b921e4bff0fdf9e2a957b4adad4b4a57aa7ebdffbb73dd82c02123f94",
|
||||
"pages/students/2019/kristian_sopkovic/README.md": "3286960fb30f584df35455f9b6dfae81ca4827a1d711d2bcd6e48c3f150c9279",
|
||||
"pages/students/2019/michal_stromko/README.md": "3ae1dd9b6638a6a249a94be3f3846286555666aefa225bb3a2c7288b35900ce7",
|
||||
"pages/students/2019/michal_stromko/vp2021/README.md": "feb2e093fdd6461239e79b1e1f96e65a1c8cd96e8a2b70535ae556a9c198046a",
|
||||
"pages/students/2019/michal_stromko/vp2021/tutorials/README.md": "40e3fa448c7329ef863e705435e23fe6b4788de440710f066fe0eed92d132bad",
|
||||
"pages/students/2019/michal_stromko/vp2021/tutorials/img/README.md": "e8d3ac160b17dfdee2c3e996bf6a03af7a6f16f9140bf5cf7ee343a82dd1865f",
|
||||
"pages/students/2019/patrik_pokrivcak/README.md": "3e3957ad0f7aca59d6eb64c38a3f5e21d8fd953200825d0d0e5cacabfbc35a7d",
|
||||
"pages/students/2019/samuel_horani/README.md": "86e6959ccc612b069687b57996fa3f61660075d6a0d65bfec64f423d39a0a999",
|
||||
"pages/students/2020/david_kostilnik/README.md": "2927524b75da59a64120fc364a0fc374986fa4d364d54e52c36800762c203264",
|
||||
"pages/students/2020/jakub_kristian_lukas/README.md": "f139d9b1ebf5a3f45612f3df5703ecdd935b90701763c27c7c529044c0b0455a",
|
||||
"pages/students/2020/kamil_tomcufcik/README.md": "9d865adf538bc6d7992ee4f4882713447da5c936fca17c43ca0f576072537048",
|
||||
"pages/students/2020/matej_kobylan/README.md": "3d7b289e17b8f25678a07e9ee0e6741688485a0ccb1e50940a6a6acc6312a547",
|
||||
"pages/students/2020/matus_suchanic/README.md": "770ca49538cca22df35f8e7ba736ee97483e4fe5788c221496553592b4e78dc6",
|
||||
"pages/students/2020/pavol_hudak/README.md": "33d06fccc6451e5f19b27b0cad001a34e81635b4ea294a01dec7771c823abc40",
|
||||
"pages/students/2020/vladyslav_krupko/README.md": "4c28e6d38651bb2cafcbf4a18e35210cd369aef2caff6c5b0aa52fac38f0fe7d",
|
||||
"pages/students/2021/artur_hyrenko/README.md": "0568261f4ade4de5472edcfeb1ffed9abae18dc67e4050f4ce2ad088839a2bb3",
|
||||
"pages/students/2021/eduard_matovka/README.md": "de2a7ae38ec87110e347956b37d0605a298ed2847f972961cc9b977da8221d43",
|
||||
"pages/students/2021/manohar_gowdru_shridharu/README.md": "c00ceb620ed7087ead5d9448d476bbb98d273d1d9e7bf1bc4355c367b26c7a6b",
|
||||
"pages/students/2021/martin_sarissky/README.md": "8e97b45a253745faa55f63c844e0b5dfe680aeaf6eb01fb8f9d06ac6e8ee8bcf",
|
||||
"pages/students/2021/matej_novotny/README.md": "b083a7cadde532e3428dc9a57bc61456fcc5905bda91e011b96033d42bf5d9cb",
|
||||
"pages/students/2021/matej_scislak/README.md": "b9a32cce8605e044a4f2828ff2d91a2995a62ef3a841e62f0a225c97221f0cc8",
|
||||
"pages/students/2021/nikita_bodnar/README.md": "2016c0dd923c0f8e561d5cea42ac81da3610fdcc54a4527f56d078e34e53ce90",
|
||||
"pages/students/2021/oleksandr_hryshchenko/README.md": "4b073992b715b6c75b79fd2c8f850a69f940966e3a61a82c625c32c945a93036",
|
||||
"pages/students/2021/vladimir_ferko/README.md": "68e7d311896eda2171e5eec1ec3a8da90d326ed91acaace8058f68664a50d271",
|
||||
"pages/students/2022/andrii_pervashov/README.md": "319dcaa1cc2e29dd7e3a710bab26cb3ac6944ab71b0b97e1de076b1199122334",
|
||||
"pages/students/2022/daniil_huzenko/README.md": "390782fbff6220a9462060ce1a62959f2a2b88f42d06e2c51d1f406b75d73f2c",
|
||||
"pages/students/2022/jakub_schwarc/README.md": "f541a8852c2b0f6f9d7182e01a34c4e3beee9bfa55427a06b331638b11eb8be6",
|
||||
"pages/students/2022/jan_malinovsky/README.md": "8af021bfb131fa005a7aec3e2f2f12fc17fa5dc14e2675311adbbfc445a4bcab",
|
||||
"pages/students/2022/jan_ptak/README.md": "131cf053764fd5423541ebe672c3b4f5da875cfb8e4b821f1335ddb967282282",
|
||||
"pages/students/2022/oleh_poiasnik/README.md": "c2f7dc3f61f8b4a5b43ded1e3ae4c7d3e7f874439ee6b17dd9c8d45dabc25bc8",
|
||||
"pages/students/2022/samuel_vasil/README.md": "67c807049147aacd04f3050f4ff0233a8b3f0a239ab173b430e13dfe113ad0a5",
|
||||
"pages/students/2022/serhii_yemets/README.md": "ffbeac893947acafe855d576322a8826f9d4f87ac344cb31f8ceeefa244b9133",
|
||||
"pages/students/2022/tetiana_mohorian/README.md": "c9efdc632bf1ca89a0bfde0dc00be7aaac8a85da3d92e2ce8506236c73e93cfb",
|
||||
"pages/students/2022/valerii_kutsenko/README.md": "dc764c609ad3c1df59cfea997d4db82a591b1b1e0764453e319d841115507e4f",
|
||||
"pages/students/2022/vladyslav_yanchenko/README.md": "4d1ce216e3b526ee437ddbc658e51d7bb83530087e43628c096a569a3854a47f",
|
||||
"pages/students/2022/yevhenii_leonov/README.md": "b90e41db0cec2451027020a9102d32a24d777e8a38b604ccca87b36cd6b3a292",
|
||||
"pages/students/2023/denis_le_thanh/README.md": "2cb83f942d86a02712b0c58778e46dc2211346d1a6eba606471dfa832245db61",
|
||||
"pages/students/2023/maksym_zatirka/README.md": "7a7d2cbe276c352dacfbc6ba6de5f15303d30ecf34845ff8da8d085f3d67c3dd",
|
||||
"pages/students/2023/oleksandr_dorybohov/README.md": "c24d6f941de0dafb4459cea8259cf147821cafc86ba65be5b528f419f734bc18",
|
||||
"pages/students/2023/ronald_zalacko/README.md": "724b0f8e6e641236dba9bddbd77f4546e09514076c7dfb151807aaf4b882c96f",
|
||||
"pages/students/2023/rostyslav_rodzhuk/README.md": "de356dd7427c8a0716c165a0f88ae47b691a86ee7a388f60e2d2e9306298415c",
|
||||
"pages/students/2023/samuel_dzurina/README.md": "4818191d044b91219c796a35010c95da5cf2093e050d494f30b219b91e13fa0e",
|
||||
"pages/students/2023/simona_bobrovcanova/README.md": "e473a1911dae10ab40e2cf6696a8be616a58c22aaf09af5953fbac475791a35e",
|
||||
"pages/students/2023/yevhenii_medushivskyi/README.md": "5710ebf91c893a12fe6d19f5372311938d1e7c7bbdf203f2dc8ed2fe7c4f5a24",
|
||||
"pages/topics/akopisat/README.md": "c7245e1fbfa4160618502c0baf8cc6bc47cd9a82b8a85bc1c645314829a7b76a",
|
||||
"pages/topics/bert/README.md": "35e507f7ec2ad1d3526e2a15f94ea085ee25f680a02daf6df62fd429bd9c25c9",
|
||||
"pages/topics/chatbot/README.md": "6f2f83ffb80109be47f9750cca9d3036ec3645abef9f2b590bd6825780c7c48a",
|
||||
"pages/topics/faq/README.md": "15cfbd9c2a1649c80a7a58922e2b66dadab5c86a5ef33ef16c82bebd4d2dbf06",
|
||||
"pages/topics/hatespeech/README.md": "364df94e70dd740c63544e2586ba7b957780f714fc0c941d1b04b02233e6cbc5",
|
||||
"pages/topics/legal/README.md": "003bb9bfe1e0ca21652091c2d11496312eb04e0689fe459e14c2d5a738e8eeea",
|
||||
"pages/topics/morphology/README.md": "e242cc5ff1a4cc98e227566c0ead999bbc95937b7c20be62cb2afb773d0d35c0",
|
||||
"pages/topics/named-entity/README.md": "66b2e25f70211d432d596e377d552b3b8f0c525b14c31e3bc9c956c3aeadca84",
|
||||
"pages/topics/named-entity/navod/README.md": "1ff87079a98411de0414754c60241e08d2214ddcd63ddf974e4340cce2ce5b02",
|
||||
"pages/topics/nlp/README.md": "6f90abf9dc3f0ff33475283c13b4a08561abf631425ec2daacb076155a9e02c2",
|
||||
"pages/topics/otvorene/README.md": "cd5544925553fe3840c0ea6f8ef60ab756e26ab6757bf810025c948d8d4f98fc",
|
||||
"pages/topics/prodigy/README.md": "5e4f691f2754c2ec4afbaab2f41e6db77feb5b322dd9344465eb40c35f116499",
|
||||
"pages/topics/python/README.md": "2ef073adba672142c39e9a59fa2e00a98ab52bda54233d46fbe6940ee23f9fcc",
|
||||
"pages/topics/question/README.md": "408078a2a67cea2699e12359e85ab641136231e6104c2afdf874a705879525df",
|
||||
"pages/topics/question/navod/README.md": "061e737c69184b2bd244316ca7ba841f7186fe01ee80ee993742a733dcad3ecd",
|
||||
"pages/topics/question/nezodpovedatelne/README.md": "b6703d9690f4599b973efb27595ce157773ae0fc0d55cf2c0a09d9f50e8e4c92",
|
||||
"pages/topics/question/validacie/README.md": "3216a7127abdfc6da50ed116f44ff2d6785e7da4af70d23aceda774e745ad562",
|
||||
"pages/topics/resources/README.md": "09405397387f00cbcc5680f7d655f2d861e4d92e5df792a62d9dfd04f3534f48",
|
||||
"pages/topics/seq2seq/README.md": "969d15c03a63a3f8d5edc9017fe5a0fb7311fdf4de4a3473a08266241f92c1e2",
|
||||
"pages/topics/spacy/README.md": "f504e5db77cb8694f08a57fb8636e522d59a0e669216f4bc8273bc3c5f375f87",
|
||||
"pages/topics/steel/README.md": "b4068cef2ed197711467ac47630d5b2064fdc8828f898f7af99664e94d833330",
|
||||
"pages/topics/translation/README.md": "a7d4289e72199b307dc5ad8fc69cda39c1a33c27a6c7447af70aa9c3cc6b8635"
|
||||
}
|
||||
},
|
||||
"retrieval_policy": {
|
||||
"published_only": true,
|
||||
"publication_policy": "explicit-false-hidden-v1",
|
||||
"academic_preparation_is_work": false
|
||||
}
|
||||
},
|
||||
"graph": {
|
||||
"sha256": "f5f85ce72994baa1c4df62c0423fd6f3a349ef7de2174a65184a6dc4628e1cdb",
|
||||
"nodes": 446,
|
||||
"relationships": 877
|
||||
},
|
||||
"parameters": {
|
||||
"limit": 40,
|
||||
"max_entities": 8
|
||||
},
|
||||
"dev_summary": {
|
||||
"questions": 722,
|
||||
"source_checked_count": 722,
|
||||
"all_facts_supported_count": 722,
|
||||
"strict_count": 722,
|
||||
"strict_accuracy": 1.0,
|
||||
"error_count": 0,
|
||||
"value_score": 1.0,
|
||||
"entity_score": 1.0,
|
||||
"relation_score": 1.0,
|
||||
"property_score": 1.0,
|
||||
"relation_choice_score": 1.0,
|
||||
"document_recall": 1.0,
|
||||
"source_recall": 1.0,
|
||||
"binding_score": 1.0,
|
||||
"path_score": 1.0,
|
||||
"answerability_accuracy": 1.0,
|
||||
"latency_mean_seconds": 0.041665,
|
||||
"latency_median_seconds": 0.040584,
|
||||
"latency_p95_seconds": 0.050737
|
||||
},
|
||||
"source_audit_summary": {
|
||||
"dev": {
|
||||
"questions": 722,
|
||||
"source_consistent": 722,
|
||||
"issues": {}
|
||||
},
|
||||
"test": {
|
||||
"questions": 320,
|
||||
"source_consistent": 320,
|
||||
"issues": {}
|
||||
}
|
||||
},
|
||||
"policy": "Report all questions including negatives. No exclusions or holdout tuning.",
|
||||
"dev_results_sha256": "5a35b798860cac4376e6b323956eb4e1437469062deec99687c953b147d238f0",
|
||||
"audit_sha256": "091e2ee00a88e9e6a459e91fb54efabd23eec5eb4dd70570aa313c3e51e93410"
|
||||
}
|
||||
233
tools/graphrag/evaluation/frozen_v5_1.json
Normal file
233
tools/graphrag/evaluation/frozen_v5_1.json
Normal file
@ -0,0 +1,233 @@
|
||||
{
|
||||
"schema_version": 2,
|
||||
"evaluation_kind": "historical_regression",
|
||||
"partition": {
|
||||
"method": "Previously exposed questions; regression, not independent TEST",
|
||||
"dev_profile_count": 72,
|
||||
"test_profile_count": 72,
|
||||
"source_profile_overlap": 72
|
||||
},
|
||||
"frozen_at_utc": "2026-10-25T16:14:12.663856+00:00",
|
||||
"fingerprints": {
|
||||
"implementation": {
|
||||
"tools/graphrag/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/build_graphrag.py": "256292101d6d7d1946e926e2717ac45465b169f4091c51ecfed4f1a779dfd700",
|
||||
"tools/graphrag/evaluation/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/evaluation/audit_benchmark.py": "6619c818a52fc284e87ed6c48a503a54a3c9dd95447463ed78f075b7c58bad80",
|
||||
"tools/graphrag/evaluation/benchmark_v2.py": "129dd774faa414f06733e1ee6333e7b411b1c75b5601b895c405778df478a563",
|
||||
"tools/graphrag/evaluation/benchmark_v3.py": "30bae6c605ed26f4b49973acec799087c4e2b97a883ccedcafb965dd909c4c4d",
|
||||
"tools/graphrag/evaluation/benchmark_v4.py": "70a8b08f7c2b2cb3e2bdc77be9efedd23ea24ac564ec1c1eb224a9f6388b3a67",
|
||||
"tools/graphrag/evaluation/check_openwebui.py": "d6b5d9947679aeabf4ec9599a7ad70b5ee917dd7c6ad747ddbf54579d8de475b",
|
||||
"tools/graphrag/evaluation/evaluate_graphrag.py": "89c364d15b70c9cb55df39d5970b4d0d79b681ba70eed7530a4e3fe64167812e",
|
||||
"tools/graphrag/evaluation/evidence_contract.py": "78e24264c176e163e1782fef1634b6c45c7f31bd4692726d02a30ab45a06648e",
|
||||
"tools/graphrag/evaluation/freeze_graphrag.py": "793c6d04a13c3217347283c609f647cd0d69b020e44bbde458bdc7ebbab8ec7e",
|
||||
"tools/graphrag/evaluation/graphrag_evaluator.py": "7f99bf0f97974058650b619ea49a8ee32284cb4b324f1ffab9baf54f5c4495f4",
|
||||
"tools/graphrag/evaluation/reproducibility.py": "f6dde1a2a6f68abd0e916dfb38d5eb756a7f8621a66b7c11e43e7580b347134a",
|
||||
"tools/graphrag/evaluation/source_oracle.py": "25aba0ebd6af1c94ec42e4d5044bad55ae0964c89ed3f06aa63a0959ab2d7ddb",
|
||||
"tools/graphrag/evaluation/source_validation.py": "9671b8978623888dbed8b8b2d1b6b01c1ce73cb0a512b03919e48873990f15ed",
|
||||
"tools/graphrag/graph_db.py": "c4b1a2edb765856b807398e4c243a8d17753529a5d2dfdb51791e28bc8de17f7",
|
||||
"tools/graphrag/graph_search.py": "8cc3668b4ad7beabf849e6978ea1d5defc818b142ee8b157b19c319998fb7541",
|
||||
"tools/graphrag/graphrag.py": "3a5ae3bfd12ef171d650548cb26c5708b472424a11cd8cb9ed64e21c9ab5bbd2",
|
||||
"tools/graphrag/neo4j_smoke.py": "fb5244c72c29ef2acf96d1e7f54335ff168eed4119db1692025eb1b99194b7bb",
|
||||
"tools/graphrag/publication.py": "fba1fa0d0bed325fd87f8d3593baae9271de1766b772d7214c7f63fd3f1c37b6",
|
||||
"tools/graphrag/tests/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/tests/test_evaluation_pipeline_v2.py": "63d1b3e80ae3c7b563374fd7ab4aa5ffad3c614eafbd15142c577abd7f756bf9",
|
||||
"tools/graphrag/tests/test_evaluation_v5.py": "9387e9d1418ebab87530986b0e29dac31cf33d762777a29a31cff24cc72e552a",
|
||||
"tools/graphrag/tests/test_evaluation_wide.py": "1b28bb74fd6b9457c869186b88606f1f7863d573aa3ab5226162e878f236d99e",
|
||||
"tools/graphrag/tests/test_evaluator_connected_v2.py": "29d7c9838ed1ff37ea3276df6feb1b6142158c43a0525712f490b648181882de",
|
||||
"tools/graphrag/tests/test_graph_publication.py": "96e53c1ae28e36c7a4290e1e60c8b398bf095ceaf883e819e1a477e2672b11c0",
|
||||
"tools/graphrag/tests/test_graph_rebuild_atomic.py": "fe37d4fff0b1f0fb1d565f0a96152b9b4e336837bc78b5977cf3b4879d7fbaf3",
|
||||
"tools/graphrag/tests/test_graph_search.py": "eb58661aef9dafe6bf7188fcdc2d79cef6652d57c64d1b81ae81a52e8e0204d7",
|
||||
"tools/graphrag/tests/test_graph_search_entity_v2.py": "0ef1a8ebd513c5a4507eb38fcf5ae6137c69e9901b5a2975ba513be5902ac693",
|
||||
"tools/graphrag/tests/test_graph_search_neo4j.py": "fec2bf72de8f752f17c9164fee5754bdb2e153828855e47efbf0000dbe82cf3b",
|
||||
"tools/graphrag/tests/test_graph_search_regressions.py": "9db7779aeb8ed9e8c0f92c1657011a81080aff3c928649e811358e3009a18c48",
|
||||
"tools/graphrag/tests/test_graphrag.py": "9ee8629d6b528dd78c2ddfc25cee95e17613f45b454fc0a38d4c591862637a9f",
|
||||
"tools/graphrag/tests/test_graphrag_evaluator.py": "1c6d08aeec9ae56ac4123239a5aed12a0081d66cc3f34b2047d95764579d7298",
|
||||
"tools/graphrag/tests/test_graphrag_freeze.py": "c4b760baf4c7ebf13b16bd4cd3c51874f5512eef3b4c61470dc4d428b0303d9f",
|
||||
"tools/graphrag/tests/test_graphrag_research_v2.py": "711008a91ab8a58ae0854e7f90329bcd42e5189fde2e2001589e97b0c22c5198",
|
||||
"tools/graphrag/tests/test_graphrag_root_title.py": "085651fe6e6081521a5dde9554abfee93456250108cf15978df25378d886a46c",
|
||||
"tools/graphrag/tests/test_source_oracle_v2.py": "0afdbe235e185ffe9f38aa667f90f5a6c20504fe29e9ac572642b39a8eb7faca",
|
||||
"requirements.txt": "26a6d097727eba03c1b6c71cd02b06373ef01ce03e567dd2bc4357ae330e5a1a",
|
||||
"tools/publication.py": "f99d445073390a733afc8d849b9fcd4b4b0890bb54d136db67d4015b78436e1a",
|
||||
"tools/retrieval_contract.py": "b8fa272c3babf924a3ce8b937fe7ae437cd959ba9f7667193ac67c18d2c5b58d",
|
||||
"tools/index_state.py": "c33920a63d04009f11ef23ca9e9eee9bf86453b7d0586d027bf3b39156afea0d",
|
||||
"tools/rag/common.py": "8497c46d5c6c27a7c76df1568360ad5e9d00d5e5a7ef186e758960cc79d81d1c",
|
||||
"tools/sync_indexes.py": "5b909b4394c24e5ce22848594b16d9aea45fb06418f5cd92bb6aa6381a0ccf10"
|
||||
},
|
||||
"dataset_sha256": "9a3b873882bbf29b905d79c9448c3c287fda30323f93a6533b88dbd59b19f558",
|
||||
"inputs": {
|
||||
"data/documents.json": "0542af2a373771cf7c4a95f93d14f4f687f6a0187846892c959aa6efc4bade52",
|
||||
"data/chunks.json": "437dde589be46e0c30842dd330de22d96a0173d2dbaff9c5f129568cb2bca4c9"
|
||||
},
|
||||
"source_corpus": {
|
||||
"sha256": "440da12a7a991824e923f70cada7c616c3fb3b0f12767ec7d75039a6a3231b10",
|
||||
"document_count": 114,
|
||||
"documents": {
|
||||
"pages/interns/bogdan_paul_chis/README.md": "3b4b946eb3c10e9f9a4092e6cffa01c5080e7579aded2f6ed3120c41ed62b647",
|
||||
"pages/interns/cesar_gutierrez/README.md": "b0be60576eed28d4b1920e9acf198684519373dfc13171567247c853b3ed699e",
|
||||
"pages/interns/oliver_pejic/README.md": "0470f3c8465be8f02204b08e4c75ef47f68c7e4ad1038faa5641cdf1811f33d5",
|
||||
"pages/interns/sevval_bulburu/README.md": "ff2a9d66253802f1af0fdfd74832e40fae41b6df23c5e61dc266f6cd0cc16c4d",
|
||||
"pages/interns/yussef_ressaissi/README.md": "f997a65699da0db3222ef7a3c37652d05dfc3419ad4ec74683bafc2c897bb987",
|
||||
"pages/students/2016/darius_lindvai/README.md": "fcaa47bb9708a6439eec5c4b7f7b4ed6c7359e423e1d940e1aed9f44957e6d62",
|
||||
"pages/students/2016/darius_lindvai/dp2021/README.md": "be3d0fea2a6d592b225eecabd9b19445c2fce62b8289c07ab6af93835db12970",
|
||||
"pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md": "352162de1b1e192228fa5d26506c028ac47e567e90df53b1bbaa6ad736ec4766",
|
||||
"pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md": "b4a81ff457624b089d618e4479afb1e3d748f6724f72104ef5518e535ae02fe5",
|
||||
"pages/students/2016/dominik_nagy/README.md": "1c4037a158d84c45fa705a0c38e47142a9d46e226f0c138bc2d56d7c38f6d74d",
|
||||
"pages/students/2016/dominik_nagy/timovy_projekt/README.md": "b81a4dab7316f7b846dcf36515f6aa9d44035c86f46f0e07b7a43308bcd31458",
|
||||
"pages/students/2016/ediz_morochovic/README.md": "045e5eb9a3df2b84140808fbca0c3163266ad0efa144bc42d9d5c597881c6ac6",
|
||||
"pages/students/2016/jakub_maruniak/README.md": "6734c41a95b9d0c1e3d226b393ad109ee4a7b82ebfffa73df2d7e0a743fefa14",
|
||||
"pages/students/2016/jakub_maruniak/dp2021/README.md": "9cd884aec70705cdb2aaa0f514b513f16de263c37b749ced7f92916cd2f91c39",
|
||||
"pages/students/2016/jakub_maruniak/dp2021/annotation/README.md": "debae0c50aea1accef0840912b9b1f37b2138f856002bb50e91d7ea2dbbe7963",
|
||||
"pages/students/2016/jakub_maruniak/dp2021/train_experiments/README.md": "01dff38b37043414fa1db204394ddbe7aade00e14d02d495572b65c85d09b194",
|
||||
"pages/students/2016/jakub_maruniak/timovy_projekt/README.md": "04114b1f3d84664aad5bdba5a0b614c5a6f23392be3c31fd9123d63db1be0a35",
|
||||
"pages/students/2016/jan_holp/README.md": "80d6a8492766e5bfa61673a372e5f059d30c8e335de39842866c51485960e4d3",
|
||||
"pages/students/2016/jan_holp/dp2021/README.md": "a62acb74009376766c7e2f9856ee01d21f84593eb9b3ce85cf2e6032aa412476",
|
||||
"pages/students/2016/jan_holp/dp2021/zdrojove_subory/README.md": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"pages/students/2016/jan_holp/timovy_projekt/README.md": "79eebdfd3af7e8d5c279077e285a580731b1cf8cc9b4454f6596796e9915f70c",
|
||||
"pages/students/2016/lukas_pokryvka/README.md": "f279456c5c277ff1ee0dd89a3464ed9f9f67b44bc185a5da9811ef5cfb675002",
|
||||
"pages/students/2016/lukas_pokryvka/dp2021/README.md": "39b61376ce108e4a930f926ab2d6a997207457121bccfcf617129a3b210a15cf",
|
||||
"pages/students/2016/lukas_pokryvka/timovy_projekt/README.md": "4de4b6c8cfed17b6c60090f82df1d55a66be70a79d3013850689b2baebdd801b",
|
||||
"pages/students/2016/mark_feher/README.md": "bec37c0319fe0869a0377d771db23d090dbda93c27328f5697cdaeb3bbccfe9b",
|
||||
"pages/students/2016/maros_harahus/README.md": "0da150e91918632c9e8cd1443f04da403595a372517e254928ce9f76c9d5033d",
|
||||
"pages/students/2016/maros_harahus/timovy_projekt/README.md": "75af19f7c68f4b646fa1dbae75f3f3dfc52633a9f9da1400d21808bb20be0d83",
|
||||
"pages/students/2016/patrik_pavlisin/README.md": "dc1c648d7cd9b0f0e021c57f9b98189e37c100871439e7e304390715913f2763",
|
||||
"pages/students/2016/patrik_pavlisin/dp21/README.md": "ac1eb0fd0360ad34aa21b7c8da5bb010a6edf10be5721f28dedc3986cd1d8c54",
|
||||
"pages/students/2016/patrik_pavlisin/dp22/README.md": "f2a8c619a812b99abab618ae388eb672407950e1f33fb8d7da7a528c4de81d50",
|
||||
"pages/students/2016/patrik_pavlisin/tp20/README.md": "ae9c771f27e7e093bc29c6888c8d0b27ed61fb41519fd0d7e7f4f6cbb4626edc",
|
||||
"pages/students/2016/tomas_kucharik/README.md": "6a1a215433eb1857660177b4cb2ecec03c6a86743d3a04cd6d5c9d9682c9e63b",
|
||||
"pages/students/2017/dmytro_ushatenko/README.md": "65f4ac177d492162b08ca5da3d9eb048bd088a3c117a28a662113b7e4bc3a4ec",
|
||||
"pages/students/2017/martin_jancura/README.md": "6a0a18d5095dcfb12abfdd72c9cfd8025d714fb5e29a7858cd2b285e4cb986b9",
|
||||
"pages/students/2017/stanislav_matsunych/README.md": "90ffa11eff4a4360b0252dbc53a116c3a5777b3d5dd86ce5c89c02bdd2051c73",
|
||||
"pages/students/2017/than_trung_thanh/README.md": "2150519b8580e7337520db4de64d2d1c82d2634380537d019f41c506dbf2979d",
|
||||
"pages/students/2018/NaN1name_buday/README.md": "23c8c58090bdc954347e36f141bea91f43c8d5b1d777e346864a2ebe84c0bcce",
|
||||
"pages/students/2018/adrian_remias/README.md": "e5bfe1d5d4e626beaa636a02d34ec58cf2cff9b0e57833905af35b80bf1465a2",
|
||||
"pages/students/2018/david_ilas/README.md": "96c45ff9c5a821ddcb1a2fc86d487bd8f4729d1b76887914b0f5fbf99af45af0",
|
||||
"pages/students/2018/david_omasta/README.md": "4164051870e1e1cf8949ed18a74196e9ea789dfbe4fee24bdeb736ca42848327",
|
||||
"pages/students/2018/martin_wencel/README.md": "0e6a7a981689f22304f8baa5de97d4315c0695c94c9277de7851943eb012253b",
|
||||
"pages/students/2018/oleh_bilykh/README.md": "4072c62dd8ee753a0c8fa43fdfbbdf566e394c2df13e6a79d08a302e332710b1",
|
||||
"pages/students/2018/ondrej_megela/README.md": "969ff2e1a436b8f957e7168cf5eb678196b99aeda17701c502b016441f644065",
|
||||
"pages/students/2018/samuel_sirotnik/README.md": "cc230ede67b6e8632511c92a5ed6d1e9deb42e70819280222bdfd369ee77fc70",
|
||||
"pages/students/2019/alina_vitko/README.md": "9b071fe2aff470c275ae027be236fe836f741f774cabb9cbbb55304a8d5102cd",
|
||||
"pages/students/2019/artem_yatsenko/README.md": "328b101e46c51c959e792cf7ca226942f81d2ab8fe9648ad6d0ecd07016429e2",
|
||||
"pages/students/2019/david_stromp/README.md": "e46ca8691d5ec894128f6f6f2ed33e2c7bd141f80719bb0449b20f10f30cca09",
|
||||
"pages/students/2019/dmytro_mural/README.md": "e881a47d847c3ef8d680844113fdbfbb87553b28982bf9eef4936f6d30923e93",
|
||||
"pages/students/2019/filip_tomas/README.md": "75a1fe7b921e4bff0fdf9e2a957b4adad4b4a57aa7ebdffbb73dd82c02123f94",
|
||||
"pages/students/2019/kristian_sopkovic/README.md": "3286960fb30f584df35455f9b6dfae81ca4827a1d711d2bcd6e48c3f150c9279",
|
||||
"pages/students/2019/michal_stromko/README.md": "3ae1dd9b6638a6a249a94be3f3846286555666aefa225bb3a2c7288b35900ce7",
|
||||
"pages/students/2019/michal_stromko/vp2021/README.md": "feb2e093fdd6461239e79b1e1f96e65a1c8cd96e8a2b70535ae556a9c198046a",
|
||||
"pages/students/2019/michal_stromko/vp2021/tutorials/README.md": "40e3fa448c7329ef863e705435e23fe6b4788de440710f066fe0eed92d132bad",
|
||||
"pages/students/2019/michal_stromko/vp2021/tutorials/img/README.md": "e8d3ac160b17dfdee2c3e996bf6a03af7a6f16f9140bf5cf7ee343a82dd1865f",
|
||||
"pages/students/2019/patrik_pokrivcak/README.md": "3e3957ad0f7aca59d6eb64c38a3f5e21d8fd953200825d0d0e5cacabfbc35a7d",
|
||||
"pages/students/2019/samuel_horani/README.md": "86e6959ccc612b069687b57996fa3f61660075d6a0d65bfec64f423d39a0a999",
|
||||
"pages/students/2020/david_kostilnik/README.md": "2927524b75da59a64120fc364a0fc374986fa4d364d54e52c36800762c203264",
|
||||
"pages/students/2020/jakub_kristian_lukas/README.md": "f139d9b1ebf5a3f45612f3df5703ecdd935b90701763c27c7c529044c0b0455a",
|
||||
"pages/students/2020/kamil_tomcufcik/README.md": "9d865adf538bc6d7992ee4f4882713447da5c936fca17c43ca0f576072537048",
|
||||
"pages/students/2020/matej_kobylan/README.md": "3d7b289e17b8f25678a07e9ee0e6741688485a0ccb1e50940a6a6acc6312a547",
|
||||
"pages/students/2020/matus_suchanic/README.md": "770ca49538cca22df35f8e7ba736ee97483e4fe5788c221496553592b4e78dc6",
|
||||
"pages/students/2020/pavol_hudak/README.md": "33d06fccc6451e5f19b27b0cad001a34e81635b4ea294a01dec7771c823abc40",
|
||||
"pages/students/2020/vladyslav_krupko/README.md": "4c28e6d38651bb2cafcbf4a18e35210cd369aef2caff6c5b0aa52fac38f0fe7d",
|
||||
"pages/students/2021/artur_hyrenko/README.md": "0568261f4ade4de5472edcfeb1ffed9abae18dc67e4050f4ce2ad088839a2bb3",
|
||||
"pages/students/2021/eduard_matovka/README.md": "de2a7ae38ec87110e347956b37d0605a298ed2847f972961cc9b977da8221d43",
|
||||
"pages/students/2021/manohar_gowdru_shridharu/README.md": "c00ceb620ed7087ead5d9448d476bbb98d273d1d9e7bf1bc4355c367b26c7a6b",
|
||||
"pages/students/2021/martin_sarissky/README.md": "8e97b45a253745faa55f63c844e0b5dfe680aeaf6eb01fb8f9d06ac6e8ee8bcf",
|
||||
"pages/students/2021/matej_novotny/README.md": "b083a7cadde532e3428dc9a57bc61456fcc5905bda91e011b96033d42bf5d9cb",
|
||||
"pages/students/2021/matej_scislak/README.md": "b9a32cce8605e044a4f2828ff2d91a2995a62ef3a841e62f0a225c97221f0cc8",
|
||||
"pages/students/2021/nikita_bodnar/README.md": "2016c0dd923c0f8e561d5cea42ac81da3610fdcc54a4527f56d078e34e53ce90",
|
||||
"pages/students/2021/oleksandr_hryshchenko/README.md": "4b073992b715b6c75b79fd2c8f850a69f940966e3a61a82c625c32c945a93036",
|
||||
"pages/students/2021/vladimir_ferko/README.md": "68e7d311896eda2171e5eec1ec3a8da90d326ed91acaace8058f68664a50d271",
|
||||
"pages/students/2022/andrii_pervashov/README.md": "319dcaa1cc2e29dd7e3a710bab26cb3ac6944ab71b0b97e1de076b1199122334",
|
||||
"pages/students/2022/daniil_huzenko/README.md": "390782fbff6220a9462060ce1a62959f2a2b88f42d06e2c51d1f406b75d73f2c",
|
||||
"pages/students/2022/jakub_schwarc/README.md": "f541a8852c2b0f6f9d7182e01a34c4e3beee9bfa55427a06b331638b11eb8be6",
|
||||
"pages/students/2022/jan_malinovsky/README.md": "8af021bfb131fa005a7aec3e2f2f12fc17fa5dc14e2675311adbbfc445a4bcab",
|
||||
"pages/students/2022/jan_ptak/README.md": "131cf053764fd5423541ebe672c3b4f5da875cfb8e4b821f1335ddb967282282",
|
||||
"pages/students/2022/oleh_poiasnik/README.md": "c2f7dc3f61f8b4a5b43ded1e3ae4c7d3e7f874439ee6b17dd9c8d45dabc25bc8",
|
||||
"pages/students/2022/samuel_vasil/README.md": "67c807049147aacd04f3050f4ff0233a8b3f0a239ab173b430e13dfe113ad0a5",
|
||||
"pages/students/2022/serhii_yemets/README.md": "ffbeac893947acafe855d576322a8826f9d4f87ac344cb31f8ceeefa244b9133",
|
||||
"pages/students/2022/tetiana_mohorian/README.md": "c9efdc632bf1ca89a0bfde0dc00be7aaac8a85da3d92e2ce8506236c73e93cfb",
|
||||
"pages/students/2022/valerii_kutsenko/README.md": "dc764c609ad3c1df59cfea997d4db82a591b1b1e0764453e319d841115507e4f",
|
||||
"pages/students/2022/vladyslav_yanchenko/README.md": "4d1ce216e3b526ee437ddbc658e51d7bb83530087e43628c096a569a3854a47f",
|
||||
"pages/students/2022/yevhenii_leonov/README.md": "b90e41db0cec2451027020a9102d32a24d777e8a38b604ccca87b36cd6b3a292",
|
||||
"pages/students/2023/denis_le_thanh/README.md": "2cb83f942d86a02712b0c58778e46dc2211346d1a6eba606471dfa832245db61",
|
||||
"pages/students/2023/maksym_zatirka/README.md": "7a7d2cbe276c352dacfbc6ba6de5f15303d30ecf34845ff8da8d085f3d67c3dd",
|
||||
"pages/students/2023/oleksandr_dorybohov/README.md": "c24d6f941de0dafb4459cea8259cf147821cafc86ba65be5b528f419f734bc18",
|
||||
"pages/students/2023/ronald_zalacko/README.md": "724b0f8e6e641236dba9bddbd77f4546e09514076c7dfb151807aaf4b882c96f",
|
||||
"pages/students/2023/rostyslav_rodzhuk/README.md": "de356dd7427c8a0716c165a0f88ae47b691a86ee7a388f60e2d2e9306298415c",
|
||||
"pages/students/2023/samuel_dzurina/README.md": "4818191d044b91219c796a35010c95da5cf2093e050d494f30b219b91e13fa0e",
|
||||
"pages/students/2023/simona_bobrovcanova/README.md": "e473a1911dae10ab40e2cf6696a8be616a58c22aaf09af5953fbac475791a35e",
|
||||
"pages/students/2023/yevhenii_medushivskyi/README.md": "5710ebf91c893a12fe6d19f5372311938d1e7c7bbdf203f2dc8ed2fe7c4f5a24",
|
||||
"pages/topics/akopisat/README.md": "c7245e1fbfa4160618502c0baf8cc6bc47cd9a82b8a85bc1c645314829a7b76a",
|
||||
"pages/topics/bert/README.md": "35e507f7ec2ad1d3526e2a15f94ea085ee25f680a02daf6df62fd429bd9c25c9",
|
||||
"pages/topics/chatbot/README.md": "6f2f83ffb80109be47f9750cca9d3036ec3645abef9f2b590bd6825780c7c48a",
|
||||
"pages/topics/faq/README.md": "15cfbd9c2a1649c80a7a58922e2b66dadab5c86a5ef33ef16c82bebd4d2dbf06",
|
||||
"pages/topics/hatespeech/README.md": "364df94e70dd740c63544e2586ba7b957780f714fc0c941d1b04b02233e6cbc5",
|
||||
"pages/topics/legal/README.md": "003bb9bfe1e0ca21652091c2d11496312eb04e0689fe459e14c2d5a738e8eeea",
|
||||
"pages/topics/morphology/README.md": "e242cc5ff1a4cc98e227566c0ead999bbc95937b7c20be62cb2afb773d0d35c0",
|
||||
"pages/topics/named-entity/README.md": "66b2e25f70211d432d596e377d552b3b8f0c525b14c31e3bc9c956c3aeadca84",
|
||||
"pages/topics/named-entity/navod/README.md": "1ff87079a98411de0414754c60241e08d2214ddcd63ddf974e4340cce2ce5b02",
|
||||
"pages/topics/nlp/README.md": "6f90abf9dc3f0ff33475283c13b4a08561abf631425ec2daacb076155a9e02c2",
|
||||
"pages/topics/otvorene/README.md": "cd5544925553fe3840c0ea6f8ef60ab756e26ab6757bf810025c948d8d4f98fc",
|
||||
"pages/topics/prodigy/README.md": "5e4f691f2754c2ec4afbaab2f41e6db77feb5b322dd9344465eb40c35f116499",
|
||||
"pages/topics/python/README.md": "2ef073adba672142c39e9a59fa2e00a98ab52bda54233d46fbe6940ee23f9fcc",
|
||||
"pages/topics/question/README.md": "408078a2a67cea2699e12359e85ab641136231e6104c2afdf874a705879525df",
|
||||
"pages/topics/question/navod/README.md": "061e737c69184b2bd244316ca7ba841f7186fe01ee80ee993742a733dcad3ecd",
|
||||
"pages/topics/question/nezodpovedatelne/README.md": "b6703d9690f4599b973efb27595ce157773ae0fc0d55cf2c0a09d9f50e8e4c92",
|
||||
"pages/topics/question/validacie/README.md": "3216a7127abdfc6da50ed116f44ff2d6785e7da4af70d23aceda774e745ad562",
|
||||
"pages/topics/resources/README.md": "09405397387f00cbcc5680f7d655f2d861e4d92e5df792a62d9dfd04f3534f48",
|
||||
"pages/topics/seq2seq/README.md": "969d15c03a63a3f8d5edc9017fe5a0fb7311fdf4de4a3473a08266241f92c1e2",
|
||||
"pages/topics/spacy/README.md": "f504e5db77cb8694f08a57fb8636e522d59a0e669216f4bc8273bc3c5f375f87",
|
||||
"pages/topics/steel/README.md": "b4068cef2ed197711467ac47630d5b2064fdc8828f898f7af99664e94d833330",
|
||||
"pages/topics/translation/README.md": "a7d4289e72199b307dc5ad8fc69cda39c1a33c27a6c7447af70aa9c3cc6b8635"
|
||||
}
|
||||
},
|
||||
"retrieval_policy": {
|
||||
"published_only": true,
|
||||
"publication_policy": "explicit-false-hidden-v1",
|
||||
"academic_preparation_is_work": false
|
||||
}
|
||||
},
|
||||
"graph": {
|
||||
"sha256": "34d3ff672efe834d2b7d07e2f1cd1c043db011d0db37fb07cc7616bced0234a0",
|
||||
"nodes": 446,
|
||||
"relationships": 877
|
||||
},
|
||||
"parameters": {
|
||||
"limit": 40,
|
||||
"max_entities": 8
|
||||
},
|
||||
"dev_summary": {
|
||||
"questions": 722,
|
||||
"source_checked_count": 722,
|
||||
"all_facts_supported_count": 722,
|
||||
"strict_count": 722,
|
||||
"strict_accuracy": 1.0,
|
||||
"error_count": 0,
|
||||
"value_score": 1.0,
|
||||
"entity_score": 1.0,
|
||||
"relation_score": 1.0,
|
||||
"property_score": 1.0,
|
||||
"relation_choice_score": 1.0,
|
||||
"document_recall": 1.0,
|
||||
"source_recall": 1.0,
|
||||
"binding_score": 1.0,
|
||||
"path_score": 1.0,
|
||||
"answerability_accuracy": 1.0,
|
||||
"latency_mean_seconds": 0.042052,
|
||||
"latency_median_seconds": 0.040355,
|
||||
"latency_p95_seconds": 0.052196
|
||||
},
|
||||
"source_audit_summary": {
|
||||
"dev": {
|
||||
"questions": 722,
|
||||
"source_consistent": 722,
|
||||
"issues": {}
|
||||
},
|
||||
"test": {
|
||||
"questions": 320,
|
||||
"source_consistent": 320,
|
||||
"issues": {}
|
||||
}
|
||||
},
|
||||
"policy": "Report all questions including negatives. No exclusions or holdout tuning.",
|
||||
"dev_results_sha256": "b940a1a42a09d25fc008f34948ee3c8b274e9fab8fe0e692e04e1bfa472f2a25",
|
||||
"audit_sha256": "81708ca63f8772673cd836fe7a1a1938fbe0e713588efcb07ed3fd4280f27829"
|
||||
}
|
||||
241
tools/graphrag/evaluation/frozen_v6.json
Normal file
241
tools/graphrag/evaluation/frozen_v6.json
Normal file
@ -0,0 +1,241 @@
|
||||
{
|
||||
"schema_version": 2,
|
||||
"evaluation_kind": "historical_regression",
|
||||
"partition": {
|
||||
"method": "Previously exposed questions; regression, not independent TEST",
|
||||
"dev_profile_count": 72,
|
||||
"test_profile_count": 72,
|
||||
"source_profile_overlap": 72
|
||||
},
|
||||
"frozen_at_utc": "2026-10-25T21:18:46.238549+00:00",
|
||||
"fingerprints": {
|
||||
"implementation": {
|
||||
"tools/graphrag/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/build_graphrag.py": "256292101d6d7d1946e926e2717ac45465b169f4091c51ecfed4f1a779dfd700",
|
||||
"tools/graphrag/evaluation/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/evaluation/audit_benchmark.py": "6619c818a52fc284e87ed6c48a503a54a3c9dd95447463ed78f075b7c58bad80",
|
||||
"tools/graphrag/evaluation/benchmark_v2.py": "129dd774faa414f06733e1ee6333e7b411b1c75b5601b895c405778df478a563",
|
||||
"tools/graphrag/evaluation/benchmark_v3.py": "30bae6c605ed26f4b49973acec799087c4e2b97a883ccedcafb965dd909c4c4d",
|
||||
"tools/graphrag/evaluation/benchmark_v4.py": "70a8b08f7c2b2cb3e2bdc77be9efedd23ea24ac564ec1c1eb224a9f6388b3a67",
|
||||
"tools/graphrag/evaluation/benchmark_v6.py": "f955e600d17358fafcb33bab772aef09d787452f6b33352e299fdd42669aaf34",
|
||||
"tools/graphrag/evaluation/check_openwebui.py": "e2a81b52f7431b27a5e2a7d2bd0801029a782ea3620c0b7a289c57bdebb994d7",
|
||||
"tools/graphrag/evaluation/evaluate_graphrag.py": "89c364d15b70c9cb55df39d5970b4d0d79b681ba70eed7530a4e3fe64167812e",
|
||||
"tools/graphrag/evaluation/evidence_contract.py": "78e24264c176e163e1782fef1634b6c45c7f31bd4692726d02a30ab45a06648e",
|
||||
"tools/graphrag/evaluation/freeze_graphrag.py": "793c6d04a13c3217347283c609f647cd0d69b020e44bbde458bdc7ebbab8ec7e",
|
||||
"tools/graphrag/evaluation/graphrag_evaluator.py": "7f99bf0f97974058650b619ea49a8ee32284cb4b324f1ffab9baf54f5c4495f4",
|
||||
"tools/graphrag/evaluation/reproducibility.py": "8db9a0e0f86236b56239f41da11803538dfaa6745bbf74dbd7618e0a73bda0ae",
|
||||
"tools/graphrag/evaluation/source_oracle.py": "f2265d0919a4019f10d2b4a986bd772684fe59c598d7ae2f5cd0daa41f81b87b",
|
||||
"tools/graphrag/evaluation/source_validation.py": "9671b8978623888dbed8b8b2d1b6b01c1ce73cb0a512b03919e48873990f15ed",
|
||||
"tools/graphrag/graph_db.py": "c4b1a2edb765856b807398e4c243a8d17753529a5d2dfdb51791e28bc8de17f7",
|
||||
"tools/graphrag/graph_search.py": "8cc3668b4ad7beabf849e6978ea1d5defc818b142ee8b157b19c319998fb7541",
|
||||
"tools/graphrag/graphrag.py": "a718efbd001301c4a809aa449a2f175ae7aca8f6f3248f539d6f0597faeb3187",
|
||||
"tools/graphrag/neo4j_smoke.py": "fb5244c72c29ef2acf96d1e7f54335ff168eed4119db1692025eb1b99194b7bb",
|
||||
"tools/graphrag/publication.py": "fba1fa0d0bed325fd87f8d3593baae9271de1766b772d7214c7f63fd3f1c37b6",
|
||||
"tools/graphrag/tests/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/tests/test_evaluation_pipeline_v2.py": "63d1b3e80ae3c7b563374fd7ab4aa5ffad3c614eafbd15142c577abd7f756bf9",
|
||||
"tools/graphrag/tests/test_evaluation_v5.py": "9387e9d1418ebab87530986b0e29dac31cf33d762777a29a31cff24cc72e552a",
|
||||
"tools/graphrag/tests/test_evaluation_wide.py": "1b28bb74fd6b9457c869186b88606f1f7863d573aa3ab5226162e878f236d99e",
|
||||
"tools/graphrag/tests/test_evaluator_connected_v2.py": "29d7c9838ed1ff37ea3276df6feb1b6142158c43a0525712f490b648181882de",
|
||||
"tools/graphrag/tests/test_graph_publication.py": "96e53c1ae28e36c7a4290e1e60c8b398bf095ceaf883e819e1a477e2672b11c0",
|
||||
"tools/graphrag/tests/test_graph_rebuild_atomic.py": "fe37d4fff0b1f0fb1d565f0a96152b9b4e336837bc78b5977cf3b4879d7fbaf3",
|
||||
"tools/graphrag/tests/test_graph_search.py": "eb58661aef9dafe6bf7188fcdc2d79cef6652d57c64d1b81ae81a52e8e0204d7",
|
||||
"tools/graphrag/tests/test_graph_search_entity_v2.py": "0ef1a8ebd513c5a4507eb38fcf5ae6137c69e9901b5a2975ba513be5902ac693",
|
||||
"tools/graphrag/tests/test_graph_search_neo4j.py": "fec2bf72de8f752f17c9164fee5754bdb2e153828855e47efbf0000dbe82cf3b",
|
||||
"tools/graphrag/tests/test_graph_search_regressions.py": "9db7779aeb8ed9e8c0f92c1657011a81080aff3c928649e811358e3009a18c48",
|
||||
"tools/graphrag/tests/test_graphrag.py": "9ee8629d6b528dd78c2ddfc25cee95e17613f45b454fc0a38d4c591862637a9f",
|
||||
"tools/graphrag/tests/test_graphrag_evaluator.py": "1c6d08aeec9ae56ac4123239a5aed12a0081d66cc3f34b2047d95764579d7298",
|
||||
"tools/graphrag/tests/test_graphrag_freeze.py": "c4b760baf4c7ebf13b16bd4cd3c51874f5512eef3b4c61470dc4d428b0303d9f",
|
||||
"tools/graphrag/tests/test_graphrag_research_v2.py": "711008a91ab8a58ae0854e7f90329bcd42e5189fde2e2001589e97b0c22c5198",
|
||||
"tools/graphrag/tests/test_graphrag_root_title.py": "085651fe6e6081521a5dde9554abfee93456250108cf15978df25378d886a46c",
|
||||
"tools/graphrag/tests/test_source_oracle_v2.py": "0afdbe235e185ffe9f38aa667f90f5a6c20504fe29e9ac572642b39a8eb7faca",
|
||||
"tools/graphrag/tests/test_title_labels.py": "2983ead68ad6e2e346d24af0fc96dc6771c163e9c2a351af426a1e0383998e6f",
|
||||
"requirements.txt": "26a6d097727eba03c1b6c71cd02b06373ef01ce03e567dd2bc4357ae330e5a1a",
|
||||
"tools/publication.py": "f99d445073390a733afc8d849b9fcd4b4b0890bb54d136db67d4015b78436e1a",
|
||||
"tools/retrieval_contract.py": "b8fa272c3babf924a3ce8b937fe7ae437cd959ba9f7667193ac67c18d2c5b58d",
|
||||
"tools/index_state.py": "c33920a63d04009f11ef23ca9e9eee9bf86453b7d0586d027bf3b39156afea0d",
|
||||
"tools/rag/common.py": "8497c46d5c6c27a7c76df1568360ad5e9d00d5e5a7ef186e758960cc79d81d1c",
|
||||
"tools/sync_indexes.py": "5b909b4394c24e5ce22848594b16d9aea45fb06418f5cd92bb6aa6381a0ccf10",
|
||||
"tools/rag/rag_utils.py": "4f898cf0facc2ae9f2ea28a36f48d4ed37bd7fc716e097b319bcf4d36a4a4f03",
|
||||
"tools/answer_evaluation/context_policy.py": "e7b7c511e5e9cafdef04969eb4007a6a61ac4b99bcc60e9e722945a15bec1f26",
|
||||
"tools/answer_evaluation/checked_generation.py": "7e017471e6281db62b79f270210db3ab14c7e31a4623bbfa3d9a5fd8911b1c20",
|
||||
"tools/answer_evaluation/answer_format.py": "86a27b4aebc6a5077e13794b81957a1cf063a1f3e070c583120ba53c1788d2f8",
|
||||
"tools/rag/evaluation/rag_metrics.py": "3e95922df90dd1b757a550040a2d9bd4f857e17d179f60170d7cc881a08f94b6",
|
||||
"tools/rag/evaluation/rag_runner.py": "031abf7d5b1a026eb199aa2a579bfb8baaa01175279d0018a364bfe50b76c3c1"
|
||||
},
|
||||
"dataset_sha256": "a7bb38be01e03603cf2fa2c7137817094dff0a0cbb3f801263609e55b28e9edc",
|
||||
"inputs": {
|
||||
"data/documents.json": "0542af2a373771cf7c4a95f93d14f4f687f6a0187846892c959aa6efc4bade52",
|
||||
"data/chunks.json": "437dde589be46e0c30842dd330de22d96a0173d2dbaff9c5f129568cb2bca4c9"
|
||||
},
|
||||
"source_corpus": {
|
||||
"sha256": "440da12a7a991824e923f70cada7c616c3fb3b0f12767ec7d75039a6a3231b10",
|
||||
"document_count": 114,
|
||||
"documents": {
|
||||
"pages/interns/bogdan_paul_chis/README.md": "3b4b946eb3c10e9f9a4092e6cffa01c5080e7579aded2f6ed3120c41ed62b647",
|
||||
"pages/interns/cesar_gutierrez/README.md": "b0be60576eed28d4b1920e9acf198684519373dfc13171567247c853b3ed699e",
|
||||
"pages/interns/oliver_pejic/README.md": "0470f3c8465be8f02204b08e4c75ef47f68c7e4ad1038faa5641cdf1811f33d5",
|
||||
"pages/interns/sevval_bulburu/README.md": "ff2a9d66253802f1af0fdfd74832e40fae41b6df23c5e61dc266f6cd0cc16c4d",
|
||||
"pages/interns/yussef_ressaissi/README.md": "f997a65699da0db3222ef7a3c37652d05dfc3419ad4ec74683bafc2c897bb987",
|
||||
"pages/students/2016/darius_lindvai/README.md": "fcaa47bb9708a6439eec5c4b7f7b4ed6c7359e423e1d940e1aed9f44957e6d62",
|
||||
"pages/students/2016/darius_lindvai/dp2021/README.md": "be3d0fea2a6d592b225eecabd9b19445c2fce62b8289c07ab6af93835db12970",
|
||||
"pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md": "352162de1b1e192228fa5d26506c028ac47e567e90df53b1bbaa6ad736ec4766",
|
||||
"pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md": "b4a81ff457624b089d618e4479afb1e3d748f6724f72104ef5518e535ae02fe5",
|
||||
"pages/students/2016/dominik_nagy/README.md": "1c4037a158d84c45fa705a0c38e47142a9d46e226f0c138bc2d56d7c38f6d74d",
|
||||
"pages/students/2016/dominik_nagy/timovy_projekt/README.md": "b81a4dab7316f7b846dcf36515f6aa9d44035c86f46f0e07b7a43308bcd31458",
|
||||
"pages/students/2016/ediz_morochovic/README.md": "045e5eb9a3df2b84140808fbca0c3163266ad0efa144bc42d9d5c597881c6ac6",
|
||||
"pages/students/2016/jakub_maruniak/README.md": "6734c41a95b9d0c1e3d226b393ad109ee4a7b82ebfffa73df2d7e0a743fefa14",
|
||||
"pages/students/2016/jakub_maruniak/dp2021/README.md": "9cd884aec70705cdb2aaa0f514b513f16de263c37b749ced7f92916cd2f91c39",
|
||||
"pages/students/2016/jakub_maruniak/dp2021/annotation/README.md": "debae0c50aea1accef0840912b9b1f37b2138f856002bb50e91d7ea2dbbe7963",
|
||||
"pages/students/2016/jakub_maruniak/dp2021/train_experiments/README.md": "01dff38b37043414fa1db204394ddbe7aade00e14d02d495572b65c85d09b194",
|
||||
"pages/students/2016/jakub_maruniak/timovy_projekt/README.md": "04114b1f3d84664aad5bdba5a0b614c5a6f23392be3c31fd9123d63db1be0a35",
|
||||
"pages/students/2016/jan_holp/README.md": "80d6a8492766e5bfa61673a372e5f059d30c8e335de39842866c51485960e4d3",
|
||||
"pages/students/2016/jan_holp/dp2021/README.md": "a62acb74009376766c7e2f9856ee01d21f84593eb9b3ce85cf2e6032aa412476",
|
||||
"pages/students/2016/jan_holp/dp2021/zdrojove_subory/README.md": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"pages/students/2016/jan_holp/timovy_projekt/README.md": "79eebdfd3af7e8d5c279077e285a580731b1cf8cc9b4454f6596796e9915f70c",
|
||||
"pages/students/2016/lukas_pokryvka/README.md": "f279456c5c277ff1ee0dd89a3464ed9f9f67b44bc185a5da9811ef5cfb675002",
|
||||
"pages/students/2016/lukas_pokryvka/dp2021/README.md": "39b61376ce108e4a930f926ab2d6a997207457121bccfcf617129a3b210a15cf",
|
||||
"pages/students/2016/lukas_pokryvka/timovy_projekt/README.md": "4de4b6c8cfed17b6c60090f82df1d55a66be70a79d3013850689b2baebdd801b",
|
||||
"pages/students/2016/mark_feher/README.md": "bec37c0319fe0869a0377d771db23d090dbda93c27328f5697cdaeb3bbccfe9b",
|
||||
"pages/students/2016/maros_harahus/README.md": "0da150e91918632c9e8cd1443f04da403595a372517e254928ce9f76c9d5033d",
|
||||
"pages/students/2016/maros_harahus/timovy_projekt/README.md": "75af19f7c68f4b646fa1dbae75f3f3dfc52633a9f9da1400d21808bb20be0d83",
|
||||
"pages/students/2016/patrik_pavlisin/README.md": "dc1c648d7cd9b0f0e021c57f9b98189e37c100871439e7e304390715913f2763",
|
||||
"pages/students/2016/patrik_pavlisin/dp21/README.md": "ac1eb0fd0360ad34aa21b7c8da5bb010a6edf10be5721f28dedc3986cd1d8c54",
|
||||
"pages/students/2016/patrik_pavlisin/dp22/README.md": "f2a8c619a812b99abab618ae388eb672407950e1f33fb8d7da7a528c4de81d50",
|
||||
"pages/students/2016/patrik_pavlisin/tp20/README.md": "ae9c771f27e7e093bc29c6888c8d0b27ed61fb41519fd0d7e7f4f6cbb4626edc",
|
||||
"pages/students/2016/tomas_kucharik/README.md": "6a1a215433eb1857660177b4cb2ecec03c6a86743d3a04cd6d5c9d9682c9e63b",
|
||||
"pages/students/2017/dmytro_ushatenko/README.md": "65f4ac177d492162b08ca5da3d9eb048bd088a3c117a28a662113b7e4bc3a4ec",
|
||||
"pages/students/2017/martin_jancura/README.md": "6a0a18d5095dcfb12abfdd72c9cfd8025d714fb5e29a7858cd2b285e4cb986b9",
|
||||
"pages/students/2017/stanislav_matsunych/README.md": "90ffa11eff4a4360b0252dbc53a116c3a5777b3d5dd86ce5c89c02bdd2051c73",
|
||||
"pages/students/2017/than_trung_thanh/README.md": "2150519b8580e7337520db4de64d2d1c82d2634380537d019f41c506dbf2979d",
|
||||
"pages/students/2018/NaN1name_buday/README.md": "23c8c58090bdc954347e36f141bea91f43c8d5b1d777e346864a2ebe84c0bcce",
|
||||
"pages/students/2018/adrian_remias/README.md": "e5bfe1d5d4e626beaa636a02d34ec58cf2cff9b0e57833905af35b80bf1465a2",
|
||||
"pages/students/2018/david_ilas/README.md": "96c45ff9c5a821ddcb1a2fc86d487bd8f4729d1b76887914b0f5fbf99af45af0",
|
||||
"pages/students/2018/david_omasta/README.md": "4164051870e1e1cf8949ed18a74196e9ea789dfbe4fee24bdeb736ca42848327",
|
||||
"pages/students/2018/martin_wencel/README.md": "0e6a7a981689f22304f8baa5de97d4315c0695c94c9277de7851943eb012253b",
|
||||
"pages/students/2018/oleh_bilykh/README.md": "4072c62dd8ee753a0c8fa43fdfbbdf566e394c2df13e6a79d08a302e332710b1",
|
||||
"pages/students/2018/ondrej_megela/README.md": "969ff2e1a436b8f957e7168cf5eb678196b99aeda17701c502b016441f644065",
|
||||
"pages/students/2018/samuel_sirotnik/README.md": "cc230ede67b6e8632511c92a5ed6d1e9deb42e70819280222bdfd369ee77fc70",
|
||||
"pages/students/2019/alina_vitko/README.md": "9b071fe2aff470c275ae027be236fe836f741f774cabb9cbbb55304a8d5102cd",
|
||||
"pages/students/2019/artem_yatsenko/README.md": "328b101e46c51c959e792cf7ca226942f81d2ab8fe9648ad6d0ecd07016429e2",
|
||||
"pages/students/2019/david_stromp/README.md": "e46ca8691d5ec894128f6f6f2ed33e2c7bd141f80719bb0449b20f10f30cca09",
|
||||
"pages/students/2019/dmytro_mural/README.md": "e881a47d847c3ef8d680844113fdbfbb87553b28982bf9eef4936f6d30923e93",
|
||||
"pages/students/2019/filip_tomas/README.md": "75a1fe7b921e4bff0fdf9e2a957b4adad4b4a57aa7ebdffbb73dd82c02123f94",
|
||||
"pages/students/2019/kristian_sopkovic/README.md": "3286960fb30f584df35455f9b6dfae81ca4827a1d711d2bcd6e48c3f150c9279",
|
||||
"pages/students/2019/michal_stromko/README.md": "3ae1dd9b6638a6a249a94be3f3846286555666aefa225bb3a2c7288b35900ce7",
|
||||
"pages/students/2019/michal_stromko/vp2021/README.md": "feb2e093fdd6461239e79b1e1f96e65a1c8cd96e8a2b70535ae556a9c198046a",
|
||||
"pages/students/2019/michal_stromko/vp2021/tutorials/README.md": "40e3fa448c7329ef863e705435e23fe6b4788de440710f066fe0eed92d132bad",
|
||||
"pages/students/2019/michal_stromko/vp2021/tutorials/img/README.md": "e8d3ac160b17dfdee2c3e996bf6a03af7a6f16f9140bf5cf7ee343a82dd1865f",
|
||||
"pages/students/2019/patrik_pokrivcak/README.md": "3e3957ad0f7aca59d6eb64c38a3f5e21d8fd953200825d0d0e5cacabfbc35a7d",
|
||||
"pages/students/2019/samuel_horani/README.md": "86e6959ccc612b069687b57996fa3f61660075d6a0d65bfec64f423d39a0a999",
|
||||
"pages/students/2020/david_kostilnik/README.md": "2927524b75da59a64120fc364a0fc374986fa4d364d54e52c36800762c203264",
|
||||
"pages/students/2020/jakub_kristian_lukas/README.md": "f139d9b1ebf5a3f45612f3df5703ecdd935b90701763c27c7c529044c0b0455a",
|
||||
"pages/students/2020/kamil_tomcufcik/README.md": "9d865adf538bc6d7992ee4f4882713447da5c936fca17c43ca0f576072537048",
|
||||
"pages/students/2020/matej_kobylan/README.md": "3d7b289e17b8f25678a07e9ee0e6741688485a0ccb1e50940a6a6acc6312a547",
|
||||
"pages/students/2020/matus_suchanic/README.md": "770ca49538cca22df35f8e7ba736ee97483e4fe5788c221496553592b4e78dc6",
|
||||
"pages/students/2020/pavol_hudak/README.md": "33d06fccc6451e5f19b27b0cad001a34e81635b4ea294a01dec7771c823abc40",
|
||||
"pages/students/2020/vladyslav_krupko/README.md": "4c28e6d38651bb2cafcbf4a18e35210cd369aef2caff6c5b0aa52fac38f0fe7d",
|
||||
"pages/students/2021/artur_hyrenko/README.md": "0568261f4ade4de5472edcfeb1ffed9abae18dc67e4050f4ce2ad088839a2bb3",
|
||||
"pages/students/2021/eduard_matovka/README.md": "de2a7ae38ec87110e347956b37d0605a298ed2847f972961cc9b977da8221d43",
|
||||
"pages/students/2021/manohar_gowdru_shridharu/README.md": "c00ceb620ed7087ead5d9448d476bbb98d273d1d9e7bf1bc4355c367b26c7a6b",
|
||||
"pages/students/2021/martin_sarissky/README.md": "8e97b45a253745faa55f63c844e0b5dfe680aeaf6eb01fb8f9d06ac6e8ee8bcf",
|
||||
"pages/students/2021/matej_novotny/README.md": "b083a7cadde532e3428dc9a57bc61456fcc5905bda91e011b96033d42bf5d9cb",
|
||||
"pages/students/2021/matej_scislak/README.md": "b9a32cce8605e044a4f2828ff2d91a2995a62ef3a841e62f0a225c97221f0cc8",
|
||||
"pages/students/2021/nikita_bodnar/README.md": "2016c0dd923c0f8e561d5cea42ac81da3610fdcc54a4527f56d078e34e53ce90",
|
||||
"pages/students/2021/oleksandr_hryshchenko/README.md": "4b073992b715b6c75b79fd2c8f850a69f940966e3a61a82c625c32c945a93036",
|
||||
"pages/students/2021/vladimir_ferko/README.md": "68e7d311896eda2171e5eec1ec3a8da90d326ed91acaace8058f68664a50d271",
|
||||
"pages/students/2022/andrii_pervashov/README.md": "319dcaa1cc2e29dd7e3a710bab26cb3ac6944ab71b0b97e1de076b1199122334",
|
||||
"pages/students/2022/daniil_huzenko/README.md": "390782fbff6220a9462060ce1a62959f2a2b88f42d06e2c51d1f406b75d73f2c",
|
||||
"pages/students/2022/jakub_schwarc/README.md": "f541a8852c2b0f6f9d7182e01a34c4e3beee9bfa55427a06b331638b11eb8be6",
|
||||
"pages/students/2022/jan_malinovsky/README.md": "8af021bfb131fa005a7aec3e2f2f12fc17fa5dc14e2675311adbbfc445a4bcab",
|
||||
"pages/students/2022/jan_ptak/README.md": "131cf053764fd5423541ebe672c3b4f5da875cfb8e4b821f1335ddb967282282",
|
||||
"pages/students/2022/oleh_poiasnik/README.md": "c2f7dc3f61f8b4a5b43ded1e3ae4c7d3e7f874439ee6b17dd9c8d45dabc25bc8",
|
||||
"pages/students/2022/samuel_vasil/README.md": "67c807049147aacd04f3050f4ff0233a8b3f0a239ab173b430e13dfe113ad0a5",
|
||||
"pages/students/2022/serhii_yemets/README.md": "ffbeac893947acafe855d576322a8826f9d4f87ac344cb31f8ceeefa244b9133",
|
||||
"pages/students/2022/tetiana_mohorian/README.md": "c9efdc632bf1ca89a0bfde0dc00be7aaac8a85da3d92e2ce8506236c73e93cfb",
|
||||
"pages/students/2022/valerii_kutsenko/README.md": "dc764c609ad3c1df59cfea997d4db82a591b1b1e0764453e319d841115507e4f",
|
||||
"pages/students/2022/vladyslav_yanchenko/README.md": "4d1ce216e3b526ee437ddbc658e51d7bb83530087e43628c096a569a3854a47f",
|
||||
"pages/students/2022/yevhenii_leonov/README.md": "b90e41db0cec2451027020a9102d32a24d777e8a38b604ccca87b36cd6b3a292",
|
||||
"pages/students/2023/denis_le_thanh/README.md": "2cb83f942d86a02712b0c58778e46dc2211346d1a6eba606471dfa832245db61",
|
||||
"pages/students/2023/maksym_zatirka/README.md": "7a7d2cbe276c352dacfbc6ba6de5f15303d30ecf34845ff8da8d085f3d67c3dd",
|
||||
"pages/students/2023/oleksandr_dorybohov/README.md": "c24d6f941de0dafb4459cea8259cf147821cafc86ba65be5b528f419f734bc18",
|
||||
"pages/students/2023/ronald_zalacko/README.md": "724b0f8e6e641236dba9bddbd77f4546e09514076c7dfb151807aaf4b882c96f",
|
||||
"pages/students/2023/rostyslav_rodzhuk/README.md": "de356dd7427c8a0716c165a0f88ae47b691a86ee7a388f60e2d2e9306298415c",
|
||||
"pages/students/2023/samuel_dzurina/README.md": "4818191d044b91219c796a35010c95da5cf2093e050d494f30b219b91e13fa0e",
|
||||
"pages/students/2023/simona_bobrovcanova/README.md": "e473a1911dae10ab40e2cf6696a8be616a58c22aaf09af5953fbac475791a35e",
|
||||
"pages/students/2023/yevhenii_medushivskyi/README.md": "5710ebf91c893a12fe6d19f5372311938d1e7c7bbdf203f2dc8ed2fe7c4f5a24",
|
||||
"pages/topics/akopisat/README.md": "c7245e1fbfa4160618502c0baf8cc6bc47cd9a82b8a85bc1c645314829a7b76a",
|
||||
"pages/topics/bert/README.md": "35e507f7ec2ad1d3526e2a15f94ea085ee25f680a02daf6df62fd429bd9c25c9",
|
||||
"pages/topics/chatbot/README.md": "6f2f83ffb80109be47f9750cca9d3036ec3645abef9f2b590bd6825780c7c48a",
|
||||
"pages/topics/faq/README.md": "15cfbd9c2a1649c80a7a58922e2b66dadab5c86a5ef33ef16c82bebd4d2dbf06",
|
||||
"pages/topics/hatespeech/README.md": "364df94e70dd740c63544e2586ba7b957780f714fc0c941d1b04b02233e6cbc5",
|
||||
"pages/topics/legal/README.md": "003bb9bfe1e0ca21652091c2d11496312eb04e0689fe459e14c2d5a738e8eeea",
|
||||
"pages/topics/morphology/README.md": "e242cc5ff1a4cc98e227566c0ead999bbc95937b7c20be62cb2afb773d0d35c0",
|
||||
"pages/topics/named-entity/README.md": "66b2e25f70211d432d596e377d552b3b8f0c525b14c31e3bc9c956c3aeadca84",
|
||||
"pages/topics/named-entity/navod/README.md": "1ff87079a98411de0414754c60241e08d2214ddcd63ddf974e4340cce2ce5b02",
|
||||
"pages/topics/nlp/README.md": "6f90abf9dc3f0ff33475283c13b4a08561abf631425ec2daacb076155a9e02c2",
|
||||
"pages/topics/otvorene/README.md": "cd5544925553fe3840c0ea6f8ef60ab756e26ab6757bf810025c948d8d4f98fc",
|
||||
"pages/topics/prodigy/README.md": "5e4f691f2754c2ec4afbaab2f41e6db77feb5b322dd9344465eb40c35f116499",
|
||||
"pages/topics/python/README.md": "2ef073adba672142c39e9a59fa2e00a98ab52bda54233d46fbe6940ee23f9fcc",
|
||||
"pages/topics/question/README.md": "408078a2a67cea2699e12359e85ab641136231e6104c2afdf874a705879525df",
|
||||
"pages/topics/question/navod/README.md": "061e737c69184b2bd244316ca7ba841f7186fe01ee80ee993742a733dcad3ecd",
|
||||
"pages/topics/question/nezodpovedatelne/README.md": "b6703d9690f4599b973efb27595ce157773ae0fc0d55cf2c0a09d9f50e8e4c92",
|
||||
"pages/topics/question/validacie/README.md": "3216a7127abdfc6da50ed116f44ff2d6785e7da4af70d23aceda774e745ad562",
|
||||
"pages/topics/resources/README.md": "09405397387f00cbcc5680f7d655f2d861e4d92e5df792a62d9dfd04f3534f48",
|
||||
"pages/topics/seq2seq/README.md": "969d15c03a63a3f8d5edc9017fe5a0fb7311fdf4de4a3473a08266241f92c1e2",
|
||||
"pages/topics/spacy/README.md": "f504e5db77cb8694f08a57fb8636e522d59a0e669216f4bc8273bc3c5f375f87",
|
||||
"pages/topics/steel/README.md": "b4068cef2ed197711467ac47630d5b2064fdc8828f898f7af99664e94d833330",
|
||||
"pages/topics/translation/README.md": "a7d4289e72199b307dc5ad8fc69cda39c1a33c27a6c7447af70aa9c3cc6b8635"
|
||||
}
|
||||
},
|
||||
"retrieval_policy": {
|
||||
"published_only": true,
|
||||
"publication_policy": "explicit-false-hidden-v1",
|
||||
"academic_preparation_is_work": false
|
||||
}
|
||||
},
|
||||
"graph": {
|
||||
"sha256": "6fd45dc58382641072d991a088fcdfcd1c0e81ce912befbae6fca700d630fe01",
|
||||
"nodes": 446,
|
||||
"relationships": 877
|
||||
},
|
||||
"parameters": {
|
||||
"limit": 40,
|
||||
"max_entities": 8
|
||||
},
|
||||
"dev_summary": {
|
||||
"questions": 722,
|
||||
"source_checked_count": 722,
|
||||
"all_facts_supported_count": 722,
|
||||
"strict_count": 722,
|
||||
"strict_accuracy": 1.0,
|
||||
"error_count": 0,
|
||||
"value_score": 1.0,
|
||||
"entity_score": 1.0,
|
||||
"relation_score": 1.0,
|
||||
"property_score": 1.0,
|
||||
"relation_choice_score": 1.0,
|
||||
"document_recall": 1.0,
|
||||
"source_recall": 1.0,
|
||||
"binding_score": 1.0,
|
||||
"path_score": 1.0,
|
||||
"answerability_accuracy": 1.0,
|
||||
"latency_mean_seconds": 0.051461,
|
||||
"latency_median_seconds": 0.04753,
|
||||
"latency_p95_seconds": 0.079209
|
||||
},
|
||||
"source_audit_summary": {
|
||||
"dev": {
|
||||
"questions": 722,
|
||||
"source_consistent": 722,
|
||||
"issues": {}
|
||||
},
|
||||
"test": {
|
||||
"questions": 320,
|
||||
"source_consistent": 320,
|
||||
"issues": {}
|
||||
}
|
||||
},
|
||||
"policy": "Report all questions including negatives. No exclusions or holdout tuning.",
|
||||
"dev_results_sha256": "d4ac47c21aed4be149a3f1aec1f7658c862da2ee24e41cc680128d013a071707",
|
||||
"audit_sha256": "d5922db25b6d40cb7e5dc7df7990e93a3caee263a6e747ae910ab340da340023"
|
||||
}
|
||||
252
tools/graphrag/evaluation/frozen_v7.json
Normal file
252
tools/graphrag/evaluation/frozen_v7.json
Normal file
@ -0,0 +1,252 @@
|
||||
{
|
||||
"schema_version": 2,
|
||||
"evaluation_kind": "independent_holdout",
|
||||
"partition": {
|
||||
"method": "disjoint logical query groups",
|
||||
"logical_group_overlap": 0,
|
||||
"previously_exposed_test_groups": 0,
|
||||
"dev_group_count": 901,
|
||||
"test_group_count": 80,
|
||||
"dev_profile_count": 72,
|
||||
"test_profile_count": 55,
|
||||
"source_profile_overlap": 55,
|
||||
"limitations": [
|
||||
"Known corpus, persons and template families; only the query/fact combinations are fresh.",
|
||||
"Two remaining document-author/category groups and seven category-list groups constrain category coverage.",
|
||||
"AI source annotation, not human annotation. No tuning on this TEST."
|
||||
]
|
||||
},
|
||||
"frozen_at_utc": "2026-10-26T00:14:20.132176+00:00",
|
||||
"fingerprints": {
|
||||
"implementation": {
|
||||
"tools/graphrag/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/build_graphrag.py": "256292101d6d7d1946e926e2717ac45465b169f4091c51ecfed4f1a779dfd700",
|
||||
"tools/graphrag/evaluation/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/evaluation/audit_benchmark.py": "6619c818a52fc284e87ed6c48a503a54a3c9dd95447463ed78f075b7c58bad80",
|
||||
"tools/graphrag/evaluation/benchmark_v2.py": "62a0b6af852d5ae8060c06db3f983ef4b797d74443f9df25a6b8bd77bf133330",
|
||||
"tools/graphrag/evaluation/benchmark_v3.py": "30bae6c605ed26f4b49973acec799087c4e2b97a883ccedcafb965dd909c4c4d",
|
||||
"tools/graphrag/evaluation/benchmark_v4.py": "7a731fe649d3d5170045b8bbcabf31ad527e5d26a934d434a4be3a4c94dc5c38",
|
||||
"tools/graphrag/evaluation/benchmark_v6.py": "f955e600d17358fafcb33bab772aef09d787452f6b33352e299fdd42669aaf34",
|
||||
"tools/graphrag/evaluation/benchmark_v7.py": "9477cd6e9a6dd0558837cf044535de75a8f101b17115e28e57a82d96d1aa01cb",
|
||||
"tools/graphrag/evaluation/check_openwebui.py": "863801048231d474ba82930cf6bf6853b4410f8295b3f97fd3d5934852431fbe",
|
||||
"tools/graphrag/evaluation/evaluate_graphrag.py": "22f48e9ac6dfae92d79ad648ca173547c6a37f98aa8199f7c37595f1b0b186f9",
|
||||
"tools/graphrag/evaluation/evidence_contract.py": "78e24264c176e163e1782fef1634b6c45c7f31bd4692726d02a30ab45a06648e",
|
||||
"tools/graphrag/evaluation/freeze_graphrag.py": "d8764d1aeb72208de55604785acff880002da1f818d8a8ad9477cf39e1f29efb",
|
||||
"tools/graphrag/evaluation/graphrag_evaluator.py": "7f99bf0f97974058650b619ea49a8ee32284cb4b324f1ffab9baf54f5c4495f4",
|
||||
"tools/graphrag/evaluation/reproducibility.py": "0e2dab6ffb17691f05f9d81dbec12ffc0f2e4e0b1a2114a75b66a5165cf7b4d2",
|
||||
"tools/graphrag/evaluation/source_oracle.py": "aed0309435fd21bc274fde7905a0720f68f359b3c30bb0b912e3371ebf0d8072",
|
||||
"tools/graphrag/evaluation/source_validation.py": "9671b8978623888dbed8b8b2d1b6b01c1ce73cb0a512b03919e48873990f15ed",
|
||||
"tools/graphrag/graph_db.py": "c4b1a2edb765856b807398e4c243a8d17753529a5d2dfdb51791e28bc8de17f7",
|
||||
"tools/graphrag/graph_search.py": "c41cbfbac0d5daa1d0b51f5f4b798a15688bbd2e0498d2cbe93c6584a99f6b7d",
|
||||
"tools/graphrag/graphrag.py": "dbc75403aa038e4021b5a70d1f17c62784b478252a94bac8db682bf38dcb39b3",
|
||||
"tools/graphrag/neo4j_smoke.py": "fb5244c72c29ef2acf96d1e7f54335ff168eed4119db1692025eb1b99194b7bb",
|
||||
"tools/graphrag/publication.py": "fba1fa0d0bed325fd87f8d3593baae9271de1766b772d7214c7f63fd3f1c37b6",
|
||||
"tools/graphrag/tests/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/tests/test_evaluation_pipeline_v2.py": "63d1b3e80ae3c7b563374fd7ab4aa5ffad3c614eafbd15142c577abd7f756bf9",
|
||||
"tools/graphrag/tests/test_evaluation_v5.py": "9387e9d1418ebab87530986b0e29dac31cf33d762777a29a31cff24cc72e552a",
|
||||
"tools/graphrag/tests/test_evaluation_wide.py": "1b28bb74fd6b9457c869186b88606f1f7863d573aa3ab5226162e878f236d99e",
|
||||
"tools/graphrag/tests/test_evaluator_connected_v2.py": "29d7c9838ed1ff37ea3276df6feb1b6142158c43a0525712f490b648181882de",
|
||||
"tools/graphrag/tests/test_graph_publication.py": "96e53c1ae28e36c7a4290e1e60c8b398bf095ceaf883e819e1a477e2672b11c0",
|
||||
"tools/graphrag/tests/test_graph_rebuild_atomic.py": "fe37d4fff0b1f0fb1d565f0a96152b9b4e336837bc78b5977cf3b4879d7fbaf3",
|
||||
"tools/graphrag/tests/test_graph_search.py": "eb58661aef9dafe6bf7188fcdc2d79cef6652d57c64d1b81ae81a52e8e0204d7",
|
||||
"tools/graphrag/tests/test_graph_search_entity_v2.py": "0ef1a8ebd513c5a4507eb38fcf5ae6137c69e9901b5a2975ba513be5902ac693",
|
||||
"tools/graphrag/tests/test_graph_search_neo4j.py": "fec2bf72de8f752f17c9164fee5754bdb2e153828855e47efbf0000dbe82cf3b",
|
||||
"tools/graphrag/tests/test_graph_search_regressions.py": "9db7779aeb8ed9e8c0f92c1657011a81080aff3c928649e811358e3009a18c48",
|
||||
"tools/graphrag/tests/test_graphrag.py": "9ee8629d6b528dd78c2ddfc25cee95e17613f45b454fc0a38d4c591862637a9f",
|
||||
"tools/graphrag/tests/test_graphrag_evaluator.py": "1c6d08aeec9ae56ac4123239a5aed12a0081d66cc3f34b2047d95764579d7298",
|
||||
"tools/graphrag/tests/test_graphrag_freeze.py": "c4b760baf4c7ebf13b16bd4cd3c51874f5512eef3b4c61470dc4d428b0303d9f",
|
||||
"tools/graphrag/tests/test_graphrag_research_v2.py": "711008a91ab8a58ae0854e7f90329bcd42e5189fde2e2001589e97b0c22c5198",
|
||||
"tools/graphrag/tests/test_graphrag_root_title.py": "085651fe6e6081521a5dde9554abfee93456250108cf15978df25378d886a46c",
|
||||
"tools/graphrag/tests/test_source_oracle_v2.py": "0afdbe235e185ffe9f38aa667f90f5a6c20504fe29e9ac572642b39a8eb7faca",
|
||||
"tools/graphrag/tests/test_title_labels.py": "2983ead68ad6e2e346d24af0fc96dc6771c163e9c2a351af426a1e0383998e6f",
|
||||
"requirements.txt": "26a6d097727eba03c1b6c71cd02b06373ef01ce03e567dd2bc4357ae330e5a1a",
|
||||
"tools/publication.py": "f99d445073390a733afc8d849b9fcd4b4b0890bb54d136db67d4015b78436e1a",
|
||||
"tools/retrieval_contract.py": "b8fa272c3babf924a3ce8b937fe7ae437cd959ba9f7667193ac67c18d2c5b58d",
|
||||
"tools/index_state.py": "c33920a63d04009f11ef23ca9e9eee9bf86453b7d0586d027bf3b39156afea0d",
|
||||
"tools/rag/common.py": "8497c46d5c6c27a7c76df1568360ad5e9d00d5e5a7ef186e758960cc79d81d1c",
|
||||
"tools/sync_indexes.py": "5b909b4394c24e5ce22848594b16d9aea45fb06418f5cd92bb6aa6381a0ccf10",
|
||||
"tools/rag/rag_utils.py": "4f898cf0facc2ae9f2ea28a36f48d4ed37bd7fc716e097b319bcf4d36a4a4f03",
|
||||
"tools/answer_evaluation/context_policy.py": "0dc2a056ca0d886d7cc8248ed4632c910c5e35bebd03ef94573df41802297f47",
|
||||
"tools/answer_evaluation/checked_generation.py": "cb821a65327424c19cbd996190b14e6aa30d9b909493f11716552f71249a0529",
|
||||
"tools/answer_evaluation/answer_format.py": "86a27b4aebc6a5077e13794b81957a1cf063a1f3e070c583120ba53c1788d2f8",
|
||||
"tools/answer_evaluation/render_answer.py": "609c534a37899b3febcea32d983da4b806c287de8f2ddf9bc0675e3280859002",
|
||||
"tools/rag/evaluation/rag_metrics.py": "3e95922df90dd1b757a550040a2d9bd4f857e17d179f60170d7cc881a08f94b6",
|
||||
"tools/rag/evaluation/rag_runner.py": "031abf7d5b1a026eb199aa2a579bfb8baaa01175279d0018a364bfe50b76c3c1"
|
||||
},
|
||||
"dataset_sha256": "0f78e9749de369d752b6e1079f174cf3f6b390f4718a672119dfd43fa5d9dfac",
|
||||
"inputs": {
|
||||
"data/documents.json": "0542af2a373771cf7c4a95f93d14f4f687f6a0187846892c959aa6efc4bade52",
|
||||
"data/chunks.json": "437dde589be46e0c30842dd330de22d96a0173d2dbaff9c5f129568cb2bca4c9"
|
||||
},
|
||||
"source_corpus": {
|
||||
"sha256": "440da12a7a991824e923f70cada7c616c3fb3b0f12767ec7d75039a6a3231b10",
|
||||
"document_count": 114,
|
||||
"documents": {
|
||||
"pages/interns/bogdan_paul_chis/README.md": "3b4b946eb3c10e9f9a4092e6cffa01c5080e7579aded2f6ed3120c41ed62b647",
|
||||
"pages/interns/cesar_gutierrez/README.md": "b0be60576eed28d4b1920e9acf198684519373dfc13171567247c853b3ed699e",
|
||||
"pages/interns/oliver_pejic/README.md": "0470f3c8465be8f02204b08e4c75ef47f68c7e4ad1038faa5641cdf1811f33d5",
|
||||
"pages/interns/sevval_bulburu/README.md": "ff2a9d66253802f1af0fdfd74832e40fae41b6df23c5e61dc266f6cd0cc16c4d",
|
||||
"pages/interns/yussef_ressaissi/README.md": "f997a65699da0db3222ef7a3c37652d05dfc3419ad4ec74683bafc2c897bb987",
|
||||
"pages/students/2016/darius_lindvai/README.md": "fcaa47bb9708a6439eec5c4b7f7b4ed6c7359e423e1d940e1aed9f44957e6d62",
|
||||
"pages/students/2016/darius_lindvai/dp2021/README.md": "be3d0fea2a6d592b225eecabd9b19445c2fce62b8289c07ab6af93835db12970",
|
||||
"pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md": "352162de1b1e192228fa5d26506c028ac47e567e90df53b1bbaa6ad736ec4766",
|
||||
"pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md": "b4a81ff457624b089d618e4479afb1e3d748f6724f72104ef5518e535ae02fe5",
|
||||
"pages/students/2016/dominik_nagy/README.md": "1c4037a158d84c45fa705a0c38e47142a9d46e226f0c138bc2d56d7c38f6d74d",
|
||||
"pages/students/2016/dominik_nagy/timovy_projekt/README.md": "b81a4dab7316f7b846dcf36515f6aa9d44035c86f46f0e07b7a43308bcd31458",
|
||||
"pages/students/2016/ediz_morochovic/README.md": "045e5eb9a3df2b84140808fbca0c3163266ad0efa144bc42d9d5c597881c6ac6",
|
||||
"pages/students/2016/jakub_maruniak/README.md": "6734c41a95b9d0c1e3d226b393ad109ee4a7b82ebfffa73df2d7e0a743fefa14",
|
||||
"pages/students/2016/jakub_maruniak/dp2021/README.md": "9cd884aec70705cdb2aaa0f514b513f16de263c37b749ced7f92916cd2f91c39",
|
||||
"pages/students/2016/jakub_maruniak/dp2021/annotation/README.md": "debae0c50aea1accef0840912b9b1f37b2138f856002bb50e91d7ea2dbbe7963",
|
||||
"pages/students/2016/jakub_maruniak/dp2021/train_experiments/README.md": "01dff38b37043414fa1db204394ddbe7aade00e14d02d495572b65c85d09b194",
|
||||
"pages/students/2016/jakub_maruniak/timovy_projekt/README.md": "04114b1f3d84664aad5bdba5a0b614c5a6f23392be3c31fd9123d63db1be0a35",
|
||||
"pages/students/2016/jan_holp/README.md": "80d6a8492766e5bfa61673a372e5f059d30c8e335de39842866c51485960e4d3",
|
||||
"pages/students/2016/jan_holp/dp2021/README.md": "a62acb74009376766c7e2f9856ee01d21f84593eb9b3ce85cf2e6032aa412476",
|
||||
"pages/students/2016/jan_holp/dp2021/zdrojove_subory/README.md": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"pages/students/2016/jan_holp/timovy_projekt/README.md": "79eebdfd3af7e8d5c279077e285a580731b1cf8cc9b4454f6596796e9915f70c",
|
||||
"pages/students/2016/lukas_pokryvka/README.md": "f279456c5c277ff1ee0dd89a3464ed9f9f67b44bc185a5da9811ef5cfb675002",
|
||||
"pages/students/2016/lukas_pokryvka/dp2021/README.md": "39b61376ce108e4a930f926ab2d6a997207457121bccfcf617129a3b210a15cf",
|
||||
"pages/students/2016/lukas_pokryvka/timovy_projekt/README.md": "4de4b6c8cfed17b6c60090f82df1d55a66be70a79d3013850689b2baebdd801b",
|
||||
"pages/students/2016/mark_feher/README.md": "bec37c0319fe0869a0377d771db23d090dbda93c27328f5697cdaeb3bbccfe9b",
|
||||
"pages/students/2016/maros_harahus/README.md": "0da150e91918632c9e8cd1443f04da403595a372517e254928ce9f76c9d5033d",
|
||||
"pages/students/2016/maros_harahus/timovy_projekt/README.md": "75af19f7c68f4b646fa1dbae75f3f3dfc52633a9f9da1400d21808bb20be0d83",
|
||||
"pages/students/2016/patrik_pavlisin/README.md": "dc1c648d7cd9b0f0e021c57f9b98189e37c100871439e7e304390715913f2763",
|
||||
"pages/students/2016/patrik_pavlisin/dp21/README.md": "ac1eb0fd0360ad34aa21b7c8da5bb010a6edf10be5721f28dedc3986cd1d8c54",
|
||||
"pages/students/2016/patrik_pavlisin/dp22/README.md": "f2a8c619a812b99abab618ae388eb672407950e1f33fb8d7da7a528c4de81d50",
|
||||
"pages/students/2016/patrik_pavlisin/tp20/README.md": "ae9c771f27e7e093bc29c6888c8d0b27ed61fb41519fd0d7e7f4f6cbb4626edc",
|
||||
"pages/students/2016/tomas_kucharik/README.md": "6a1a215433eb1857660177b4cb2ecec03c6a86743d3a04cd6d5c9d9682c9e63b",
|
||||
"pages/students/2017/dmytro_ushatenko/README.md": "65f4ac177d492162b08ca5da3d9eb048bd088a3c117a28a662113b7e4bc3a4ec",
|
||||
"pages/students/2017/martin_jancura/README.md": "6a0a18d5095dcfb12abfdd72c9cfd8025d714fb5e29a7858cd2b285e4cb986b9",
|
||||
"pages/students/2017/stanislav_matsunych/README.md": "90ffa11eff4a4360b0252dbc53a116c3a5777b3d5dd86ce5c89c02bdd2051c73",
|
||||
"pages/students/2017/than_trung_thanh/README.md": "2150519b8580e7337520db4de64d2d1c82d2634380537d019f41c506dbf2979d",
|
||||
"pages/students/2018/NaN1name_buday/README.md": "23c8c58090bdc954347e36f141bea91f43c8d5b1d777e346864a2ebe84c0bcce",
|
||||
"pages/students/2018/adrian_remias/README.md": "e5bfe1d5d4e626beaa636a02d34ec58cf2cff9b0e57833905af35b80bf1465a2",
|
||||
"pages/students/2018/david_ilas/README.md": "96c45ff9c5a821ddcb1a2fc86d487bd8f4729d1b76887914b0f5fbf99af45af0",
|
||||
"pages/students/2018/david_omasta/README.md": "4164051870e1e1cf8949ed18a74196e9ea789dfbe4fee24bdeb736ca42848327",
|
||||
"pages/students/2018/martin_wencel/README.md": "0e6a7a981689f22304f8baa5de97d4315c0695c94c9277de7851943eb012253b",
|
||||
"pages/students/2018/oleh_bilykh/README.md": "4072c62dd8ee753a0c8fa43fdfbbdf566e394c2df13e6a79d08a302e332710b1",
|
||||
"pages/students/2018/ondrej_megela/README.md": "969ff2e1a436b8f957e7168cf5eb678196b99aeda17701c502b016441f644065",
|
||||
"pages/students/2018/samuel_sirotnik/README.md": "cc230ede67b6e8632511c92a5ed6d1e9deb42e70819280222bdfd369ee77fc70",
|
||||
"pages/students/2019/alina_vitko/README.md": "9b071fe2aff470c275ae027be236fe836f741f774cabb9cbbb55304a8d5102cd",
|
||||
"pages/students/2019/artem_yatsenko/README.md": "328b101e46c51c959e792cf7ca226942f81d2ab8fe9648ad6d0ecd07016429e2",
|
||||
"pages/students/2019/david_stromp/README.md": "e46ca8691d5ec894128f6f6f2ed33e2c7bd141f80719bb0449b20f10f30cca09",
|
||||
"pages/students/2019/dmytro_mural/README.md": "e881a47d847c3ef8d680844113fdbfbb87553b28982bf9eef4936f6d30923e93",
|
||||
"pages/students/2019/filip_tomas/README.md": "75a1fe7b921e4bff0fdf9e2a957b4adad4b4a57aa7ebdffbb73dd82c02123f94",
|
||||
"pages/students/2019/kristian_sopkovic/README.md": "3286960fb30f584df35455f9b6dfae81ca4827a1d711d2bcd6e48c3f150c9279",
|
||||
"pages/students/2019/michal_stromko/README.md": "3ae1dd9b6638a6a249a94be3f3846286555666aefa225bb3a2c7288b35900ce7",
|
||||
"pages/students/2019/michal_stromko/vp2021/README.md": "feb2e093fdd6461239e79b1e1f96e65a1c8cd96e8a2b70535ae556a9c198046a",
|
||||
"pages/students/2019/michal_stromko/vp2021/tutorials/README.md": "40e3fa448c7329ef863e705435e23fe6b4788de440710f066fe0eed92d132bad",
|
||||
"pages/students/2019/michal_stromko/vp2021/tutorials/img/README.md": "e8d3ac160b17dfdee2c3e996bf6a03af7a6f16f9140bf5cf7ee343a82dd1865f",
|
||||
"pages/students/2019/patrik_pokrivcak/README.md": "3e3957ad0f7aca59d6eb64c38a3f5e21d8fd953200825d0d0e5cacabfbc35a7d",
|
||||
"pages/students/2019/samuel_horani/README.md": "86e6959ccc612b069687b57996fa3f61660075d6a0d65bfec64f423d39a0a999",
|
||||
"pages/students/2020/david_kostilnik/README.md": "2927524b75da59a64120fc364a0fc374986fa4d364d54e52c36800762c203264",
|
||||
"pages/students/2020/jakub_kristian_lukas/README.md": "f139d9b1ebf5a3f45612f3df5703ecdd935b90701763c27c7c529044c0b0455a",
|
||||
"pages/students/2020/kamil_tomcufcik/README.md": "9d865adf538bc6d7992ee4f4882713447da5c936fca17c43ca0f576072537048",
|
||||
"pages/students/2020/matej_kobylan/README.md": "3d7b289e17b8f25678a07e9ee0e6741688485a0ccb1e50940a6a6acc6312a547",
|
||||
"pages/students/2020/matus_suchanic/README.md": "770ca49538cca22df35f8e7ba736ee97483e4fe5788c221496553592b4e78dc6",
|
||||
"pages/students/2020/pavol_hudak/README.md": "33d06fccc6451e5f19b27b0cad001a34e81635b4ea294a01dec7771c823abc40",
|
||||
"pages/students/2020/vladyslav_krupko/README.md": "4c28e6d38651bb2cafcbf4a18e35210cd369aef2caff6c5b0aa52fac38f0fe7d",
|
||||
"pages/students/2021/artur_hyrenko/README.md": "0568261f4ade4de5472edcfeb1ffed9abae18dc67e4050f4ce2ad088839a2bb3",
|
||||
"pages/students/2021/eduard_matovka/README.md": "de2a7ae38ec87110e347956b37d0605a298ed2847f972961cc9b977da8221d43",
|
||||
"pages/students/2021/manohar_gowdru_shridharu/README.md": "c00ceb620ed7087ead5d9448d476bbb98d273d1d9e7bf1bc4355c367b26c7a6b",
|
||||
"pages/students/2021/martin_sarissky/README.md": "8e97b45a253745faa55f63c844e0b5dfe680aeaf6eb01fb8f9d06ac6e8ee8bcf",
|
||||
"pages/students/2021/matej_novotny/README.md": "b083a7cadde532e3428dc9a57bc61456fcc5905bda91e011b96033d42bf5d9cb",
|
||||
"pages/students/2021/matej_scislak/README.md": "b9a32cce8605e044a4f2828ff2d91a2995a62ef3a841e62f0a225c97221f0cc8",
|
||||
"pages/students/2021/nikita_bodnar/README.md": "2016c0dd923c0f8e561d5cea42ac81da3610fdcc54a4527f56d078e34e53ce90",
|
||||
"pages/students/2021/oleksandr_hryshchenko/README.md": "4b073992b715b6c75b79fd2c8f850a69f940966e3a61a82c625c32c945a93036",
|
||||
"pages/students/2021/vladimir_ferko/README.md": "68e7d311896eda2171e5eec1ec3a8da90d326ed91acaace8058f68664a50d271",
|
||||
"pages/students/2022/andrii_pervashov/README.md": "319dcaa1cc2e29dd7e3a710bab26cb3ac6944ab71b0b97e1de076b1199122334",
|
||||
"pages/students/2022/daniil_huzenko/README.md": "390782fbff6220a9462060ce1a62959f2a2b88f42d06e2c51d1f406b75d73f2c",
|
||||
"pages/students/2022/jakub_schwarc/README.md": "f541a8852c2b0f6f9d7182e01a34c4e3beee9bfa55427a06b331638b11eb8be6",
|
||||
"pages/students/2022/jan_malinovsky/README.md": "8af021bfb131fa005a7aec3e2f2f12fc17fa5dc14e2675311adbbfc445a4bcab",
|
||||
"pages/students/2022/jan_ptak/README.md": "131cf053764fd5423541ebe672c3b4f5da875cfb8e4b821f1335ddb967282282",
|
||||
"pages/students/2022/oleh_poiasnik/README.md": "c2f7dc3f61f8b4a5b43ded1e3ae4c7d3e7f874439ee6b17dd9c8d45dabc25bc8",
|
||||
"pages/students/2022/samuel_vasil/README.md": "67c807049147aacd04f3050f4ff0233a8b3f0a239ab173b430e13dfe113ad0a5",
|
||||
"pages/students/2022/serhii_yemets/README.md": "ffbeac893947acafe855d576322a8826f9d4f87ac344cb31f8ceeefa244b9133",
|
||||
"pages/students/2022/tetiana_mohorian/README.md": "c9efdc632bf1ca89a0bfde0dc00be7aaac8a85da3d92e2ce8506236c73e93cfb",
|
||||
"pages/students/2022/valerii_kutsenko/README.md": "dc764c609ad3c1df59cfea997d4db82a591b1b1e0764453e319d841115507e4f",
|
||||
"pages/students/2022/vladyslav_yanchenko/README.md": "4d1ce216e3b526ee437ddbc658e51d7bb83530087e43628c096a569a3854a47f",
|
||||
"pages/students/2022/yevhenii_leonov/README.md": "b90e41db0cec2451027020a9102d32a24d777e8a38b604ccca87b36cd6b3a292",
|
||||
"pages/students/2023/denis_le_thanh/README.md": "2cb83f942d86a02712b0c58778e46dc2211346d1a6eba606471dfa832245db61",
|
||||
"pages/students/2023/maksym_zatirka/README.md": "7a7d2cbe276c352dacfbc6ba6de5f15303d30ecf34845ff8da8d085f3d67c3dd",
|
||||
"pages/students/2023/oleksandr_dorybohov/README.md": "c24d6f941de0dafb4459cea8259cf147821cafc86ba65be5b528f419f734bc18",
|
||||
"pages/students/2023/ronald_zalacko/README.md": "724b0f8e6e641236dba9bddbd77f4546e09514076c7dfb151807aaf4b882c96f",
|
||||
"pages/students/2023/rostyslav_rodzhuk/README.md": "de356dd7427c8a0716c165a0f88ae47b691a86ee7a388f60e2d2e9306298415c",
|
||||
"pages/students/2023/samuel_dzurina/README.md": "4818191d044b91219c796a35010c95da5cf2093e050d494f30b219b91e13fa0e",
|
||||
"pages/students/2023/simona_bobrovcanova/README.md": "e473a1911dae10ab40e2cf6696a8be616a58c22aaf09af5953fbac475791a35e",
|
||||
"pages/students/2023/yevhenii_medushivskyi/README.md": "5710ebf91c893a12fe6d19f5372311938d1e7c7bbdf203f2dc8ed2fe7c4f5a24",
|
||||
"pages/topics/akopisat/README.md": "c7245e1fbfa4160618502c0baf8cc6bc47cd9a82b8a85bc1c645314829a7b76a",
|
||||
"pages/topics/bert/README.md": "35e507f7ec2ad1d3526e2a15f94ea085ee25f680a02daf6df62fd429bd9c25c9",
|
||||
"pages/topics/chatbot/README.md": "6f2f83ffb80109be47f9750cca9d3036ec3645abef9f2b590bd6825780c7c48a",
|
||||
"pages/topics/faq/README.md": "15cfbd9c2a1649c80a7a58922e2b66dadab5c86a5ef33ef16c82bebd4d2dbf06",
|
||||
"pages/topics/hatespeech/README.md": "364df94e70dd740c63544e2586ba7b957780f714fc0c941d1b04b02233e6cbc5",
|
||||
"pages/topics/legal/README.md": "003bb9bfe1e0ca21652091c2d11496312eb04e0689fe459e14c2d5a738e8eeea",
|
||||
"pages/topics/morphology/README.md": "e242cc5ff1a4cc98e227566c0ead999bbc95937b7c20be62cb2afb773d0d35c0",
|
||||
"pages/topics/named-entity/README.md": "66b2e25f70211d432d596e377d552b3b8f0c525b14c31e3bc9c956c3aeadca84",
|
||||
"pages/topics/named-entity/navod/README.md": "1ff87079a98411de0414754c60241e08d2214ddcd63ddf974e4340cce2ce5b02",
|
||||
"pages/topics/nlp/README.md": "6f90abf9dc3f0ff33475283c13b4a08561abf631425ec2daacb076155a9e02c2",
|
||||
"pages/topics/otvorene/README.md": "cd5544925553fe3840c0ea6f8ef60ab756e26ab6757bf810025c948d8d4f98fc",
|
||||
"pages/topics/prodigy/README.md": "5e4f691f2754c2ec4afbaab2f41e6db77feb5b322dd9344465eb40c35f116499",
|
||||
"pages/topics/python/README.md": "2ef073adba672142c39e9a59fa2e00a98ab52bda54233d46fbe6940ee23f9fcc",
|
||||
"pages/topics/question/README.md": "408078a2a67cea2699e12359e85ab641136231e6104c2afdf874a705879525df",
|
||||
"pages/topics/question/navod/README.md": "061e737c69184b2bd244316ca7ba841f7186fe01ee80ee993742a733dcad3ecd",
|
||||
"pages/topics/question/nezodpovedatelne/README.md": "b6703d9690f4599b973efb27595ce157773ae0fc0d55cf2c0a09d9f50e8e4c92",
|
||||
"pages/topics/question/validacie/README.md": "3216a7127abdfc6da50ed116f44ff2d6785e7da4af70d23aceda774e745ad562",
|
||||
"pages/topics/resources/README.md": "09405397387f00cbcc5680f7d655f2d861e4d92e5df792a62d9dfd04f3534f48",
|
||||
"pages/topics/seq2seq/README.md": "969d15c03a63a3f8d5edc9017fe5a0fb7311fdf4de4a3473a08266241f92c1e2",
|
||||
"pages/topics/spacy/README.md": "f504e5db77cb8694f08a57fb8636e522d59a0e669216f4bc8273bc3c5f375f87",
|
||||
"pages/topics/steel/README.md": "b4068cef2ed197711467ac47630d5b2064fdc8828f898f7af99664e94d833330",
|
||||
"pages/topics/translation/README.md": "a7d4289e72199b307dc5ad8fc69cda39c1a33c27a6c7447af70aa9c3cc6b8635"
|
||||
}
|
||||
},
|
||||
"retrieval_policy": {
|
||||
"published_only": true,
|
||||
"publication_policy": "explicit-false-hidden-v1",
|
||||
"academic_preparation_is_work": false
|
||||
}
|
||||
},
|
||||
"graph": {
|
||||
"sha256": "566817ce7ddebb2638585192c148c41421071bdf719674fc6ddddb1c99a0e36f",
|
||||
"nodes": 446,
|
||||
"relationships": 877
|
||||
},
|
||||
"parameters": {
|
||||
"limit": 40,
|
||||
"max_entities": 8
|
||||
},
|
||||
"dev_summary": {
|
||||
"questions": 1046,
|
||||
"source_checked_count": 1046,
|
||||
"all_facts_supported_count": 1046,
|
||||
"strict_count": 1046,
|
||||
"strict_accuracy": 1.0,
|
||||
"error_count": 0,
|
||||
"value_score": 1.0,
|
||||
"entity_score": 1.0,
|
||||
"relation_score": 1.0,
|
||||
"property_score": 1.0,
|
||||
"relation_choice_score": 1.0,
|
||||
"document_recall": 1.0,
|
||||
"source_recall": 1.0,
|
||||
"binding_score": 1.0,
|
||||
"path_score": 1.0,
|
||||
"answerability_accuracy": 1.0,
|
||||
"latency_mean_seconds": 0.081848,
|
||||
"latency_median_seconds": 0.071172,
|
||||
"latency_p95_seconds": 0.113998
|
||||
},
|
||||
"source_audit_summary": {
|
||||
"dev": {
|
||||
"questions": 1046,
|
||||
"source_consistent": 1046,
|
||||
"issues": {}
|
||||
},
|
||||
"test": {
|
||||
"questions": 80,
|
||||
"source_consistent": 80,
|
||||
"issues": {}
|
||||
}
|
||||
},
|
||||
"policy": "Report all questions including negatives. No exclusions or holdout tuning.",
|
||||
"dev_results_sha256": "d1a5d7b6d5aff3c0002f36a60cebc07627a79ec6d57de119dd587e8ab70143b0",
|
||||
"audit_sha256": "7825d4f3e4e535eb5f49e975dfef363b9b813f1de5c97e2387e5c2f3e578e6a5"
|
||||
}
|
||||
1471
tools/graphrag/evaluation/graphrag_evaluator.py
Normal file
1471
tools/graphrag/evaluation/graphrag_evaluator.py
Normal file
File diff suppressed because it is too large
Load Diff
File diff suppressed because it is too large
Load Diff
71956
tools/graphrag/evaluation/graphrag_questions_v2.json
Normal file
71956
tools/graphrag/evaluation/graphrag_questions_v2.json
Normal file
File diff suppressed because it is too large
Load Diff
74495
tools/graphrag/evaluation/graphrag_questions_v3.json
Normal file
74495
tools/graphrag/evaluation/graphrag_questions_v3.json
Normal file
File diff suppressed because it is too large
Load Diff
133691
tools/graphrag/evaluation/graphrag_questions_v4.json
Normal file
133691
tools/graphrag/evaluation/graphrag_questions_v4.json
Normal file
File diff suppressed because it is too large
Load Diff
132933
tools/graphrag/evaluation/graphrag_questions_v6.json
Normal file
132933
tools/graphrag/evaluation/graphrag_questions_v6.json
Normal file
File diff suppressed because it is too large
Load Diff
143614
tools/graphrag/evaluation/graphrag_questions_v7.json
Normal file
143614
tools/graphrag/evaluation/graphrag_questions_v7.json
Normal file
File diff suppressed because it is too large
Load Diff
93
tools/graphrag/evaluation/reproducibility.py
Normal file
93
tools/graphrag/evaluation/reproducibility.py
Normal file
@ -0,0 +1,93 @@
|
||||
"""Content fingerprints used to freeze retrieval before holdout evaluation."""
|
||||
from __future__ import annotations
|
||||
|
||||
import hashlib
|
||||
import json
|
||||
import os
|
||||
import platform
|
||||
import subprocess
|
||||
from datetime import datetime, timezone
|
||||
from pathlib import Path
|
||||
from typing import Any
|
||||
from tools.publication import DEFAULT_PUBLISHED_ONLY, PUBLICATION_POLICY_VERSION
|
||||
|
||||
ROOT = Path(__file__).resolve().parents[3]
|
||||
|
||||
|
||||
def sha256_file(path: Path) -> str:
|
||||
return hashlib.sha256(path.read_bytes()).hexdigest()
|
||||
|
||||
|
||||
def source_corpus_fingerprint(root: Path = ROOT) -> dict[str, Any]:
|
||||
"""Bind independent expectations to the original Markdown, not graph output."""
|
||||
wiki = Path(os.getenv('ZPWIKI_ROOT', str(root.parent / 'zpwiki')))
|
||||
pages = wiki / 'pages'
|
||||
if not pages.is_dir():
|
||||
raise RuntimeError(f'Original ZP Wiki Markdown directory is missing: {pages}')
|
||||
documents = {str(path.relative_to(wiki)): sha256_file(path)
|
||||
for path in sorted(pages.rglob('README.md')) if path.is_file()}
|
||||
serialized = json.dumps(documents, sort_keys=True, separators=(',', ':')).encode()
|
||||
return {'sha256': hashlib.sha256(serialized).hexdigest(),
|
||||
'document_count': len(documents), 'documents': documents}
|
||||
|
||||
|
||||
def content_fingerprints(questions: Path, root: Path = ROOT) -> dict[str, Any]:
|
||||
files = sorted((root / 'tools/graphrag').rglob('*.py'))
|
||||
# requirements.txt and tools/ are present both in the checkout and image.
|
||||
files.extend(root / name for name in [
|
||||
'requirements.txt', 'tools/publication.py', 'tools/retrieval_contract.py',
|
||||
'tools/index_state.py', 'tools/rag/common.py', 'tools/sync_indexes.py',
|
||||
'tools/rag/rag_utils.py', 'tools/answer_evaluation/context_policy.py',
|
||||
'tools/answer_evaluation/checked_generation.py', 'tools/answer_evaluation/answer_format.py',
|
||||
'tools/answer_evaluation/render_answer.py',
|
||||
'tools/rag/evaluation/rag_metrics.py', 'tools/rag/evaluation/rag_runner.py'])
|
||||
return {
|
||||
'implementation': {str(path.relative_to(root)): sha256_file(path) for path in files},
|
||||
'dataset_sha256': sha256_file(questions),
|
||||
'inputs': {name: sha256_file(root / name) for name in ['data/documents.json', 'data/chunks.json']},
|
||||
'source_corpus': source_corpus_fingerprint(root),
|
||||
'retrieval_policy': {'published_only': DEFAULT_PUBLISHED_ONLY,
|
||||
'publication_policy': PUBLICATION_POLICY_VERSION,
|
||||
'academic_preparation_is_work': False},
|
||||
}
|
||||
|
||||
|
||||
def graph_fingerprint(session: Any) -> dict[str, Any]:
|
||||
nodes = session.run(
|
||||
'MATCH (n) WHERE n.graph_scope = $scope '
|
||||
'RETURN labels(n) AS labels, properties(n) AS properties', scope='zpwiki'
|
||||
).data()
|
||||
edges = session.run(
|
||||
'MATCH (a)-[r]->(b) WHERE a.graph_scope = $scope AND b.graph_scope = $scope '
|
||||
'RETURN labels(a) AS source_labels, coalesce(a.id, a.path, a.name) AS source, '
|
||||
'type(r) AS type, properties(r) AS properties, labels(b) AS target_labels, '
|
||||
'coalesce(b.id, b.path, b.name) AS target', scope='zpwiki'
|
||||
).data()
|
||||
# elementId and row order are deliberately excluded: they change on rebuild.
|
||||
canonical = lambda rows: sorted(json.dumps(row, sort_keys=True, ensure_ascii=False, default=str) for row in rows)
|
||||
content = json.dumps({'nodes': canonical(nodes), 'relationships': canonical(edges)}, ensure_ascii=False)
|
||||
return {'sha256': hashlib.sha256(content.encode()).hexdigest(),
|
||||
'nodes': len(nodes), 'relationships': len(edges)}
|
||||
|
||||
|
||||
def run_metadata(questions: Path) -> dict[str, Any]:
|
||||
def revision(path: Path) -> str | None:
|
||||
result = subprocess.run(['git', '-C', str(path), 'rev-parse', 'HEAD'],
|
||||
text=True, capture_output=True, check=False)
|
||||
return result.stdout.strip() if result.returncode == 0 else None
|
||||
return {'started_at_utc': datetime.now(timezone.utc).isoformat(),
|
||||
'python': platform.python_version(), 'git_head': revision(ROOT),
|
||||
'wiki_git_head': revision(Path(os.getenv('ZPWIKI_ROOT', str(ROOT.parent / 'zpwiki')))),
|
||||
'fingerprints': content_fingerprints(questions)}
|
||||
|
||||
|
||||
def verify_freeze(manifest: dict, metadata: dict, graph: dict, *, limit: int, max_entities: int,
|
||||
audit: Path | None) -> None:
|
||||
if manifest['fingerprints'] != metadata['fingerprints']:
|
||||
raise RuntimeError('Frozen implementation, benchmark or inputs changed. TEST refused.')
|
||||
if manifest['graph'] != graph:
|
||||
raise RuntimeError('Neo4j graph changed since DEV freeze. TEST refused.')
|
||||
if manifest['parameters'] != {'limit': limit, 'max_entities': max_entities}:
|
||||
raise RuntimeError('Retrieval parameters differ from DEV freeze. TEST refused.')
|
||||
if audit is None or sha256_file(audit) != manifest['audit_sha256']:
|
||||
raise RuntimeError('Source audit differs from DEV freeze. TEST refused.')
|
||||
File diff suppressed because it is too large
Load Diff
@ -0,0 +1,381 @@
|
||||
{
|
||||
"method": "Fresh LLM-generation holdout over previously measured, frozen graph queries.",
|
||||
"graph_freeze_sha256": "07867eb5300498b5862b1e4a607d9f5b050b9fdeab19b1fb6129810e28313a62",
|
||||
"audit_sha256": "220fd00ab08cceee6d5141ca5c1a02ec2877d1eee83b36ea707c6a076ba69e15",
|
||||
"generation_files": {
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/evaluate_graph_answers.py": "d34f324c0c490a02111eed31c45864c068b2b856040bea0201f731ab4ac527f5",
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/graph_answer_prompt.txt": "1900178f4ae805e258726a2df853ab2d0766033cf2ed956d28ea8e0caa7c653f",
|
||||
"tools/rag/evaluation/rag_runner.py": "a011b29e2b6aa47df9350e74fc358f05780a355170a819dbb1cfd16d2971493b"
|
||||
},
|
||||
"model": "model120-fast",
|
||||
"temperature": 0,
|
||||
"workers": 3,
|
||||
"dev_ids": [
|
||||
"wide-001",
|
||||
"wide-002",
|
||||
"wide-041",
|
||||
"wide-042",
|
||||
"wide-081",
|
||||
"wide-082",
|
||||
"wide-113",
|
||||
"wide-114",
|
||||
"wide-137",
|
||||
"wide-138",
|
||||
"wide-169",
|
||||
"wide-170",
|
||||
"wide-193",
|
||||
"wide-194",
|
||||
"wide-217",
|
||||
"wide-218",
|
||||
"wide-249",
|
||||
"wide-250",
|
||||
"wide-289",
|
||||
"wide-290"
|
||||
],
|
||||
"test_ids": [
|
||||
"wide-003",
|
||||
"wide-004",
|
||||
"wide-005",
|
||||
"wide-006",
|
||||
"wide-007",
|
||||
"wide-008",
|
||||
"wide-009",
|
||||
"wide-010",
|
||||
"wide-011",
|
||||
"wide-012",
|
||||
"wide-013",
|
||||
"wide-014",
|
||||
"wide-015",
|
||||
"wide-016",
|
||||
"wide-017",
|
||||
"wide-018",
|
||||
"wide-019",
|
||||
"wide-020",
|
||||
"wide-021",
|
||||
"wide-022",
|
||||
"wide-023",
|
||||
"wide-024",
|
||||
"wide-025",
|
||||
"wide-026",
|
||||
"wide-027",
|
||||
"wide-028",
|
||||
"wide-029",
|
||||
"wide-030",
|
||||
"wide-031",
|
||||
"wide-032",
|
||||
"wide-033",
|
||||
"wide-034",
|
||||
"wide-035",
|
||||
"wide-036",
|
||||
"wide-037",
|
||||
"wide-038",
|
||||
"wide-039",
|
||||
"wide-040",
|
||||
"wide-043",
|
||||
"wide-044",
|
||||
"wide-045",
|
||||
"wide-046",
|
||||
"wide-047",
|
||||
"wide-048",
|
||||
"wide-049",
|
||||
"wide-050",
|
||||
"wide-051",
|
||||
"wide-052",
|
||||
"wide-053",
|
||||
"wide-054",
|
||||
"wide-055",
|
||||
"wide-056",
|
||||
"wide-057",
|
||||
"wide-058",
|
||||
"wide-059",
|
||||
"wide-060",
|
||||
"wide-061",
|
||||
"wide-062",
|
||||
"wide-063",
|
||||
"wide-064",
|
||||
"wide-065",
|
||||
"wide-066",
|
||||
"wide-067",
|
||||
"wide-068",
|
||||
"wide-069",
|
||||
"wide-070",
|
||||
"wide-071",
|
||||
"wide-072",
|
||||
"wide-073",
|
||||
"wide-074",
|
||||
"wide-075",
|
||||
"wide-076",
|
||||
"wide-077",
|
||||
"wide-078",
|
||||
"wide-079",
|
||||
"wide-080",
|
||||
"wide-083",
|
||||
"wide-084",
|
||||
"wide-085",
|
||||
"wide-086",
|
||||
"wide-087",
|
||||
"wide-088",
|
||||
"wide-089",
|
||||
"wide-090",
|
||||
"wide-091",
|
||||
"wide-092",
|
||||
"wide-093",
|
||||
"wide-094",
|
||||
"wide-095",
|
||||
"wide-096",
|
||||
"wide-097",
|
||||
"wide-098",
|
||||
"wide-099",
|
||||
"wide-100",
|
||||
"wide-101",
|
||||
"wide-102",
|
||||
"wide-103",
|
||||
"wide-104",
|
||||
"wide-105",
|
||||
"wide-106",
|
||||
"wide-107",
|
||||
"wide-108",
|
||||
"wide-109",
|
||||
"wide-110",
|
||||
"wide-111",
|
||||
"wide-112",
|
||||
"wide-115",
|
||||
"wide-116",
|
||||
"wide-117",
|
||||
"wide-118",
|
||||
"wide-119",
|
||||
"wide-120",
|
||||
"wide-121",
|
||||
"wide-122",
|
||||
"wide-123",
|
||||
"wide-124",
|
||||
"wide-125",
|
||||
"wide-126",
|
||||
"wide-127",
|
||||
"wide-128",
|
||||
"wide-129",
|
||||
"wide-130",
|
||||
"wide-131",
|
||||
"wide-132",
|
||||
"wide-133",
|
||||
"wide-134",
|
||||
"wide-135",
|
||||
"wide-136",
|
||||
"wide-139",
|
||||
"wide-140",
|
||||
"wide-141",
|
||||
"wide-142",
|
||||
"wide-143",
|
||||
"wide-144",
|
||||
"wide-145",
|
||||
"wide-146",
|
||||
"wide-147",
|
||||
"wide-148",
|
||||
"wide-149",
|
||||
"wide-150",
|
||||
"wide-151",
|
||||
"wide-152",
|
||||
"wide-153",
|
||||
"wide-154",
|
||||
"wide-155",
|
||||
"wide-156",
|
||||
"wide-157",
|
||||
"wide-158",
|
||||
"wide-159",
|
||||
"wide-160",
|
||||
"wide-161",
|
||||
"wide-162",
|
||||
"wide-163",
|
||||
"wide-164",
|
||||
"wide-165",
|
||||
"wide-166",
|
||||
"wide-167",
|
||||
"wide-168",
|
||||
"wide-171",
|
||||
"wide-172",
|
||||
"wide-173",
|
||||
"wide-174",
|
||||
"wide-175",
|
||||
"wide-176",
|
||||
"wide-177",
|
||||
"wide-178",
|
||||
"wide-179",
|
||||
"wide-180",
|
||||
"wide-181",
|
||||
"wide-182",
|
||||
"wide-183",
|
||||
"wide-184",
|
||||
"wide-185",
|
||||
"wide-186",
|
||||
"wide-187",
|
||||
"wide-188",
|
||||
"wide-189",
|
||||
"wide-190",
|
||||
"wide-191",
|
||||
"wide-192",
|
||||
"wide-195",
|
||||
"wide-196",
|
||||
"wide-197",
|
||||
"wide-198",
|
||||
"wide-199",
|
||||
"wide-200",
|
||||
"wide-201",
|
||||
"wide-202",
|
||||
"wide-203",
|
||||
"wide-204",
|
||||
"wide-205",
|
||||
"wide-206",
|
||||
"wide-207",
|
||||
"wide-208",
|
||||
"wide-209",
|
||||
"wide-210",
|
||||
"wide-211",
|
||||
"wide-212",
|
||||
"wide-213",
|
||||
"wide-214",
|
||||
"wide-215",
|
||||
"wide-216",
|
||||
"wide-219",
|
||||
"wide-220",
|
||||
"wide-221",
|
||||
"wide-222",
|
||||
"wide-223",
|
||||
"wide-224",
|
||||
"wide-225",
|
||||
"wide-226",
|
||||
"wide-227",
|
||||
"wide-228",
|
||||
"wide-229",
|
||||
"wide-230",
|
||||
"wide-231",
|
||||
"wide-232",
|
||||
"wide-233",
|
||||
"wide-234",
|
||||
"wide-235",
|
||||
"wide-236",
|
||||
"wide-237",
|
||||
"wide-238",
|
||||
"wide-239",
|
||||
"wide-240",
|
||||
"wide-241",
|
||||
"wide-242",
|
||||
"wide-243",
|
||||
"wide-244",
|
||||
"wide-245",
|
||||
"wide-246",
|
||||
"wide-247",
|
||||
"wide-248",
|
||||
"wide-251",
|
||||
"wide-252",
|
||||
"wide-253",
|
||||
"wide-254",
|
||||
"wide-255",
|
||||
"wide-256",
|
||||
"wide-257",
|
||||
"wide-258",
|
||||
"wide-259",
|
||||
"wide-260",
|
||||
"wide-261",
|
||||
"wide-262",
|
||||
"wide-263",
|
||||
"wide-264",
|
||||
"wide-265",
|
||||
"wide-266",
|
||||
"wide-267",
|
||||
"wide-268",
|
||||
"wide-269",
|
||||
"wide-270",
|
||||
"wide-271",
|
||||
"wide-272",
|
||||
"wide-273",
|
||||
"wide-274",
|
||||
"wide-275",
|
||||
"wide-276",
|
||||
"wide-277",
|
||||
"wide-278",
|
||||
"wide-279",
|
||||
"wide-280",
|
||||
"wide-281",
|
||||
"wide-282",
|
||||
"wide-283",
|
||||
"wide-284",
|
||||
"wide-285",
|
||||
"wide-286",
|
||||
"wide-287",
|
||||
"wide-288",
|
||||
"wide-291",
|
||||
"wide-292",
|
||||
"wide-293",
|
||||
"wide-294",
|
||||
"wide-295",
|
||||
"wide-296",
|
||||
"wide-297",
|
||||
"wide-298",
|
||||
"wide-299",
|
||||
"wide-300",
|
||||
"wide-301",
|
||||
"wide-302",
|
||||
"wide-303",
|
||||
"wide-304",
|
||||
"wide-305",
|
||||
"wide-306",
|
||||
"wide-307",
|
||||
"wide-308",
|
||||
"wide-309",
|
||||
"wide-310",
|
||||
"wide-311",
|
||||
"wide-312",
|
||||
"wide-313",
|
||||
"wide-314",
|
||||
"wide-315",
|
||||
"wide-316",
|
||||
"wide-317",
|
||||
"wide-318",
|
||||
"wide-319",
|
||||
"wide-320"
|
||||
],
|
||||
"dev_count": 20,
|
||||
"test_count": 300,
|
||||
"target_accuracy": 0.92,
|
||||
"selected_split": "dev",
|
||||
"selected_ids": [
|
||||
"wide-001",
|
||||
"wide-002",
|
||||
"wide-041",
|
||||
"wide-042",
|
||||
"wide-081",
|
||||
"wide-082",
|
||||
"wide-113",
|
||||
"wide-114",
|
||||
"wide-137",
|
||||
"wide-138",
|
||||
"wide-169",
|
||||
"wide-170",
|
||||
"wide-193",
|
||||
"wide-194",
|
||||
"wide-217",
|
||||
"wide-218",
|
||||
"wide-249",
|
||||
"wide-250",
|
||||
"wide-289",
|
||||
"wide-290"
|
||||
],
|
||||
"policy": "Evaluate all 300; retain every failure; do not tune on this TEST.",
|
||||
"test_categories": {
|
||||
"shared_keyword_pair": 38,
|
||||
"same_academic_year_pair": 38,
|
||||
"same_start_year_pair": 30,
|
||||
"person_title_year": 22,
|
||||
"person_keyword_title": 30,
|
||||
"document_author_category_multi_hop": 22,
|
||||
"person_multiple_categories": 22,
|
||||
"candidate_set_aggregation": 30,
|
||||
"conjunctive_disambiguation": 38,
|
||||
"negative_lookup": 30
|
||||
},
|
||||
"limitations": [
|
||||
"Known corpus/profiles and templates; model outputs for these 300 questions were not previously observed.",
|
||||
"Harness supplies graph context; native OpenWebUI tool choice and browser UI are outside this experiment.",
|
||||
"Checks structured factual claims, their source support/citations and required prose values; not a general semantic judge of arbitrary prose."
|
||||
]
|
||||
}
|
||||
@ -0,0 +1,301 @@
|
||||
id,category,strict,error,latency_seconds,bindings_ok,sources_ok,status_ok,count_ok,set_ok,text_values_ok,question,answer
|
||||
wide-003,shared_keyword_pair,True,,6.699744368997926,True,True,True,True,True,True,Pre osoby Manohar Gowdru Shridhara a Nikita Bodnar over rovnaké kľúčové slovo nlp.,"{""answer"": ""Áno, obe osoby Manohar Gowdru Shridhara a Nikita Bodnar majú ako kľúčové slovo NLP. Zdroje: https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu, https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""status"": ""ok"", ""claims"": [{""person"": ""Manohar Gowdru Shridhara"", ""keyword"": ""NLP""}, {""person"": ""Nikita Bodnar"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar""], ""count"": 2}"
|
||||
wide-004,shared_keyword_pair,True,,5.666554606999853,True,True,True,True,True,True,Over spoločné kľúčové slovo nlp pri osobách Jakub Maruniak a Nikita Bodnar.,"{""answer"": ""Spoločné kľúčové slovo NLP majú Jakub Maruniak a Nikita Bodnar. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak, https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""status"": ""ok"", ""claims"": [{""person"": ""Jakub Maruniak"", ""keyword"": ""NLP""}, {""person"": ""Nikita Bodnar"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar""], ""count"": 2}"
|
||||
wide-005,shared_keyword_pair,True,,11.765499916000408,True,True,True,True,True,True,Majú osoby Denis Le Thanh a Samuel Vasiľ spoločné kľúčové slovo nlp?,"{""answer"": ""Áno, osoby Denis Le Thanh a Samuel Vasiľ majú spoločné kľúčové slovo NLP. Samuel Vasiľ má kľúčové slovo NLP podľa zdroja https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil a Denis Le Thanh má kľúčové slovo NLP podľa zdroja https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh."", ""status"": ""ok"", ""claims"": [{""person"": ""Samuel Vasiľ"", ""keyword"": ""NLP""}, {""person"": ""Denis Le Thanh"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""], ""count"": 2}"
|
||||
wide-006,shared_keyword_pair,True,,9.003742946995771,True,True,True,True,True,True,Pre osoby Lukáš Pokrývka a Stanislav Matsunych over rovnaké kľúčové slovo nlp.,"{""answer"": ""Áno, obe osoby Lukáš Pokrývka a Stanislav Matsunych majú kľúčové slovo NLP. Lukáš Pokrývka má toto kľúčové slovo v dokumente pages/students/2016/lukas_pokryvka/timovy_projekt/README.md (zdroj: https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt). Stanislav Matsunych má kľúčové slovo NLP v dokumente pages/students/2017/stanislav_matsunych/README.md (zdroj: https://zp.kemt.fei.tuke.sk/students/2017/stanislav_matsunych)."", ""status"": ""ok"", ""claims"": [{""person"": ""Lukáš Pokrývka"", ""keyword"": ""NLP""}, {""person"": ""Stanislav Matsunych"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2017/stanislav_matsunych""], ""count"": 2}"
|
||||
wide-007,shared_keyword_pair,True,,10.538517578002939,True,True,True,True,True,True,Over spoločné kľúčové slovo nlp pri osobách Oleksandr Dorybohov a Youssef Ressaissi.,"{""answer"": ""Spoločné kľúčové slovo NLP majú Oleksandr Dorybohov a Youssef Ressaissi. Zdroje: https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov, https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi"", ""status"": ""ok"", ""claims"": [{""person"": ""Youssef Ressaissi"", ""keyword"": ""NLP""}, {""person"": ""Oleksandr Dorybohov"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""], ""count"": 2}"
|
||||
wide-008,shared_keyword_pair,True,,8.536271106997447,True,True,True,True,True,True,Majú osoby Denis Le Thanh a Tomáš Kuchárik spoločné kľúčové slovo nlp?,"{""answer"": ""Áno, obe osoby, Denis Le Thanh a Tomáš Kuchárik, majú spoločné kľúčové slovo NLP. Tieto údaje sú potvrdené v ich profiloch na stránkach https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh a https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik."", ""status"": ""ok"", ""claims"": [{""person"": ""Tomáš Kuchárik"", ""keyword"": ""NLP""}, {""person"": ""Denis Le Thanh"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""], ""count"": 2}"
|
||||
wide-009,shared_keyword_pair,True,,9.359552573005203,True,True,True,True,True,True,Pre osoby Dávid Iľaš a Maroš Harahus over rovnaké kľúčové slovo nlp.,"{""answer"": ""Áno, obe osoby Dávid Iľaš a Maroš Harahus majú rovnaké kľúčové slovo NLP. Dávid Iľaš má kľúčové slovo NLP podľa zdroja https://zp.kemt.fei.tuke.sk/students/2018/david_ilas a Maroš Harahus má kľúčové slovo NLP podľa zdroja https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus."", ""status"": ""ok"", ""claims"": [{""person"": ""Dávid Iľaš"", ""keyword"": ""NLP""}, {""person"": ""Maroš Harahus"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/david_ilas"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""], ""count"": 2}"
|
||||
wide-010,shared_keyword_pair,True,,9.009257842997613,True,True,True,True,True,True,Over spoločné kľúčové slovo nlp pri osobách Nikita Bodnar a Oleksandr Dorybohov.,"{""answer"": ""Spoločným kľúčovým slovom pre Nikitu Bodnara a Oleksandra Dorybohova je NLP. Tieto údaje sú potvrdené v zdrojoch: https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar a https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov."", ""status"": ""ok"", ""claims"": [{""person"": ""Nikita Bodnar"", ""keyword"": ""NLP""}, {""person"": ""Oleksandr Dorybohov"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""], ""count"": 2}"
|
||||
wide-011,shared_keyword_pair,True,,10.274840045000019,True,True,True,True,True,True,Majú osoby Lukáš Pokrývka a Martin NaN1 spoločné kľúčové slovo nlp?,"{""answer"": ""Áno, obe osoby Lukáš Pokrývka a Martin NaN1 majú spoločné kľúčové slovo NLP. Lukáš Pokrývka má toto kľúčové slovo v dokumente na stránke https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt a Martin NaN1 v dokumente na stránke https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday."", ""status"": ""ok"", ""claims"": [{""person"": ""Lukáš Pokrývka"", ""keyword"": ""NLP""}, {""person"": ""Martin NaN1"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday""], ""count"": 2}"
|
||||
wide-012,shared_keyword_pair,True,,8.777758887998061,True,True,True,True,True,True,Pre osoby Martin Šarišský a Yevhenii Leonov over rovnaké kľúčové slovo nlp.,"{""answer"": ""Osoba Martin Šarišský má kľúčové slovo NLP (zdroj: https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky). Osoba Yevhenii Leonov má kľúčové slovo NLP (zdroj: https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov)."", ""status"": ""ok"", ""claims"": [{""person"": ""Martin Šarišský"", ""keyword"": ""NLP""}, {""person"": ""Yevhenii Leonov"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov""], ""count"": 2}"
|
||||
wide-013,shared_keyword_pair,True,,13.491731257003266,True,True,True,True,True,True,Over spoločné kľúčové slovo nlp pri osobách Maksym Zatirka a Patrik Pavlišin.,"{""answer"": ""Spoločné kľúčové slovo NLP majú osoby Patrik Pavlišin a Maksym Zatirka. Patrik Pavlišin má kľúčové slovo NLP v dokumente pages/students/2016/patrik_pavlisin/README.md (zdroj: https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin). Maksym Zatirka má kľúčové slovo NLP v dokumente pages/students/2023/maksym_zatirka/README.md (zdroj: https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka)."", ""status"": ""ok"", ""claims"": [{""person"": ""Patrik Pavlišin"", ""keyword"": ""NLP""}, {""person"": ""Maksym Zatirka"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""], ""count"": 2}"
|
||||
wide-014,shared_keyword_pair,True,,8.736353909996978,True,True,True,True,True,True,Majú osoby Artem Yatsenko a Matej Novotný spoločné kľúčové slovo nlp?,"{""answer"": ""Áno, obe osoby Artem Yatsenko a Matej Novotný majú spoločné kľúčové slovo NLP. Artem Yatsenko má toto kľúčové slovo uvedené v dokumente pages/students/2019/artem_yatsenko/README.md (zdroj: https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko) a Matej Novotný v dokumente pages/students/2021/matej_novotny/README.md (zdroj: https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny)."", ""status"": ""ok"", ""claims"": [{""person"": ""Artem Yatsenko"", ""keyword"": ""NLP""}, {""person"": ""Matej Novotný"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny""], ""count"": 2}"
|
||||
wide-015,shared_keyword_pair,True,,15.575955378000799,True,True,True,True,True,True,Pre osoby Kristián Sopkovič a Yevhenii Medushivskyi over rovnaké kľúčové slovo nlp.,"{""answer"": ""Áno, obe osoby, Kristián Sopkovič a Yevhenii Medushivskyi, majú rovnaké kľúčové slovo NLP. Kristián Sopkovič má toto kľúčové slovo v dokumente z roku 2019 (https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic) a Yevhenii Medushivskyi v dokumente z roku 2023 (https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi)."", ""status"": ""ok"", ""claims"": [{""person"": ""Kristián Sopkovič"", ""keyword"": ""NLP""}, {""person"": ""Yevhenii Medushivskyi"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""], ""count"": 2}"
|
||||
wide-016,shared_keyword_pair,True,,7.991483903999324,True,True,True,True,True,True,Over spoločné kľúčové slovo nlp pri osobách Alina Vitko a Manohar Gowdru Shridhara.,"{""answer"": ""Spoločné kľúčové slovo NLP majú Alina Vitko a Manohar Gowdru Shridhara. Alina Vitko má kľúčové slovo NLP v dokumente na stránke https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko. Manohar Gowdru Shridhara má kľúčové slovo NLP v dokumente na stránke https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu."", ""status"": ""ok"", ""claims"": [{""person"": ""Alina Vitko"", ""keyword"": ""NLP""}, {""person"": ""Manohar Gowdru Shridhara"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu""], ""count"": 2}"
|
||||
wide-017,shared_keyword_pair,True,,15.949837186002696,True,True,True,True,True,True,Majú osoby Andrii Pervashov a Valerii Kutsenko spoločné kľúčové slovo nlp?,"{""answer"": ""Áno, osoby Andrii Pervashov a Valerii Kutsenko majú spoločné kľúčové slovo NLP. Andrii Pervashov má kľúčové slovo NLP podľa zdroja https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov a Valerii Kutsenko má kľúčové slovo NLP podľa zdroja https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko."", ""status"": ""ok"", ""claims"": [{""person"": ""Andrii Pervashov"", ""keyword"": ""NLP""}, {""person"": ""Valerii Kutsenko"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""], ""count"": 2}"
|
||||
wide-018,shared_keyword_pair,True,,6.7982784530031495,True,True,True,True,True,True,Pre osoby Jakub Maruniak a Yevhenii Medushivskyi over rovnaké kľúčové slovo nlp.,"{""answer"": ""Obe osoby, Yevhenii Medushivskyi a Jakub Maruniak, majú ako kľúčové slovo NLP. Yevhenii Medushivskyi je uvedený v zdroji https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi a Jakub Maruniak v zdroji https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak."", ""status"": ""ok"", ""claims"": [{""person"": ""Yevhenii Medushivskyi"", ""keyword"": ""NLP""}, {""person"": ""Jakub Maruniak"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""], ""count"": 2}"
|
||||
wide-019,shared_keyword_pair,True,,12.657017598998209,True,True,True,True,True,True,Over spoločné kľúčové slovo nlp pri osobách Adrián Remiáš a Bogdan Paul Chiș.,"{""answer"": ""Spoločné kľúčové slovo NLP majú Adrián Remiáš a Bogdan Paul Chiș. Adrián Remiáš má kľúčové slovo NLP v dokumente pages/students/2018/adrian_remias/README.md (https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias). Bogdan Paul Chiș má kľúčové slovo NLP v dokumente pages/interns/bogdan_paul_chis/README.md (https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis)."", ""status"": ""ok"", ""claims"": [{""person"": ""Adrián Remiáš"", ""keyword"": ""NLP""}, {""person"": ""Bogdan Paul Chiș"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis""], ""count"": 2}"
|
||||
wide-020,shared_keyword_pair,True,,6.938394573000551,True,True,True,True,True,True,Majú osoby Oleh Bilykh a Ondrej Megela spoločné kľúčové slovo question-answer?,"{""answer"": ""Áno, osoby Oleh Bilykh a Ondrej Megela majú spoločné kľúčové slovo question-answer. Tento fakt je potvrdený pre Olega Bilykha na stránke https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh a pre Ondreja Megelu na stránke https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela."", ""status"": ""ok"", ""claims"": [{""person"": ""Oleh Bilykh"", ""keyword"": ""question-answer""}, {""person"": ""Ondrej Megela"", ""keyword"": ""question-answer""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""], ""count"": 2}"
|
||||
wide-021,shared_keyword_pair,True,,10.601334623002913,True,True,True,True,True,True,Pre osoby Bogdan Paul Chiș a Samuel Džurina over rovnaké kľúčové slovo nlp.,"{""answer"": ""Áno, obe osoby, Bogdan Paul Chiș a Samuel Džurina, majú rovnaké kľúčové slovo NLP. Zdroje: https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis, https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""status"": ""ok"", ""claims"": [{""person"": ""Bogdan Paul Chiș"", ""keyword"": ""NLP""}, {""person"": ""Samuel Džurina"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""], ""count"": 2}"
|
||||
wide-022,shared_keyword_pair,True,,10.63887820099626,True,True,True,True,True,True,Over spoločné kľúčové slovo nlp pri osobách Dárius Lindvai a Dominik Nagy.,"{""answer"": ""Spoločné kľúčové slovo NLP majú Dárius Lindvai a Dominik Nagy. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai, https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""status"": ""ok"", ""claims"": [{""person"": ""Dárius Lindvai"", ""keyword"": ""NLP""}, {""person"": ""Dominik Nagy"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy""], ""count"": 2}"
|
||||
wide-023,shared_keyword_pair,True,,7.379739687996334,True,True,True,True,True,True,Majú osoby Artem Yatsenko a Maksym Zatirka spoločné kľúčové slovo nlp?,"{""answer"": ""Áno, obe osoby Artem Yatsenko a Maksym Zatirka majú spoločné kľúčové slovo NLP. Artem Yatsenko má toto kľúčové slovo uvedené v dokumente pages/students/2019/artem_yatsenko/README.md (zdroj: https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko) a Maksym Zatirka v dokumente pages/students/2023/maksym_zatirka/README.md (zdroj: https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka)."", ""status"": ""ok"", ""claims"": [{""person"": ""Artem Yatsenko"", ""keyword"": ""NLP""}, {""person"": ""Maksym Zatirka"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""], ""count"": 2}"
|
||||
wide-024,shared_keyword_pair,True,,8.829382572002942,True,True,True,True,True,True,Pre osoby Denis Le Thanh a Oleksandr Dorybohov over rovnaké kľúčové slovo lm.,"{""answer"": ""Áno, obe osoby Denis Le Thanh a Oleksandr Dorybohov majú rovnaké kľúčové slovo LM. Tieto údaje sú potvrdené v zdrojoch: https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh a https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov."", ""status"": ""ok"", ""claims"": [{""person"": ""Denis Le Thanh"", ""keyword"": ""LM""}, {""person"": ""Oleksandr Dorybohov"", ""keyword"": ""LM""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""], ""count"": 2}"
|
||||
wide-025,shared_keyword_pair,True,,9.64496994500223,True,True,True,True,True,True,Over spoločné kľúčové slovo nlp pri osobách Artur Hyrenko a Than Trung Thanh.,"{""answer"": ""Spoločné kľúčové slovo NLP majú Artur Hyrenko a Than Trung Thanh. Zdroje: https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh, https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko."", ""status"": ""ok"", ""claims"": [{""person"": ""Than Trung Thanh"", ""keyword"": ""NLP""}, {""person"": ""Artur Hyrenko"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko""], ""count"": 2}"
|
||||
wide-026,shared_keyword_pair,True,,10.304747886999394,True,True,True,True,True,True,Majú osoby Lukáš Pokrývka a Than Trung Thanh spoločné kľúčové slovo nlp?,"{""answer"": ""Áno, obe osoby Lukáš Pokrývka a Than Trung Thanh majú spoločné kľúčové slovo NLP. Lukáš Pokrývka má toto kľúčové slovo uvedené v dokumente týkajúcom sa tímového projektu (https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt) a Than Trung Thanh ho má v hlavnom dokumente svojho profilu (https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh)."", ""status"": ""ok"", ""claims"": [{""person"": ""Lukáš Pokrývka"", ""keyword"": ""NLP""}, {""person"": ""Than Trung Thanh"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh""], ""count"": 2}"
|
||||
wide-027,shared_keyword_pair,True,,9.40718223300064,True,True,True,True,True,True,Pre osoby Artur Hyrenko a Rostyslav Rodzhuk over rovnaké kľúčové slovo nlp.,"{""answer"": ""Áno, obe osoby Artur Hyrenko a Rostyslav Rodzhuk majú ako kľúčové slovo NLP. Zdroje: https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko a https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk."", ""status"": ""ok"", ""claims"": [{""person"": ""Artur Hyrenko"", ""keyword"": ""NLP""}, {""person"": ""Rostyslav Rodzhuk"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""], ""count"": 2}"
|
||||
wide-028,shared_keyword_pair,True,,10.532162452000193,True,True,True,True,True,True,Over spoločné kľúčové slovo nlp pri osobách Denis Le Thanh a Ján Holp.,"{""answer"": ""Spoločné kľúčové slovo NLP majú Denis Le Thanh a Ján Holp. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/jan_holp, https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""status"": ""ok"", ""claims"": [{""person"": ""Ján Holp"", ""keyword"": ""NLP""}, {""person"": ""Denis Le Thanh"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""], ""count"": 2}"
|
||||
wide-029,shared_keyword_pair,True,,9.789691318001132,True,True,True,True,True,True,Majú osoby Dávid Stromp a Ediz Morochovič spoločné kľúčové slovo nlp?,"{""answer"": ""Áno, obe osoby Dávid Stromp a Ediz Morochovič majú spoločné kľúčové slovo NLP. Dávid Stromp má toto kľúčové slovo uvedené v dokumente pages/students/2019/david_stromp/README.md (zdroj: https://zp.kemt.fei.tuke.sk/students/2019/david_stromp) a Ediz Morochovič v dokumente pages/students/2016/ediz_morochovic/README.md (zdroj: https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic)."", ""status"": ""ok"", ""claims"": [{""person"": ""Dávid Stromp"", ""keyword"": ""NLP""}, {""person"": ""Ediz Morochovič"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic""], ""count"": 2}"
|
||||
wide-030,shared_keyword_pair,True,,11.241516061993025,True,True,True,True,True,True,Pre osoby Kristián Sopkovič a Martin Wencel over rovnaké kľúčové slovo spacy.,"{""answer"": ""Áno, obe osoby, Martin Wencel a Kristián Sopkovič, majú v grafoch uvedené kľúčové slovo Spacy. Martin Wencel je uvedený na stránke https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel a Kristián Sopkovič na stránke https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic."", ""status"": ""ok"", ""claims"": [{""person"": ""Martin Wencel"", ""keyword"": ""Spacy""}, {""person"": ""Kristián Sopkovič"", ""keyword"": ""Spacy""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""], ""count"": 2}"
|
||||
wide-031,shared_keyword_pair,True,,10.634745764997206,True,True,True,True,True,True,Over spoločné kľúčové slovo nlp pri osobách Jakub Schwarc a Ján Holp.,"{""answer"": ""Spoločné kľúčové slovo NLP majú Jakub Schwarc a Ján Holp. Ján Holp má toto kľúčové slovo v dokumente z roku 2016 (https://zp.kemt.fei.tuke.sk/students/2016/jan_holp) a Jakub Schwarc v dokumente z roku 2022 (https://zp.kemt.fei.tuke.sk/students/2022/jakub_schwarc)."", ""status"": ""ok"", ""claims"": [{""person"": ""Ján Holp"", ""keyword"": ""NLP""}, {""person"": ""Jakub Schwarc"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2022/jakub_schwarc""], ""count"": 2}"
|
||||
wide-032,shared_keyword_pair,True,,11.027207719998842,True,True,True,True,True,True,Majú osoby Dávid Stromp a Márk Fehér spoločné kľúčové slovo nlp?,"{""answer"": ""Áno, obe osoby Dávid Stromp a Márk Fehér majú spoločné kľúčové slovo NLP. Dávid Stromp má toto kľúčové slovo v dokumente pages/students/2019/david_stromp/README.md (zdroj: https://zp.kemt.fei.tuke.sk/students/2019/david_stromp) a Márk Fehér v dokumente pages/students/2016/mark_feher/README.md (zdroj: https://zp.kemt.fei.tuke.sk/students/2016/mark_feher)."", ""status"": ""ok"", ""claims"": [{""person"": ""Dávid Stromp"", ""keyword"": ""NLP""}, {""person"": ""Márk Fehér"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher""], ""count"": 2}"
|
||||
wide-033,shared_keyword_pair,True,,9.521409880995634,True,True,True,True,True,True,Pre osoby Stanislav Matsunych a Youssef Ressaissi over rovnaké kľúčové slovo nlp.,"{""answer"": ""Áno, obe osoby Stanislav Matsunych a Youssef Ressaissi majú rovnaké kľúčové slovo NLP. Zdroje: https://zp.kemt.fei.tuke.sk/students/2017/stanislav_matsunych, https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi"", ""status"": ""ok"", ""claims"": [{""person"": ""Stanislav Matsunych"", ""keyword"": ""NLP""}, {""person"": ""Youssef Ressaissi"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2017/stanislav_matsunych"", ""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi""], ""count"": 2}"
|
||||
wide-034,shared_keyword_pair,True,,10.085962933000701,True,True,True,True,True,True,Over spoločné kľúčové slovo nlp pri osobách Ján Malinovský a Lukáš Pokrývka.,"{""answer"": ""Spoločné kľúčové slovo NLP majú Ján Malinovský a Lukáš Pokrývka. Lukáš Pokrývka má toto kľúčové slovo v dokumente na stránke https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt a Ján Malinovský na stránke https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky."", ""status"": ""ok"", ""claims"": [{""person"": ""Lukáš Pokrývka"", ""keyword"": ""NLP""}, {""person"": ""Ján Malinovský"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""], ""count"": 2}"
|
||||
wide-035,shared_keyword_pair,True,,9.319875779998256,True,True,True,True,True,True,Majú osoby Ján Holp a Sevval Bulburu spoločné kľúčové slovo nlp?,"{""answer"": ""Áno, obe osoby Ján Holp a Sevval Bulburu majú spoločné kľúčové slovo NLP. Ján Holp má toto kľúčové slovo uvedené v dokumente pages/students/2016/jan_holp/README.md (zdroj: https://zp.kemt.fei.tuke.sk/students/2016/jan_holp) a Sevval Bulburu v dokumente pages/interns/sevval_bulburu/README.md (zdroj: https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu)."", ""status"": ""ok"", ""claims"": [{""person"": ""Ján Holp"", ""keyword"": ""NLP""}, {""person"": ""Sevval Bulburu"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu""], ""count"": 2}"
|
||||
wide-036,shared_keyword_pair,True,,9.90310135600157,True,True,True,True,True,True,Pre osoby Oleh Bilykh a Ondrej Megela over rovnaké kľúčové slovo qa.,"{""answer"": ""Áno, obe osoby, Oleh Bilykh a Ondrej Megela, majú rovnaké kľúčové slovo QA. Zdroje: https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh, https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""status"": ""ok"", ""claims"": [{""person"": ""Oleh Bilykh"", ""keyword"": ""QA""}, {""person"": ""Ondrej Megela"", ""keyword"": ""QA""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""], ""count"": 2}"
|
||||
wide-037,shared_keyword_pair,True,,9.461803379999765,True,True,True,True,True,True,Over spoločné kľúčové slovo nlp pri osobách Andrii Pervashov a Oleh Bilykh.,"{""answer"": ""Spoločné kľúčové slovo NLP majú osoby Oleh Bilykh a Andrii Pervashov. Zdroje: https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh, https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov."", ""status"": ""ok"", ""claims"": [{""person"": ""Oleh Bilykh"", ""keyword"": ""NLP""}, {""person"": ""Andrii Pervashov"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""], ""count"": 2}"
|
||||
wide-038,shared_keyword_pair,True,,8.896227124998404,True,True,True,True,True,True,Majú osoby Tetiana Mohorian a Valerii Kutsenko spoločné kľúčové slovo rag?,"{""answer"": ""Áno, osoby Tetiana Mohorian a Valerii Kutsenko majú spoločné kľúčové slovo RAG. Toto je potvrdené v ich profiloch na stránkach https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian a https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko."", ""status"": ""ok"", ""claims"": [{""person"": ""Tetiana Mohorian"", ""keyword"": ""RAG""}, {""person"": ""Valerii Kutsenko"", ""keyword"": ""RAG""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""], ""count"": 2}"
|
||||
wide-039,shared_keyword_pair,True,,9.704090511993854,True,True,True,True,True,True,Pre osoby Alina Vitko a Matej Kobyľan over rovnaké kľúčové slovo ir.,"{""answer"": ""Áno, obe osoby, Alina Vitko a Matej Kobyľan, majú priradené kľúčové slovo \""ir\"". Alina Vitko je uvedená na stránke https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko a Matej Kobyľan na stránke https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan."", ""status"": ""ok"", ""claims"": [{""person"": ""Alina Vitko"", ""keyword"": ""ir""}, {""person"": ""Matej Kobyľan"", ""keyword"": ""ir""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""], ""count"": 2}"
|
||||
wide-040,shared_keyword_pair,True,,8.09319808800501,True,True,True,True,True,True,Over spoločné kľúčové slovo nlp pri osobách Oleksandr Hryshchenko a Serhii Yemets.,"{""answer"": ""Spoločné kľúčové slovo NLP majú Oleksandr Hryshchenko a Serhii Yemets. Zdroje: https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko, https://zp.kemt.fei.tuke.sk/students/2022/serhii_yemets"", ""status"": ""ok"", ""claims"": [{""person"": ""Oleksandr Hryshchenko"", ""keyword"": ""NLP""}, {""person"": ""Serhii Yemets"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/serhii_yemets""], ""count"": 2}"
|
||||
wide-043,same_academic_year_pair,True,,12.992187249998096,True,True,True,True,True,True,Porovnaj rovnaké roky práce pri osobách Alina Vitko a Artem Yatsenko.,"{""answer"": ""Alina Vitko a Artem Yatsenko majú spoločné roky práce 2021 a 2022. Obe osoby pracovali v roku 2021 a 2022, čo je potvrdené zdrojmi: https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko a https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko."", ""status"": ""ok"", ""claims"": [{""person"": ""Alina Vitko"", ""year"": 2021}, {""person"": ""Alina Vitko"", ""year"": 2022}, {""person"": ""Artem Yatsenko"", ""year"": 2021}, {""person"": ""Artem Yatsenko"", ""year"": 2022}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""], ""count"": 2}"
|
||||
wide-044,same_academic_year_pair,True,,7.993425487999048,True,True,True,True,True,True,Aké spoločné roky práce spájajú osoby Patrik Pavlišin a Samuel Širotník?,"{""answer"": ""Spoločným rokom práce pre Patrika Pavlišina a Samuela Širotníka je 2020. Patrik Pavlišin pracoval v roku 2020 (zdroj: https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin) a Samuel Širotník tiež v roku 2020 (zdroj: https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik)."", ""status"": ""ok"", ""claims"": [{""person"": ""Patrik Pavlišin"", ""year"": 2020}, {""person"": ""Samuel Širotník"", ""year"": 2020}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik""], ""count"": 1}"
|
||||
wide-045,same_academic_year_pair,True,,11.783585913006391,True,True,True,True,True,True,Ktoré spoločné roky prác majú osoby Lukáš Pokrývka a Márk Fehér?,"{""answer"": ""Lukáš Pokrývka a Márk Fehér majú spoločný rok prác 2021. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka, https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""status"": ""ok"", ""claims"": [{""person"": ""Lukáš Pokrývka"", ""year"": 2021}, {""person"": ""Márk Fehér"", ""year"": 2021}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher""], ""count"": 1}"
|
||||
wide-046,same_academic_year_pair,True,,8.095852152000589,True,True,True,True,True,True,Porovnaj rovnaké roky práce pri osobách Kristián Sopkovič a Ondrej Megela.,"{""answer"": ""Kristián Sopkovič a Ondrej Megela majú rovnaký rok práce 2022. Zdroje: https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic, https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""status"": ""ok"", ""claims"": [{""person"": ""Kristián Sopkovič"", ""year"": 2022}, {""person"": ""Ondrej Megela"", ""year"": 2022}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""], ""count"": 2}"
|
||||
wide-047,same_academic_year_pair,True,,14.414462206004828,True,True,True,True,True,True,Aké spoločné roky práce spájajú osoby Martin Šarišský a Matej Ščišľak?,"{""answer"": ""Martin Šarišský a Matej Ščišľak majú spoločné roky práce 2024, 2025 a 2026. Tieto údaje sú potvrdené v zdrojoch: https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky a https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak."", ""status"": ""ok"", ""claims"": [{""person"": ""Martin Šarišský"", ""year"": 2024}, {""person"": ""Martin Šarišský"", ""year"": 2025}, {""person"": ""Martin Šarišský"", ""year"": 2026}, {""person"": ""Matej Ščišľak"", ""year"": 2024}, {""person"": ""Matej Ščišľak"", ""year"": 2025}, {""person"": ""Matej Ščišľak"", ""year"": 2026}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""], ""count"": 3}"
|
||||
wide-048,same_academic_year_pair,True,,7.2015859890016145,True,True,True,True,True,True,Ktoré spoločné roky prác majú osoby Márk Fehér a Ondrej Megela?,"{""answer"": ""Márk Fehér a Ondrej Megela majú spoločný rok prác 2022. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/mark_feher, https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""status"": ""ok"", ""claims"": [{""person"": ""Márk Fehér"", ""year"": 2022}, {""person"": ""Ondrej Megela"", ""year"": 2022}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""], ""count"": 1}"
|
||||
wide-049,same_academic_year_pair,True,,11.857852802997513,True,True,True,True,True,True,Porovnaj rovnaké roky práce pri osobách Daniil Huzenko a Vladyslav Yanchenko.,"{""answer"": ""Daniil Huzenko a Vladyslav Yanchenko majú rovnaký rok práce 2025. Zdroje: https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko, https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko."", ""status"": ""ok"", ""claims"": [{""person"": ""Daniil Huzenko"", ""year"": 2025}, {""person"": ""Vladyslav Yanchenko"", ""year"": 2025}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""], ""count"": 2}"
|
||||
wide-050,same_academic_year_pair,True,,9.958301602004212,True,True,True,True,True,True,Aké spoločné roky práce spájajú osoby Matúš Suchanič a Ondrej Megela?,"{""answer"": ""Matúš Suchanič a Ondrej Megela majú spoločné roky práce 2022 a 2023. Tieto údaje sú potvrdené zdrojmi: https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic a https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela."", ""status"": ""ok"", ""claims"": [{""person"": ""Matúš Suchanič"", ""year"": 2022}, {""person"": ""Matúš Suchanič"", ""year"": 2023}, {""person"": ""Ondrej Megela"", ""year"": 2022}, {""person"": ""Ondrej Megela"", ""year"": 2023}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""], ""count"": 2}"
|
||||
wide-051,same_academic_year_pair,True,,10.470878234002157,True,True,True,True,True,True,Ktoré spoločné roky prác majú osoby Artur Hyrenko a Maksym Zatirka?,"{""answer"": ""Osoby Artur Hyrenko a Maksym Zatirka majú spoločný rok práce 2026. Zdroje: https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko, https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""status"": ""ok"", ""claims"": [{""person"": ""Artur Hyrenko"", ""year"": 2026}, {""person"": ""Maksym Zatirka"", ""year"": 2026}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""], ""count"": 1}"
|
||||
wide-052,same_academic_year_pair,True,,8.66265292999742,True,True,True,True,True,True,Porovnaj rovnaké roky práce pri osobách Matúš Suchanič a Vladyslav Krupko.,"{""answer"": ""Matúš Suchanič a Vladyslav Krupko majú rovnaký rok práce 2023. Zdroje: https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic, https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""status"": ""ok"", ""claims"": [{""person"": ""Matúš Suchanič"", ""year"": 2023}, {""person"": ""Vladyslav Krupko"", ""year"": 2023}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""], ""count"": 2}"
|
||||
wide-053,same_academic_year_pair,True,,8.393673475999094,True,True,True,True,True,True,Aké spoločné roky práce spájajú osoby Jakub Maruniak a Samuel Širotník?,"{""answer"": ""Spoločným rokom práce pre Jakuba Maruniaka a Samuela Širotníka je 2020. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak, https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""status"": ""ok"", ""claims"": [{""person"": ""Jakub Maruniak"", ""year"": 2020}, {""person"": ""Samuel Širotník"", ""year"": 2020}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik""], ""count"": 1}"
|
||||
wide-054,same_academic_year_pair,True,,8.700021895005193,True,True,True,True,True,True,Ktoré spoločné roky prác majú osoby Dmytro Ushatenko a Maroš Harahus?,"{""answer"": ""Osoby Dmytro Ushatenko a Maroš Harahus majú spoločný rok práce 2020. Dmytro Ushatenko pracoval v roku 2020 (zdroj: https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko) a Maroš Harahus tiež v roku 2020 (zdroj: https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus)."", ""status"": ""ok"", ""claims"": [{""person"": ""Dmytro Ushatenko"", ""year"": 2020}, {""person"": ""Maroš Harahus"", ""year"": 2020}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""], ""count"": 1}"
|
||||
wide-055,same_academic_year_pair,True,,9.511775334001868,True,True,True,True,True,True,Porovnaj rovnaké roky práce pri osobách Jakub Schwarc a Martin Šarišský.,"{""answer"": ""Jakub Schwarc a Martin Šarišský majú rovnaký rok práce 2026. Zdroje: https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky, https://zp.kemt.fei.tuke.sk/students/2022/jakub_schwarc."", ""status"": ""ok"", ""claims"": [{""person"": ""Martin Šarišský"", ""year"": 2026}, {""person"": ""Jakub Schwarc"", ""year"": 2026}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/jakub_schwarc""], ""count"": 2}"
|
||||
wide-056,same_academic_year_pair,True,,10.811054402998707,True,True,True,True,True,True,Aké spoločné roky práce spájajú osoby Márk Fehér a Patrik Pavlišin?,"{""answer"": ""Spoločné roky práce pre Márka Fehéra a Patrika Pavlišina sú 2021 a 2022. Tieto údaje sú potvrdené zdrojmi: https://zp.kemt.fei.tuke.sk/students/2016/mark_feher a https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin."", ""status"": ""ok"", ""claims"": [{""person"": ""Márk Fehér"", ""year"": 2021}, {""person"": ""Márk Fehér"", ""year"": 2022}, {""person"": ""Patrik Pavlišin"", ""year"": 2021}, {""person"": ""Patrik Pavlišin"", ""year"": 2022}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""], ""count"": 2}"
|
||||
wide-057,same_academic_year_pair,True,,9.067882338000345,True,True,True,True,True,True,Ktoré spoločné roky prác majú osoby Denis Le Thanh a Ján Pták?,"{""answer"": ""Osoby Denis Le Thanh a Ján Pták majú spoločný rok práce 2026. Zdroje: https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh, https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""status"": ""ok"", ""claims"": [{""person"": ""Denis Le Thanh"", ""year"": 2026}, {""person"": ""Ján Pták"", ""year"": 2026}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""], ""count"": 1}"
|
||||
wide-058,same_academic_year_pair,True,,9.767850545002148,True,True,True,True,True,True,Porovnaj rovnaké roky práce pri osobách Artur Hyrenko a Rostyslav Rodzhuk.,"{""answer"": ""Artur Hyrenko a Rostyslav Rodzhuk majú rovnaký rok práce 2026. Zdroje: https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko, https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""status"": ""ok"", ""claims"": [{""person"": ""Artur Hyrenko"", ""year"": 2026}, {""person"": ""Rostyslav Rodzhuk"", ""year"": 2026}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""], ""count"": 2}"
|
||||
wide-059,same_academic_year_pair,True,,8.003912930995284,True,True,True,True,True,True,Aké spoločné roky práce spájajú osoby Dávid Kostilník a Vladyslav Yanchenko?,"{""answer"": ""Osoby Dávid Kostilník a Vladyslav Yanchenko majú spoločný rok práce 2025. Dávid Kostilník je uvedený v roku 2025 (zdroj: https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik) a Vladyslav Yanchenko je tiež uvedený v roku 2025 (zdroj: https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko)."", ""status"": ""ok"", ""claims"": [{""person"": ""Dávid Kostilník"", ""year"": 2025}, {""person"": ""Vladyslav Yanchenko"", ""year"": 2025}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""], ""count"": 1}"
|
||||
wide-060,same_academic_year_pair,True,,10.589566226000898,True,True,True,True,True,True,Ktoré spoločné roky prác majú osoby Alina Vitko a Jakub Maruniak?,"{""answer"": ""Osoby Alina Vitko a Jakub Maruniak majú spoločný rok prác 2021. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak, https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""status"": ""ok"", ""claims"": [{""person"": ""Jakub Maruniak"", ""year"": 2021}, {""person"": ""Alina Vitko"", ""year"": 2021}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""], ""count"": 1}"
|
||||
wide-061,same_academic_year_pair,True,,8.728929495002376,True,True,True,True,True,True,Porovnaj rovnaké roky práce pri osobách Dávid Stromp a Matúš Suchanič.,"{""answer"": ""Dávid Stromp a Matúš Suchanič majú rovnaký rok práce 2022. Zdroje: https://zp.kemt.fei.tuke.sk/students/2019/david_stromp, https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""status"": ""ok"", ""claims"": [{""person"": ""Dávid Stromp"", ""year"": 2022}, {""person"": ""Matúš Suchanič"", ""year"": 2022}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""], ""count"": 2}"
|
||||
wide-062,same_academic_year_pair,True,,9.624930268000753,True,True,True,True,True,True,Aké spoločné roky práce spájajú osoby Filip Tomáš a Valerii Kutsenko?,"{""answer"": ""Osoby Filip Tomáš a Valerii Kutsenko majú spoločný rok práce 2025. Zdroje: https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas, https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""status"": ""ok"", ""claims"": [{""person"": ""Filip Tomáš"", ""year"": 2025}, {""person"": ""Valerii Kutsenko"", ""year"": 2025}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""], ""count"": 1}"
|
||||
wide-063,same_academic_year_pair,True,,7.708646625003894,True,True,True,True,True,True,Ktoré spoločné roky prác majú osoby Jakub Maruniak a Tomáš Kuchárik?,"{""answer"": ""Osoby Jakub Maruniak a Tomáš Kuchárik majú spoločný rok prác 2021. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak, https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""status"": ""ok"", ""claims"": [{""person"": ""Jakub Maruniak"", ""year"": 2021}, {""person"": ""Tomáš Kuchárik"", ""year"": 2021}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""], ""count"": 1}"
|
||||
wide-064,same_academic_year_pair,True,,9.076152639994689,True,True,True,True,True,True,Porovnaj rovnaké roky práce pri osobách Oleh Bilykh a Samuel Horáni.,"{""answer"": ""Oleh Bilykh a Samuel Horáni majú rovnaký rok práce 2021. Zdroje: https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh, https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""status"": ""ok"", ""claims"": [{""person"": ""Oleh Bilykh"", ""year"": 2021}, {""person"": ""Samuel Horáni"", ""year"": 2021}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani""], ""count"": 2}"
|
||||
wide-065,same_academic_year_pair,True,,8.600696289999178,True,True,True,True,True,True,Aké spoločné roky práce spájajú osoby Dmytro Ushatenko a Patrik Pavlišin?,"{""answer"": ""Spoločným rokom práce pre Dmytra Ushatenka a Patrika Pavlišina je 2020. Dmytro Ushatenko pracoval v roku 2020 (zdroj: https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko) a Patrik Pavlišin pracoval v roku 2020 (zdroj: https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin)."", ""status"": ""ok"", ""claims"": [{""person"": ""Dmytro Ushatenko"", ""year"": 2020}, {""person"": ""Patrik Pavlišin"", ""year"": 2020}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""], ""count"": 1}"
|
||||
wide-066,same_academic_year_pair,True,,9.30446918799862,True,True,True,True,True,True,Ktoré spoločné roky prác majú osoby Jakub Maruniak a Ondrej Megela?,"{""answer"": ""Osoby Jakub Maruniak a Ondrej Megela majú spoločný rok práce 2020. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak, https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""status"": ""ok"", ""claims"": [{""person"": ""Ondrej Megela"", ""year"": 2020}, {""person"": ""Jakub Maruniak"", ""year"": 2020}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""], ""count"": 1}"
|
||||
wide-067,same_academic_year_pair,True,,10.539549341003294,True,True,True,True,True,True,Porovnaj rovnaké roky práce pri osobách Alina Vitko a Dmytro Mural.,"{""answer"": ""Alina Vitko a Dmytro Mural majú rovnaké roky práce 2021 a 2022. Zdroje: https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko, https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural."", ""status"": ""ok"", ""claims"": [{""person"": ""Alina Vitko"", ""year"": 2021}, {""person"": ""Alina Vitko"", ""year"": 2022}, {""person"": ""Dmytro Mural"", ""year"": 2021}, {""person"": ""Dmytro Mural"", ""year"": 2022}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural""], ""count"": 2}"
|
||||
wide-068,same_academic_year_pair,True,,8.96055851499841,True,True,True,True,True,True,Aké spoločné roky práce spájajú osoby Tetiana Mohorian a Yevhenii Leonov?,"{""answer"": ""Spoločným rokom práce, ktorý spája Tetiana Mohorian a Yevhenii Leonov, je rok 2025. Tieto údaje sú potvrdené v zdrojoch: https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian a https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov."", ""status"": ""ok"", ""claims"": [{""person"": ""Tetiana Mohorian"", ""year"": 2025}, {""person"": ""Yevhenii Leonov"", ""year"": 2025}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov""], ""count"": 1}"
|
||||
wide-069,same_academic_year_pair,True,,10.708338853000896,True,True,True,True,True,True,Ktoré spoločné roky prác majú osoby Oleksandr Hryshchenko a Ronald Zalacko?,"{""answer"": ""Oleksandr Hryshchenko a Ronald Zalacko majú spoločný rok práce 2026. Zdroje: https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko, https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""status"": ""ok"", ""claims"": [{""person"": ""Oleksandr Hryshchenko"", ""year"": 2026}, {""person"": ""Ronald Zalacko"", ""year"": 2026}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""], ""count"": 1}"
|
||||
wide-070,same_academic_year_pair,True,,7.392514177001431,True,True,True,True,True,True,Porovnaj rovnaké roky práce pri osobách Adrián Remiáš a Pavol Hudák.,"{""answer"": ""Adrián Remiáš a Pavol Hudák majú rovnaký rok práce 2024. Zdroje: https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias, https://zp.kemt.fei.tuke.sk/students/2020/pavol_hudak."", ""status"": ""ok"", ""claims"": [{""person"": ""Adrián Remiáš"", ""year"": 2024}, {""person"": ""Pavol Hudák"", ""year"": 2024}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2020/pavol_hudak""], ""count"": 2}"
|
||||
wide-071,same_academic_year_pair,True,,13.657042221995653,True,True,True,True,True,True,Aké spoločné roky práce spájajú osoby Nikita Bodnar a Patrik Pokrivčák?,"{""answer"": ""Spoločnými rokmi práce osôb Nikita Bodnar a Patrik Pokrivčák sú roky 2024 a 2025. Obe osoby majú zaznamenané roky 2024 a 2025 v zdrojoch: https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar a https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak."", ""status"": ""ok"", ""claims"": [{""person"": ""Nikita Bodnar"", ""year"": 2024}, {""person"": ""Nikita Bodnar"", ""year"": 2025}, {""person"": ""Patrik Pokrivčák"", ""year"": 2024}, {""person"": ""Patrik Pokrivčák"", ""year"": 2025}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak""], ""count"": 2}"
|
||||
wide-072,same_academic_year_pair,True,,6.338669182994636,True,True,True,True,True,True,Ktoré spoločné roky prác majú osoby Ján Malinovský a Simona Bobrovčanová?,"{""answer"": ""Osoby Ján Malinovský a Simona Bobrovčanová majú spoločný rok práce 2026. Zdroje: https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky, https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""status"": ""ok"", ""claims"": [{""person"": ""Ján Malinovský"", ""year"": 2026}, {""person"": ""Simona Bobrovčanová"", ""year"": 2026}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""], ""count"": 1}"
|
||||
wide-073,same_academic_year_pair,True,,11.086802947000251,True,True,True,True,True,True,Porovnaj rovnaké roky práce pri osobách Jakub Maruniak a Márk Fehér.,"{""answer"": ""Jakub Maruniak a Márk Fehér majú rovnaký rok práce 2021. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak, https://zp.kemt.fei.tuke.sk/students/2016/mark_feher."", ""status"": ""ok"", ""claims"": [{""person"": ""Jakub Maruniak"", ""year"": 2021}, {""person"": ""Márk Fehér"", ""year"": 2021}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher""], ""count"": 2}"
|
||||
wide-074,same_academic_year_pair,True,,8.229125010002463,True,True,True,True,True,True,Aké spoločné roky práce spájajú osoby Kamil Tomčufčík a Valerii Kutsenko?,"{""answer"": ""Osoby Kamil Tomčufčík a Valerii Kutsenko majú spoločný rok práce 2025. Zdroje: https://zp.kemt.fei.tuke.sk/students/2020/kamil_tomcufcik, https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""status"": ""ok"", ""claims"": [{""person"": ""Kamil Tomčufčík"", ""year"": 2025}, {""person"": ""Valerii Kutsenko"", ""year"": 2025}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2020/kamil_tomcufcik"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""], ""count"": 1}"
|
||||
wide-075,same_academic_year_pair,True,,9.072914823002066,True,True,True,True,True,True,Ktoré spoločné roky prác majú osoby Serhii Yemets a Tetiana Mohorian?,"{""answer"": ""Osoby Serhii Yemets a Tetiana Mohorian majú spoločný rok prác 2025. Zdroje: https://zp.kemt.fei.tuke.sk/students/2022/serhii_yemets, https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian"", ""status"": ""ok"", ""claims"": [{""person"": ""Serhii Yemets"", ""year"": 2025}, {""person"": ""Tetiana Mohorian"", ""year"": 2025}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/serhii_yemets"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""], ""count"": 1}"
|
||||
wide-076,same_academic_year_pair,True,,7.277860586000315,True,True,True,True,True,True,Porovnaj rovnaké roky práce pri osobách Martin Šarišský a Serhii Yemets.,"{""answer"": ""Martin Šarišský a Serhii Yemets majú rovnaký rok práce 2025. Zdroje: https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky, https://zp.kemt.fei.tuke.sk/students/2022/serhii_yemets"", ""status"": ""ok"", ""claims"": [{""person"": ""Martin Šarišský"", ""year"": 2025}, {""person"": ""Serhii Yemets"", ""year"": 2025}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/serhii_yemets""], ""count"": 2}"
|
||||
wide-077,same_academic_year_pair,True,,8.747992983000586,True,True,True,True,True,True,Aké spoločné roky práce spájajú osoby Matej Kobyľan a Nikita Bodnar?,"{""answer"": ""Spoločným rokom práce pre Mateja Kobyľana a Nikitu Bodnara je 2024. Zdroje: https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan, https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""status"": ""ok"", ""claims"": [{""person"": ""Matej Kobyľan"", ""year"": 2024}, {""person"": ""Nikita Bodnar"", ""year"": 2024}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar""], ""count"": 1}"
|
||||
wide-078,same_academic_year_pair,True,,7.9442629190016305,True,True,True,True,True,True,Ktoré spoločné roky prác majú osoby Dárius Lindvai a Martin NaN1?,"{""answer"": ""Osoby Dárius Lindvai a Martin NaN1 majú spoločný rok práce 2020. Dárius Lindvai má prácu z roku 2020 (zdroj: https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai) a Martin NaN1 má prácu z roku 2020 (zdroj: https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday)."", ""status"": ""ok"", ""claims"": [{""person"": ""Dárius Lindvai"", ""year"": 2020}, {""person"": ""Martin NaN1"", ""year"": 2020}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday""], ""count"": 1}"
|
||||
wide-079,same_academic_year_pair,True,,8.828723204998823,True,True,True,True,True,True,Porovnaj rovnaké roky práce pri osobách Artur Hyrenko a Samuel Džurina.,"{""answer"": ""Artur Hyrenko a Samuel Džurina majú rovnaký rok práce 2026. Zdroje: https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko, https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""status"": ""ok"", ""claims"": [{""person"": ""Artur Hyrenko"", ""year"": 2026}, {""person"": ""Samuel Džurina"", ""year"": 2026}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""], ""count"": 2}"
|
||||
wide-080,same_academic_year_pair,False,,10.36691496399726,True,True,True,True,True,True,Aké spoločné roky práce spájajú osoby Dávid Stromp a Dominik Nagy?,"{""answer"": ""Spoločné roky práce pre Dávida Strompa a Dominika Nagya sú 2021 a 2022. Tieto údaje sú potvrdené zdrojmi: https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy a https://zp.kemt.fei.tuke.sk/students/2019/david_stromp."", ""status"": ""ok"", ""claims"": [{""person"": ""Dominik Nagy"", ""year"": 2021}, {""person"": ""Dominik Nagy"", ""year"": 2022}, {""person"": ""Dávid Stromp"", ""year"": 2021}, {""person"": ""Dávid Stromp"", ""year"": 2022}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp""], ""count"": 2}"
|
||||
wide-083,same_start_year_pair,True,,8.719621158001246,True,True,True,True,True,True,Aký spoločný rok začiatku štúdia majú osoby Lukáš Pokrývka a Maroš Harahus?,"{""answer"": ""Lukáš Pokrývka a Maroš Harahus majú spoločný rok začiatku štúdia 2016. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka, https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""status"": ""ok"", ""claims"": [{""person"": ""Lukáš Pokrývka"", ""start_year"": 2016}, {""person"": ""Maroš Harahus"", ""start_year"": 2016}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""], ""count"": 2}"
|
||||
wide-084,same_start_year_pair,True,,12.174287679998088,True,True,True,True,True,True,Porovnaj rovnaký rok začiatku štúdia osôb Dávid Kostilník a Jakub Kristián Lukas.,"{""answer"": ""Dávid Kostilník a Jakub Kristián Lukas začali štúdium v rovnakom roku 2020. Zdroje: https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik, https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas"", ""status"": ""ok"", ""claims"": [{""person"": ""Dávid Kostilník"", ""start_year"": 2020}, {""person"": ""Jakub Kristián Lukas"", ""start_year"": 2020}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas""], ""count"": 2}"
|
||||
wide-085,same_start_year_pair,True,,5.55311806199461,True,True,True,True,True,True,Aký spoločný rok začiatku štúdia majú osoby Dominik Nagy a Jakub Maruniak?,"{""answer"": ""Dominik Nagy a Jakub Maruniak majú spoločný rok začiatku štúdia 2016. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy, https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""status"": ""ok"", ""claims"": [{""person"": ""Dominik Nagy"", ""start_year"": 2016}, {""person"": ""Jakub Maruniak"", ""start_year"": 2016}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""], ""count"": 2}"
|
||||
wide-086,same_start_year_pair,True,,10.080774428999575,True,True,True,True,True,True,Aký spoločný rok začiatku štúdia majú osoby Artem Yatsenko a Samuel Horáni?,"{""answer"": ""Artem Yatsenko a Samuel Horáni majú spoločný rok začiatku štúdia 2019. Zdroje: https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko, https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""status"": ""ok"", ""claims"": [{""person"": ""Artem Yatsenko"", ""start_year"": 2019}, {""person"": ""Samuel Horáni"", ""start_year"": 2019}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani""], ""count"": 2}"
|
||||
wide-087,same_start_year_pair,True,,7.166185222995409,True,True,True,True,True,True,Porovnaj rovnaký rok začiatku štúdia osôb Dmytro Mural a Samuel Horáni.,"{""answer"": ""Dmytro Mural a Samuel Horáni začali štúdium v rovnakom roku 2019. Zdroje: https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural, https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""status"": ""ok"", ""claims"": [{""person"": ""Dmytro Mural"", ""start_year"": 2019}, {""person"": ""Samuel Horáni"", ""start_year"": 2019}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani""], ""count"": 2}"
|
||||
wide-088,same_start_year_pair,True,,9.089845142996637,True,True,True,True,True,True,Aký spoločný rok začiatku štúdia majú osoby Ján Holp a Maroš Harahus?,"{""answer"": ""Osoby Ján Holp a Maroš Harahus majú spoločný rok začiatku štúdia 2016. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/jan_holp, https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""status"": ""ok"", ""claims"": [{""person"": ""Ján Holp"", ""start_year"": 2016}, {""person"": ""Maroš Harahus"", ""start_year"": 2016}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""], ""count"": 2}"
|
||||
wide-089,same_start_year_pair,True,,7.242540999999619,True,True,True,True,True,True,Aký spoločný rok začiatku štúdia majú osoby Dávid Kostilník a Vladyslav Krupko?,"{""answer"": ""Dávid Kostilník a Vladyslav Krupko majú spoločný rok začiatku štúdia 2020. Zdroje: https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik, https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""status"": ""ok"", ""claims"": [{""person"": ""Dávid Kostilník"", ""start_year"": 2020}, {""person"": ""Vladyslav Krupko"", ""start_year"": 2020}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""], ""count"": 2}"
|
||||
wide-090,same_start_year_pair,True,,9.571305277997453,True,True,True,True,True,True,Porovnaj rovnaký rok začiatku štúdia osôb Martin Jancura a Stanislav Matsunych.,"{""answer"": ""Martin Jancura a Stanislav Matsunych začali štúdium v rovnakom roku 2017. Zdroje: https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura, https://zp.kemt.fei.tuke.sk/students/2017/stanislav_matsunych"", ""status"": ""ok"", ""claims"": [{""person"": ""Martin Jancura"", ""start_year"": 2017}, {""person"": ""Stanislav Matsunych"", ""start_year"": 2017}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2017/stanislav_matsunych""], ""count"": 2}"
|
||||
wide-091,same_start_year_pair,True,,7.682041077001486,True,True,True,True,True,True,Aký spoločný rok začiatku štúdia majú osoby Matej Novotný a Nikita Bodnar?,"{""answer"": ""Matej Novotný a Nikita Bodnar majú spoločný rok začiatku štúdia 2021. Zdroje: https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny, https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""status"": ""ok"", ""claims"": [{""person"": ""Matej Novotný"", ""start_year"": 2021}, {""person"": ""Nikita Bodnar"", ""start_year"": 2021}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar""], ""count"": 2}"
|
||||
wide-092,same_start_year_pair,True,,9.652925777001656,True,True,True,True,True,True,Aký spoločný rok začiatku štúdia majú osoby Dávid Omasta a Martin Wencel?,"{""answer"": ""Dávid Omasta a Martin Wencel majú spoločný rok začiatku štúdia 2018. Zdroje: https://zp.kemt.fei.tuke.sk/students/2018/david_omasta, https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""status"": ""ok"", ""claims"": [{""person"": ""Dávid Omasta"", ""start_year"": 2018}, {""person"": ""Martin Wencel"", ""start_year"": 2018}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""], ""count"": 2}"
|
||||
wide-093,same_start_year_pair,True,,7.145516338998277,True,True,True,True,True,True,Porovnaj rovnaký rok začiatku štúdia osôb Samuel Vasiľ a Valerii Kutsenko.,"{""answer"": ""Samuel Vasiľ a Valerii Kutsenko začali štúdium v rovnakom roku 2022. Zdroje: https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil, https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""status"": ""ok"", ""claims"": [{""person"": ""Samuel Vasiľ"", ""start_year"": 2022}, {""person"": ""Valerii Kutsenko"", ""start_year"": 2022}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""], ""count"": 2}"
|
||||
wide-094,same_start_year_pair,True,,9.363720138004282,True,True,True,True,True,True,Aký spoločný rok začiatku štúdia majú osoby Dmytro Mural a Kristián Sopkovič?,"{""answer"": ""Dmytro Mural a Kristián Sopkovič majú spoločný rok začiatku štúdia 2019. Zdroje: https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural, https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""status"": ""ok"", ""claims"": [{""person"": ""Dmytro Mural"", ""start_year"": 2019}, {""person"": ""Kristián Sopkovič"", ""start_year"": 2019}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""], ""count"": 2}"
|
||||
wide-095,same_start_year_pair,True,,7.0345262230039225,True,True,True,True,True,True,Aký spoločný rok začiatku štúdia majú osoby Oleksandr Dorybohov a Samuel Džurina?,"{""answer"": ""Oleksandr Dorybohov a Samuel Džurina majú spoločný rok začiatku štúdia 2023. Zdroje: https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov, https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""status"": ""ok"", ""claims"": [{""person"": ""Oleksandr Dorybohov"", ""start_year"": 2023}, {""person"": ""Samuel Džurina"", ""start_year"": 2023}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""], ""count"": 2}"
|
||||
wide-096,same_start_year_pair,True,,9.334781532001216,True,True,True,True,True,True,Porovnaj rovnaký rok začiatku štúdia osôb Michal Stromko a Patrik Pokrivčák.,"{""answer"": ""Michal Stromko a Patrik Pokrivčák začali štúdium v rovnakom roku 2019. Zdroje: https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko, https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak"", ""status"": ""ok"", ""claims"": [{""person"": ""Michal Stromko"", ""start_year"": 2019}, {""person"": ""Patrik Pokrivčák"", ""start_year"": 2019}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak""], ""count"": 2}"
|
||||
wide-097,same_start_year_pair,True,,7.029824302000634,True,True,True,True,True,True,Aký spoločný rok začiatku štúdia majú osoby Martin Šarišský a Matej Ščišľak?,"{""answer"": ""Martin Šarišský a Matej Ščišľak majú spoločný rok začiatku štúdia 2021. Zdroje: https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky, https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""status"": ""ok"", ""claims"": [{""person"": ""Martin Šarišský"", ""start_year"": 2021}, {""person"": ""Matej Ščišľak"", ""start_year"": 2021}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""], ""count"": 2}"
|
||||
wide-098,same_start_year_pair,True,,9.2781991909942,True,True,True,True,True,True,Aký spoločný rok začiatku štúdia majú osoby Matej Kobyľan a Pavol Hudák?,"{""answer"": ""Spoločný rok začiatku štúdia pre Mateja Kobyľana a Pavola Hudáka je 2020. Zdroje: https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan, https://zp.kemt.fei.tuke.sk/students/2020/pavol_hudak"", ""status"": ""ok"", ""claims"": [{""person"": ""Matej Kobyľan"", ""start_year"": 2020}, {""person"": ""Pavol Hudák"", ""start_year"": 2020}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2020/pavol_hudak""], ""count"": 2}"
|
||||
wide-099,same_start_year_pair,True,,6.882240877996082,True,True,True,True,True,True,Porovnaj rovnaký rok začiatku štúdia osôb Alina Vitko a Dávid Stromp.,"{""answer"": ""Alina Vitko a Dávid Stromp začali štúdium v rovnakom roku 2019. Zdroje: https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko, https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""status"": ""ok"", ""claims"": [{""person"": ""Alina Vitko"", ""start_year"": 2019}, {""person"": ""Dávid Stromp"", ""start_year"": 2019}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp""], ""count"": 2}"
|
||||
wide-100,same_start_year_pair,True,,9.426582434993179,True,True,True,True,True,True,Aký spoločný rok začiatku štúdia majú osoby Ronald Zalacko a Simona Bobrovčanová?,"{""answer"": ""Ronald Zalacko a Simona Bobrovčanová majú spoločný rok začiatku štúdia 2023. Zdroje: https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko, https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""status"": ""ok"", ""claims"": [{""person"": ""Ronald Zalacko"", ""start_year"": 2023}, {""person"": ""Simona Bobrovčanová"", ""start_year"": 2023}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""], ""count"": 2}"
|
||||
wide-101,same_start_year_pair,True,,6.825582851000945,True,True,True,True,True,True,Aký spoločný rok začiatku štúdia majú osoby Jakub Schwarc a Valerii Kutsenko?,"{""answer"": ""Osoby Jakub Schwarc a Valerii Kutsenko majú spoločný rok začiatku štúdia 2022. Zdroje: https://zp.kemt.fei.tuke.sk/students/2022/jakub_schwarc, https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""status"": ""ok"", ""claims"": [{""person"": ""Jakub Schwarc"", ""start_year"": 2022}, {""person"": ""Valerii Kutsenko"", ""start_year"": 2022}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/jakub_schwarc"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""], ""count"": 2}"
|
||||
wide-102,same_start_year_pair,True,,9.520078122004634,True,True,True,True,True,True,Porovnaj rovnaký rok začiatku štúdia osôb Ján Malinovský a Tetiana Mohorian.,"{""answer"": ""Ján Malinovský a Tetiana Mohorian začali štúdium v rovnakom roku 2022. Zdroje: https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky, https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian"", ""status"": ""ok"", ""claims"": [{""person"": ""Ján Malinovský"", ""start_year"": 2022}, {""person"": ""Tetiana Mohorian"", ""start_year"": 2022}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""], ""count"": 2}"
|
||||
wide-103,same_start_year_pair,True,,6.680194066000695,True,True,True,True,True,True,Aký spoločný rok začiatku štúdia majú osoby Martin Šarišský a Vladimír Ferko?,"{""answer"": ""Martin Šarišský a Vladimír Ferko majú spoločný rok začiatku štúdia 2021. Zdroje: https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky, https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""status"": ""ok"", ""claims"": [{""person"": ""Martin Šarišský"", ""start_year"": 2021}, {""person"": ""Vladimír Ferko"", ""start_year"": 2021}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""], ""count"": 2}"
|
||||
wide-104,same_start_year_pair,False,,9.48697051199997,True,True,True,True,True,False,Aký spoločný rok začiatku štúdia majú osoby Adrián Remiáš a Martin NaN1?,"{""answer"": ""Spoločný rok začiatku štúdia pre Adriána Remiáša a Martina NaN1 je 2018. Zdroje: https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias, https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday"", ""status"": ""ok"", ""claims"": [{""person"": ""Adrián Remiáš"", ""start_year"": 2018}, {""person"": ""Martin NaN1"", ""start_year"": 2018}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday""], ""count"": 1}"
|
||||
wide-105,same_start_year_pair,True,,6.5554323559990735,True,True,True,True,True,True,Porovnaj rovnaký rok začiatku štúdia osôb Dominik Nagy a Maroš Harahus.,"{""answer"": ""Dominik Nagy a Maroš Harahus začali štúdium v rovnakom roku 2016. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy, https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""status"": ""ok"", ""claims"": [{""person"": ""Dominik Nagy"", ""start_year"": 2016}, {""person"": ""Maroš Harahus"", ""start_year"": 2016}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""], ""count"": 2}"
|
||||
wide-106,same_start_year_pair,True,,9.503550268003892,True,True,True,True,True,True,Aký spoločný rok začiatku štúdia majú osoby Kamil Tomčufčík a Matúš Suchanič?,"{""answer"": ""Spoločný rok začiatku štúdia pre Kamil Tomčufčík a Matúš Suchanič je 2020. Zdroje: https://zp.kemt.fei.tuke.sk/students/2020/kamil_tomcufcik, https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""status"": ""ok"", ""claims"": [{""person"": ""Kamil Tomčufčík"", ""start_year"": 2020}, {""person"": ""Matúš Suchanič"", ""start_year"": 2020}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2020/kamil_tomcufcik"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""], ""count"": 2}"
|
||||
wide-107,same_start_year_pair,True,,6.221047974002431,True,True,True,True,True,True,Aký spoločný rok začiatku štúdia majú osoby Dominik Nagy a Márk Fehér?,"{""answer"": ""Dominik Nagy a Márk Fehér majú spoločný rok začiatku štúdia 2016. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy, https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""status"": ""ok"", ""claims"": [{""person"": ""Dominik Nagy"", ""start_year"": 2016}, {""person"": ""Márk Fehér"", ""start_year"": 2016}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher""], ""count"": 2}"
|
||||
wide-108,same_start_year_pair,True,,11.524189818002924,True,True,True,True,True,True,Porovnaj rovnaký rok začiatku štúdia osôb Artur Hyrenko a Manohar Gowdru Shridhara.,"{""answer"": ""Artur Hyrenko a Manohar Gowdru Shridhara začali štúdium v rovnakom roku 2021. Zdroje: https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko, https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""status"": ""ok"", ""claims"": [{""person"": ""Artur Hyrenko"", ""start_year"": 2021}, {""person"": ""Manohar Gowdru Shridhara"", ""start_year"": 2021}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu""], ""count"": 2}"
|
||||
wide-109,same_start_year_pair,True,,5.475857990000804,True,True,True,True,True,True,Aký spoločný rok začiatku štúdia majú osoby Adrián Remiáš a Dávid Iľaš?,"{""answer"": ""Adrián Remiáš a Dávid Iľaš majú spoločný rok začiatku štúdia 2018. Zdroje: https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias, https://zp.kemt.fei.tuke.sk/students/2018/david_ilas"", ""status"": ""ok"", ""claims"": [{""person"": ""Adrián Remiáš"", ""start_year"": 2018}, {""person"": ""Dávid Iľaš"", ""start_year"": 2018}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_ilas""], ""count"": 2}"
|
||||
wide-110,same_start_year_pair,True,,10.211346320000303,True,True,True,True,True,True,Aký spoločný rok začiatku štúdia majú osoby Filip Tomáš a Samuel Horáni?,"{""answer"": ""Osoby Filip Tomáš a Samuel Horáni majú spoločný rok začiatku štúdia 2019. Zdroje: https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas, https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""status"": ""ok"", ""claims"": [{""person"": ""Filip Tomáš"", ""start_year"": 2019}, {""person"": ""Samuel Horáni"", ""start_year"": 2019}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani""], ""count"": 2}"
|
||||
wide-111,same_start_year_pair,True,,8.28008010499616,True,True,True,True,True,True,Porovnaj rovnaký rok začiatku štúdia osôb Dominik Nagy a Tomáš Kuchárik.,"{""answer"": ""Dominik Nagy a Tomáš Kuchárik začali štúdium v rovnakom roku 2016 (zdroje: https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy, https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik)."", ""status"": ""ok"", ""claims"": [{""person"": ""Dominik Nagy"", ""start_year"": 2016}, {""person"": ""Tomáš Kuchárik"", ""start_year"": 2016}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""], ""count"": 2}"
|
||||
wide-112,same_start_year_pair,True,,9.384743433998665,True,True,True,True,True,True,Aký spoločný rok začiatku štúdia majú osoby Jakub Maruniak a Tomáš Kuchárik?,"{""answer"": ""Jakub Maruniak a Tomáš Kuchárik majú spoločný rok začiatku štúdia 2016. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak, https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""status"": ""ok"", ""claims"": [{""person"": ""Jakub Maruniak"", ""start_year"": 2016}, {""person"": ""Tomáš Kuchárik"", ""start_year"": 2016}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""], ""count"": 1}"
|
||||
wide-115,person_title_year,True,,7.64530175300024,True,True,True,True,True,True,Uveď názov práce osoby Dárius Lindvai a rok práce pre rok 2021.,"{""answer"": ""Osoba Dárius Lindvai má v roku 2021 prácu s názvom \""Obnovenie interpunkcie pomocou hlbokých neurónových sietí\"". Zdroj: https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""status"": ""ok"", ""claims"": [{""person"": ""Dárius Lindvai"", ""title"": ""Obnovenie interpunkcie pomocou hlbokých neurónových sietí"", ""year"": 2021}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai""], ""count"": 1}"
|
||||
wide-116,person_title_year,True,,6.991201303004345,True,True,True,True,True,True,Aký názov práce a rok práce sú pri osobe Jakub Maruniak uvedené pre rok 2019?,"{""answer"": ""Pre rok 2019 je pri osobe Jakub Maruniak uvedený názov práce \""Rešerš\"" a rok 2019. Zdroj: https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""status"": ""ok"", ""claims"": [{""person"": ""Jakub Maruniak"", ""title"": ""Rešerš"", ""year"": 2019}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""], ""count"": 1}"
|
||||
wide-117,person_title_year,True,,7.595171244000085,True,True,True,True,True,True,Uveď názov práce osoby Andrii Pervashov a rok práce pre rok 2027.,"{""answer"": ""Osoba Andrii Pervashov má v roku 2027 prácu s názvom \""Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu\"" (zdroj: https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov)."", ""status"": ""ok"", ""claims"": [{""person"": ""Andrii Pervashov"", ""title"": ""Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu"", ""year"": 2027}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""], ""count"": 1}"
|
||||
wide-118,person_title_year,True,,6.700285118997272,True,True,True,True,True,True,Uveď názov práce osoby Andrii Pervashov a rok práce pre rok 2025.,"{""answer"": ""Osoba Andrii Pervashov má v roku 2025 prácu s názvom \""Korekcia textu pomocou neurónových sietí\"". Zdroj: https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""status"": ""ok"", ""claims"": [{""person"": ""Andrii Pervashov"", ""title"": ""Korekcia textu pomocou neurónových sietí"", ""year"": 2025}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""], ""count"": 1}"
|
||||
wide-119,person_title_year,False,"JSONDecodeError: Expecting ',' delimiter: line 1 column 135 (char 134)",7.856277612998383,,,,,,,Aký názov diplomového projektu a rok práce sú pri osobe Ján Malinovský uvedené pre rok 2026?,null
|
||||
wide-120,person_title_year,True,,5.406756443000631,True,True,True,True,True,True,Uveď názov práce osoby Dávid Kostilník a rok práce pre rok 2025.,"{""answer"": ""Dávid Kostilník má v roku 2025 prácu s názvom \""Sémantické vyhľadávanie pomocou veľkých modelov\"". Zdroj: https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik"", ""status"": ""ok"", ""claims"": [{""person"": ""Dávid Kostilník"", ""title"": ""Sémantické vyhľadávanie pomocou veľkých modelov"", ""year"": 2025}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik""], ""count"": 1}"
|
||||
wide-121,person_title_year,True,,7.843929166003363,True,True,True,True,True,True,Uveď názov práce osoby Martin NaN1 a rok práce pre rok 2020.,"{""answer"": ""Osoba Martin NaN1 má v roku 2020 prácu s názvom \""Využitie najnovších nástrojov v rámci prirodzeného spracovania reči\"" (zdroj: https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday)."", ""status"": ""ok"", ""claims"": [{""person"": ""Martin NaN1"", ""title"": ""Využitie najnovších nástrojov v rámci prirodzeného spracovania reči"", ""year"": 2020}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday""], ""count"": 1}"
|
||||
wide-122,person_title_year,True,,5.50400585099851,True,True,True,True,True,True,Aký názov práce a rok práce sú pri osobe Oleksandr Dorybohov uvedené pre rok 2026?,"{""answer"": ""Pre osobu Oleksandr Dorybohov je v roku 2026 uvedená práca s názvom \""Automatické odpovede na otázky v právnej oblasti\"". Zdroj: https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""status"": ""ok"", ""claims"": [{""person"": ""Oleksandr Dorybohov"", ""title"": ""Automatické odpovede na otázky v právnej oblasti"", ""year"": 2026}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""], ""count"": 1}"
|
||||
wide-123,person_title_year,True,,7.8118334250029875,True,True,True,True,True,True,Uveď názov práce osoby Martin Šarišský a rok práce pre rok 2026.,"{""answer"": ""Martin Šarišský má v roku 2026 prácu s názvom \""Agentové systémy pomocou veľkého jazykového modelu\"" (zdroj: https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky)."", ""status"": ""ok"", ""claims"": [{""person"": ""Martin Šarišský"", ""title"": ""Agentové systémy pomocou veľkého jazykového modelu"", ""year"": 2026}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""], ""count"": 1}"
|
||||
wide-124,person_title_year,True,,5.611420686000201,True,True,True,True,True,True,Uveď názov práce osoby Daniil Huzenko a rok práce pre rok 2025.,"{""answer"": ""Daniil Huzenko má v roku 2025 prácu s názvom \""Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia\"". Zdroj: https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""status"": ""ok"", ""claims"": [{""person"": ""Daniil Huzenko"", ""title"": ""Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia"", ""year"": 2025}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""], ""count"": 1}"
|
||||
wide-125,person_title_year,True,,7.626659750996623,True,True,True,True,True,True,Aký názov práce a rok práce sú pri osobe Márk Fehér uvedené pre rok 2022?,"{""answer"": ""Pre osobu Márk Fehér je v roku 2022 uvedená práca s názvom \""Klasifikácia textu metódami strojového učenia\"" (zdroj: https://zp.kemt.fei.tuke.sk/students/2016/mark_feher)."", ""status"": ""ok"", ""claims"": [{""person"": ""Márk Fehér"", ""title"": ""Klasifikácia textu metódami strojového učenia"", ""year"": 2022}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher""], ""count"": 1}"
|
||||
wide-126,person_title_year,True,,5.4480505640021875,True,True,True,True,True,True,Uveď názov práce osoby Michal Stromko a rok práce pre rok 2022.,"{""answer"": ""Michal Stromko v roku 2022 vydal prácu s názvom \""Indexovanie slovenského textu pomocou Elasticsearch\"". Zdroj: https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""status"": ""ok"", ""claims"": [{""person"": ""Michal Stromko"", ""title"": ""Indexovanie slovenského textu pomocou Elasticsearch"", ""year"": 2022}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""], ""count"": 1}"
|
||||
wide-127,person_title_year,True,,7.319815613998799,True,True,True,True,True,True,Uveď názov práce osoby Samuel Džurina a rok práce pre rok 2026.,"{""answer"": ""Samuel Džurina má v roku 2026 prácu s názvom \""Dialógový systém pre podporu firemných procesov\"" (zdroj: https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina)."", ""status"": ""ok"", ""claims"": [{""person"": ""Samuel Džurina"", ""title"": ""Dialógový systém pre podporu firemných procesov"", ""year"": 2026}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""], ""count"": 1}"
|
||||
wide-128,person_title_year,True,,5.924834024001029,True,True,True,True,True,True,Aký názov práce a rok práce sú pri osobe Kristián Sopkovič uvedené pre rok 2022?,"{""answer"": ""Pre rok 2022 je pri osobe Kristián Sopkovič uvedená práca s názvom \""Model Spacy pre spracovanie prirodzeného jazyka v slovenčine\"". Zdroj: https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""status"": ""ok"", ""claims"": [{""person"": ""Kristián Sopkovič"", ""title"": ""Model Spacy pre spracovanie prirodzeného jazyka v slovenčine"", ""year"": 2022}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""], ""count"": 1}"
|
||||
wide-129,person_title_year,True,,8.256344303001242,True,True,True,True,True,True,Uveď názov diplomového projektu osoby Maroš Harahus a rok práce pre rok 2020.,"{""answer"": ""Maroš Harahus v roku 2020 vypracoval diplomový projekt s názvom „Doplnenie podpory morfologického značkovania slovenského jazyka do nlp frameworku (spacy alebo flair)\"". Zdroj: https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""status"": ""ok"", ""claims"": [{""person"": ""Maroš Harahus"", ""title"": ""Doplnenie podpory morfologického značkovania slovenského jazyka do nlp frameworku (spacy alebo flair)"", ""year"": 2020}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""], ""count"": 1}"
|
||||
wide-130,person_title_year,True,,5.6732517479977105,True,True,True,True,True,True,Uveď názov práce osoby Matej Kobyľan a rok práce pre rok 2023.,"{""answer"": ""Matej Kobyľan v roku 2023 vydal prácu s názvom \""Systém pre monitoring médií\"" (zdroj: https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan)."", ""status"": ""ok"", ""claims"": [{""person"": ""Matej Kobyľan"", ""title"": ""Systém pre monitoring médií"", ""year"": 2023}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""], ""count"": 1}"
|
||||
wide-131,person_title_year,True,,8.2095386889996,True,True,True,True,True,True,Aký názov práce a rok práce sú pri osobe Eduard Matovka uvedené pre rok 2024?,"{""answer"": ""Pre Eduarda Matovku je v roku 2024 uvedená práca s názvom \""Slovenská konverzačná umelá inteligencia\"" (zdroj: https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka)."", ""status"": ""ok"", ""claims"": [{""person"": ""Eduard Matovka"", ""title"": ""Slovenská konverzačná umelá inteligencia"", ""year"": 2024}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka""], ""count"": 1}"
|
||||
wide-132,person_title_year,True,,4.313341328997922,True,True,True,True,True,True,Uveď názov práce osoby Patrik Pavlišin a rok práce pre rok 2022.,"{""answer"": ""Patrik Pavlišin v roku 2022 vydal prácu s názvom „Neurónový strojový preklad“ (zdroj: https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin)."", ""status"": ""ok"", ""claims"": [{""person"": ""Patrik Pavlišin"", ""title"": ""Neurónový strojový preklad"", ""year"": 2022}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""], ""count"": 1}"
|
||||
wide-133,person_title_year,True,,8.382512608994148,True,True,True,True,True,True,Uveď názov práce osoby Matej Ščišľak a rok práce pre rok 2024.,"{""answer"": ""Matej Ščišľak v roku 2024 vypracoval prácu s názvom \""Dialógový systém pre potreby samosprávy\"". Zdroj: https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""status"": ""ok"", ""claims"": [{""person"": ""Matej Ščišľak"", ""title"": ""Dialógový systém pre potreby samosprávy"", ""year"": 2024}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""], ""count"": 1}"
|
||||
wide-134,person_title_year,True,,4.108209114005149,True,True,True,True,True,True,Aký názov práce a rok práce sú pri osobe Matúš Suchanič uvedené pre rok 2023?,"{""answer"": ""Pre rok 2023 je pri osobe Matúš Suchanič uvedená práca s názvom \""Automatická kategorizácia slovenského textu\"" (zdroj: https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic)."", ""status"": ""ok"", ""claims"": [{""person"": ""Matúš Suchanič"", ""title"": ""Automatická kategorizácia slovenského textu"", ""year"": 2023}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""], ""count"": 1}"
|
||||
wide-135,person_title_year,True,,7.9910924850046285,True,True,True,True,True,True,Uveď názov práce osoby Alina Vitko a rok práce pre rok 2021.,"{""answer"": ""Osoba Alina Vitko má v roku 2021 prácu s názvom \""Vytovrenie prehľadu existujúcich systémov QA.\"" (zdroj: https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko)."", ""status"": ""ok"", ""claims"": [{""person"": ""Alina Vitko"", ""title"": ""Vytovrenie prehľadu existujúcich systémov QA."", ""year"": 2021}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""], ""count"": 1}"
|
||||
wide-136,person_title_year,True,,5.380558614997426,True,True,True,True,True,True,Uveď názov diplomového projektu osoby Lukáš Pokrývka a rok práce pre rok 2020.,"{""answer"": ""Lukáš Pokrývka v roku 2020 vypracoval diplomový projekt s názvom \""Paralelné trénovanie neurónových sietí pomocou knižnice Pytorch.\"" (zdroj: https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka)"", ""status"": ""ok"", ""claims"": [{""person"": ""Lukáš Pokrývka"", ""title"": ""Paralelné trénovanie neurónových sietí pomocou knižnice Pytorch."", ""year"": 2020}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""], ""count"": 1}"
|
||||
wide-139,person_keyword_title,False,JSONDecodeError: Expecting property name enclosed in double quotes: line 1 column 119 (char 118),8.51874773700547,,,,,,,Uveď názov práce osoby Dominik Nagy v roku 2022 s kľúčovým slovom nlp.,null
|
||||
wide-140,person_keyword_title,True,,5.7996268090064405,True,True,True,True,True,True,Aký názov práce osoby Michal Stromko v roku 2022 súvisí s kľúčovým slovom nlp?,"{""answer"": ""Michal Stromko v roku 2022 vypracoval prácu s názvom \""Indexovanie slovenského textu pomocou Elasticsearch\"", ktorá súvisí s kľúčovým slovom NLP. Zdroj: https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""status"": ""ok"", ""claims"": [{""person"": ""Michal Stromko"", ""title"": ""Indexovanie slovenského textu pomocou Elasticsearch"", ""year"": 2022, ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""], ""count"": 1}"
|
||||
wide-141,person_keyword_title,False,JSONDecodeError: Expecting property name enclosed in double quotes: line 1 column 113 (char 112),8.499829861000762,,,,,,,Uveď názov práce osoby Martin Šarišský v roku 2026 s kľúčovým slovom rasa.,null
|
||||
wide-142,person_keyword_title,False,,8.239055701000325,False,True,False,True,True,True,Uveď názov práce osoby Dárius Lindvai v roku 2019 s kľúčovým slovom lstm.,"{""answer"": ""Na základe dodaných grafových faktov nie je možné určiť názov práce osoby Dárius Lindvai z roku 2019 s kľúčovým slovom lstm, pretože v grafe chýba záznam, ktorý by spájal rok 2019, kľúčové slovo lstm a názov práce tej istej osoby. Zdroj https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai uvádza pre rok 2019 prácu s názvom 'rešerš', ale neobsahuje kľúčové slovo lstm. Zdroj https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial uvádza kľúčové slovo lstm, ale neuvádza rok 2019 ani názov práce."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial""], ""count"": 0}"
|
||||
wide-143,person_keyword_title,False,,9.427794609000557,False,True,True,True,True,True,Aký názov práce osoby Dominik Nagy v roku 2022 súvisí s kľúčovým slovom seq2seq?,"{""answer"": ""V roku 2022 má Dominik Nagy prácu s názvom „Neurónový strojový preklad pomocou knižnice Fairseq“ [1], ktorá súvisí s kľúčovým slovom „seq2seq“ [2]."", ""status"": ""ok"", ""claims"": [{""person"": ""Dominik Nagy"", ""title"": ""Neurónový strojový preklad pomocou knižnice Fairseq"", ""year"": 2022}, {""person"": ""Dominik Nagy"", ""keyword"": ""seq2seq""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy/timovy_projekt""], ""count"": 1}"
|
||||
wide-144,person_keyword_title,True,,9.193312716000946,True,True,True,True,True,True,Uveď názov práce osoby Dárius Lindvai v roku 2021 s kľúčovým slovom interpunction.,"{""answer"": ""Dárius Lindvai v roku 2021 vypracoval prácu s názvom „Obnovenie interpunkcie pomocou hlbokých neurónových sietí“, ktorá má kľúčové slovo interpunction. Zdroj: https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""status"": ""ok"", ""claims"": [{""person"": ""Dárius Lindvai"", ""title"": ""Obnovenie interpunkcie pomocou hlbokých neurónových sietí"", ""year"": 2021, ""keyword"": ""interpunction""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai""], ""count"": 1}"
|
||||
wide-145,person_keyword_title,False,,10.574943351995898,False,True,False,True,True,True,Uveď názov práce osoby Dárius Lindvai v roku 2019 s kľúčovým slovom python.,"{""answer"": ""Na základe dodaných grafových faktov neexistuje práca osoby Dárius Lindvai z roku 2019, ktorá by mala kľúčové slovo python. Osoba Dárius Lindvai má v roku 2019 prácu s názvom \""rešerš\"" (zdroj: https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai), ale táto práca nemá priradené kľúčové slovo python. Kľúčové slovo python je priradené k dokumentu v ceste pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md (zdroj: https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial), ale pre tento dokument nie je v grafe uvedený rok 2019 ani názov práce."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial""], ""count"": 0}"
|
||||
wide-146,person_keyword_title,True,,7.7894158019989845,True,True,True,True,True,True,Aký názov práce osoby Simona Bobrovčanová v roku 2026 súvisí s kľúčovým slovom lm?,"{""answer"": ""Názov práce osoby Simona Bobrovčanová v roku 2026 súvisiacej s kľúčovým slovom LM je \""Automatická sumarizácia slovenského textu\"". Zdroj: https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""status"": ""ok"", ""claims"": [{""person"": ""Simona Bobrovčanová"", ""title"": ""Automatická sumarizácia slovenského textu"", ""year"": 2026, ""keyword"": ""LM""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""], ""count"": 1}"
|
||||
wide-147,person_keyword_title,True,,10.804093170001579,True,True,True,True,True,True,Uveď názov práce osoby Martin NaN1 v roku 2020 s kľúčovým slovom gpt.,"{""answer"": ""Martin NaN1 v roku 2020 vydal prácu s názvom \""Využitie najnovších nástrojov v rámci prirodzeného spracovania reči\"", ktorá obsahuje kľúčové slovo gpt. Zdroj: https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday"", ""status"": ""ok"", ""claims"": [{""person"": ""Martin NaN1"", ""title"": ""Využitie najnovších nástrojov v rámci prirodzeného spracovania reči"", ""year"": 2020, ""keyword"": ""gpt""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday""], ""count"": 1}"
|
||||
wide-148,person_keyword_title,True,,4.910634503998153,True,True,True,True,True,True,Uveď názov práce osoby Patrik Pavlišin v roku 2020 s kľúčovým slovom translation.,"{""answer"": ""Patrik Pavlišin v roku 2020 vydal prácu s názvom \""Metódy automatického prekladu\"", ktorá má kľúčové slovo translation. Zdroj: https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""status"": ""ok"", ""claims"": [{""person"": ""Patrik Pavlišin"", ""title"": ""Metódy automatického prekladu"", ""year"": 2020, ""keyword"": ""translation""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""], ""count"": 1}"
|
||||
wide-149,person_keyword_title,True,,8.948702435998712,True,True,True,True,True,True,Aký názov práce osoby Michal Stromko v roku 2022 súvisí s kľúčovým slovom ir?,"{""answer"": ""Michal Stromko v roku 2022 vypracoval prácu s názvom \""Indexovanie slovenského textu pomocou Elasticsearch\"", ktorá súvisí s kľúčovým slovom ir. Zdroj: https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""status"": ""ok"", ""claims"": [{""person"": ""Michal Stromko"", ""title"": ""Indexovanie slovenského textu pomocou Elasticsearch"", ""year"": 2022, ""keyword"": ""ir""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""], ""count"": 1}"
|
||||
wide-150,person_keyword_title,True,,6.8871356439995,True,True,True,True,True,True,Uveď názov práce osoby Samuel Vasiľ v roku 2026 s kľúčovým slovom nlp.,"{""answer"": ""Samuel Vasiľ má v roku 2026 prácu s názvom \""Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI\"" s kľúčovým slovom NLP. Zdroj: https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""status"": ""ok"", ""claims"": [{""person"": ""Samuel Vasiľ"", ""title"": ""Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI"", ""year"": 2026, ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""], ""count"": 1}"
|
||||
wide-151,person_keyword_title,True,,7.582760322999093,True,True,True,True,True,True,Uveď názov práce osoby Michal Stromko v roku 2022 s kľúčovým slovom demo.,"{""answer"": ""Michal Stromko v roku 2022 vypracoval prácu s názvom \""Indexovanie slovenského textu pomocou Elasticsearch\"", ktorá obsahuje kľúčové slovo demo. Zdroj: https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""status"": ""ok"", ""claims"": [{""person"": ""Michal Stromko"", ""title"": ""Indexovanie slovenského textu pomocou Elasticsearch"", ""year"": 2022, ""keyword"": ""demo""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""], ""count"": 1}"
|
||||
wide-152,person_keyword_title,True,,7.1138568820024375,True,True,True,True,True,True,Aký názov práce osoby Dávid Iľaš v roku 2023 súvisí s kľúčovým slovom nlp?,"{""answer"": ""Osoba Dávid Iľaš má v roku 2023 prácu s názvom \""Rozpoznávanie emócií z textu.\"", ktorá súvisí s kľúčovým slovom NLP. Zdroj: https://zp.kemt.fei.tuke.sk/students/2018/david_ilas"", ""status"": ""ok"", ""claims"": [{""person"": ""Dávid Iľaš"", ""title"": ""Rozpoznávanie emócií z textu."", ""year"": 2023, ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/david_ilas""], ""count"": 1}"
|
||||
wide-153,person_keyword_title,True,,7.93297110900312,True,True,True,True,True,True,Uveď názov práce osoby Michal Stromko v roku 2024 s kľúčovým slovom cloud.,"{""answer"": ""Michal Stromko v roku 2024 vypracoval prácu s názvom \""Sémantické vyhľadávanie v slovenskom texte\"", ktorá obsahuje kľúčové slovo cloud. Zdroj: https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""status"": ""ok"", ""claims"": [{""person"": ""Michal Stromko"", ""title"": ""Sémantické vyhľadávanie v slovenskom texte"", ""year"": 2024, ""keyword"": ""cloud""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""], ""count"": 1}"
|
||||
wide-154,person_keyword_title,True,,7.315907237993088,True,True,True,True,True,True,Uveď názov práce osoby Lukáš Pokrývka v roku 2019 s kľúčovým slovom cloud.,"{""answer"": ""Názov práce Lukáša Pokrývku z roku 2019 s kľúčovým slovom cloud je Paralelné spracovanie prirodzeného jazyka. Zdroj: https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""status"": ""ok"", ""claims"": [{""person"": ""Lukáš Pokrývka"", ""title"": ""Paralelné spracovanie prirodzeného jazyka"", ""year"": 2019, ""keyword"": ""cloud""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""], ""count"": 1}"
|
||||
wide-155,person_keyword_title,False,,8.323158056002285,True,True,True,True,True,False,Aký názov práce osoby Matej Ščišľak v roku 2026 súvisí s kľúčovým slovom chatbot?,"{""answer"": ""Osoba Matej Ščišľak má v roku 2026 prácu s názvom \""Znalostné grafy pre zlepšenie vyhľadávania právnych informáci.\"", ktorá súvisí s kľúčovým slovom chatbot. Zdroj: https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""status"": ""ok"", ""claims"": [{""person"": ""Matej Ščišľak"", ""title"": ""Znalostné grafy pre zlepšenie vyhľadávania právnych informácií."", ""year"": 2026, ""keyword"": ""chatbot""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""], ""count"": 1}"
|
||||
wide-156,person_keyword_title,True,,6.521070124996186,True,True,True,True,True,True,Uveď názov práce osoby Oleh Poiasnik v roku 2027 s kľúčovým slovom rag.,"{""answer"": ""Oleh Poiasnik má v roku 2027 prácu s názvom „Expertný agentový systém na podporu rozhodovania v lekárni“ s kľúčovým slovom RAG. Zdroj: https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""status"": ""ok"", ""claims"": [{""person"": ""Oleh Poiasnik"", ""title"": ""Expertný agentový systém na podporu rozhodovania v lekárni"", ""year"": 2027, ""keyword"": ""RAG""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""], ""count"": 1}"
|
||||
wide-157,person_keyword_title,True,,8.291034098998352,True,True,True,True,True,True,Uveď názov práce osoby Ondrej Megela v roku 2023 s kľúčovým slovom lm.,"{""answer"": ""Ondrej Megela v roku 2023 vypracoval prácu s názvom \""Automatické generovanie otázok v slovenskom jazyku\"", ktorá obsahuje kľúčové slovo LM. Zdroj: https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""status"": ""ok"", ""claims"": [{""person"": ""Ondrej Megela"", ""title"": ""Automatické generovanie otázok v slovenskom jazyku"", ""year"": 2023, ""keyword"": ""LM""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""], ""count"": 1}"
|
||||
wide-158,person_keyword_title,True,,6.099724388004688,True,True,True,True,True,True,Aký názov práce osoby Ján Malinovský v roku 2026 súvisí s kľúčovým slovom nlp?,"{""answer"": ""Názov práce Ján Malinovský z roku 2026 súvisiaci s kľúčovým slovom NLP je „Grafové vyhľadávanie pre podporu vzdelávania“ (zdroj: https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky)."", ""status"": ""ok"", ""claims"": [{""person"": ""Ján Malinovský"", ""title"": ""Grafové vyhľadávanie pre podporu vzdelávania"", ""year"": 2026, ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""], ""count"": 1}"
|
||||
wide-159,person_keyword_title,False,,9.068388027997571,False,True,True,True,True,True,Uveď názov práce osoby Than Trung Thanh v roku 2020 s kľúčovým slovom anotation.,"{""answer"": ""Osoba Than Trung Thanh v roku 2020 vypracovala prácu s názvom \""Rozpoznávanie pomenovaných entít v slovenskom jazyku pomocou nástrojov Spacy a Prodigy\"", ktorá obsahuje kľúčové slovo anotation. Zdroj: https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""status"": ""ok"", ""claims"": [{""person"": ""Than Trung Thanh"", ""title"": ""Rozpoznávanie pomenovaných entít v slovenskom jazyku pomocou nástrojov Spacy a Prodigy"", ""year"": 2020}, {""person"": ""Than Trung Thanh"", ""keyword"": ""anotation""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh""], ""count"": 1}"
|
||||
wide-160,person_keyword_title,True,,6.224928866002301,True,True,True,True,True,True,Uveď názov práce osoby Andrii Pervashov v roku 2025 s kľúčovým slovom nlp.,"{""answer"": ""Andrii Pervashov má v roku 2025 prácu s názvom \""Korekcia textu pomocou neurónových sietí\"" a kľúčovým slovom NLP. Zdroj: https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""status"": ""ok"", ""claims"": [{""person"": ""Andrii Pervashov"", ""title"": ""Korekcia textu pomocou neurónových sietí"", ""year"": 2025, ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""], ""count"": 1}"
|
||||
wide-161,person_keyword_title,False,,9.423955840997223,True,True,True,True,True,False,Aký názov práce osoby Kristián Sopkovič v roku 2024 súvisí s kľúčovým slovom spacy?,"{""answer"": ""Kristián Sopkovič v roku 2024 vypracoval prácu s názvom „Neurónové vyhľadávanie na základe sémantickej podobnosti vektorov."", ""status"": ""ok"", ""claims"": [{""person"": ""Kristián Sopkovič"", ""title"": ""Neurónové vyhľadávanie na základe sémantickej podobnosti vektorov."", ""year"": 2024, ""keyword"": ""Spacy""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""], ""count"": 1}"
|
||||
wide-162,person_keyword_title,True,,6.191365853002935,True,True,True,True,True,True,Uveď názov práce osoby Simona Bobrovčanová v roku 2026 s kľúčovým slovom nlp.,"{""answer"": ""Osoba Simona Bobrovčanová má v roku 2026 prácu s názvom \""Automatická sumarizácia slovenského textu\"" a kľúčovým slovom NLP. Zdroj: https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""status"": ""ok"", ""claims"": [{""person"": ""Simona Bobrovčanová"", ""title"": ""Automatická sumarizácia slovenského textu"", ""year"": 2026, ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""], ""count"": 1}"
|
||||
wide-163,person_keyword_title,False,,10.652335631006281,False,True,True,True,True,True,Uveď názov práce osoby Rostyslav Rodzhuk v roku 2025 s kľúčovým slovom nlp.,"{""answer"": ""Osoba Rostyslav Rodzhuk má v roku 2025 prácu s názvom \""Veľký jazykový model ako inteligentný agent\"" a kľúčovým slovom NLP. Zdroj: https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""status"": ""ok"", ""claims"": [{""person"": ""Rostyslav Rodzhuk"", ""title"": ""Veľký jazykový model ako inteligentný agent"", ""year"": 2025}, {""person"": ""Rostyslav Rodzhuk"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""], ""count"": 1}"
|
||||
wide-164,person_keyword_title,True,,6.74385710900242,True,True,True,True,True,True,Aký názov práce osoby Patrik Pokrivčák v roku 2025 súvisí s kľúčovým slovom hate?,"{""answer"": ""Osoba Patrik Pokrivčák má v roku 2025 prácu s názvom \""Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov\"", ktorá súvisí s kľúčovým slovom hate. Zdroj: https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak"", ""status"": ""ok"", ""claims"": [{""person"": ""Patrik Pokrivčák"", ""title"": ""Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov"", ""year"": 2025, ""keyword"": ""hate""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak""], ""count"": 1}"
|
||||
wide-165,person_keyword_title,True,,9.475837231002515,True,True,True,True,True,True,Uveď názov práce osoby Dárius Lindvai v roku 2019 s kľúčovým slovom nn.,"{""answer"": ""Osoba Dárius Lindvai má v roku 2019 prácu s názvom \""rešerš\"" a kľúčovým slovom \""nn\"". Zdroj: https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""status"": ""ok"", ""claims"": [{""person"": ""Dárius Lindvai"", ""title"": ""rešerš"", ""year"": 2019, ""keyword"": ""nn""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai""], ""count"": 1}"
|
||||
wide-166,person_keyword_title,True,,5.933394573999976,True,True,True,True,True,True,Uveď názov práce osoby Oleksandr Dorybohov v roku 2026 s kľúčovým slovom nlp.,"{""answer"": ""Oleksandr Dorybohov má v roku 2026 prácu s názvom \""Automatické odpovede na otázky v právnej oblasti\"" s kľúčovým slovom NLP. Zdroj: https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""status"": ""ok"", ""claims"": [{""person"": ""Oleksandr Dorybohov"", ""title"": ""Automatické odpovede na otázky v právnej oblasti"", ""year"": 2026, ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""], ""count"": 1}"
|
||||
wide-167,person_keyword_title,True,,8.969329906001803,True,True,True,True,True,True,Aký názov práce osoby Lukáš Pokrývka v roku 2020 súvisí s kľúčovým slovom gpu?,"{""answer"": ""Názov práce Lukáša Pokrývku z roku 2020 súvisiacej s kľúčovým slovom GPU je \""Paralelné trénovanie neurónových sietí pomocou knižnice Pytorch.\"" (zdroj: https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka)"", ""status"": ""ok"", ""claims"": [{""person"": ""Lukáš Pokrývka"", ""title"": ""Paralelné trénovanie neurónových sietí pomocou knižnice Pytorch."", ""year"": 2020, ""keyword"": ""GPU""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""], ""count"": 1}"
|
||||
wide-168,person_keyword_title,True,,6.5191473989980295,True,True,True,True,True,True,Uveď názov práce osoby Matej Ščišľak v roku 2024 s kľúčovým slovom nlp.,"{""answer"": ""Matej Ščišľak v roku 2024 vytvoril prácu s názvom \""Dialógový systém pre potreby samosprávy\"", ktorá má kľúčové slovo NLP. Zdroj: https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""status"": ""ok"", ""claims"": [{""person"": ""Matej Ščišľak"", ""title"": ""Dialógový systém pre potreby samosprávy"", ""year"": 2024, ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""], ""count"": 1}"
|
||||
wide-171,document_author_category_multi_hop,True,,7.691536218000692,True,True,True,True,True,True,Ktorý autor dokumentu je pri osobe Dávid Omasta spojený s kategóriou dp2023?,"{""answer"": ""Pri osobe Dávid Omasta a kategórii dp2023 je ako autor dokumentu uvedený Daniel Hladek. Zdroj: https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""status"": ""ok"", ""claims"": [{""person"": ""Dávid Omasta"", ""category"": ""dp2023"", ""document_author"": ""Daniel Hladek""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""], ""count"": 1}"
|
||||
wide-172,document_author_category_multi_hop,True,,5.241324082999199,True,True,True,True,True,True,"Kto je autor dokumentu osoby Matúš Suchanič, ktorý patrí do kategórie vp2022?","{""answer"": ""Autorom dokumentu osoby Matúš Suchanič v kategórii vp2022 je Daniel Hladek. Zdroj: https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""status"": ""ok"", ""claims"": [{""person"": ""Matúš Suchanič"", ""document_author"": ""Daniel Hladek"", ""category"": ""vp2022""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""], ""count"": 1}"
|
||||
wide-173,document_author_category_multi_hop,True,,6.954509536997648,True,True,True,True,True,True,Ktorý autor dokumentu je pri osobe Kamil Tomčufčík spojený s kategóriou dp2025?,"{""answer"": ""Autorom dokumentu spojeným s osobou Kamil Tomčufčík a kategóriou dp2025 je Daniel Hladek. Zdroj: https://zp.kemt.fei.tuke.sk/students/2020/kamil_tomcufcik"", ""status"": ""ok"", ""claims"": [{""person"": ""Kamil Tomčufčík"", ""category"": ""dp2025"", ""document_author"": ""Daniel Hladek""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2020/kamil_tomcufcik""], ""count"": 1}"
|
||||
wide-174,document_author_category_multi_hop,True,,5.2895403880029335,True,True,True,True,True,True,Ktorý autor dokumentu je pri osobe Artur Hyrenko spojený s kategóriou dp2026?,"{""answer"": ""Autorom dokumentu spojeným s osobou Artur Hyrenko a kategóriou dp2026 je Daniel Hladek. Zdroj: https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""status"": ""ok"", ""claims"": [{""person"": ""Artur Hyrenko"", ""category"": ""dp2026"", ""document_author"": ""Daniel Hladek""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko""], ""count"": 1}"
|
||||
wide-175,document_author_category_multi_hop,True,,7.420917933995952,True,True,True,True,True,True,"Kto je autor dokumentu osoby Serhii Yemets, ktorý patrí do kategórie bp2025?","{""answer"": ""Autorom dokumentu osoby Serhii Yemets v kategórii bp2025 je Daniel Hladek. Zdroj: https://zp.kemt.fei.tuke.sk/students/2022/serhii_yemets"", ""status"": ""ok"", ""claims"": [{""person"": ""Serhii Yemets"", ""document_author"": ""Daniel Hladek"", ""category"": ""bp2025""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/serhii_yemets""], ""count"": 1}"
|
||||
wide-176,document_author_category_multi_hop,True,,7.267075166004361,True,True,True,True,True,True,Ktorý autor dokumentu je pri osobe Dárius Lindvai spojený s kategóriou tp2020?,"{""answer"": ""Pri osobe Dárius Lindvai spojená s kategóriou tp2020 je dokumentový autor Dárius Lindvai, čo je potvrdené v zdrojoch: https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers a https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial."", ""status"": ""ok"", ""claims"": [{""person"": ""Dárius Lindvai"", ""category"": ""tp2020"", ""document_author"": ""Dárius Lindvai""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial""], ""count"": 1}"
|
||||
wide-177,document_author_category_multi_hop,True,,7.992678946000524,True,True,True,True,True,True,Ktorý autor dokumentu je pri osobe Maroš Harahus spojený s kategóriou tp2020?,"{""answer"": ""Autorom dokumentu spojeným s osobou Maroš Harahus a kategóriou tp2020 je Maroš Harahus. Zdroj: https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""status"": ""ok"", ""claims"": [{""person"": ""Maroš Harahus"", ""document_author"": ""Maroš Harahus"", ""category"": ""tp2020""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt""], ""count"": 1}"
|
||||
wide-178,document_author_category_multi_hop,False,,7.213448406997486,False,True,True,True,True,True,"Kto je autor dokumentu osoby Patrik Pokrivčák, ktorý patrí do kategórie dp2025?","{""answer"": ""Autorom dokumentu osoby Patrik Pokrivčák v kategórii dp2025 je Daniel Hladek. Zdroj: https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak"", ""status"": ""ok"", ""claims"": [{""person"": ""Daniel Hladek"", ""document_author"": ""Daniel Hladek"", ""category"": ""dp2025""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak""], ""count"": 1}"
|
||||
wide-179,document_author_category_multi_hop,True,,5.843621088999498,True,True,True,True,True,True,Ktorý autor dokumentu je pri osobe Dávid Stromp spojený s kategóriou bp2022?,"{""answer"": ""Autorom dokumentu spojeným s osobou Dávid Stromp a kategóriou bp2022 je Maroš Harahus. Zdroj: https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""status"": ""ok"", ""claims"": [{""person"": ""Dávid Stromp"", ""category"": ""bp2022"", ""document_author"": ""Maroš Harahus""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp""], ""count"": 1}"
|
||||
wide-180,document_author_category_multi_hop,True,,6.530649876003736,True,True,True,True,True,True,Ktorý autor dokumentu je pri osobe Dávid Iľaš spojený s kategóriou dp2023?,"{""answer"": ""Pri osobe Dávid Iľaš je s kategóriou dp2023 spojený dokumentový autor Daniel Hladek. Zdroj: https://zp.kemt.fei.tuke.sk/students/2018/david_ilas"", ""status"": ""ok"", ""claims"": [{""person"": ""Dávid Iľaš"", ""document_author"": ""Daniel Hladek"", ""category"": ""dp2023""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/david_ilas""], ""count"": 1}"
|
||||
wide-181,document_author_category_multi_hop,False,,5.399389828002313,False,True,True,True,True,True,"Kto je autor dokumentu osoby Jakub Maruniak, ktorý patrí do kategórie dp2021?","{""answer"": ""Autorom dokumentu osoby Jakub Maruniak v kategórii dp2021 je Daniel Hladek. Zdroj: https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""status"": ""ok"", ""claims"": [{""person"": ""Daniel Hladek"", ""document_author"": ""Daniel Hladek"", ""category"": ""dp2021""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""], ""count"": 1}"
|
||||
wide-182,document_author_category_multi_hop,True,,6.547648766005295,True,True,True,True,True,True,Ktorý autor dokumentu je pri osobe Valerii Kutsenko spojený s kategóriou dp2027?,"{""answer"": ""Autorom dokumentu spojeným s osobou Valerii Kutsenko a kategóriou dp2027 je Daniel Hladek. Zdroj: https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""status"": ""ok"", ""claims"": [{""person"": ""Valerii Kutsenko"", ""document_author"": ""Daniel Hladek"", ""category"": ""dp2027""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""], ""count"": 1}"
|
||||
wide-183,document_author_category_multi_hop,True,,5.38755500499974,True,True,True,True,True,True,Ktorý autor dokumentu je pri osobe Martin Jancura spojený s kategóriou bp2021?,"{""answer"": ""Autorom dokumentu spojeným s osobou Martin Jancura a kategóriou bp2021 je Daniel Hladek. Zdroj: https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""status"": ""ok"", ""claims"": [{""person"": ""Martin Jancura"", ""document_author"": ""Daniel Hladek"", ""category"": ""bp2021""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""], ""count"": 1}"
|
||||
wide-184,document_author_category_multi_hop,True,,6.554086822005047,True,True,True,True,True,True,"Kto je autor dokumentu osoby Nikita Bodnar, ktorý patrí do kategórie vp2023?","{""answer"": ""Autorom dokumentu osoby Nikita Bodnar v kategórii vp2023 je Daniel Hladek. Zdroj: https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""status"": ""ok"", ""claims"": [{""person"": ""Nikita Bodnar"", ""document_author"": ""Daniel Hladek"", ""category"": ""vp2023""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar""], ""count"": 1}"
|
||||
wide-185,document_author_category_multi_hop,True,,5.499499361001654,True,True,True,True,True,True,Ktorý autor dokumentu je pri osobe Matej Ščišľak spojený s kategóriou dp2026?,"{""answer"": ""Pri osobe Matej Ščišľak je s kategóriou dp2026 spojený dokumentový autor Daniel Hladek. Zdroj: https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""status"": ""ok"", ""claims"": [{""person"": ""Matej Ščišľak"", ""category"": ""dp2026"", ""document_author"": ""Daniel Hladek""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""], ""count"": 1}"
|
||||
wide-186,document_author_category_multi_hop,True,,7.084702929998457,True,True,True,True,True,True,Ktorý autor dokumentu je pri osobe Lukáš Pokrývka spojený s kategóriou tp2020?,"{""answer"": ""Autorom dokumentu spojeným s osobou Lukáš Pokrývka a kategóriou tp2020 je Lukáš Pokrývka (zdroj: https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt)."", ""status"": ""ok"", ""claims"": [{""person"": ""Lukáš Pokrývka"", ""document_author"": ""Lukáš Pokrývka"", ""category"": ""tp2020""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt""], ""count"": 1}"
|
||||
wide-187,document_author_category_multi_hop,True,,5.604316528995696,True,True,True,True,True,True,"Kto je autor dokumentu osoby Andrii Pervashov, ktorý patrí do kategórie dp2027?","{""answer"": ""Autorom dokumentu osoby Andrii Pervashov v kategórii dp2027 je Daniel Hladek. Zdroj: https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""status"": ""ok"", ""claims"": [{""person"": ""Andrii Pervashov"", ""document_author"": ""Daniel Hladek"", ""category"": ""dp2027""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""], ""count"": 1}"
|
||||
wide-188,document_author_category_multi_hop,True,,6.835225114999048,True,True,True,True,True,True,Ktorý autor dokumentu je pri osobe Samuel Horáni spojený s kategóriou vp2021?,"{""answer"": ""Autorom dokumentu spojeným s osobou Samuel Horáni a kategóriou vp2021 je Daniel Hladek. Zdroj: https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""status"": ""ok"", ""claims"": [{""person"": ""Samuel Horáni"", ""document_author"": ""Daniel Hladek"", ""category"": ""vp2021""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani""], ""count"": 1}"
|
||||
wide-189,document_author_category_multi_hop,True,,5.236019719995966,True,True,True,True,True,True,Ktorý autor dokumentu je pri osobe Yevhenii Leonov spojený s kategóriou vp2024?,"{""answer"": ""Autorom dokumentu spojeným s osobou Yevhenii Leonov a kategóriou vp2024 je Daniel Hladek. Zdroj: https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""status"": ""ok"", ""claims"": [{""person"": ""Yevhenii Leonov"", ""category"": ""vp2024"", ""document_author"": ""Daniel Hladek""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov""], ""count"": 1}"
|
||||
wide-190,document_author_category_multi_hop,True,,6.673279062000802,True,True,True,True,True,True,"Kto je autor dokumentu osoby Oleh Bilykh, ktorý patrí do kategórie bp2021?","{""answer"": ""Autorom dokumentu osoby Oleh Bilykh v kategórii bp2021 je Daniel Hladek. Zdroj: https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""status"": ""ok"", ""claims"": [{""person"": ""Oleh Bilykh"", ""document_author"": ""Daniel Hladek"", ""category"": ""bp2021""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""], ""count"": 1}"
|
||||
wide-191,document_author_category_multi_hop,True,,4.902594167993811,True,True,True,True,True,True,Ktorý autor dokumentu je pri osobe Ján Holp spojený s kategóriou tp2020?,"{""answer"": ""Autorom dokumentu spojeným s osobou Ján Holp a kategóriou tp2020 je Ján Holp [1]."", ""status"": ""ok"", ""claims"": [{""person"": ""Ján Holp"", ""document_author"": ""Ján Holp"", ""category"": ""tp2020""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt""], ""count"": 1}"
|
||||
wide-192,document_author_category_multi_hop,True,,7.23534662900056,True,True,True,True,True,True,Ktorý autor dokumentu je pri osobe Oleksandr Hryshchenko spojený s kategóriou dp2026?,"{""answer"": ""Autorom dokumentu spojeným s osobou Oleksandr Hryshchenko a kategóriou dp2026 je Daniel Hladek. Zdroj: https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""status"": ""ok"", ""claims"": [{""person"": ""Oleksandr Hryshchenko"", ""category"": ""dp2026"", ""document_author"": ""Daniel Hladek""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko""], ""count"": 1}"
|
||||
wide-195,person_multiple_categories,True,,4.123462159004703,True,True,True,True,True,True,Aké všetky kategórie majú dokumenty osoby Samuel Džurina?,"{""answer"": ""Samuel Džurina má dokumenty v kategórii bp2026 (zdroj: https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina)."", ""status"": ""ok"", ""claims"": [{""person"": ""Samuel Džurina"", ""category"": ""bp2026""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""], ""count"": 1}"
|
||||
wide-196,person_multiple_categories,True,,6.55695073500101,True,True,True,True,True,True,Vypíš všetky kategórie dokumentov osoby Daniil Huzenko.,"{""answer"": ""Osoba Daniil Huzenko má dokument v kategórii bp2025 (zdroj: https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko)."", ""status"": ""ok"", ""claims"": [{""person"": ""Daniil Huzenko"", ""category"": ""bp2025""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""], ""count"": 1}"
|
||||
wide-197,person_multiple_categories,True,,3.839980998003739,True,True,True,True,True,True,Aké všetky kategórie majú dokumenty osoby Than Trung Thanh?,"{""answer"": ""Osoba Than Trung Thanh má dokumenty v kategórii bp2021. Zdroj: https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""status"": ""ok"", ""claims"": [{""person"": ""Than Trung Thanh"", ""category"": ""bp2021""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh""], ""count"": 1}"
|
||||
wide-198,person_multiple_categories,True,,5.812021667996305,True,True,True,True,True,True,Aké všetky kategórie majú dokumenty osoby Vladimír Ferko?,"{""answer"": ""Vladimír Ferko má dokumenty v kategórii bp2024 [1]."", ""status"": ""ok"", ""claims"": [{""person"": ""Vladimír Ferko"", ""category"": ""bp2024""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""], ""count"": 1}"
|
||||
wide-199,person_multiple_categories,True,,4.070570078998571,True,True,True,True,True,True,Vypíš všetky kategórie dokumentov osoby Dmytro Ushatenko.,"{""answer"": ""Osoba Dmytro Ushatenko má dokument v kategórii bp2020 (zdroj: https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko)."", ""status"": ""ok"", ""claims"": [{""person"": ""Dmytro Ushatenko"", ""category"": ""bp2020""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko""], ""count"": 1}"
|
||||
wide-200,person_multiple_categories,True,,5.895577477996994,True,True,True,True,True,True,Aké všetky kategórie majú dokumenty osoby Martin Wencel?,"{""answer"": ""Martin Wencel má dokumenty v kategórii bp2021 (zdroj: https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel)."", ""status"": ""ok"", ""claims"": [{""person"": ""Martin Wencel"", ""category"": ""bp2021""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""], ""count"": 1}"
|
||||
wide-201,person_multiple_categories,True,,4.787276399998518,True,True,True,True,True,True,Aké všetky kategórie majú dokumenty osoby Serhii Yemets?,"{""answer"": ""Osoba Serhii Yemets má dokumenty v kategórii bp2025 (zdroj: https://zp.kemt.fei.tuke.sk/students/2022/serhii_yemets)."", ""status"": ""ok"", ""claims"": [{""person"": ""Serhii Yemets"", ""category"": ""bp2025""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/serhii_yemets""], ""count"": 1}"
|
||||
wide-202,person_multiple_categories,True,,4.874617752000631,True,True,True,True,True,True,Vypíš všetky kategórie dokumentov osoby Oliver Pejic.,"{""answer"": ""Osoba Oliver Pejic má dokumenty v kategórii iaeste [1]."", ""status"": ""ok"", ""claims"": [{""person"": ""Oliver Pejic"", ""category"": ""iaeste""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic""], ""count"": 1}"
|
||||
wide-203,person_multiple_categories,True,,4.45105388200318,True,True,True,True,True,True,Aké všetky kategórie majú dokumenty osoby Maksym Zatirka?,"{""answer"": ""Osoba Maksym Zatirka má dokumenty v kategórii bp2026 [1]."", ""status"": ""ok"", ""claims"": [{""person"": ""Maksym Zatirka"", ""category"": ""bp2026""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""], ""count"": 1}"
|
||||
wide-204,person_multiple_categories,True,,4.655141262002871,True,True,True,True,True,True,Aké všetky kategórie majú dokumenty osoby Martin Jancura?,"{""answer"": ""Martin Jancura má dokumenty v kategóriách bp2021 a dp2023 [1]."", ""status"": ""ok"", ""claims"": [{""person"": ""Martin Jancura"", ""category"": ""bp2021""}, {""person"": ""Martin Jancura"", ""category"": ""dp2023""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""], ""count"": 2}"
|
||||
wide-205,person_multiple_categories,True,,5.410459575999994,True,True,True,True,True,True,Vypíš všetky kategórie dokumentov osoby Oleksandr Hryshchenko.,"{""answer"": ""Oleksandr Hryshchenko má dokument v kategórii dp2026 (zdroj: https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko)."", ""status"": ""ok"", ""claims"": [{""person"": ""Oleksandr Hryshchenko"", ""category"": ""dp2026""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko""], ""count"": 1}"
|
||||
wide-206,person_multiple_categories,True,,4.934618246996251,True,True,True,True,True,True,Aké všetky kategórie majú dokumenty osoby Márk Fehér?,"{""answer"": ""Osoba Márk Fehér má dokumenty v kategórii dp2022 (zdroj: https://zp.kemt.fei.tuke.sk/students/2016/mark_feher)."", ""status"": ""ok"", ""claims"": [{""person"": ""Márk Fehér"", ""category"": ""dp2022""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher""], ""count"": 1}"
|
||||
wide-207,person_multiple_categories,True,,5.351602836002712,True,True,True,True,True,True,Aké všetky kategórie majú dokumenty osoby Oleh Bilykh?,"{""answer"": ""Oleh Bilykh má dokumenty v kategórii bp2021 (zdroj: https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh)."", ""status"": ""ok"", ""claims"": [{""person"": ""Oleh Bilykh"", ""category"": ""bp2021""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""], ""count"": 1}"
|
||||
wide-208,person_multiple_categories,True,,4.647810752998339,True,True,True,True,True,True,Vypíš všetky kategórie dokumentov osoby Ján Pták.,"{""answer"": ""Osoba Ján Pták má dokument v kategórii dp2027 (zdroj: https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak)."", ""status"": ""ok"", ""claims"": [{""person"": ""Ján Pták"", ""category"": ""dp2027""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""], ""count"": 1}"
|
||||
wide-209,person_multiple_categories,False,JSONDecodeError: Expecting value: line 1 column 1 (char 0),8.321756921002816,,,,,,,Aké všetky kategórie majú dokumenty osoby Yevhenii Medushivskyi?,null
|
||||
wide-210,person_multiple_categories,True,,4.485325813999225,True,True,True,True,True,True,Aké všetky kategórie majú dokumenty osoby Ediz Morochovič?,"{""answer"": ""Osoba Ediz Morochovič má dokumenty v kategórii bp2019 (zdroj: https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic)."", ""status"": ""ok"", ""claims"": [{""person"": ""Ediz Morochovič"", ""category"": ""bp2019""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic""], ""count"": 1}"
|
||||
wide-211,person_multiple_categories,True,,6.549260562998825,True,True,True,True,True,True,Vypíš všetky kategórie dokumentov osoby Alina Vitko.,"{""answer"": ""Osoba Alina Vitko má dokument v kategórii bp2022 (zdroj: https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko)."", ""status"": ""ok"", ""claims"": [{""person"": ""Alina Vitko"", ""category"": ""bp2022""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""], ""count"": 1}"
|
||||
wide-212,person_multiple_categories,True,,4.947871591997682,True,True,True,True,True,True,Aké všetky kategórie majú dokumenty osoby Cesar Abascal Gutierrez?,"{""answer"": ""Osoba Cesar Abascal Gutierrez má dokumenty v kategórii iaeste. Zdroj: https://zp.kemt.fei.tuke.sk/interns/cesar_gutierrez"", ""status"": ""ok"", ""claims"": [{""person"": ""Cesar Abascal Gutierrez"", ""category"": ""iaeste""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/interns/cesar_gutierrez""], ""count"": 1}"
|
||||
wide-213,person_multiple_categories,True,,4.7744402950047515,True,True,True,True,True,True,Aké všetky kategórie majú dokumenty osoby Bogdan Paul Chiș?,"{""answer"": ""Osoba Bogdan Paul Chiș má dokumenty v kategórii erasmus. Zdroj: https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis"", ""status"": ""ok"", ""claims"": [{""person"": ""Bogdan Paul Chiș"", ""category"": ""erasmus""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis""], ""count"": 1}"
|
||||
wide-214,person_multiple_categories,True,,5.108398393000243,True,True,True,True,True,True,Vypíš všetky kategórie dokumentov osoby Matej Kobyľan.,"{""answer"": ""Osoba Matej Kobyľan má dokument v kategórii bp2023 (zdroj: https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan)."", ""status"": ""ok"", ""claims"": [{""person"": ""Matej Kobyľan"", ""category"": ""bp2023""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""], ""count"": 1}"
|
||||
wide-215,person_multiple_categories,True,,5.243163012994046,True,True,True,True,True,True,Aké všetky kategórie majú dokumenty osoby Oleksandr Dorybohov?,"{""answer"": ""Oleksandr Dorybohov má dokumenty v kategórii bp2026 (zdroj: https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov)."", ""status"": ""ok"", ""claims"": [{""person"": ""Oleksandr Dorybohov"", ""category"": ""bp2026""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""], ""count"": 1}"
|
||||
wide-216,person_multiple_categories,True,,5.386864268002682,True,True,True,True,True,True,Aké všetky kategórie majú dokumenty osoby Denis Le Thanh?,"{""answer"": ""Osoba Denis Le Thanh má dokumenty v kategórii bp2026. Zdroj: https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""status"": ""ok"", ""claims"": [{""person"": ""Denis Le Thanh"", ""category"": ""bp2026""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""], ""count"": 1}"
|
||||
wide-219,candidate_set_aggregation,True,,7.7192733800038695,True,True,True,True,True,True,"Z kandidátov Artur Hyrenko, Matej Ščišľak, Adrián Remiáš vyber osoby s prácou v roku 2026. Aký je ich počet?","{""answer"": ""Počet osôb s prácou v roku 2026 je 2. Sú to Artur Hyrenko a Matej Ščišľak. Adrián Remiáš nemá prácu v roku 2026. Zdroje: https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko, https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""status"": ""ok"", ""claims"": [{""person"": ""Artur Hyrenko"", ""year"": 2026}, {""person"": ""Matej Ščišľak"", ""year"": 2026}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""], ""count"": 2}"
|
||||
wide-220,candidate_set_aggregation,True,,7.372822696001094,True,True,True,True,True,True,"Z kandidátov Alina Vitko, Márk Fehér, Adrián Remiáš vyber osoby s prácou v roku 2021. Koľko ich je?","{""answer"": ""Dvaja kandidáti, Alina Vitko a Márk Fehér, majú prácu v roku 2021. Zdroje: https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko, https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""status"": ""ok"", ""claims"": [{""person"": ""Alina Vitko"", ""year"": 2021}, {""person"": ""Márk Fehér"", ""year"": 2021}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher""], ""count"": 2}"
|
||||
wide-221,candidate_set_aggregation,True,,10.551185654003348,True,True,True,True,True,True,"Z kandidátov Andrii Pervashov, Daniil Huzenko, Adrián Remiáš vyber osoby s prácou v roku 2025. Aký je ich počet?","{""answer"": ""Počet kandidátov s prácou v roku 2025 je 2, a to Andrii Pervashov a Daniil Huzenko. Zdroje: https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov, https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""status"": ""ok"", ""claims"": [{""person"": ""Andrii Pervashov"", ""year"": 2025}, {""person"": ""Daniil Huzenko"", ""year"": 2025}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""], ""count"": 2}"
|
||||
wide-222,candidate_set_aggregation,True,,7.566261407999264,True,True,True,True,True,True,"Z kandidátov Andrii Pervashov, Valerii Kutsenko, Adrián Remiáš vyber osoby s prácou v roku 2027. Aký je ich počet?","{""answer"": ""Počet osôb s prácou v roku 2027 je 2. Sú nimi Andrii Pervashov a Valerii Kutsenko. Zdroje: https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov, https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""status"": ""ok"", ""claims"": [{""person"": ""Andrii Pervashov"", ""year"": 2027}, {""person"": ""Valerii Kutsenko"", ""year"": 2027}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""], ""count"": 2}"
|
||||
wide-223,candidate_set_aggregation,True,,10.795403767995595,True,True,True,True,True,True,"Z kandidátov Alina Vitko, Artem Yatsenko, Adrián Remiáš vyber osoby s prácou v roku 2022. Koľko ich je?","{""answer"": ""Dvaja kandidáti, Alina Vitko a Artem Yatsenko, majú prácu v roku 2022. Zdroje: https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko, https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""status"": ""ok"", ""claims"": [{""person"": ""Alina Vitko"", ""year"": 2022}, {""person"": ""Artem Yatsenko"", ""year"": 2022}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""], ""count"": 2}"
|
||||
wide-224,candidate_set_aggregation,True,,7.357641800997953,True,True,True,True,True,True,"Z kandidátov Adrián Remiáš, Dávid Kostilník, Alina Vitko vyber osoby s prácou v roku 2024. Aký je ich počet?","{""answer"": ""Počet osôb s prácou v roku 2024 je 2. Sú to Adrián Remiáš a Dávid Kostilník. Zdroje: https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias, https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik"", ""status"": ""ok"", ""claims"": [{""person"": ""Adrián Remiáš"", ""year"": 2024}, {""person"": ""Dávid Kostilník"", ""year"": 2024}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik""], ""count"": 2}"
|
||||
wide-225,candidate_set_aggregation,True,,10.645838413998717,True,True,True,True,True,True,"Z kandidátov Dárius Lindvai, Martin Wencel, Adrián Remiáš vyber osoby s prácou v roku 2020. Aký je ich počet?","{""answer"": ""Počet kandidátov s prácou v roku 2020 je 2. Sú to Dárius Lindvai a Martin Wencel. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai, https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""status"": ""ok"", ""claims"": [{""person"": ""Dárius Lindvai"", ""year"": 2020}, {""person"": ""Martin Wencel"", ""year"": 2020}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""], ""count"": 2}"
|
||||
wide-226,candidate_set_aggregation,True,,7.666217147998395,True,True,True,True,True,True,"Z kandidátov Dárius Lindvai, Ediz Morochovič, Adrián Remiáš vyber osoby s prácou v roku 2019. Koľko ich je?","{""answer"": ""Dárius Lindvai a Ediz Morochovič majú prácu v roku 2019, čo je spolu 2 osoby. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai, https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic"", ""status"": ""ok"", ""claims"": [{""person"": ""Dárius Lindvai"", ""year"": 2019}, {""person"": ""Ediz Morochovič"", ""year"": 2019}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic""], ""count"": 2}"
|
||||
wide-227,candidate_set_aggregation,True,,10.733524051000131,True,True,True,True,True,True,"Z kandidátov Adrián Remiáš, Matej Kobyľan, Alina Vitko vyber osoby s prácou v roku 2024. Aký je ich počet?","{""answer"": ""Počet osôb s prácou v roku 2024 je 2. Sú to Adrián Remiáš a Matej Kobyľan. Zdroje: https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias, https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""status"": ""ok"", ""claims"": [{""person"": ""Adrián Remiáš"", ""year"": 2024}, {""person"": ""Matej Kobyľan"", ""year"": 2024}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""], ""count"": 2}"
|
||||
wide-228,candidate_set_aggregation,True,,8.750566690003325,True,True,True,True,True,True,"Z kandidátov Artur Hyrenko, Ján Malinovský, Adrián Remiáš vyber osoby s prácou v roku 2026. Aký je ich počet?","{""answer"": ""Počet osôb s prácou v roku 2026 je 2. Sú to Artur Hyrenko a Ján Malinovský. Zdroje: https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko, https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""status"": ""ok"", ""claims"": [{""person"": ""Artur Hyrenko"", ""year"": 2026}, {""person"": ""Ján Malinovský"", ""year"": 2026}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""], ""count"": 2}"
|
||||
wide-229,candidate_set_aggregation,True,,10.704826668006717,True,True,True,True,True,True,"Z kandidátov Dávid Iľaš, Martin Šarišský, Adrián Remiáš vyber osoby s prácou v roku 2023. Koľko ich je?","{""answer"": ""Dávid Iľaš a Martin Šarišský majú prácu v roku 2023, čo je spolu 2 osoby. Zdroje: https://zp.kemt.fei.tuke.sk/students/2018/david_ilas, https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""status"": ""ok"", ""claims"": [{""person"": ""Dávid Iľaš"", ""year"": 2023}, {""person"": ""Martin Šarišský"", ""year"": 2023}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/david_ilas"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""], ""count"": 2}"
|
||||
wide-230,candidate_set_aggregation,True,,8.786429461004445,True,True,True,True,True,True,"Z kandidátov Adrián Remiáš, Matej Ščišľak, Alina Vitko vyber osoby s prácou v roku 2024. Aký je ich počet?","{""answer"": ""Počet osôb s prácou v roku 2024 je 2. Sú to Adrián Remiáš a Matej Ščišľak. Zdroje: https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias, https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""status"": ""ok"", ""claims"": [{""person"": ""Adrián Remiáš"", ""year"": 2024}, {""person"": ""Matej Ščišľak"", ""year"": 2024}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""], ""count"": 2}"
|
||||
wide-231,candidate_set_aggregation,True,,9.847875152001507,True,True,True,True,True,True,"Z kandidátov Artur Hyrenko, Oleksandr Dorybohov, Adrián Remiáš vyber osoby s prácou v roku 2026. Aký je ich počet?","{""answer"": ""Počet kandidátov s prácou v roku 2026 je 2. Sú to Artur Hyrenko a Oleksandr Dorybohov. Zdroje: https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko, https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""status"": ""ok"", ""claims"": [{""person"": ""Artur Hyrenko"", ""year"": 2026}, {""person"": ""Oleksandr Dorybohov"", ""year"": 2026}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""], ""count"": 2}"
|
||||
wide-232,candidate_set_aggregation,False,JSONDecodeError: Expecting value: line 1 column 1 (char 0),13.339628460002132,,,,,,,"Z kandidátov Dávid Omasta, Jakub Kristián Lukas, Adrián Remiáš vyber osoby s prácou v roku 2023. Koľko ich je?",null
|
||||
wide-233,candidate_set_aggregation,True,,8.772020734999387,True,True,True,True,True,True,"Z kandidátov Alina Vitko, Jakub Maruniak, Adrián Remiáš vyber osoby s prácou v roku 2021. Aký je ich počet?","{""answer"": ""Počet osôb s prácou v roku 2021 je 2. Sú to Alina Vitko a Jakub Maruniak. Zdroje: https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko, https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""status"": ""ok"", ""claims"": [{""person"": ""Alina Vitko"", ""year"": 2021}, {""person"": ""Jakub Maruniak"", ""year"": 2021}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""], ""count"": 2}"
|
||||
wide-234,candidate_set_aggregation,True,,11.249018417001935,True,True,True,True,True,True,"Z kandidátov Adrián Remiáš, Dávid Omasta, Alina Vitko vyber osoby s prácou v roku 2024. Aký je ich počet?","{""answer"": ""Počet osôb s prácou v roku 2024 je 2. Sú to Adrián Remiáš a Dávid Omasta. Zdroje: https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias, https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""status"": ""ok"", ""claims"": [{""person"": ""Adrián Remiáš"", ""year"": 2024}, {""person"": ""Dávid Omasta"", ""year"": 2024}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""], ""count"": 2}"
|
||||
wide-235,candidate_set_aggregation,True,,8.039425630006008,True,True,True,True,True,True,"Z kandidátov Dominik Nagy, Lukáš Pokrývka, Adrián Remiáš vyber osoby s prácou v roku 2019. Koľko ich je?","{""answer"": ""Dvaja kandidáti, Dominik Nagy a Lukáš Pokrývka, majú prácu v roku 2019. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy, https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""status"": ""ok"", ""claims"": [{""person"": ""Dominik Nagy"", ""year"": 2019}, {""person"": ""Lukáš Pokrývka"", ""year"": 2019}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""], ""count"": 2}"
|
||||
wide-236,candidate_set_aggregation,False,JSONDecodeError: Expecting value: line 1 column 1 (char 0),15.70306140199682,,,,,,,"Z kandidátov Dávid Iľaš, Vladyslav Krupko, Adrián Remiáš vyber osoby s prácou v roku 2023. Aký je ich počet?",null
|
||||
wide-237,candidate_set_aggregation,True,,7.519558184001653,True,True,True,True,True,True,"Z kandidátov Andrii Pervashov, Matej Ščišľak, Adrián Remiáš vyber osoby s prácou v roku 2025. Aký je ich počet?","{""answer"": ""Počet osôb s prácou v roku 2025 je 2. Sú to Andrii Pervashov a Matej Ščišľak. Zdroje: https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov, https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""status"": ""ok"", ""claims"": [{""person"": ""Andrii Pervashov"", ""year"": 2025}, {""person"": ""Matej Ščišľak"", ""year"": 2025}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""], ""count"": 2}"
|
||||
wide-238,candidate_set_aggregation,True,,12.04440959099884,True,True,True,True,True,True,"Z kandidátov Andrii Pervashov, Patrik Pokrivčák, Adrián Remiáš vyber osoby s prácou v roku 2025. Koľko ich je?","{""answer"": ""Dvaja kandidáti, Andrii Pervashov a Patrik Pokrivčák, majú prácu v roku 2025. Zdroje: https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov, https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak"", ""status"": ""ok"", ""claims"": [{""person"": ""Andrii Pervashov"", ""year"": 2025}, {""person"": ""Patrik Pokrivčák"", ""year"": 2025}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak""], ""count"": 2}"
|
||||
wide-239,candidate_set_aggregation,False,JSONDecodeError: Expecting value: line 1 column 1 (char 0),15.513169307996577,,,,,,,"Z kandidátov Dárius Lindvai, Dmytro Ushatenko, Adrián Remiáš vyber osoby s prácou v roku 2020. Aký je ich počet?",null
|
||||
wide-240,candidate_set_aggregation,True,,7.4692764049977995,True,True,True,True,True,True,"Z kandidátov Alina Vitko, Michal Stromko, Adrián Remiáš vyber osoby s prácou v roku 2021. Aký je ich počet?","{""answer"": ""Počet osôb s prácou v roku 2021 je 2: Alina Vitko a Michal Stromko. Zdroje: https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko, https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""status"": ""ok"", ""claims"": [{""person"": ""Alina Vitko"", ""year"": 2021}, {""person"": ""Michal Stromko"", ""year"": 2021}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""], ""count"": 2}"
|
||||
wide-241,candidate_set_aggregation,True,,11.048038004999398,True,True,True,True,True,True,"Z kandidátov Adrián Remiáš, Pavol Hudák, Alina Vitko vyber osoby s prácou v roku 2024. Koľko ich je?","{""answer"": ""Dvaja kandidáti, Adrián Remiáš a Pavol Hudák, majú prácu v roku 2024. Zdroje: https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias, https://zp.kemt.fei.tuke.sk/students/2020/pavol_hudak"", ""status"": ""ok"", ""claims"": [{""person"": ""Adrián Remiáš"", ""year"": 2024}, {""person"": ""Pavol Hudák"", ""year"": 2024}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2020/pavol_hudak""], ""count"": 2}"
|
||||
wide-242,candidate_set_aggregation,True,,10.065853608997713,True,True,True,True,True,True,"Z kandidátov Alina Vitko, Dmytro Mural, Adrián Remiáš vyber osoby s prácou v roku 2022. Aký je ich počet?","{""answer"": ""Počet osôb s prácou v roku 2022 je 2: Alina Vitko a Dmytro Mural. Zdroje: https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko, https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""status"": ""ok"", ""claims"": [{""person"": ""Alina Vitko"", ""year"": 2022}, {""person"": ""Dmytro Mural"", ""year"": 2022}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural""], ""count"": 2}"
|
||||
wide-243,candidate_set_aggregation,True,,8.257452006000676,True,True,True,True,True,True,"Z kandidátov Alina Vitko, Kristián Sopkovič, Adrián Remiáš vyber osoby s prácou v roku 2022. Aký je ich počet?","{""answer"": ""Počet osôb s prácou v roku 2022 je 2. Sú to Alina Vitko a Kristián Sopkovič. Zdroje: https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko, https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""status"": ""ok"", ""claims"": [{""person"": ""Alina Vitko"", ""year"": 2022}, {""person"": ""Kristián Sopkovič"", ""year"": 2022}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""], ""count"": 2}"
|
||||
wide-244,candidate_set_aggregation,True,,10.002914138000051,True,True,True,True,True,True,"Z kandidátov Dávid Omasta, Filip Tomáš, Adrián Remiáš vyber osoby s prácou v roku 2023. Koľko ich je?","{""answer"": ""Dávid Omasta a Filip Tomáš majú prácu v roku 2023, čo je spolu 2 osoby. Zdroje: https://zp.kemt.fei.tuke.sk/students/2018/david_omasta, https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""status"": ""ok"", ""claims"": [{""person"": ""Dávid Omasta"", ""year"": 2023}, {""person"": ""Filip Tomáš"", ""year"": 2023}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""], ""count"": 2}"
|
||||
wide-245,candidate_set_aggregation,True,,8.243047608004417,True,True,True,True,True,True,"Z kandidátov Dominik Nagy, Ján Holp, Adrián Remiáš vyber osoby s prácou v roku 2019. Aký je ich počet?","{""answer"": ""Počet osôb s prácou v roku 2019 je 2. Sú to Dominik Nagy a Ján Holp. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy, https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""status"": ""ok"", ""claims"": [{""person"": ""Dominik Nagy"", ""year"": 2019}, {""person"": ""Ján Holp"", ""year"": 2019}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""], ""count"": 2}"
|
||||
wide-246,candidate_set_aggregation,True,,9.787830825000128,True,True,True,True,True,True,"Z kandidátov Alina Vitko, Filip Tomáš, Adrián Remiáš vyber osoby s prácou v roku 2021. Aký je ich počet?","{""answer"": ""Počet kandidátov s prácou v roku 2021 je 2. Sú to Alina Vitko a Filip Tomáš. Zdroje: https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko, https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""status"": ""ok"", ""claims"": [{""person"": ""Alina Vitko"", ""year"": 2021}, {""person"": ""Filip Tomáš"", ""year"": 2021}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""], ""count"": 2}"
|
||||
wide-247,candidate_set_aggregation,True,,9.740451630997995,True,True,True,True,True,True,"Z kandidátov Alina Vitko, Matúš Suchanič, Adrián Remiáš vyber osoby s prácou v roku 2022. Koľko ich je?","{""answer"": ""Z kandidátov Alina Vitko a Matúš Suchanič majú prácu v roku 2022, čo je spolu 2 osoby. Adrián Remiáš v roku 2022 prácu nemá. Zdroje: https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko, https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""status"": ""ok"", ""claims"": [{""person"": ""Alina Vitko"", ""year"": 2022}, {""person"": ""Matúš Suchanič"", ""year"": 2022}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""], ""count"": 2}"
|
||||
wide-248,candidate_set_aggregation,True,,9.86519188999955,True,True,True,True,True,True,"Z kandidátov Artur Hyrenko, Denis Le Thanh, Adrián Remiáš vyber osoby s prácou v roku 2026. Aký je ich počet?","{""answer"": ""Počet kandidátov s prácou v roku 2026 je 2, a to Artur Hyrenko a Denis Le Thanh. Zdroje: https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko, https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""status"": ""ok"", ""claims"": [{""person"": ""Artur Hyrenko"", ""year"": 2026}, {""person"": ""Denis Le Thanh"", ""year"": 2026}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""], ""count"": 2}"
|
||||
wide-251,conjunctive_disambiguation,True,,8.290319315005036,True,True,True,True,True,True,Ktorá z osôb Matej Kobyľan a Adrián Remiáš spĺňa kľúčové slovo ir a rok práce 2024?,"{""answer"": ""Matej Kobyľan spĺňa kľúčové slovo ir a rok práce 2024 (zdroj: https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan)."", ""status"": ""ok"", ""claims"": [{""person"": ""Matej Kobyľan"", ""year"": 2024, ""keyword"": ""ir""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""], ""count"": 1}"
|
||||
wide-252,conjunctive_disambiguation,True,,7.219944579999719,True,True,True,True,True,True,Ktorá z osôb Patrik Pavlišin a Dárius Lindvai má kľúčové slovo translation a jej práca je z roku 2019?,"{""answer"": ""Patrik Pavlišin má kľúčové slovo translation a jeho práca je z roku 2019. Dárius Lindvai nemá v grafoch uvedené kľúčové slovo translation ani rok 2019. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""status"": ""ok"", ""claims"": [{""person"": ""Patrik Pavlišin"", ""year"": 2019, ""keyword"": ""translation""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""], ""count"": 1}"
|
||||
wide-253,conjunctive_disambiguation,True,,5.840062208997551,True,True,True,True,True,True,Ktorá z osôb Dárius Lindvai a Ediz Morochovič spĺňa kľúčové slovo nn a rok práce 2019?,"{""answer"": ""Dárius Lindvai spĺňa kľúčové slovo nn a rok práce 2019 (https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai)."", ""status"": ""ok"", ""claims"": [{""person"": ""Dárius Lindvai"", ""year"": 2019, ""keyword"": ""nn""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai""], ""count"": 1}"
|
||||
wide-254,conjunctive_disambiguation,True,,6.407496858999366,True,True,True,True,True,True,Ktorá z osôb Filip Tomáš a Dávid Omasta spĺňa kľúčové slovo testovanie a rok práce 2023?,"{""answer"": ""Osoba Filip Tomáš spĺňa kľúčové slovo testovanie a rok práce 2023 (zdroj: https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas)."", ""status"": ""ok"", ""claims"": [{""person"": ""Filip Tomáš"", ""year"": 2023, ""keyword"": ""testovanie""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""], ""count"": 1}"
|
||||
wide-255,conjunctive_disambiguation,True,,4.776170264995017,True,True,True,True,True,True,Ktorá z osôb Michal Stromko a Alina Vitko má kľúčové slovo cloud a jej práca je z roku 2022?,"{""answer"": ""Michal Stromko má kľúčové slovo cloud a jeho práca je z roku 2022. Zdroj: https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""status"": ""ok"", ""claims"": [{""person"": ""Michal Stromko"", ""year"": 2022, ""keyword"": ""cloud""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""], ""count"": 1}"
|
||||
wide-256,conjunctive_disambiguation,True,,6.568239268002799,True,True,True,True,True,True,Ktorá z osôb Oleh Bilykh a Dmytro Ushatenko spĺňa kľúčové slovo question-answer a rok práce 2020?,"{""answer"": ""Oleh Bilykh spĺňa kľúčové slovo question-answer a rok práce 2020 (zdroj: https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh)."", ""status"": ""ok"", ""claims"": [{""person"": ""Oleh Bilykh"", ""year"": 2020, ""keyword"": ""question-answer""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""], ""count"": 1}"
|
||||
wide-257,conjunctive_disambiguation,True,,4.94857262000005,True,True,True,True,True,True,Ktorá z osôb Matej Ščišľak a Eduard Matovka spĺňa kľúčové slovo dialog a rok práce 2026?,"{""answer"": ""Matej Ščišľak spĺňa kľúčové slovo \""dialog\"" a rok práce 2026 (zdroj: https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak)."", ""status"": ""ok"", ""claims"": [{""person"": ""Matej Ščišľak"", ""year"": 2026, ""keyword"": ""dialog""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""], ""count"": 1}"
|
||||
wide-258,conjunctive_disambiguation,True,,6.659346368003753,True,True,True,True,True,True,Ktorá z osôb Artem Yatsenko a Dávid Stromp má kľúčové slovo spacy a jej práca je z roku 2022?,"{""answer"": ""Artem Yatsenko má kľúčové slovo Spacy a jeho práca je z roku 2022 (zdroj: https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko)."", ""status"": ""ok"", ""claims"": [{""person"": ""Artem Yatsenko"", ""year"": 2022, ""keyword"": ""Spacy""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""], ""count"": 1}"
|
||||
wide-259,conjunctive_disambiguation,True,,5.258838747999107,True,True,True,True,True,True,Ktorá z osôb Michal Stromko a Alina Vitko spĺňa kľúčové slovo nlp a rok práce 2023?,"{""answer"": ""Michal Stromko spĺňa kľúčové slovo NLP a rok práce 2023. Alina Vitko nemá v grafoch uvedené tieto údaje. Zdroje: https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""status"": ""ok"", ""claims"": [{""person"": ""Michal Stromko"", ""year"": 2023, ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""], ""count"": 1}"
|
||||
wide-260,conjunctive_disambiguation,True,,7.194393290999869,True,True,True,True,True,True,Ktorá z osôb Martin Šarišský a Alina Vitko spĺňa kľúčové slovo nlp a rok práce 2023?,"{""answer"": ""Martin Šarišský spĺňa kľúčové slovo NLP a rok práce 2023. Alina Vitko nemá v grafe zaznamenaný rok 2023 ani kľúčové slovo NLP. Zdroje: https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""status"": ""ok"", ""claims"": [{""person"": ""Martin Šarišský"", ""year"": 2023, ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""], ""count"": 1}"
|
||||
wide-261,conjunctive_disambiguation,True,,5.320920971003943,True,True,True,True,True,True,Ktorá z osôb Ondrej Megela a Dárius Lindvai má kľúčové slovo fairseq a jej práca je z roku 2020?,"{""answer"": ""Ondrej Megela má kľúčové slovo fairseq a jeho práca je z roku 2020 (zdroj: https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela)."", ""status"": ""ok"", ""claims"": [{""person"": ""Ondrej Megela"", ""year"": 2020, ""keyword"": ""fairseq""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""], ""count"": 1}"
|
||||
wide-262,conjunctive_disambiguation,True,,7.518260585995449,True,True,True,True,True,True,Ktorá z osôb Patrik Pokrivčák a Dávid Kostilník spĺňa kľúčové slovo hate a rok práce 2024?,"{""answer"": ""Patrik Pokrivčák spĺňa kľúčové slovo 'hate' a rok práce 2024, zatiaľ čo Dávid Kostilník tieto kritériá nespĺňa. Zdroj: https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak"", ""status"": ""ok"", ""claims"": [{""person"": ""Patrik Pokrivčák"", ""year"": 2024, ""keyword"": ""hate""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak""], ""count"": 1}"
|
||||
wide-263,conjunctive_disambiguation,True,,5.239184719997866,True,True,True,True,True,True,Ktorá z osôb Kristián Sopkovič a Adrián Remiáš spĺňa kľúčové slovo nlp a rok práce 2021?,"{""answer"": ""Kristián Sopkovič spĺňa kľúčové slovo NLP a rok práce 2021, zatiaľ čo Adrián Remiáš nemá v grafoch uvedené tieto údaje. Zdroje: https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""status"": ""ok"", ""claims"": [{""person"": ""Kristián Sopkovič"", ""year"": 2021, ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""], ""count"": 1}"
|
||||
wide-264,conjunctive_disambiguation,True,,7.584487269996316,True,True,True,True,True,True,Ktorá z osôb Dmytro Ushatenko a Alina Vitko má kľúčové slovo nlp a jej práca je z roku 2020?,"{""answer"": ""Dmytro Ushatenko má kľúčové slovo NLP a jeho práca je z roku 2020 (zdroj: https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko)."", ""status"": ""ok"", ""claims"": [{""person"": ""Dmytro Ushatenko"", ""year"": 2020, ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko""], ""count"": 1}"
|
||||
wide-265,conjunctive_disambiguation,True,,4.588180135993753,True,True,True,True,True,True,Ktorá z osôb Ondrej Megela a Alina Vitko spĺňa kľúčové slovo nlp a rok práce 2023?,"{""answer"": ""Ondrej Megela spĺňa kľúčové slovo NLP a rok práce 2023 (zdroj: https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela)."", ""status"": ""ok"", ""claims"": [{""person"": ""Ondrej Megela"", ""year"": 2023, ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""], ""count"": 1}"
|
||||
wide-266,conjunctive_disambiguation,True,,7.256377336001606,True,True,True,True,True,True,Ktorá z osôb Than Trung Thanh a Dmytro Ushatenko spĺňa kľúčové slovo anotation a rok práce 2020?,"{""answer"": ""Than Trung Thanh spĺňa kľúčové slovo anotation a rok práce 2020, zatiaľ čo Dmytro Ushatenko tieto kritériá nespĺňa. Zdroje: https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""status"": ""ok"", ""claims"": [{""person"": ""Than Trung Thanh"", ""year"": 2020, ""keyword"": ""anotation""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh""], ""count"": 1}"
|
||||
wide-267,conjunctive_disambiguation,True,,4.091823563001526,True,True,True,True,True,True,Ktorá z osôb Kristián Sopkovič a Alina Vitko má kľúčové slovo spacy a jej práca je z roku 2022?,"{""answer"": ""Kristián Sopkovič má kľúčové slovo Spacy a jeho práca je z roku 2022 (zdroj: https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic)."", ""status"": ""ok"", ""claims"": [{""person"": ""Kristián Sopkovič"", ""year"": 2022, ""keyword"": ""Spacy""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""], ""count"": 1}"
|
||||
wide-268,conjunctive_disambiguation,True,,7.003688570999657,True,True,True,True,True,True,Ktorá z osôb Artem Yatsenko a Cesar Abascal Gutierrez spĺňa kľúčové slovo ner a rok práce 2022?,"{""answer"": ""Osoba Artem Yatsenko spĺňa kľúčové slovo NER a rok práce 2022. Zdroj: https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""status"": ""ok"", ""claims"": [{""person"": ""Artem Yatsenko"", ""year"": 2022, ""keyword"": ""NER""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""], ""count"": 1}"
|
||||
wide-269,conjunctive_disambiguation,True,,3.9448283739984618,True,True,True,True,True,True,Ktorá z osôb Oleh Bilykh a Artem Yatsenko spĺňa kľúčové slovo drqa a rok práce 2021?,"{""answer"": ""Oleh Bilykh spĺňa kľúčové slovo drqa a rok práce 2021. Zdroj: https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""status"": ""ok"", ""claims"": [{""person"": ""Oleh Bilykh"", ""year"": 2021, ""keyword"": ""drqa""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""], ""count"": 1}"
|
||||
wide-270,conjunctive_disambiguation,True,,7.2973852189970785,True,True,True,True,True,True,Ktorá z osôb Filip Tomáš a Daniil Huzenko má kľúčové slovo testovanie a jej práca je z roku 2025?,"{""answer"": ""Filip Tomáš má kľúčové slovo testovanie a jeho práca je z roku 2025 (zdroj: https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas)."", ""status"": ""ok"", ""claims"": [{""person"": ""Filip Tomáš"", ""year"": 2025, ""keyword"": ""testovanie""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""], ""count"": 1}"
|
||||
wide-271,conjunctive_disambiguation,True,,4.728661907996866,True,True,True,True,True,True,Ktorá z osôb Maksym Zatirka a Artur Hyrenko spĺňa kľúčové slovo db a rok práce 2026?,"{""answer"": ""Maksym Zatirka spĺňa kľúčové slovo DB a rok práce 2026, zatiaľ čo Artur Hyrenko nemá v grafe uvedené tieto údaje. Zdroje: https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""status"": ""ok"", ""claims"": [{""person"": ""Maksym Zatirka"", ""year"": 2026, ""keyword"": ""DB""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""], ""count"": 1}"
|
||||
wide-272,conjunctive_disambiguation,True,,7.658525220002048,True,True,True,True,True,True,Ktorá z osôb Lukáš Pokrývka a Artem Yatsenko spĺňa kľúčové slovo cloud a rok práce 2021?,"{""answer"": ""Lukáš Pokrývka spĺňa kľúčové slovo cloud a rok práce 2021, zatiaľ čo Artem Yatsenko nemá v grafe uvedené tieto údaje. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""status"": ""ok"", ""claims"": [{""person"": ""Lukáš Pokrývka"", ""year"": 2021, ""keyword"": ""cloud""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""], ""count"": 1}"
|
||||
wide-273,conjunctive_disambiguation,True,,4.929320309005561,True,True,True,True,True,True,Ktorá z osôb Lukáš Pokrývka a Alina Vitko má kľúčové slovo cloud a jej práca je z roku 2021?,"{""answer"": ""Lukáš Pokrývka má kľúčové slovo cloud a jeho práca je z roku 2021 (zdroj: https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka)."", ""status"": ""ok"", ""claims"": [{""person"": ""Lukáš Pokrývka"", ""year"": 2021, ""keyword"": ""cloud""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""], ""count"": 1}"
|
||||
wide-274,conjunctive_disambiguation,True,,9.057492628002365,True,True,True,True,True,True,Ktorá z osôb Valerii Kutsenko a Adrián Remiáš spĺňa kľúčové slovo nlp a rok práce 2025?,"{""answer"": ""Osoba Valerii Kutsenko spĺňa kľúčové slovo NLP a rok práce 2025, zatiaľ čo pre Adriána Remiáša nie sú v grafe uvedené žiadne údaje o roku 2025 ani kľúčovom slove NLP. Zdroje: https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""status"": ""ok"", ""claims"": [{""person"": ""Valerii Kutsenko"", ""year"": 2025, ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""], ""count"": 1}"
|
||||
wide-275,conjunctive_disambiguation,True,,4.394214208004996,True,True,True,True,True,True,Ktorá z osôb Martin Jancura a Dmytro Ushatenko spĺňa kľúčové slovo opennmt a rok práce 2020?,"{""answer"": ""Martin Jancura spĺňa kľúčové slovo opennmt a rok práce 2020. Dmytro Ushatenko v poskytnutých grafoch nemá tieto údaje. Zdroje: https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""status"": ""ok"", ""claims"": [{""person"": ""Martin Jancura"", ""year"": 2020, ""keyword"": ""opennmt""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""], ""count"": 1}"
|
||||
wide-276,conjunctive_disambiguation,True,,8.695488644996658,True,True,True,True,True,True,Ktorá z osôb Ondrej Megela a Dárius Lindvai má kľúčové slovo question-answer a jej práca je z roku 2020?,"{""answer"": ""Ondrej Megela má kľúčové slovo question-answer a jeho práca je z roku 2020. Dárius Lindvai nemá v grafoch uvedené kľúčové slovo question-answer ani prácu z roku 2020. Zdroje: https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""status"": ""ok"", ""claims"": [{""person"": ""Ondrej Megela"", ""year"": 2020, ""keyword"": ""question-answer""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""], ""count"": 1}"
|
||||
wide-277,conjunctive_disambiguation,True,,4.561247384001035,True,True,True,True,True,True,Ktorá z osôb Martin Wencel a Artem Yatsenko spĺňa kľúčové slovo spacy a rok práce 2020?,"{""answer"": ""Martin Wencel spĺňa kľúčové slovo Spacy a rok práce 2020 (zdroj: https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel)."", ""status"": ""ok"", ""claims"": [{""person"": ""Martin Wencel"", ""year"": 2020, ""keyword"": ""Spacy""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""], ""count"": 1}"
|
||||
wide-278,conjunctive_disambiguation,True,,7.106551545999537,True,True,True,True,True,True,Ktorá z osôb Jakub Maruniak a Artem Yatsenko spĺňa kľúčové slovo annotation a rok práce 2021?,"{""answer"": ""Osoba Jakub Maruniak spĺňa kľúčové slovo 'annotation' a rok práce 2021, čo je potvrdené v zdroji https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak."", ""status"": ""ok"", ""claims"": [{""person"": ""Jakub Maruniak"", ""year"": 2021, ""keyword"": ""annotation""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""], ""count"": 1}"
|
||||
wide-279,conjunctive_disambiguation,True,,3.8795665049983654,True,True,True,True,True,True,Ktorá z osôb Vladimír Ferko a Andrii Pervashov má kľúčové slovo nlp a jej práca je z roku 2024?,"{""answer"": ""Vladimír Ferko má kľúčové slovo NLP a jeho práca je z roku 2024 (zdroj: https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko)."", ""status"": ""ok"", ""claims"": [{""person"": ""Vladimír Ferko"", ""year"": 2024, ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""], ""count"": 1}"
|
||||
wide-280,conjunctive_disambiguation,True,,8.457105479996244,True,True,True,True,True,True,Ktorá z osôb Maksym Zatirka a Denis Le Thanh spĺňa kľúčové slovo graph a rok práce 2026?,"{""answer"": ""Maksym Zatirka spĺňa kľúčové slovo graph a rok práce 2026, zatiaľ čo pre Denis Le Thanh nie sú v grafoch uvedené žiadne údaje o roku 2026 ani kľúčovom slove graph. Zdroje: https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""status"": ""ok"", ""claims"": [{""person"": ""Maksym Zatirka"", ""year"": 2026, ""keyword"": ""graph""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""], ""count"": 1}"
|
||||
wide-281,conjunctive_disambiguation,True,,4.085568874994351,True,True,True,True,True,True,Ktorá z osôb Martin Wencel a Dárius Lindvai spĺňa kľúčové slovo demo a rok práce 2020?,"{""answer"": ""Martin Wencel spĺňa kľúčové slovo demo a rok práce 2020, zatiaľ čo Dárius Lindvai v poskytnutých údajoch tieto kritériá nespĺňa. Zdroje: https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""status"": ""ok"", ""claims"": [{""person"": ""Martin Wencel"", ""year"": 2020, ""keyword"": ""demo""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""], ""count"": 1}"
|
||||
wide-282,conjunctive_disambiguation,True,,7.9133985659937025,True,True,True,True,True,True,Ktorá z osôb Ondrej Megela a Artem Yatsenko má kľúčové slovo lm a jej práca je z roku 2022?,"{""answer"": ""Ondrej Megela má kľúčové slovo LM a jeho práca je z roku 2022. Zdroj: https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""status"": ""ok"", ""claims"": [{""person"": ""Ondrej Megela"", ""year"": 2022, ""keyword"": ""LM""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""], ""count"": 1}"
|
||||
wide-283,conjunctive_disambiguation,False,,9.018380888002866,False,True,True,True,True,True,Ktorá z osôb Dárius Lindvai a Alina Vitko spĺňa kľúčové slovo anaconda a rok práce 2021?,"{""answer"": ""Dárius Lindvai spĺňa kľúčové slovo anaconda a rok práce 2021, zatiaľ čo Alina Vitko nemá v grafoch zaznamenané žiadne údaje spĺňajúce tieto podmienky. Dárius Lindvai má rok 2021 v dokumente https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai a kľúčové slovo anaconda v dokumente https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial."", ""status"": ""ok"", ""claims"": [{""person"": ""Dárius Lindvai"", ""year"": 2021, ""document_path"": ""pages/students/2016/darius_lindvai/README.md""}, {""person"": ""Dárius Lindvai"", ""keyword"": ""anaconda"", ""document_path"": ""pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial""], ""count"": 1}"
|
||||
wide-284,conjunctive_disambiguation,True,,6.446719039995514,True,True,True,True,True,True,Ktorá z osôb Jakub Maruniak a Alina Vitko spĺňa kľúčové slovo nlp a rok práce 2020?,"{""answer"": ""Osoba Jakub Maruniak spĺňa kľúčové slovo NLP a rok práce 2020, čo je doložené v zdroji https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak."", ""status"": ""ok"", ""claims"": [{""person"": ""Jakub Maruniak"", ""year"": 2020, ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""], ""count"": 1}"
|
||||
wide-285,conjunctive_disambiguation,True,,9.707872013001179,True,True,True,True,True,True,Ktorá z osôb Dárius Lindvai a Dominik Nagy má kľúčové slovo pytorch a jej práca je z roku 2019?,"{""answer"": ""Dárius Lindvai má kľúčové slovo pytorch a jeho práca je z roku 2019 (zdroje: https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai, https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial). Dominik Nagy nemá v grafe uvedené kľúčové slovo pytorch ani prácu z roku 2019."", ""status"": ""ok"", ""claims"": [{""person"": ""Dárius Lindvai"", ""year"": 2019, ""keyword"": ""pytorch""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial""], ""count"": 1}"
|
||||
wide-286,conjunctive_disambiguation,True,,7.281992283002182,True,True,True,True,True,True,Ktorá z osôb Ediz Morochovič a Cesar Abascal Gutierrez spĺňa kľúčové slovo ner a rok práce 2019?,"{""answer"": ""Osoba Ediz Morochovič spĺňa kľúčové slovo NER a rok práce 2019, čo je potvrdené v zdrojoch [1](https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic). Osoba Cesar Abascal Gutierrez nemá v dodaných faktoch uvedené kľúčové slovo NER ani rok 2019."", ""status"": ""ok"", ""claims"": [{""person"": ""Ediz Morochovič"", ""year"": 2019, ""keyword"": ""NER""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic""], ""count"": 1}"
|
||||
wide-287,conjunctive_disambiguation,True,,8.911685728999146,True,True,True,True,True,True,Ktorá z osôb Stanislav Matsunych a Adrián Remiáš spĺňa kľúčové slovo nlp a rok práce 2019?,"{""answer"": ""Stanislav Matsunych spĺňa kľúčové slovo NLP a rok práce 2019 (zdroj: https://zp.kemt.fei.tuke.sk/students/2017/stanislav_matsunych)."", ""status"": ""ok"", ""claims"": [{""person"": ""Stanislav Matsunych"", ""year"": 2019, ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2017/stanislav_matsunych""], ""count"": 1}"
|
||||
wide-288,conjunctive_disambiguation,True,,5.03515259300184,True,True,True,True,True,True,Ktorá z osôb Matej Ščišľak a Jakub Schwarc má kľúčové slovo rasa a jej práca je z roku 2026?,"{""answer"": ""Matej Ščišľak má kľúčové slovo 'rasa' a jeho práca je z roku 2026 (zdroj: https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak)."", ""status"": ""ok"", ""claims"": [{""person"": ""Matej Ščišľak"", ""year"": 2026, ""keyword"": ""rasa""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""], ""count"": 1}"
|
||||
wide-291,negative_lookup,True,,5.53823840500263,True,True,True,True,True,True,Aký názov práce má osoba Dávid Iľaš s kľúčovým slovom cluster?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o osobe Dávid Iľaš s kľúčovým slovom cluster."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [], ""count"": 0}"
|
||||
wide-292,negative_lookup,True,,4.538664214000164,True,True,True,True,True,True,Aký názov práce má osoba Martin NaN1 s kľúčovým slovom opennmt?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o osobe Martin s kľúčovým slovom opennmt ani o názve jeho práce. Zdroj: https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday"", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday""], ""count"": 0}"
|
||||
wide-293,negative_lookup,True,,3.460392613997101,True,True,True,True,True,True,Aký názov práce má osoba Stanislav Matsunych s kľúčovým slovom cassandra?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o osobe Stanislav Matsunych s kľúčovým slovom cassandra."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [], ""count"": 0}"
|
||||
wide-294,negative_lookup,True,,4.047304077997978,True,True,True,True,True,True,Aký názov práce má osoba Rostyslav Rodzhuk s kľúčovým slovom translation?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o osobe Rostyslav Rodzhuk s kľúčovým slovom translation."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [], ""count"": 0}"
|
||||
wide-295,negative_lookup,True,,2.1742468329975964,True,True,True,True,True,True,Aký názov práce má osoba Adrián Remiáš s kľúčovým slovom agent?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o osobe Adrián Remiáš s kľúčovým slovom agent."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [], ""count"": 0}"
|
||||
wide-296,negative_lookup,True,,5.470801062001556,True,True,True,True,True,True,Aký názov práce má osoba Oleh Poiasnik v roku 2018?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o názve práce osoby Oleh Poiasnik v roku 2018. Dostupný zdroj (https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik) sa týka roku 2022."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""], ""count"": 0}"
|
||||
wide-297,negative_lookup,True,,4.190618332002487,True,True,True,True,True,True,Aký názov práce má osoba Cesar Abascal Gutierrez s kľúčovým slovom chatbot?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o osobe Cesar Abascal Gutierrez s kľúčovým slovom chatbot."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [], ""count"": 0}"
|
||||
wide-298,negative_lookup,True,,2.034728049999103,True,True,True,True,True,True,Aký názov práce má osoba Samuel Horáni s kľúčovým slovom agent?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o osobe Samuel Horáni s kľúčovým slovom agent."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [], ""count"": 0}"
|
||||
wide-299,negative_lookup,True,,5.025690648006275,True,True,True,True,True,True,Aký názov práce má osoba Samuel Širotník v roku 2018?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o názve práce osoby Samuel Širotník v roku 2018. Zdroj: https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik""], ""count"": 0}"
|
||||
wide-300,negative_lookup,True,,3.9049685309946653,True,True,True,True,True,True,Aký názov práce má osoba Ján Pták v roku 2018?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o názve práce osoby Ján Pták v roku 2018. Dostupný zdroj (https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak) sa týka roku 2022."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""], ""count"": 0}"
|
||||
wide-301,negative_lookup,True,,6.157832761993632,True,True,True,True,True,True,Aký názov práce má osoba Oleh Bilykh v roku 2018?,"{""answer"": ""Na základe dodaných grafových faktov nie je možné určiť názov práce osoby Oleh Bilykh v roku 2018, pretože neexistujú žiadne zodpovedajúce fakty."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""], ""count"": 0}"
|
||||
wide-302,negative_lookup,True,,2.3194820119970245,True,True,True,True,True,True,Aký názov práce má osoba Sevval Bulburu s kľúčovým slovom annotation?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o osobe Sevval Bulburu s kľúčovým slovom annotation."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [], ""count"": null}"
|
||||
wide-303,negative_lookup,True,,3.9633937789985794,True,True,True,True,True,True,Aký názov práce má osoba Ediz Morochovič s kľúčovým slovom gpu?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o osobe Ediz Morochovič s kľúčovým slovom gpu."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [], ""count"": 0}"
|
||||
wide-304,negative_lookup,True,,4.055577051003638,True,True,True,True,True,True,Aký názov práce má osoba Daniil Huzenko v roku 2018?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o názve práce osoby Daniil Huzenko v roku 2018. Jediný dostupný zdroj sa týka roku 2022."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""], ""count"": 0}"
|
||||
wide-305,negative_lookup,True,,4.846808893998968,True,True,True,True,True,True,Aký názov práce má osoba Jakub Schwarc v roku 2018?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o názve práce osoby Jakub Schwarc v roku 2018. Dostupný zdroj (https://zp.kemt.fei.tuke.sk/students/2022/jakub_schwarc) sa týka roku 2022."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/jakub_schwarc""], ""count"": 0}"
|
||||
wide-306,negative_lookup,True,,4.063987007997639,True,True,True,True,True,True,Aký názov práce má osoba Youssef Ressaissi v roku 2018?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o názve práce osoby Youssef Ressaissi v roku 2018."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [], ""count"": 0}"
|
||||
wide-307,negative_lookup,True,,5.840548838998075,True,True,True,True,True,True,Aký názov práce má osoba Maksym Zatirka v roku 2018?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o názve práce osoby Maksym Zatirka v roku 2018. Jediný dostupný zdroj sa týka roku 2023 (https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka)."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""], ""count"": 0}"
|
||||
wide-308,negative_lookup,True,,2.309492806001799,True,True,True,True,True,True,Aký názov práce má osoba Patrik Pavlišin s kľúčovým slovom spacy?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o osobe Patrik Pavlišin s kľúčovým slovom spacy."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [], ""count"": 0}"
|
||||
wide-309,negative_lookup,True,,5.432989887995063,True,True,True,True,True,True,Aký názov práce má osoba Tomáš Kuchárik v roku 2018?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o názve práce osoby Tomáš Kuchárik v roku 2018. K dispozícii je len zdroj pre rok 2016: https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""], ""count"": 0}"
|
||||
wide-310,negative_lookup,True,,3.9099001540016616,True,True,True,True,True,True,Aký názov práce má osoba Sevval Bulburu v roku 2018?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o názve práce osoby Sevval Bulburu v roku 2018."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [], ""count"": 0}"
|
||||
wide-311,negative_lookup,True,,5.625917255994864,True,True,True,True,True,True,Aký názov práce má osoba Eduard Matovka v roku 2018?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o názve práce osoby Eduard Matovka v roku 2018. K dispozícii je len zdroj pre rok 2021: https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka""], ""count"": 0}"
|
||||
wide-312,negative_lookup,True,,1.646204315002251,True,True,True,True,True,True,Aký názov práce má osoba Lucia Chýbajúca Vzorová?,"{""answer"": ""Požadované údaje o osobe Lucia Chýbajúca Vzorová sa nenašli."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [], ""count"": null}"
|
||||
wide-313,negative_lookup,True,,5.2200822480008355,True,True,True,True,True,True,Aký názov práce má osoba Serhii Yemets v roku 2018?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o názve práce osoby Serhii Yemets v roku 2018. K dispozícii je len zdroj pre rok 2022: https://zp.kemt.fei.tuke.sk/students/2022/serhii_yemets."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/serhii_yemets""], ""count"": 0}"
|
||||
wide-314,negative_lookup,True,,3.4291655240012915,True,True,True,True,True,True,Aký názov práce má osoba Jozef Neznámy Overovací?,"{""answer"": ""Požadované údaje o osobe Jozef Neznámy Overovací sa nenašli."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [], ""count"": null}"
|
||||
wide-315,negative_lookup,True,,3.5061925330010126,True,True,True,True,True,True,Aký názov práce má osoba Vladimír Ferko s kľúčovým slovom cluster?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o osobe Vladimír Ferko s kľúčovým slovom cluster."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [], ""count"": null}"
|
||||
wide-316,negative_lookup,True,,2.7539666459997534,True,True,True,True,True,True,Aký názov práce má osoba Ján Malinovský s kľúčovým slovom ir?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o osobe Ján Malinovský s kľúčovým slovom 'ir'."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [], ""count"": null}"
|
||||
wide-317,negative_lookup,True,,4.164983741000469,True,True,True,True,True,True,Aký názov práce má osoba Ján Holp s kľúčovým slovom interpunction?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o osobe Ján Holp s kľúčovým slovom interpunction."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [], ""count"": 0}"
|
||||
wide-318,negative_lookup,True,,1.7391303290060023,True,True,True,True,True,True,Aký názov práce má osoba Petra Neznáma Overovacia?,"{""answer"": ""Požadované údaje o osobe Petra Neznáma Overovacia sa nenašli."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [], ""count"": null}"
|
||||
wide-319,negative_lookup,True,,4.787630693994288,True,True,True,True,True,True,Aký názov práce má osoba Vladyslav Yanchenko v roku 2018?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o názve práce osoby Vladyslav Yanchenko v roku 2018. Jediný dostupný zdroj sa týka roku 2022 (https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko)."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""], ""count"": 0}"
|
||||
wide-320,negative_lookup,True,,3.4466839759988943,True,True,True,True,True,True,Aký názov práce má osoba Dávid Iľaš v roku 2018?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o názve práce osoby Dávid Iľaš v roku 2018. Zdroj: https://zp.kemt.fei.tuke.sk/students/2018/david_ilas"", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/david_ilas""], ""count"": 0}"
|
||||
|
File diff suppressed because it is too large
Load Diff
File diff suppressed because it is too large
Load Diff
@ -0,0 +1,661 @@
|
||||
{
|
||||
"method": "Fresh LLM-generation holdout over previously measured, frozen graph queries.",
|
||||
"graph_freeze_sha256": "07867eb5300498b5862b1e4a607d9f5b050b9fdeab19b1fb6129810e28313a62",
|
||||
"audit_sha256": "220fd00ab08cceee6d5141ca5c1a02ec2877d1eee83b36ea707c6a076ba69e15",
|
||||
"generation_files": {
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/evaluate_graph_answers.py": "d34f324c0c490a02111eed31c45864c068b2b856040bea0201f731ab4ac527f5",
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/graph_answer_prompt.txt": "1900178f4ae805e258726a2df853ab2d0766033cf2ed956d28ea8e0caa7c653f",
|
||||
"tools/rag/evaluation/rag_runner.py": "a011b29e2b6aa47df9350e74fc358f05780a355170a819dbb1cfd16d2971493b"
|
||||
},
|
||||
"model": "model120-fast",
|
||||
"temperature": 0,
|
||||
"workers": 3,
|
||||
"dev_ids": [
|
||||
"wide-001",
|
||||
"wide-002",
|
||||
"wide-041",
|
||||
"wide-042",
|
||||
"wide-081",
|
||||
"wide-082",
|
||||
"wide-113",
|
||||
"wide-114",
|
||||
"wide-137",
|
||||
"wide-138",
|
||||
"wide-169",
|
||||
"wide-170",
|
||||
"wide-193",
|
||||
"wide-194",
|
||||
"wide-217",
|
||||
"wide-218",
|
||||
"wide-249",
|
||||
"wide-250",
|
||||
"wide-289",
|
||||
"wide-290"
|
||||
],
|
||||
"test_ids": [
|
||||
"wide-003",
|
||||
"wide-004",
|
||||
"wide-005",
|
||||
"wide-006",
|
||||
"wide-007",
|
||||
"wide-008",
|
||||
"wide-009",
|
||||
"wide-010",
|
||||
"wide-011",
|
||||
"wide-012",
|
||||
"wide-013",
|
||||
"wide-014",
|
||||
"wide-015",
|
||||
"wide-016",
|
||||
"wide-017",
|
||||
"wide-018",
|
||||
"wide-019",
|
||||
"wide-020",
|
||||
"wide-021",
|
||||
"wide-022",
|
||||
"wide-023",
|
||||
"wide-024",
|
||||
"wide-025",
|
||||
"wide-026",
|
||||
"wide-027",
|
||||
"wide-028",
|
||||
"wide-029",
|
||||
"wide-030",
|
||||
"wide-031",
|
||||
"wide-032",
|
||||
"wide-033",
|
||||
"wide-034",
|
||||
"wide-035",
|
||||
"wide-036",
|
||||
"wide-037",
|
||||
"wide-038",
|
||||
"wide-039",
|
||||
"wide-040",
|
||||
"wide-043",
|
||||
"wide-044",
|
||||
"wide-045",
|
||||
"wide-046",
|
||||
"wide-047",
|
||||
"wide-048",
|
||||
"wide-049",
|
||||
"wide-050",
|
||||
"wide-051",
|
||||
"wide-052",
|
||||
"wide-053",
|
||||
"wide-054",
|
||||
"wide-055",
|
||||
"wide-056",
|
||||
"wide-057",
|
||||
"wide-058",
|
||||
"wide-059",
|
||||
"wide-060",
|
||||
"wide-061",
|
||||
"wide-062",
|
||||
"wide-063",
|
||||
"wide-064",
|
||||
"wide-065",
|
||||
"wide-066",
|
||||
"wide-067",
|
||||
"wide-068",
|
||||
"wide-069",
|
||||
"wide-070",
|
||||
"wide-071",
|
||||
"wide-072",
|
||||
"wide-073",
|
||||
"wide-074",
|
||||
"wide-075",
|
||||
"wide-076",
|
||||
"wide-077",
|
||||
"wide-078",
|
||||
"wide-079",
|
||||
"wide-080",
|
||||
"wide-083",
|
||||
"wide-084",
|
||||
"wide-085",
|
||||
"wide-086",
|
||||
"wide-087",
|
||||
"wide-088",
|
||||
"wide-089",
|
||||
"wide-090",
|
||||
"wide-091",
|
||||
"wide-092",
|
||||
"wide-093",
|
||||
"wide-094",
|
||||
"wide-095",
|
||||
"wide-096",
|
||||
"wide-097",
|
||||
"wide-098",
|
||||
"wide-099",
|
||||
"wide-100",
|
||||
"wide-101",
|
||||
"wide-102",
|
||||
"wide-103",
|
||||
"wide-104",
|
||||
"wide-105",
|
||||
"wide-106",
|
||||
"wide-107",
|
||||
"wide-108",
|
||||
"wide-109",
|
||||
"wide-110",
|
||||
"wide-111",
|
||||
"wide-112",
|
||||
"wide-115",
|
||||
"wide-116",
|
||||
"wide-117",
|
||||
"wide-118",
|
||||
"wide-119",
|
||||
"wide-120",
|
||||
"wide-121",
|
||||
"wide-122",
|
||||
"wide-123",
|
||||
"wide-124",
|
||||
"wide-125",
|
||||
"wide-126",
|
||||
"wide-127",
|
||||
"wide-128",
|
||||
"wide-129",
|
||||
"wide-130",
|
||||
"wide-131",
|
||||
"wide-132",
|
||||
"wide-133",
|
||||
"wide-134",
|
||||
"wide-135",
|
||||
"wide-136",
|
||||
"wide-139",
|
||||
"wide-140",
|
||||
"wide-141",
|
||||
"wide-142",
|
||||
"wide-143",
|
||||
"wide-144",
|
||||
"wide-145",
|
||||
"wide-146",
|
||||
"wide-147",
|
||||
"wide-148",
|
||||
"wide-149",
|
||||
"wide-150",
|
||||
"wide-151",
|
||||
"wide-152",
|
||||
"wide-153",
|
||||
"wide-154",
|
||||
"wide-155",
|
||||
"wide-156",
|
||||
"wide-157",
|
||||
"wide-158",
|
||||
"wide-159",
|
||||
"wide-160",
|
||||
"wide-161",
|
||||
"wide-162",
|
||||
"wide-163",
|
||||
"wide-164",
|
||||
"wide-165",
|
||||
"wide-166",
|
||||
"wide-167",
|
||||
"wide-168",
|
||||
"wide-171",
|
||||
"wide-172",
|
||||
"wide-173",
|
||||
"wide-174",
|
||||
"wide-175",
|
||||
"wide-176",
|
||||
"wide-177",
|
||||
"wide-178",
|
||||
"wide-179",
|
||||
"wide-180",
|
||||
"wide-181",
|
||||
"wide-182",
|
||||
"wide-183",
|
||||
"wide-184",
|
||||
"wide-185",
|
||||
"wide-186",
|
||||
"wide-187",
|
||||
"wide-188",
|
||||
"wide-189",
|
||||
"wide-190",
|
||||
"wide-191",
|
||||
"wide-192",
|
||||
"wide-195",
|
||||
"wide-196",
|
||||
"wide-197",
|
||||
"wide-198",
|
||||
"wide-199",
|
||||
"wide-200",
|
||||
"wide-201",
|
||||
"wide-202",
|
||||
"wide-203",
|
||||
"wide-204",
|
||||
"wide-205",
|
||||
"wide-206",
|
||||
"wide-207",
|
||||
"wide-208",
|
||||
"wide-209",
|
||||
"wide-210",
|
||||
"wide-211",
|
||||
"wide-212",
|
||||
"wide-213",
|
||||
"wide-214",
|
||||
"wide-215",
|
||||
"wide-216",
|
||||
"wide-219",
|
||||
"wide-220",
|
||||
"wide-221",
|
||||
"wide-222",
|
||||
"wide-223",
|
||||
"wide-224",
|
||||
"wide-225",
|
||||
"wide-226",
|
||||
"wide-227",
|
||||
"wide-228",
|
||||
"wide-229",
|
||||
"wide-230",
|
||||
"wide-231",
|
||||
"wide-232",
|
||||
"wide-233",
|
||||
"wide-234",
|
||||
"wide-235",
|
||||
"wide-236",
|
||||
"wide-237",
|
||||
"wide-238",
|
||||
"wide-239",
|
||||
"wide-240",
|
||||
"wide-241",
|
||||
"wide-242",
|
||||
"wide-243",
|
||||
"wide-244",
|
||||
"wide-245",
|
||||
"wide-246",
|
||||
"wide-247",
|
||||
"wide-248",
|
||||
"wide-251",
|
||||
"wide-252",
|
||||
"wide-253",
|
||||
"wide-254",
|
||||
"wide-255",
|
||||
"wide-256",
|
||||
"wide-257",
|
||||
"wide-258",
|
||||
"wide-259",
|
||||
"wide-260",
|
||||
"wide-261",
|
||||
"wide-262",
|
||||
"wide-263",
|
||||
"wide-264",
|
||||
"wide-265",
|
||||
"wide-266",
|
||||
"wide-267",
|
||||
"wide-268",
|
||||
"wide-269",
|
||||
"wide-270",
|
||||
"wide-271",
|
||||
"wide-272",
|
||||
"wide-273",
|
||||
"wide-274",
|
||||
"wide-275",
|
||||
"wide-276",
|
||||
"wide-277",
|
||||
"wide-278",
|
||||
"wide-279",
|
||||
"wide-280",
|
||||
"wide-281",
|
||||
"wide-282",
|
||||
"wide-283",
|
||||
"wide-284",
|
||||
"wide-285",
|
||||
"wide-286",
|
||||
"wide-287",
|
||||
"wide-288",
|
||||
"wide-291",
|
||||
"wide-292",
|
||||
"wide-293",
|
||||
"wide-294",
|
||||
"wide-295",
|
||||
"wide-296",
|
||||
"wide-297",
|
||||
"wide-298",
|
||||
"wide-299",
|
||||
"wide-300",
|
||||
"wide-301",
|
||||
"wide-302",
|
||||
"wide-303",
|
||||
"wide-304",
|
||||
"wide-305",
|
||||
"wide-306",
|
||||
"wide-307",
|
||||
"wide-308",
|
||||
"wide-309",
|
||||
"wide-310",
|
||||
"wide-311",
|
||||
"wide-312",
|
||||
"wide-313",
|
||||
"wide-314",
|
||||
"wide-315",
|
||||
"wide-316",
|
||||
"wide-317",
|
||||
"wide-318",
|
||||
"wide-319",
|
||||
"wide-320"
|
||||
],
|
||||
"dev_count": 20,
|
||||
"test_count": 300,
|
||||
"target_accuracy": 0.92,
|
||||
"selected_split": "test",
|
||||
"selected_ids": [
|
||||
"wide-003",
|
||||
"wide-004",
|
||||
"wide-005",
|
||||
"wide-006",
|
||||
"wide-007",
|
||||
"wide-008",
|
||||
"wide-009",
|
||||
"wide-010",
|
||||
"wide-011",
|
||||
"wide-012",
|
||||
"wide-013",
|
||||
"wide-014",
|
||||
"wide-015",
|
||||
"wide-016",
|
||||
"wide-017",
|
||||
"wide-018",
|
||||
"wide-019",
|
||||
"wide-020",
|
||||
"wide-021",
|
||||
"wide-022",
|
||||
"wide-023",
|
||||
"wide-024",
|
||||
"wide-025",
|
||||
"wide-026",
|
||||
"wide-027",
|
||||
"wide-028",
|
||||
"wide-029",
|
||||
"wide-030",
|
||||
"wide-031",
|
||||
"wide-032",
|
||||
"wide-033",
|
||||
"wide-034",
|
||||
"wide-035",
|
||||
"wide-036",
|
||||
"wide-037",
|
||||
"wide-038",
|
||||
"wide-039",
|
||||
"wide-040",
|
||||
"wide-043",
|
||||
"wide-044",
|
||||
"wide-045",
|
||||
"wide-046",
|
||||
"wide-047",
|
||||
"wide-048",
|
||||
"wide-049",
|
||||
"wide-050",
|
||||
"wide-051",
|
||||
"wide-052",
|
||||
"wide-053",
|
||||
"wide-054",
|
||||
"wide-055",
|
||||
"wide-056",
|
||||
"wide-057",
|
||||
"wide-058",
|
||||
"wide-059",
|
||||
"wide-060",
|
||||
"wide-061",
|
||||
"wide-062",
|
||||
"wide-063",
|
||||
"wide-064",
|
||||
"wide-065",
|
||||
"wide-066",
|
||||
"wide-067",
|
||||
"wide-068",
|
||||
"wide-069",
|
||||
"wide-070",
|
||||
"wide-071",
|
||||
"wide-072",
|
||||
"wide-073",
|
||||
"wide-074",
|
||||
"wide-075",
|
||||
"wide-076",
|
||||
"wide-077",
|
||||
"wide-078",
|
||||
"wide-079",
|
||||
"wide-080",
|
||||
"wide-083",
|
||||
"wide-084",
|
||||
"wide-085",
|
||||
"wide-086",
|
||||
"wide-087",
|
||||
"wide-088",
|
||||
"wide-089",
|
||||
"wide-090",
|
||||
"wide-091",
|
||||
"wide-092",
|
||||
"wide-093",
|
||||
"wide-094",
|
||||
"wide-095",
|
||||
"wide-096",
|
||||
"wide-097",
|
||||
"wide-098",
|
||||
"wide-099",
|
||||
"wide-100",
|
||||
"wide-101",
|
||||
"wide-102",
|
||||
"wide-103",
|
||||
"wide-104",
|
||||
"wide-105",
|
||||
"wide-106",
|
||||
"wide-107",
|
||||
"wide-108",
|
||||
"wide-109",
|
||||
"wide-110",
|
||||
"wide-111",
|
||||
"wide-112",
|
||||
"wide-115",
|
||||
"wide-116",
|
||||
"wide-117",
|
||||
"wide-118",
|
||||
"wide-119",
|
||||
"wide-120",
|
||||
"wide-121",
|
||||
"wide-122",
|
||||
"wide-123",
|
||||
"wide-124",
|
||||
"wide-125",
|
||||
"wide-126",
|
||||
"wide-127",
|
||||
"wide-128",
|
||||
"wide-129",
|
||||
"wide-130",
|
||||
"wide-131",
|
||||
"wide-132",
|
||||
"wide-133",
|
||||
"wide-134",
|
||||
"wide-135",
|
||||
"wide-136",
|
||||
"wide-139",
|
||||
"wide-140",
|
||||
"wide-141",
|
||||
"wide-142",
|
||||
"wide-143",
|
||||
"wide-144",
|
||||
"wide-145",
|
||||
"wide-146",
|
||||
"wide-147",
|
||||
"wide-148",
|
||||
"wide-149",
|
||||
"wide-150",
|
||||
"wide-151",
|
||||
"wide-152",
|
||||
"wide-153",
|
||||
"wide-154",
|
||||
"wide-155",
|
||||
"wide-156",
|
||||
"wide-157",
|
||||
"wide-158",
|
||||
"wide-159",
|
||||
"wide-160",
|
||||
"wide-161",
|
||||
"wide-162",
|
||||
"wide-163",
|
||||
"wide-164",
|
||||
"wide-165",
|
||||
"wide-166",
|
||||
"wide-167",
|
||||
"wide-168",
|
||||
"wide-171",
|
||||
"wide-172",
|
||||
"wide-173",
|
||||
"wide-174",
|
||||
"wide-175",
|
||||
"wide-176",
|
||||
"wide-177",
|
||||
"wide-178",
|
||||
"wide-179",
|
||||
"wide-180",
|
||||
"wide-181",
|
||||
"wide-182",
|
||||
"wide-183",
|
||||
"wide-184",
|
||||
"wide-185",
|
||||
"wide-186",
|
||||
"wide-187",
|
||||
"wide-188",
|
||||
"wide-189",
|
||||
"wide-190",
|
||||
"wide-191",
|
||||
"wide-192",
|
||||
"wide-195",
|
||||
"wide-196",
|
||||
"wide-197",
|
||||
"wide-198",
|
||||
"wide-199",
|
||||
"wide-200",
|
||||
"wide-201",
|
||||
"wide-202",
|
||||
"wide-203",
|
||||
"wide-204",
|
||||
"wide-205",
|
||||
"wide-206",
|
||||
"wide-207",
|
||||
"wide-208",
|
||||
"wide-209",
|
||||
"wide-210",
|
||||
"wide-211",
|
||||
"wide-212",
|
||||
"wide-213",
|
||||
"wide-214",
|
||||
"wide-215",
|
||||
"wide-216",
|
||||
"wide-219",
|
||||
"wide-220",
|
||||
"wide-221",
|
||||
"wide-222",
|
||||
"wide-223",
|
||||
"wide-224",
|
||||
"wide-225",
|
||||
"wide-226",
|
||||
"wide-227",
|
||||
"wide-228",
|
||||
"wide-229",
|
||||
"wide-230",
|
||||
"wide-231",
|
||||
"wide-232",
|
||||
"wide-233",
|
||||
"wide-234",
|
||||
"wide-235",
|
||||
"wide-236",
|
||||
"wide-237",
|
||||
"wide-238",
|
||||
"wide-239",
|
||||
"wide-240",
|
||||
"wide-241",
|
||||
"wide-242",
|
||||
"wide-243",
|
||||
"wide-244",
|
||||
"wide-245",
|
||||
"wide-246",
|
||||
"wide-247",
|
||||
"wide-248",
|
||||
"wide-251",
|
||||
"wide-252",
|
||||
"wide-253",
|
||||
"wide-254",
|
||||
"wide-255",
|
||||
"wide-256",
|
||||
"wide-257",
|
||||
"wide-258",
|
||||
"wide-259",
|
||||
"wide-260",
|
||||
"wide-261",
|
||||
"wide-262",
|
||||
"wide-263",
|
||||
"wide-264",
|
||||
"wide-265",
|
||||
"wide-266",
|
||||
"wide-267",
|
||||
"wide-268",
|
||||
"wide-269",
|
||||
"wide-270",
|
||||
"wide-271",
|
||||
"wide-272",
|
||||
"wide-273",
|
||||
"wide-274",
|
||||
"wide-275",
|
||||
"wide-276",
|
||||
"wide-277",
|
||||
"wide-278",
|
||||
"wide-279",
|
||||
"wide-280",
|
||||
"wide-281",
|
||||
"wide-282",
|
||||
"wide-283",
|
||||
"wide-284",
|
||||
"wide-285",
|
||||
"wide-286",
|
||||
"wide-287",
|
||||
"wide-288",
|
||||
"wide-291",
|
||||
"wide-292",
|
||||
"wide-293",
|
||||
"wide-294",
|
||||
"wide-295",
|
||||
"wide-296",
|
||||
"wide-297",
|
||||
"wide-298",
|
||||
"wide-299",
|
||||
"wide-300",
|
||||
"wide-301",
|
||||
"wide-302",
|
||||
"wide-303",
|
||||
"wide-304",
|
||||
"wide-305",
|
||||
"wide-306",
|
||||
"wide-307",
|
||||
"wide-308",
|
||||
"wide-309",
|
||||
"wide-310",
|
||||
"wide-311",
|
||||
"wide-312",
|
||||
"wide-313",
|
||||
"wide-314",
|
||||
"wide-315",
|
||||
"wide-316",
|
||||
"wide-317",
|
||||
"wide-318",
|
||||
"wide-319",
|
||||
"wide-320"
|
||||
],
|
||||
"policy": "Evaluate all 300; retain every failure; do not tune on this TEST.",
|
||||
"test_categories": {
|
||||
"shared_keyword_pair": 38,
|
||||
"same_academic_year_pair": 38,
|
||||
"same_start_year_pair": 30,
|
||||
"person_title_year": 22,
|
||||
"person_keyword_title": 30,
|
||||
"document_author_category_multi_hop": 22,
|
||||
"person_multiple_categories": 22,
|
||||
"candidate_set_aggregation": 30,
|
||||
"conjunctive_disambiguation": 38,
|
||||
"negative_lookup": 30
|
||||
},
|
||||
"limitations": [
|
||||
"Known corpus/profiles and templates; model outputs for these 300 questions were not previously observed.",
|
||||
"Harness supplies graph context; native OpenWebUI tool choice and browser UI are outside this experiment.",
|
||||
"Checks structured factual claims, their source support/citations and required prose values; not a general semantic judge of arbitrary prose."
|
||||
]
|
||||
}
|
||||
@ -0,0 +1,40 @@
|
||||
id,category,strict,error,latency_seconds,attempts,first_pass_strict
|
||||
wide-001,shared_keyword_pair,True,,7.432791330997134,1,True
|
||||
wide-002,shared_keyword_pair,True,,9.3359067220008,1,True
|
||||
wide-041,same_academic_year_pair,True,,13.052469432994258,1,True
|
||||
wide-042,same_academic_year_pair,True,,7.94166571200185,1,True
|
||||
wide-080,same_academic_year_pair,True,,8.928297609003494,1,True
|
||||
wide-081,same_start_year_pair,True,,8.421164927000063,1,True
|
||||
wide-082,same_start_year_pair,True,,8.470174660003977,1,True
|
||||
wide-104,same_start_year_pair,True,,9.088728798000375,1,True
|
||||
wide-113,person_title_year,True,,7.292930210009217,1,True
|
||||
wide-114,person_title_year,True,,8.822794015999534,1,True
|
||||
wide-119,person_title_year,True,,5.405082925994066,1,True
|
||||
wide-137,person_keyword_title,True,,9.147465852001915,1,True
|
||||
wide-138,person_keyword_title,True,,6.318841665008222,1,True
|
||||
wide-139,person_keyword_title,True,,10.469266973988852,1,True
|
||||
wide-141,person_keyword_title,True,,6.316172414997709,1,True
|
||||
wide-142,person_keyword_title,False,,10.959449250003672,1,False
|
||||
wide-143,person_keyword_title,True,,8.508081905994914,1,True
|
||||
wide-145,person_keyword_title,True,,13.52746086299885,1,True
|
||||
wide-155,person_keyword_title,True,,6.8860766970028635,1,True
|
||||
wide-159,person_keyword_title,True,,10.890385270991828,1,True
|
||||
wide-161,person_keyword_title,True,,6.801796521991491,1,True
|
||||
wide-163,person_keyword_title,True,,10.777118418001919,1,True
|
||||
wide-169,document_author_category_multi_hop,True,,4.879302582994569,1,True
|
||||
wide-170,document_author_category_multi_hop,True,,8.241740879006102,1,True
|
||||
wide-178,document_author_category_multi_hop,True,,5.5909052140050335,1,True
|
||||
wide-181,document_author_category_multi_hop,True,,8.192060016008327,1,True
|
||||
wide-193,person_multiple_categories,True,,4.390313146999688,1,True
|
||||
wide-194,person_multiple_categories,True,,6.805427877989132,1,True
|
||||
wide-209,person_multiple_categories,True,,5.125700485994457,1,True
|
||||
wide-217,candidate_set_aggregation,True,,9.28586104400165,1,True
|
||||
wide-218,candidate_set_aggregation,True,,7.510667574999388,1,True
|
||||
wide-232,candidate_set_aggregation,True,,10.86943264301226,1,True
|
||||
wide-236,candidate_set_aggregation,True,,7.126413513993612,1,True
|
||||
wide-239,candidate_set_aggregation,True,,11.048067500989418,1,True
|
||||
wide-249,conjunctive_disambiguation,True,,4.892320775994449,1,True
|
||||
wide-250,conjunctive_disambiguation,True,,8.952342251010123,1,True
|
||||
wide-283,conjunctive_disambiguation,True,,7.288101250000182,1,True
|
||||
wide-289,negative_lookup,True,,5.516414188998169,1,True
|
||||
wide-290,negative_lookup,True,,4.058507394001936,1,True
|
||||
|
File diff suppressed because it is too large
Load Diff
@ -0,0 +1,425 @@
|
||||
{
|
||||
"method": "Previously exposed LLM questions; regression, not independent TEST.",
|
||||
"graph_freeze_sha256": "ca1d2d71f60a8e65b82d727ad14556aabf2e03f2acdce1755c3e2a7a9a3149d3",
|
||||
"audit_sha256": "81708ca63f8772673cd836fe7a1a1938fbe0e713588efcb07ed3fd4280f27829",
|
||||
"generation_files": {
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/evaluate_graph_answers.py": "3b58e210fcd934a5488575e1b0ebb46a2e94ce72ee12f1e1a666c726c66d68af",
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/graph_answer_prompt.txt": "64d2bd817657f390c306ea01bf2dad41f70cd6993e06b2e3b2f4713bae0d249c",
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/answer_format.py": "86a27b4aebc6a5077e13794b81957a1cf063a1f3e070c583120ba53c1788d2f8",
|
||||
"tools/rag/evaluation/rag_runner.py": "a011b29e2b6aa47df9350e74fc358f05780a355170a819dbb1cfd16d2971493b"
|
||||
},
|
||||
"model": "model120-fast",
|
||||
"temperature": 0,
|
||||
"workers": 3,
|
||||
"dev_ids": [
|
||||
"wide-001",
|
||||
"wide-002",
|
||||
"wide-041",
|
||||
"wide-042",
|
||||
"wide-080",
|
||||
"wide-081",
|
||||
"wide-082",
|
||||
"wide-104",
|
||||
"wide-113",
|
||||
"wide-114",
|
||||
"wide-119",
|
||||
"wide-137",
|
||||
"wide-138",
|
||||
"wide-139",
|
||||
"wide-141",
|
||||
"wide-142",
|
||||
"wide-143",
|
||||
"wide-145",
|
||||
"wide-155",
|
||||
"wide-159",
|
||||
"wide-161",
|
||||
"wide-163",
|
||||
"wide-169",
|
||||
"wide-170",
|
||||
"wide-178",
|
||||
"wide-181",
|
||||
"wide-193",
|
||||
"wide-194",
|
||||
"wide-209",
|
||||
"wide-217",
|
||||
"wide-218",
|
||||
"wide-232",
|
||||
"wide-236",
|
||||
"wide-239",
|
||||
"wide-249",
|
||||
"wide-250",
|
||||
"wide-283",
|
||||
"wide-289",
|
||||
"wide-290"
|
||||
],
|
||||
"test_ids": [
|
||||
"wide-003",
|
||||
"wide-004",
|
||||
"wide-005",
|
||||
"wide-006",
|
||||
"wide-007",
|
||||
"wide-008",
|
||||
"wide-009",
|
||||
"wide-010",
|
||||
"wide-011",
|
||||
"wide-012",
|
||||
"wide-013",
|
||||
"wide-014",
|
||||
"wide-015",
|
||||
"wide-016",
|
||||
"wide-017",
|
||||
"wide-018",
|
||||
"wide-019",
|
||||
"wide-020",
|
||||
"wide-021",
|
||||
"wide-022",
|
||||
"wide-023",
|
||||
"wide-024",
|
||||
"wide-025",
|
||||
"wide-026",
|
||||
"wide-027",
|
||||
"wide-028",
|
||||
"wide-029",
|
||||
"wide-030",
|
||||
"wide-031",
|
||||
"wide-032",
|
||||
"wide-033",
|
||||
"wide-034",
|
||||
"wide-035",
|
||||
"wide-036",
|
||||
"wide-037",
|
||||
"wide-038",
|
||||
"wide-039",
|
||||
"wide-040",
|
||||
"wide-043",
|
||||
"wide-044",
|
||||
"wide-045",
|
||||
"wide-046",
|
||||
"wide-047",
|
||||
"wide-048",
|
||||
"wide-049",
|
||||
"wide-050",
|
||||
"wide-051",
|
||||
"wide-052",
|
||||
"wide-053",
|
||||
"wide-054",
|
||||
"wide-055",
|
||||
"wide-056",
|
||||
"wide-057",
|
||||
"wide-058",
|
||||
"wide-059",
|
||||
"wide-060",
|
||||
"wide-061",
|
||||
"wide-062",
|
||||
"wide-063",
|
||||
"wide-064",
|
||||
"wide-065",
|
||||
"wide-066",
|
||||
"wide-067",
|
||||
"wide-068",
|
||||
"wide-069",
|
||||
"wide-070",
|
||||
"wide-071",
|
||||
"wide-072",
|
||||
"wide-073",
|
||||
"wide-074",
|
||||
"wide-075",
|
||||
"wide-076",
|
||||
"wide-077",
|
||||
"wide-078",
|
||||
"wide-079",
|
||||
"wide-080",
|
||||
"wide-083",
|
||||
"wide-084",
|
||||
"wide-085",
|
||||
"wide-086",
|
||||
"wide-087",
|
||||
"wide-088",
|
||||
"wide-089",
|
||||
"wide-090",
|
||||
"wide-091",
|
||||
"wide-092",
|
||||
"wide-093",
|
||||
"wide-094",
|
||||
"wide-095",
|
||||
"wide-096",
|
||||
"wide-097",
|
||||
"wide-098",
|
||||
"wide-099",
|
||||
"wide-100",
|
||||
"wide-101",
|
||||
"wide-102",
|
||||
"wide-103",
|
||||
"wide-104",
|
||||
"wide-105",
|
||||
"wide-106",
|
||||
"wide-107",
|
||||
"wide-108",
|
||||
"wide-109",
|
||||
"wide-110",
|
||||
"wide-111",
|
||||
"wide-112",
|
||||
"wide-115",
|
||||
"wide-116",
|
||||
"wide-117",
|
||||
"wide-118",
|
||||
"wide-119",
|
||||
"wide-120",
|
||||
"wide-121",
|
||||
"wide-122",
|
||||
"wide-123",
|
||||
"wide-124",
|
||||
"wide-125",
|
||||
"wide-126",
|
||||
"wide-127",
|
||||
"wide-128",
|
||||
"wide-129",
|
||||
"wide-130",
|
||||
"wide-131",
|
||||
"wide-132",
|
||||
"wide-133",
|
||||
"wide-134",
|
||||
"wide-135",
|
||||
"wide-136",
|
||||
"wide-139",
|
||||
"wide-140",
|
||||
"wide-141",
|
||||
"wide-142",
|
||||
"wide-143",
|
||||
"wide-144",
|
||||
"wide-145",
|
||||
"wide-146",
|
||||
"wide-147",
|
||||
"wide-148",
|
||||
"wide-149",
|
||||
"wide-150",
|
||||
"wide-151",
|
||||
"wide-152",
|
||||
"wide-153",
|
||||
"wide-154",
|
||||
"wide-155",
|
||||
"wide-156",
|
||||
"wide-157",
|
||||
"wide-158",
|
||||
"wide-159",
|
||||
"wide-160",
|
||||
"wide-161",
|
||||
"wide-162",
|
||||
"wide-163",
|
||||
"wide-164",
|
||||
"wide-165",
|
||||
"wide-166",
|
||||
"wide-167",
|
||||
"wide-168",
|
||||
"wide-171",
|
||||
"wide-172",
|
||||
"wide-173",
|
||||
"wide-174",
|
||||
"wide-175",
|
||||
"wide-176",
|
||||
"wide-177",
|
||||
"wide-178",
|
||||
"wide-179",
|
||||
"wide-180",
|
||||
"wide-181",
|
||||
"wide-182",
|
||||
"wide-183",
|
||||
"wide-184",
|
||||
"wide-185",
|
||||
"wide-186",
|
||||
"wide-187",
|
||||
"wide-188",
|
||||
"wide-189",
|
||||
"wide-190",
|
||||
"wide-191",
|
||||
"wide-192",
|
||||
"wide-195",
|
||||
"wide-196",
|
||||
"wide-197",
|
||||
"wide-198",
|
||||
"wide-199",
|
||||
"wide-200",
|
||||
"wide-201",
|
||||
"wide-202",
|
||||
"wide-203",
|
||||
"wide-204",
|
||||
"wide-205",
|
||||
"wide-206",
|
||||
"wide-207",
|
||||
"wide-208",
|
||||
"wide-209",
|
||||
"wide-210",
|
||||
"wide-211",
|
||||
"wide-212",
|
||||
"wide-213",
|
||||
"wide-214",
|
||||
"wide-215",
|
||||
"wide-216",
|
||||
"wide-219",
|
||||
"wide-220",
|
||||
"wide-221",
|
||||
"wide-222",
|
||||
"wide-223",
|
||||
"wide-224",
|
||||
"wide-225",
|
||||
"wide-226",
|
||||
"wide-227",
|
||||
"wide-228",
|
||||
"wide-229",
|
||||
"wide-230",
|
||||
"wide-231",
|
||||
"wide-232",
|
||||
"wide-233",
|
||||
"wide-234",
|
||||
"wide-235",
|
||||
"wide-236",
|
||||
"wide-237",
|
||||
"wide-238",
|
||||
"wide-239",
|
||||
"wide-240",
|
||||
"wide-241",
|
||||
"wide-242",
|
||||
"wide-243",
|
||||
"wide-244",
|
||||
"wide-245",
|
||||
"wide-246",
|
||||
"wide-247",
|
||||
"wide-248",
|
||||
"wide-251",
|
||||
"wide-252",
|
||||
"wide-253",
|
||||
"wide-254",
|
||||
"wide-255",
|
||||
"wide-256",
|
||||
"wide-257",
|
||||
"wide-258",
|
||||
"wide-259",
|
||||
"wide-260",
|
||||
"wide-261",
|
||||
"wide-262",
|
||||
"wide-263",
|
||||
"wide-264",
|
||||
"wide-265",
|
||||
"wide-266",
|
||||
"wide-267",
|
||||
"wide-268",
|
||||
"wide-269",
|
||||
"wide-270",
|
||||
"wide-271",
|
||||
"wide-272",
|
||||
"wide-273",
|
||||
"wide-274",
|
||||
"wide-275",
|
||||
"wide-276",
|
||||
"wide-277",
|
||||
"wide-278",
|
||||
"wide-279",
|
||||
"wide-280",
|
||||
"wide-281",
|
||||
"wide-282",
|
||||
"wide-283",
|
||||
"wide-284",
|
||||
"wide-285",
|
||||
"wide-286",
|
||||
"wide-287",
|
||||
"wide-288",
|
||||
"wide-291",
|
||||
"wide-292",
|
||||
"wide-293",
|
||||
"wide-294",
|
||||
"wide-295",
|
||||
"wide-296",
|
||||
"wide-297",
|
||||
"wide-298",
|
||||
"wide-299",
|
||||
"wide-300",
|
||||
"wide-301",
|
||||
"wide-302",
|
||||
"wide-303",
|
||||
"wide-304",
|
||||
"wide-305",
|
||||
"wide-306",
|
||||
"wide-307",
|
||||
"wide-308",
|
||||
"wide-309",
|
||||
"wide-310",
|
||||
"wide-311",
|
||||
"wide-312",
|
||||
"wide-313",
|
||||
"wide-314",
|
||||
"wide-315",
|
||||
"wide-316",
|
||||
"wide-317",
|
||||
"wide-318",
|
||||
"wide-319",
|
||||
"wide-320"
|
||||
],
|
||||
"dev_count": 39,
|
||||
"test_count": 300,
|
||||
"target_accuracy": 0.92,
|
||||
"selected_split": "dev",
|
||||
"selected_ids": [
|
||||
"wide-001",
|
||||
"wide-002",
|
||||
"wide-041",
|
||||
"wide-042",
|
||||
"wide-080",
|
||||
"wide-081",
|
||||
"wide-082",
|
||||
"wide-104",
|
||||
"wide-113",
|
||||
"wide-114",
|
||||
"wide-119",
|
||||
"wide-137",
|
||||
"wide-138",
|
||||
"wide-139",
|
||||
"wide-141",
|
||||
"wide-142",
|
||||
"wide-143",
|
||||
"wide-145",
|
||||
"wide-155",
|
||||
"wide-159",
|
||||
"wide-161",
|
||||
"wide-163",
|
||||
"wide-169",
|
||||
"wide-170",
|
||||
"wide-178",
|
||||
"wide-181",
|
||||
"wide-193",
|
||||
"wide-194",
|
||||
"wide-209",
|
||||
"wide-217",
|
||||
"wide-218",
|
||||
"wide-232",
|
||||
"wide-236",
|
||||
"wide-239",
|
||||
"wide-249",
|
||||
"wide-250",
|
||||
"wide-283",
|
||||
"wide-289",
|
||||
"wide-290"
|
||||
],
|
||||
"selected_count": 39,
|
||||
"selected_dev_overlap": 39,
|
||||
"format_repair_limit": 1,
|
||||
"repair_policy": "Only JSON/schema failures; same question/context, no gold; retain all attempts.",
|
||||
"dev_results_sha256": null,
|
||||
"policy": "Evaluate every declared regression case, including DEV overlap; retain all failures and stop tuning after this freeze.",
|
||||
"selected_categories": {
|
||||
"shared_keyword_pair": 2,
|
||||
"same_academic_year_pair": 3,
|
||||
"same_start_year_pair": 3,
|
||||
"person_title_year": 3,
|
||||
"person_keyword_title": 11,
|
||||
"document_author_category_multi_hop": 4,
|
||||
"person_multiple_categories": 3,
|
||||
"candidate_set_aggregation": 5,
|
||||
"conjunctive_disambiguation": 3,
|
||||
"negative_lookup": 2
|
||||
},
|
||||
"limitations": [
|
||||
"Known corpus/profiles and templates; model outputs for these 300 questions were not previously observed.",
|
||||
"Harness supplies graph context; native OpenWebUI tool choice and browser UI are outside this experiment.",
|
||||
"Checks structured factual claims, their source support/citations and required prose values; not a general semantic judge of arbitrary prose."
|
||||
]
|
||||
}
|
||||
@ -0,0 +1,321 @@
|
||||
id,category,strict,error,latency_seconds,attempts,first_pass_strict
|
||||
wide-001,shared_keyword_pair,True,,12.681157764003729,1,True
|
||||
wide-002,shared_keyword_pair,True,,7.440348913005437,1,True
|
||||
wide-003,shared_keyword_pair,True,,6.8628689809993375,1,True
|
||||
wide-004,shared_keyword_pair,True,,7.915003027010243,1,True
|
||||
wide-005,shared_keyword_pair,True,,11.64334254800633,1,True
|
||||
wide-006,shared_keyword_pair,True,,9.263334328003111,1,True
|
||||
wide-007,shared_keyword_pair,True,,10.080044332993566,1,True
|
||||
wide-008,shared_keyword_pair,True,,9.102414163004141,1,True
|
||||
wide-009,shared_keyword_pair,True,,8.990864911000244,1,True
|
||||
wide-010,shared_keyword_pair,True,,10.98848542298947,1,True
|
||||
wide-011,shared_keyword_pair,True,,9.469930938998004,1,True
|
||||
wide-012,shared_keyword_pair,True,,11.050285377990804,1,True
|
||||
wide-013,shared_keyword_pair,True,,8.279340490000322,1,True
|
||||
wide-014,shared_keyword_pair,True,,10.769162045005942,1,True
|
||||
wide-015,shared_keyword_pair,True,,10.199135344999377,1,True
|
||||
wide-016,shared_keyword_pair,True,,12.438964514003601,1,True
|
||||
wide-017,shared_keyword_pair,True,,10.442358953005169,1,True
|
||||
wide-018,shared_keyword_pair,True,,10.590256554991356,1,True
|
||||
wide-019,shared_keyword_pair,True,,9.393680679990212,1,True
|
||||
wide-020,shared_keyword_pair,True,,10.050156186000095,1,True
|
||||
wide-021,shared_keyword_pair,True,,10.283129505012766,1,True
|
||||
wide-022,shared_keyword_pair,True,,9.261356490998878,1,True
|
||||
wide-023,shared_keyword_pair,True,,11.352632169000572,1,True
|
||||
wide-024,shared_keyword_pair,True,,7.952293816997553,1,True
|
||||
wide-025,shared_keyword_pair,True,,11.707699684004183,1,True
|
||||
wide-026,shared_keyword_pair,True,,7.244572512994637,1,True
|
||||
wide-027,shared_keyword_pair,True,,11.86879978099023,1,True
|
||||
wide-028,shared_keyword_pair,True,,6.436980010010302,1,True
|
||||
wide-029,shared_keyword_pair,True,,13.4112125190004,1,True
|
||||
wide-030,shared_keyword_pair,True,,6.320292321004672,1,True
|
||||
wide-031,shared_keyword_pair,True,,13.030589675996453,1,True
|
||||
wide-032,shared_keyword_pair,True,,8.23478609599988,1,True
|
||||
wide-033,shared_keyword_pair,True,,11.427597190995584,1,True
|
||||
wide-034,shared_keyword_pair,True,,7.945492083003046,1,True
|
||||
wide-035,shared_keyword_pair,True,,10.91667144499661,1,True
|
||||
wide-036,shared_keyword_pair,True,,7.704312329005916,1,True
|
||||
wide-037,shared_keyword_pair,True,,9.866947228001663,1,True
|
||||
wide-038,shared_keyword_pair,True,,9.0944732450007,1,True
|
||||
wide-039,shared_keyword_pair,True,,9.955326469003921,1,True
|
||||
wide-040,shared_keyword_pair,True,,10.126550430999487,1,True
|
||||
wide-041,same_academic_year_pair,True,,8.00595778299612,1,True
|
||||
wide-042,same_academic_year_pair,True,,10.224936337006511,1,True
|
||||
wide-043,same_academic_year_pair,True,,7.973652732995106,1,True
|
||||
wide-044,same_academic_year_pair,True,,11.643997175007826,1,True
|
||||
wide-045,same_academic_year_pair,True,,7.812763041001745,1,True
|
||||
wide-046,same_academic_year_pair,True,,11.01834614200925,1,True
|
||||
wide-047,same_academic_year_pair,True,,9.787194718010142,1,True
|
||||
wide-048,same_academic_year_pair,True,,11.489561196009163,1,True
|
||||
wide-049,same_academic_year_pair,True,,10.164007376006339,1,True
|
||||
wide-050,same_academic_year_pair,True,,9.938125018001301,1,True
|
||||
wide-051,same_academic_year_pair,True,,9.78176777700719,1,True
|
||||
wide-052,same_academic_year_pair,True,,9.160806122003123,1,True
|
||||
wide-053,same_academic_year_pair,True,,9.269089786990662,1,True
|
||||
wide-054,same_academic_year_pair,True,,9.431611267005792,1,True
|
||||
wide-055,same_academic_year_pair,True,,9.327960707989405,1,True
|
||||
wide-056,same_academic_year_pair,True,,9.804446037000162,1,True
|
||||
wide-057,same_academic_year_pair,True,,8.234563728998182,1,True
|
||||
wide-058,same_academic_year_pair,True,,9.821240933990339,1,True
|
||||
wide-059,same_academic_year_pair,True,,6.477854401004151,1,True
|
||||
wide-060,same_academic_year_pair,True,,10.462991334003164,1,True
|
||||
wide-061,same_academic_year_pair,True,,6.2554830580047565,1,True
|
||||
wide-062,same_academic_year_pair,True,,10.774600299002486,1,True
|
||||
wide-063,same_academic_year_pair,True,,6.288768262995291,1,True
|
||||
wide-064,same_academic_year_pair,True,,11.15352754900232,1,True
|
||||
wide-065,same_academic_year_pair,True,,5.480506381005398,1,True
|
||||
wide-066,same_academic_year_pair,True,,10.729390800988767,1,True
|
||||
wide-067,same_academic_year_pair,True,,7.499470337992534,1,True
|
||||
wide-068,same_academic_year_pair,True,,11.094555151008535,1,True
|
||||
wide-069,same_academic_year_pair,True,,7.680634538002778,1,True
|
||||
wide-070,same_academic_year_pair,True,,10.041368676989805,1,True
|
||||
wide-071,same_academic_year_pair,True,,9.15008538699476,1,True
|
||||
wide-072,same_academic_year_pair,True,,9.846425030991668,1,True
|
||||
wide-073,same_academic_year_pair,True,,8.89766675599094,1,True
|
||||
wide-074,same_academic_year_pair,True,,8.42804765701294,1,True
|
||||
wide-075,same_academic_year_pair,True,,8.904354819998844,1,True
|
||||
wide-076,same_academic_year_pair,True,,8.653263764994335,1,True
|
||||
wide-077,same_academic_year_pair,True,,8.350220588996308,1,True
|
||||
wide-078,same_academic_year_pair,True,,9.132759956002701,1,True
|
||||
wide-079,same_academic_year_pair,True,,8.293541837992962,1,True
|
||||
wide-080,same_academic_year_pair,True,,10.156925554998452,1,True
|
||||
wide-081,same_start_year_pair,True,,7.918382621995988,1,True
|
||||
wide-082,same_start_year_pair,True,,10.321019872004399,1,True
|
||||
wide-083,same_start_year_pair,True,,7.002511290003895,1,True
|
||||
wide-084,same_start_year_pair,True,,10.437800674000755,1,True
|
||||
wide-085,same_start_year_pair,True,,6.816185226009111,1,True
|
||||
wide-086,same_start_year_pair,True,,10.71233119200042,1,True
|
||||
wide-087,same_start_year_pair,True,,6.4720146839972585,1,True
|
||||
wide-088,same_start_year_pair,True,,10.198497953009792,1,True
|
||||
wide-089,same_start_year_pair,True,,6.79203049800708,1,True
|
||||
wide-090,same_start_year_pair,True,,10.413568222007598,1,True
|
||||
wide-091,same_start_year_pair,True,,7.510395374993095,1,True
|
||||
wide-092,same_start_year_pair,True,,10.110175805006293,1,True
|
||||
wide-093,same_start_year_pair,True,,7.382416222986649,1,True
|
||||
wide-094,same_start_year_pair,True,,9.637755793010001,1,True
|
||||
wide-095,same_start_year_pair,True,,7.721356611000374,1,True
|
||||
wide-096,same_start_year_pair,True,,9.783646965996013,1,True
|
||||
wide-097,same_start_year_pair,True,,8.19954388300539,1,True
|
||||
wide-098,same_start_year_pair,True,,9.142149596998934,1,True
|
||||
wide-099,same_start_year_pair,True,,7.995075654995162,1,True
|
||||
wide-100,same_start_year_pair,True,,9.23304197700054,1,True
|
||||
wide-101,same_start_year_pair,True,,8.445941337995464,1,True
|
||||
wide-102,same_start_year_pair,True,,9.29434829299862,1,True
|
||||
wide-103,same_start_year_pair,True,,8.262059757005773,1,True
|
||||
wide-104,same_start_year_pair,True,,8.660338338988367,1,True
|
||||
wide-105,same_start_year_pair,True,,8.136423168994952,1,True
|
||||
wide-106,same_start_year_pair,True,,8.826232392006204,1,True
|
||||
wide-107,same_start_year_pair,True,,8.023831066006096,1,True
|
||||
wide-108,same_start_year_pair,True,,9.481848634008202,1,True
|
||||
wide-109,same_start_year_pair,True,,7.782530160999158,1,True
|
||||
wide-110,same_start_year_pair,True,,10.06139503599843,1,True
|
||||
wide-111,same_start_year_pair,True,,7.194188486013445,1,True
|
||||
wide-112,same_start_year_pair,True,,9.618882115988526,1,True
|
||||
wide-113,person_title_year,True,,6.316762108996045,1,True
|
||||
wide-114,person_title_year,True,,8.973571240989259,1,True
|
||||
wide-115,person_title_year,True,,5.77858125900093,1,True
|
||||
wide-116,person_title_year,True,,8.171107051006402,1,True
|
||||
wide-117,person_title_year,True,,5.923224907994154,1,True
|
||||
wide-118,person_title_year,True,,8.248448436992476,1,True
|
||||
wide-119,person_title_year,True,,6.6704190939926775,1,True
|
||||
wide-120,person_title_year,True,,7.390637057993445,1,True
|
||||
wide-121,person_title_year,True,,6.828236892994028,1,True
|
||||
wide-122,person_title_year,True,,7.436154732989962,1,True
|
||||
wide-123,person_title_year,True,,7.201046439004131,1,True
|
||||
wide-124,person_title_year,True,,7.452169609998236,1,True
|
||||
wide-125,person_title_year,True,,7.024459202992148,1,True
|
||||
wide-126,person_title_year,True,,7.134706636992632,1,True
|
||||
wide-127,person_title_year,True,,6.701897156002815,1,True
|
||||
wide-128,person_title_year,True,,7.7986834320036,1,True
|
||||
wide-129,person_title_year,False,,7.78502085400396,1,False
|
||||
wide-130,person_title_year,True,,7.579418053996051,1,True
|
||||
wide-131,person_title_year,True,,7.29737891399418,1,True
|
||||
wide-132,person_title_year,True,,6.5710127700003795,1,True
|
||||
wide-133,person_title_year,True,,7.670121143004508,1,True
|
||||
wide-134,person_title_year,True,,6.268109227006789,1,True
|
||||
wide-135,person_title_year,True,,7.80891695599712,1,True
|
||||
wide-136,person_title_year,True,,6.535969970005681,1,True
|
||||
wide-137,person_keyword_title,True,,8.499110547010787,1,True
|
||||
wide-138,person_keyword_title,True,,7.348516454003402,1,True
|
||||
wide-139,person_keyword_title,True,,8.490620700002182,1,True
|
||||
wide-140,person_keyword_title,True,,7.142724603007082,1,True
|
||||
wide-141,person_keyword_title,True,,7.750912368996069,1,True
|
||||
wide-142,person_keyword_title,False,,9.134571484988555,1,False
|
||||
wide-143,person_keyword_title,True,,9.924621155005298,1,True
|
||||
wide-144,person_keyword_title,True,,9.80673293399741,1,True
|
||||
wide-145,person_keyword_title,False,,9.125109145010356,1,False
|
||||
wide-146,person_keyword_title,True,,7.816306863998761,1,True
|
||||
wide-147,person_keyword_title,True,,9.222393247997388,1,True
|
||||
wide-148,person_keyword_title,True,,6.4315986309957225,1,True
|
||||
wide-149,person_keyword_title,True,,8.975530234994949,1,True
|
||||
wide-150,person_keyword_title,True,,6.5634262770036,1,True
|
||||
wide-151,person_keyword_title,True,,8.981235069994,1,True
|
||||
wide-152,person_keyword_title,True,,6.80172690100153,1,True
|
||||
wide-153,person_keyword_title,True,,8.104526370007079,1,True
|
||||
wide-154,person_keyword_title,True,,7.002095560004818,1,True
|
||||
wide-155,person_keyword_title,True,,8.536377580996486,1,True
|
||||
wide-156,person_keyword_title,True,,7.33249492100731,1,True
|
||||
wide-157,person_keyword_title,True,,8.53190982498927,1,True
|
||||
wide-158,person_keyword_title,True,,6.987181315998896,1,True
|
||||
wide-159,person_keyword_title,True,,9.206439533008961,1,True
|
||||
wide-160,person_keyword_title,True,,7.2076548890036065,1,True
|
||||
wide-161,person_keyword_title,True,,9.755865868995897,1,True
|
||||
wide-162,person_keyword_title,True,,6.598434728002758,1,True
|
||||
wide-163,person_keyword_title,True,,9.665300851003849,1,True
|
||||
wide-164,person_keyword_title,True,,6.409714323002845,1,True
|
||||
wide-165,person_keyword_title,True,,9.189696266010287,1,True
|
||||
wide-166,person_keyword_title,True,,6.362806601988268,1,True
|
||||
wide-167,person_keyword_title,True,,9.12334693899902,1,True
|
||||
wide-168,person_keyword_title,True,,6.939789495998411,1,True
|
||||
wide-169,document_author_category_multi_hop,True,,8.274773390003247,1,True
|
||||
wide-170,document_author_category_multi_hop,True,,5.761120869006845,1,True
|
||||
wide-171,document_author_category_multi_hop,True,,7.484641218994511,1,True
|
||||
wide-172,document_author_category_multi_hop,True,,5.7914811780065065,1,True
|
||||
wide-173,document_author_category_multi_hop,True,,7.744038484990597,1,True
|
||||
wide-174,document_author_category_multi_hop,True,,5.857030038998346,1,True
|
||||
wide-175,document_author_category_multi_hop,True,,8.176481470989529,1,True
|
||||
wide-176,document_author_category_multi_hop,True,,7.8557383849984035,1,True
|
||||
wide-177,document_author_category_multi_hop,True,,7.886023836006643,1,True
|
||||
wide-178,document_author_category_multi_hop,True,,7.453686430002563,1,True
|
||||
wide-179,document_author_category_multi_hop,True,,5.2365985850046854,1,True
|
||||
wide-180,document_author_category_multi_hop,True,,7.151028209991637,1,True
|
||||
wide-181,document_author_category_multi_hop,True,,5.116186750004999,1,True
|
||||
wide-182,document_author_category_multi_hop,True,,7.575539704004768,1,True
|
||||
wide-183,document_author_category_multi_hop,True,,5.5021829689940205,1,True
|
||||
wide-184,document_author_category_multi_hop,True,,7.557064304011874,1,True
|
||||
wide-185,document_author_category_multi_hop,True,,5.2788128620013595,1,True
|
||||
wide-186,document_author_category_multi_hop,True,,7.775028784992173,1,True
|
||||
wide-187,document_author_category_multi_hop,True,,5.468235724998522,1,True
|
||||
wide-188,document_author_category_multi_hop,True,,7.458582812003442,1,True
|
||||
wide-189,document_author_category_multi_hop,True,,5.423984528999426,1,True
|
||||
wide-190,document_author_category_multi_hop,True,,6.802945887990063,1,True
|
||||
wide-191,document_author_category_multi_hop,True,,5.720807204997982,1,True
|
||||
wide-192,document_author_category_multi_hop,True,,6.970476242990117,1,True
|
||||
wide-193,person_multiple_categories,True,,5.315446266002255,1,True
|
||||
wide-194,person_multiple_categories,True,,6.611033188004512,1,True
|
||||
wide-195,person_multiple_categories,True,,4.514709312992636,1,True
|
||||
wide-196,person_multiple_categories,True,,6.597614583995892,1,True
|
||||
wide-197,person_multiple_categories,True,,4.054451817995869,1,True
|
||||
wide-198,person_multiple_categories,True,,6.207983192012762,1,True
|
||||
wide-199,person_multiple_categories,True,,4.590510104011628,1,True
|
||||
wide-200,person_multiple_categories,True,,6.553350798989413,1,True
|
||||
wide-201,person_multiple_categories,True,,4.605876973000704,1,True
|
||||
wide-202,person_multiple_categories,True,,5.585335472002043,1,True
|
||||
wide-203,person_multiple_categories,True,,4.492845022992697,1,True
|
||||
wide-204,person_multiple_categories,True,,6.641766903994721,1,True
|
||||
wide-205,person_multiple_categories,True,,5.62207466000109,1,True
|
||||
wide-206,person_multiple_categories,True,,6.369739195986767,1,True
|
||||
wide-207,person_multiple_categories,True,,4.450628942999174,1,True
|
||||
wide-208,person_multiple_categories,True,,5.57498624100117,1,True
|
||||
wide-209,person_multiple_categories,True,,5.34890157400514,1,True
|
||||
wide-210,person_multiple_categories,True,,6.2012351820012555,1,True
|
||||
wide-211,person_multiple_categories,True,,5.767825509014074,1,True
|
||||
wide-212,person_multiple_categories,True,,5.083963163997396,1,True
|
||||
wide-213,person_multiple_categories,True,,5.3684891809971305,1,True
|
||||
wide-214,person_multiple_categories,True,,4.774883028992917,1,True
|
||||
wide-215,person_multiple_categories,True,,5.859735618010745,1,True
|
||||
wide-216,person_multiple_categories,True,,5.045369378000032,1,True
|
||||
wide-217,candidate_set_aggregation,True,,8.18277867299912,1,True
|
||||
wide-218,candidate_set_aggregation,True,,7.061751248998917,1,True
|
||||
wide-219,candidate_set_aggregation,True,,9.888737866000156,1,True
|
||||
wide-220,candidate_set_aggregation,True,,6.534448446996976,1,True
|
||||
wide-221,candidate_set_aggregation,True,,10.02607991900004,1,True
|
||||
wide-222,candidate_set_aggregation,True,,6.639642160007497,1,True
|
||||
wide-223,candidate_set_aggregation,True,,10.05624425499991,1,True
|
||||
wide-224,candidate_set_aggregation,True,,6.380346581994672,1,True
|
||||
wide-225,candidate_set_aggregation,True,,9.750748607999412,1,True
|
||||
wide-226,candidate_set_aggregation,True,,6.927533381007379,1,True
|
||||
wide-227,candidate_set_aggregation,True,,9.749435025994899,1,True
|
||||
wide-228,candidate_set_aggregation,True,,7.000018507009372,1,True
|
||||
wide-229,candidate_set_aggregation,True,,9.393544332007878,1,True
|
||||
wide-230,candidate_set_aggregation,True,,7.075158320993069,1,True
|
||||
wide-231,candidate_set_aggregation,True,,9.68925523001235,1,True
|
||||
wide-232,candidate_set_aggregation,True,,7.470996176998597,1,True
|
||||
wide-233,candidate_set_aggregation,True,,9.546211912995204,1,True
|
||||
wide-234,candidate_set_aggregation,True,,7.121646208994207,1,True
|
||||
wide-235,candidate_set_aggregation,True,,9.106454324006336,1,True
|
||||
wide-236,candidate_set_aggregation,True,,7.33974453000701,1,True
|
||||
wide-237,candidate_set_aggregation,True,,9.92777099799423,1,True
|
||||
wide-238,candidate_set_aggregation,True,,7.6532076459989185,1,True
|
||||
wide-239,candidate_set_aggregation,True,,9.878883134995704,1,True
|
||||
wide-240,candidate_set_aggregation,True,,6.794067700000596,1,True
|
||||
wide-241,candidate_set_aggregation,True,,9.484167262999108,1,True
|
||||
wide-242,candidate_set_aggregation,True,,6.586464612002601,1,True
|
||||
wide-243,candidate_set_aggregation,True,,9.679727968003135,1,True
|
||||
wide-244,candidate_set_aggregation,True,,6.853099594998639,1,True
|
||||
wide-245,candidate_set_aggregation,True,,9.588607818004675,1,True
|
||||
wide-246,candidate_set_aggregation,True,,6.615246096000192,1,True
|
||||
wide-247,candidate_set_aggregation,True,,9.338731531999656,1,True
|
||||
wide-248,candidate_set_aggregation,True,,6.656504976010183,1,True
|
||||
wide-249,conjunctive_disambiguation,True,,8.06964380700083,1,True
|
||||
wide-250,conjunctive_disambiguation,True,,5.727493058991968,1,True
|
||||
wide-251,conjunctive_disambiguation,True,,7.403562118997797,1,True
|
||||
wide-252,conjunctive_disambiguation,True,,6.389556170004653,1,True
|
||||
wide-253,conjunctive_disambiguation,True,,7.190451546994154,1,True
|
||||
wide-254,conjunctive_disambiguation,True,,5.571824425001978,1,True
|
||||
wide-255,conjunctive_disambiguation,True,,6.363713938990259,1,True
|
||||
wide-256,conjunctive_disambiguation,True,,5.9705328209965955,1,True
|
||||
wide-257,conjunctive_disambiguation,True,,6.814727099001175,1,True
|
||||
wide-258,conjunctive_disambiguation,True,,6.060012061992893,1,True
|
||||
wide-259,conjunctive_disambiguation,True,,6.477906736996374,1,True
|
||||
wide-260,conjunctive_disambiguation,True,,6.108023989989306,1,True
|
||||
wide-261,conjunctive_disambiguation,True,,6.89838379000139,1,True
|
||||
wide-262,conjunctive_disambiguation,True,,6.639250446998631,1,True
|
||||
wide-263,conjunctive_disambiguation,True,,7.647332847991493,1,True
|
||||
wide-264,conjunctive_disambiguation,True,,6.806039610994048,1,True
|
||||
wide-265,conjunctive_disambiguation,True,,7.480212347989436,1,True
|
||||
wide-266,conjunctive_disambiguation,True,,5.939997524998034,1,True
|
||||
wide-267,conjunctive_disambiguation,True,,7.483691226007068,1,True
|
||||
wide-268,conjunctive_disambiguation,True,,5.128309691994218,1,True
|
||||
wide-269,conjunctive_disambiguation,True,,7.950514240990742,1,True
|
||||
wide-270,conjunctive_disambiguation,True,,3.838128978997702,1,True
|
||||
wide-271,conjunctive_disambiguation,True,,7.203258510999149,1,True
|
||||
wide-272,conjunctive_disambiguation,True,,5.274275976000354,1,True
|
||||
wide-273,conjunctive_disambiguation,True,,7.145530178997433,1,True
|
||||
wide-274,conjunctive_disambiguation,True,,5.765552001001197,1,True
|
||||
wide-275,conjunctive_disambiguation,True,,7.404864780008211,1,True
|
||||
wide-276,conjunctive_disambiguation,True,,6.352571280993288,1,True
|
||||
wide-277,conjunctive_disambiguation,True,,7.504300720000174,1,True
|
||||
wide-278,conjunctive_disambiguation,True,,6.016011193001759,1,True
|
||||
wide-279,conjunctive_disambiguation,True,,7.295396494999295,1,True
|
||||
wide-280,conjunctive_disambiguation,True,,5.834808207000606,1,True
|
||||
wide-281,conjunctive_disambiguation,True,,7.8035292659915285,1,True
|
||||
wide-282,conjunctive_disambiguation,True,,6.399204970992287,1,True
|
||||
wide-283,conjunctive_disambiguation,True,,9.671940870990511,1,True
|
||||
wide-284,conjunctive_disambiguation,True,,5.51546201200108,1,True
|
||||
wide-285,conjunctive_disambiguation,True,,10.154824249999365,1,True
|
||||
wide-286,conjunctive_disambiguation,True,,4.581112927000504,1,True
|
||||
wide-287,conjunctive_disambiguation,True,,9.536005122994538,1,True
|
||||
wide-288,conjunctive_disambiguation,True,,5.152376526006265,1,True
|
||||
wide-289,negative_lookup,True,,5.77029365299677,1,True
|
||||
wide-290,negative_lookup,True,,4.0657596189994365,1,True
|
||||
wide-291,negative_lookup,True,,5.455527030004305,1,True
|
||||
wide-292,negative_lookup,True,,3.0121111600019503,1,True
|
||||
wide-293,negative_lookup,True,,2.800542648998089,1,True
|
||||
wide-294,negative_lookup,True,,2.3347310710087186,1,True
|
||||
wide-295,negative_lookup,True,,3.137155468997662,1,True
|
||||
wide-296,negative_lookup,True,,4.624817319010617,1,True
|
||||
wide-297,negative_lookup,True,,2.6547789269970963,1,True
|
||||
wide-298,negative_lookup,True,,3.314983567004674,1,True
|
||||
wide-299,negative_lookup,True,,4.695426902995678,1,True
|
||||
wide-300,negative_lookup,True,,4.431371640996076,1,True
|
||||
wide-301,negative_lookup,True,,6.186935618010466,1,True
|
||||
wide-302,negative_lookup,True,,2.142409003005014,1,True
|
||||
wide-303,negative_lookup,True,,3.43618969200179,1,True
|
||||
wide-304,negative_lookup,True,,5.18562207800278,1,True
|
||||
wide-305,negative_lookup,True,,4.38843695500691,1,True
|
||||
wide-306,negative_lookup,True,,5.134904260004987,1,True
|
||||
wide-307,negative_lookup,True,,2.6632863889972214,1,True
|
||||
wide-308,negative_lookup,True,,3.1229624890111154,1,True
|
||||
wide-309,negative_lookup,True,,4.524710755009437,1,True
|
||||
wide-310,negative_lookup,True,,3.0614984529966023,1,True
|
||||
wide-311,negative_lookup,True,,3.266464348009322,1,True
|
||||
wide-312,negative_lookup,True,,2.7247217559925048,1,True
|
||||
wide-313,negative_lookup,True,,4.237170866996166,1,True
|
||||
wide-314,negative_lookup,True,,2.5491485459933756,1,True
|
||||
wide-315,negative_lookup,True,,3.5208440470014466,1,True
|
||||
wide-316,negative_lookup,True,,4.705917885992676,1,True
|
||||
wide-317,negative_lookup,True,,4.300244467012817,1,True
|
||||
wide-318,negative_lookup,True,,4.2143690299999435,1,True
|
||||
wide-319,negative_lookup,True,,4.686885363000329,1,True
|
||||
wide-320,negative_lookup,True,,3.806223741004942,1,True
|
||||
|
File diff suppressed because it is too large
Load Diff
@ -0,0 +1,411 @@
|
||||
[
|
||||
{
|
||||
"id": "wide-129",
|
||||
"category": "person_title_year",
|
||||
"question": "Uveď názov diplomového projektu osoby Maroš Harahus a rok práce pre rok 2020.",
|
||||
"graph_context": {
|
||||
"status": "ok",
|
||||
"reason": null,
|
||||
"facts": [
|
||||
{
|
||||
"person": "Maroš Harahus",
|
||||
"title": "Doplnenie podpory morfologického značkovania slovenského jazyka do nlp frameworku (spacy alebo flair)",
|
||||
"year": 2020,
|
||||
"document_path": "pages/students/2016/maros_harahus/README.md",
|
||||
"source_url": "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"
|
||||
}
|
||||
],
|
||||
"sources": [
|
||||
{
|
||||
"document_path": "pages/students/2016/maros_harahus/README.md",
|
||||
"source_url": "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"
|
||||
}
|
||||
],
|
||||
"aggregation": null
|
||||
},
|
||||
"strict": false,
|
||||
"attempts": [
|
||||
{
|
||||
"response": {
|
||||
"choices": [
|
||||
{
|
||||
"finish_reason": "stop",
|
||||
"index": 0,
|
||||
"message": {
|
||||
"role": "assistant",
|
||||
"content": "{\n\"answer\": \"Maroš Harahus v roku 2020 vypracoval diplomový projekt s názvom Doplnenie podpory morfologického značkovania slovenského jazyka do nlp frameworku (spacy alebo flair). Zdroj: https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus\",\n\"status\": \"ok\",\n\"claims\": [\n{\n\"person\": \"Maroš Harahus\",\n\"title\": \"Doplnenie podpory morfologického značkovania slovenského jazyka do nlp frameworku (spacy alebo flair)\",\n\"year\": 2020,\n\"keyword\": \"diplomový projekt\"\n}\n],\n\"source_urls\": [\n\"https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus\"\n],\n\"count\": 1\n}"
|
||||
}
|
||||
}
|
||||
],
|
||||
"created": 1792945390,
|
||||
"model": "Qwen3.5-122B-A10B-Q4_K_M",
|
||||
"system_fingerprint": "b8580-7c203670f",
|
||||
"object": "chat.completion",
|
||||
"usage": {
|
||||
"completion_tokens": 207,
|
||||
"prompt_tokens": 1060,
|
||||
"total_tokens": 1267,
|
||||
"prompt_tokens_details": {
|
||||
"cached_tokens": 741
|
||||
}
|
||||
},
|
||||
"id": "chatcmpl-g1NApedgMI4Zy7dBR2SrY5S62SKWblvZ",
|
||||
"timings": {
|
||||
"cache_n": 741,
|
||||
"prompt_n": 319,
|
||||
"prompt_ms": 526.979,
|
||||
"prompt_per_token_ms": 1.651971786833856,
|
||||
"prompt_per_second": 605.3372145759129,
|
||||
"predicted_n": 207,
|
||||
"predicted_ms": 4996.334,
|
||||
"predicted_per_token_ms": 24.13687922705314,
|
||||
"predicted_per_second": 41.430376752234736
|
||||
}
|
||||
},
|
||||
"format_normalized": false,
|
||||
"strict": false
|
||||
}
|
||||
],
|
||||
"response": {
|
||||
"choices": [
|
||||
{
|
||||
"finish_reason": "stop",
|
||||
"index": 0,
|
||||
"message": {
|
||||
"role": "assistant",
|
||||
"content": "{\n\"answer\": \"Maroš Harahus v roku 2020 vypracoval diplomový projekt s názvom Doplnenie podpory morfologického značkovania slovenského jazyka do nlp frameworku (spacy alebo flair). Zdroj: https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus\",\n\"status\": \"ok\",\n\"claims\": [\n{\n\"person\": \"Maroš Harahus\",\n\"title\": \"Doplnenie podpory morfologického značkovania slovenského jazyka do nlp frameworku (spacy alebo flair)\",\n\"year\": 2020,\n\"keyword\": \"diplomový projekt\"\n}\n],\n\"source_urls\": [\n\"https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus\"\n],\n\"count\": 1\n}"
|
||||
}
|
||||
}
|
||||
],
|
||||
"created": 1792945390,
|
||||
"model": "Qwen3.5-122B-A10B-Q4_K_M",
|
||||
"system_fingerprint": "b8580-7c203670f",
|
||||
"object": "chat.completion",
|
||||
"usage": {
|
||||
"completion_tokens": 207,
|
||||
"prompt_tokens": 1060,
|
||||
"total_tokens": 1267,
|
||||
"prompt_tokens_details": {
|
||||
"cached_tokens": 741
|
||||
}
|
||||
},
|
||||
"id": "chatcmpl-g1NApedgMI4Zy7dBR2SrY5S62SKWblvZ",
|
||||
"timings": {
|
||||
"cache_n": 741,
|
||||
"prompt_n": 319,
|
||||
"prompt_ms": 526.979,
|
||||
"prompt_per_token_ms": 1.651971786833856,
|
||||
"prompt_per_second": 605.3372145759129,
|
||||
"predicted_n": 207,
|
||||
"predicted_ms": 4996.334,
|
||||
"predicted_per_token_ms": 24.13687922705314,
|
||||
"predicted_per_second": 41.430376752234736
|
||||
}
|
||||
},
|
||||
"answer": {
|
||||
"answer": "Maroš Harahus v roku 2020 vypracoval diplomový projekt s názvom Doplnenie podpory morfologického značkovania slovenského jazyka do nlp frameworku (spacy alebo flair). Zdroj: https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus",
|
||||
"status": "ok",
|
||||
"claims": [
|
||||
{
|
||||
"person": "Maroš Harahus",
|
||||
"title": "Doplnenie podpory morfologického značkovania slovenského jazyka do nlp frameworku (spacy alebo flair)",
|
||||
"year": 2020,
|
||||
"keyword": "diplomový projekt"
|
||||
}
|
||||
],
|
||||
"source_urls": [
|
||||
"https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"
|
||||
],
|
||||
"count": 1
|
||||
},
|
||||
"bindings_ok": true,
|
||||
"unsupported_claims": [
|
||||
{
|
||||
"person": "Maroš Harahus",
|
||||
"title": "Doplnenie podpory morfologického značkovania slovenského jazyka do nlp frameworku (spacy alebo flair)",
|
||||
"year": 2020,
|
||||
"keyword": "diplomový projekt"
|
||||
}
|
||||
],
|
||||
"sources_ok": true,
|
||||
"status_ok": true,
|
||||
"count_ok": true,
|
||||
"set_ok": true,
|
||||
"text_values_ok": true,
|
||||
"missing_text_values": [],
|
||||
"contradictory_thesis_label": false,
|
||||
"latency_seconds": 7.78502085400396
|
||||
},
|
||||
{
|
||||
"id": "wide-142",
|
||||
"category": "person_keyword_title",
|
||||
"question": "Uveď názov práce osoby Dárius Lindvai v roku 2019 s kľúčovým slovom lstm.",
|
||||
"graph_context": {
|
||||
"status": "ok",
|
||||
"reason": null,
|
||||
"facts": [
|
||||
{
|
||||
"person": "Dárius Lindvai",
|
||||
"title": "rešerš",
|
||||
"year": 2019,
|
||||
"document_path": "pages/students/2016/darius_lindvai/README.md",
|
||||
"source_url": "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"
|
||||
},
|
||||
{
|
||||
"person": "Dárius Lindvai",
|
||||
"keyword": "lstm",
|
||||
"document_path": "pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md",
|
||||
"source_url": "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"
|
||||
}
|
||||
],
|
||||
"sources": [
|
||||
{
|
||||
"document_path": "pages/students/2016/darius_lindvai/README.md",
|
||||
"source_url": "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"
|
||||
},
|
||||
{
|
||||
"document_path": "pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md",
|
||||
"source_url": "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"
|
||||
}
|
||||
],
|
||||
"aggregation": null
|
||||
},
|
||||
"strict": false,
|
||||
"attempts": [
|
||||
{
|
||||
"response": {
|
||||
"choices": [
|
||||
{
|
||||
"finish_reason": "stop",
|
||||
"index": 0,
|
||||
"message": {
|
||||
"role": "assistant",
|
||||
"content": "{\"answer\": \"V roku 2019 má Dárius Lindvai prácu s názvom \\\"rešerš\\\", ale v dodaných grafových faktoch nie je pre túto prácu (dokument pages/students/2016/darius_lindvai/README.md) uvedený kľúčové slovo \\\"lstm\\\". Kľúčové slovo \\\"lstm\\\" je priradené k inému dokumentu (pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md), pre ktorý nie je v roku 2019 uvedený názov práce. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai, https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial\", \"status\": \"no_answer\", \"claims\": [], \"source_urls\": [\"https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai\", \"https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial\"], \"count\": 0}"
|
||||
}
|
||||
}
|
||||
],
|
||||
"created": 1792945424,
|
||||
"model": "Qwen3.5-122B-A10B-Q4_K_M",
|
||||
"system_fingerprint": "b8580-7c203670f",
|
||||
"object": "chat.completion",
|
||||
"usage": {
|
||||
"completion_tokens": 271,
|
||||
"prompt_tokens": 1179,
|
||||
"total_tokens": 1450,
|
||||
"prompt_tokens_details": {
|
||||
"cached_tokens": 757
|
||||
}
|
||||
},
|
||||
"id": "chatcmpl-GN6RM6r1ZLYbSY2fIyiP4vJ01UYBpkFB",
|
||||
"timings": {
|
||||
"cache_n": 757,
|
||||
"prompt_n": 422,
|
||||
"prompt_ms": 564.135,
|
||||
"prompt_per_token_ms": 1.3368127962085308,
|
||||
"prompt_per_second": 748.0478963368697,
|
||||
"predicted_n": 271,
|
||||
"predicted_ms": 6580.341,
|
||||
"predicted_per_token_ms": 24.28170110701107,
|
||||
"predicted_per_second": 41.18327606426475
|
||||
}
|
||||
},
|
||||
"format_normalized": false,
|
||||
"strict": false
|
||||
}
|
||||
],
|
||||
"response": {
|
||||
"choices": [
|
||||
{
|
||||
"finish_reason": "stop",
|
||||
"index": 0,
|
||||
"message": {
|
||||
"role": "assistant",
|
||||
"content": "{\"answer\": \"V roku 2019 má Dárius Lindvai prácu s názvom \\\"rešerš\\\", ale v dodaných grafových faktoch nie je pre túto prácu (dokument pages/students/2016/darius_lindvai/README.md) uvedený kľúčové slovo \\\"lstm\\\". Kľúčové slovo \\\"lstm\\\" je priradené k inému dokumentu (pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md), pre ktorý nie je v roku 2019 uvedený názov práce. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai, https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial\", \"status\": \"no_answer\", \"claims\": [], \"source_urls\": [\"https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai\", \"https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial\"], \"count\": 0}"
|
||||
}
|
||||
}
|
||||
],
|
||||
"created": 1792945424,
|
||||
"model": "Qwen3.5-122B-A10B-Q4_K_M",
|
||||
"system_fingerprint": "b8580-7c203670f",
|
||||
"object": "chat.completion",
|
||||
"usage": {
|
||||
"completion_tokens": 271,
|
||||
"prompt_tokens": 1179,
|
||||
"total_tokens": 1450,
|
||||
"prompt_tokens_details": {
|
||||
"cached_tokens": 757
|
||||
}
|
||||
},
|
||||
"id": "chatcmpl-GN6RM6r1ZLYbSY2fIyiP4vJ01UYBpkFB",
|
||||
"timings": {
|
||||
"cache_n": 757,
|
||||
"prompt_n": 422,
|
||||
"prompt_ms": 564.135,
|
||||
"prompt_per_token_ms": 1.3368127962085308,
|
||||
"prompt_per_second": 748.0478963368697,
|
||||
"predicted_n": 271,
|
||||
"predicted_ms": 6580.341,
|
||||
"predicted_per_token_ms": 24.28170110701107,
|
||||
"predicted_per_second": 41.18327606426475
|
||||
}
|
||||
},
|
||||
"answer": {
|
||||
"answer": "V roku 2019 má Dárius Lindvai prácu s názvom \"rešerš\", ale v dodaných grafových faktoch nie je pre túto prácu (dokument pages/students/2016/darius_lindvai/README.md) uvedený kľúčové slovo \"lstm\". Kľúčové slovo \"lstm\" je priradené k inému dokumentu (pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md), pre ktorý nie je v roku 2019 uvedený názov práce. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai, https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial",
|
||||
"status": "no_answer",
|
||||
"claims": [],
|
||||
"source_urls": [
|
||||
"https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai",
|
||||
"https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"
|
||||
],
|
||||
"count": 0
|
||||
},
|
||||
"bindings_ok": false,
|
||||
"unsupported_claims": [],
|
||||
"sources_ok": true,
|
||||
"status_ok": false,
|
||||
"count_ok": true,
|
||||
"set_ok": true,
|
||||
"text_values_ok": true,
|
||||
"missing_text_values": [],
|
||||
"contradictory_thesis_label": false,
|
||||
"latency_seconds": 9.134571484988555
|
||||
},
|
||||
{
|
||||
"id": "wide-145",
|
||||
"category": "person_keyword_title",
|
||||
"question": "Uveď názov práce osoby Dárius Lindvai v roku 2019 s kľúčovým slovom python.",
|
||||
"graph_context": {
|
||||
"status": "ok",
|
||||
"reason": null,
|
||||
"facts": [
|
||||
{
|
||||
"person": "Dárius Lindvai",
|
||||
"title": "rešerš",
|
||||
"year": 2019,
|
||||
"document_path": "pages/students/2016/darius_lindvai/README.md",
|
||||
"source_url": "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"
|
||||
},
|
||||
{
|
||||
"person": "Dárius Lindvai",
|
||||
"keyword": "python",
|
||||
"document_path": "pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md",
|
||||
"source_url": "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"
|
||||
}
|
||||
],
|
||||
"sources": [
|
||||
{
|
||||
"document_path": "pages/students/2016/darius_lindvai/README.md",
|
||||
"source_url": "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"
|
||||
},
|
||||
{
|
||||
"document_path": "pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md",
|
||||
"source_url": "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"
|
||||
},
|
||||
{
|
||||
"document_path": "pages/topics/python/README.md",
|
||||
"source_url": "https://zp.kemt.fei.tuke.sk/topics/python"
|
||||
}
|
||||
],
|
||||
"aggregation": null
|
||||
},
|
||||
"strict": false,
|
||||
"attempts": [
|
||||
{
|
||||
"response": {
|
||||
"choices": [
|
||||
{
|
||||
"finish_reason": "stop",
|
||||
"index": 0,
|
||||
"message": {
|
||||
"role": "assistant",
|
||||
"content": "{\n\"answer\": \"Nenašli sa žiadne fakty o práci Dárius Lindvai z roku 2019 s kľúčovým slovom python. Zdrojové údaje uvádzajú pre Dárius Lindvai v roku 2019 prácu s názvom \\\"rešerš\\\" (https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai), ale kľúčové slovo \\\"python\\\" je spojené s iným dokumentom bez uvedeného roku a názvu práce (https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial).\",\n\"status\": \"no_answer\",\n\"claims\": [],\n\"source_urls\": [\n\"https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai\",\n\"https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial\"\n],\n\"count\": 0\n}"
|
||||
}
|
||||
}
|
||||
],
|
||||
"created": 1792945433,
|
||||
"model": "Qwen3.5-122B-A10B-Q4_K_M",
|
||||
"system_fingerprint": "b8580-7c203670f",
|
||||
"object": "chat.completion",
|
||||
"usage": {
|
||||
"completion_tokens": 235,
|
||||
"prompt_tokens": 1208,
|
||||
"total_tokens": 1443,
|
||||
"prompt_tokens_details": {
|
||||
"cached_tokens": 741
|
||||
}
|
||||
},
|
||||
"id": "chatcmpl-wedgIgmgk8EORiFxPHOLuxXJnrOP8YqX",
|
||||
"timings": {
|
||||
"cache_n": 741,
|
||||
"prompt_n": 467,
|
||||
"prompt_ms": 621.672,
|
||||
"prompt_per_token_ms": 1.331203426124197,
|
||||
"prompt_per_second": 751.1999897051821,
|
||||
"predicted_n": 235,
|
||||
"predicted_ms": 5720.465,
|
||||
"predicted_per_token_ms": 24.34240425531915,
|
||||
"predicted_per_second": 41.080576491596396
|
||||
}
|
||||
},
|
||||
"format_normalized": false,
|
||||
"strict": false
|
||||
}
|
||||
],
|
||||
"response": {
|
||||
"choices": [
|
||||
{
|
||||
"finish_reason": "stop",
|
||||
"index": 0,
|
||||
"message": {
|
||||
"role": "assistant",
|
||||
"content": "{\n\"answer\": \"Nenašli sa žiadne fakty o práci Dárius Lindvai z roku 2019 s kľúčovým slovom python. Zdrojové údaje uvádzajú pre Dárius Lindvai v roku 2019 prácu s názvom \\\"rešerš\\\" (https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai), ale kľúčové slovo \\\"python\\\" je spojené s iným dokumentom bez uvedeného roku a názvu práce (https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial).\",\n\"status\": \"no_answer\",\n\"claims\": [],\n\"source_urls\": [\n\"https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai\",\n\"https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial\"\n],\n\"count\": 0\n}"
|
||||
}
|
||||
}
|
||||
],
|
||||
"created": 1792945433,
|
||||
"model": "Qwen3.5-122B-A10B-Q4_K_M",
|
||||
"system_fingerprint": "b8580-7c203670f",
|
||||
"object": "chat.completion",
|
||||
"usage": {
|
||||
"completion_tokens": 235,
|
||||
"prompt_tokens": 1208,
|
||||
"total_tokens": 1443,
|
||||
"prompt_tokens_details": {
|
||||
"cached_tokens": 741
|
||||
}
|
||||
},
|
||||
"id": "chatcmpl-wedgIgmgk8EORiFxPHOLuxXJnrOP8YqX",
|
||||
"timings": {
|
||||
"cache_n": 741,
|
||||
"prompt_n": 467,
|
||||
"prompt_ms": 621.672,
|
||||
"prompt_per_token_ms": 1.331203426124197,
|
||||
"prompt_per_second": 751.1999897051821,
|
||||
"predicted_n": 235,
|
||||
"predicted_ms": 5720.465,
|
||||
"predicted_per_token_ms": 24.34240425531915,
|
||||
"predicted_per_second": 41.080576491596396
|
||||
}
|
||||
},
|
||||
"answer": {
|
||||
"answer": "Nenašli sa žiadne fakty o práci Dárius Lindvai z roku 2019 s kľúčovým slovom python. Zdrojové údaje uvádzajú pre Dárius Lindvai v roku 2019 prácu s názvom \"rešerš\" (https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai), ale kľúčové slovo \"python\" je spojené s iným dokumentom bez uvedeného roku a názvu práce (https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial).",
|
||||
"status": "no_answer",
|
||||
"claims": [],
|
||||
"source_urls": [
|
||||
"https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai",
|
||||
"https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"
|
||||
],
|
||||
"count": 0
|
||||
},
|
||||
"bindings_ok": false,
|
||||
"unsupported_claims": [],
|
||||
"sources_ok": true,
|
||||
"status_ok": false,
|
||||
"count_ok": true,
|
||||
"set_ok": true,
|
||||
"text_values_ok": true,
|
||||
"missing_text_values": [],
|
||||
"contradictory_thesis_label": false,
|
||||
"latency_seconds": 9.125109145010356
|
||||
}
|
||||
]
|
||||
@ -0,0 +1,706 @@
|
||||
{
|
||||
"method": "Previously exposed LLM questions; regression, not independent TEST.",
|
||||
"graph_freeze_sha256": "ca1d2d71f60a8e65b82d727ad14556aabf2e03f2acdce1755c3e2a7a9a3149d3",
|
||||
"audit_sha256": "81708ca63f8772673cd836fe7a1a1938fbe0e713588efcb07ed3fd4280f27829",
|
||||
"generation_files": {
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/evaluate_graph_answers.py": "3b58e210fcd934a5488575e1b0ebb46a2e94ce72ee12f1e1a666c726c66d68af",
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/graph_answer_prompt.txt": "64d2bd817657f390c306ea01bf2dad41f70cd6993e06b2e3b2f4713bae0d249c",
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/answer_format.py": "86a27b4aebc6a5077e13794b81957a1cf063a1f3e070c583120ba53c1788d2f8",
|
||||
"tools/rag/evaluation/rag_runner.py": "a011b29e2b6aa47df9350e74fc358f05780a355170a819dbb1cfd16d2971493b"
|
||||
},
|
||||
"model": "model120-fast",
|
||||
"temperature": 0,
|
||||
"workers": 3,
|
||||
"dev_ids": [
|
||||
"wide-001",
|
||||
"wide-002",
|
||||
"wide-041",
|
||||
"wide-042",
|
||||
"wide-080",
|
||||
"wide-081",
|
||||
"wide-082",
|
||||
"wide-104",
|
||||
"wide-113",
|
||||
"wide-114",
|
||||
"wide-119",
|
||||
"wide-137",
|
||||
"wide-138",
|
||||
"wide-139",
|
||||
"wide-141",
|
||||
"wide-142",
|
||||
"wide-143",
|
||||
"wide-145",
|
||||
"wide-155",
|
||||
"wide-159",
|
||||
"wide-161",
|
||||
"wide-163",
|
||||
"wide-169",
|
||||
"wide-170",
|
||||
"wide-178",
|
||||
"wide-181",
|
||||
"wide-193",
|
||||
"wide-194",
|
||||
"wide-209",
|
||||
"wide-217",
|
||||
"wide-218",
|
||||
"wide-232",
|
||||
"wide-236",
|
||||
"wide-239",
|
||||
"wide-249",
|
||||
"wide-250",
|
||||
"wide-283",
|
||||
"wide-289",
|
||||
"wide-290"
|
||||
],
|
||||
"test_ids": [
|
||||
"wide-003",
|
||||
"wide-004",
|
||||
"wide-005",
|
||||
"wide-006",
|
||||
"wide-007",
|
||||
"wide-008",
|
||||
"wide-009",
|
||||
"wide-010",
|
||||
"wide-011",
|
||||
"wide-012",
|
||||
"wide-013",
|
||||
"wide-014",
|
||||
"wide-015",
|
||||
"wide-016",
|
||||
"wide-017",
|
||||
"wide-018",
|
||||
"wide-019",
|
||||
"wide-020",
|
||||
"wide-021",
|
||||
"wide-022",
|
||||
"wide-023",
|
||||
"wide-024",
|
||||
"wide-025",
|
||||
"wide-026",
|
||||
"wide-027",
|
||||
"wide-028",
|
||||
"wide-029",
|
||||
"wide-030",
|
||||
"wide-031",
|
||||
"wide-032",
|
||||
"wide-033",
|
||||
"wide-034",
|
||||
"wide-035",
|
||||
"wide-036",
|
||||
"wide-037",
|
||||
"wide-038",
|
||||
"wide-039",
|
||||
"wide-040",
|
||||
"wide-043",
|
||||
"wide-044",
|
||||
"wide-045",
|
||||
"wide-046",
|
||||
"wide-047",
|
||||
"wide-048",
|
||||
"wide-049",
|
||||
"wide-050",
|
||||
"wide-051",
|
||||
"wide-052",
|
||||
"wide-053",
|
||||
"wide-054",
|
||||
"wide-055",
|
||||
"wide-056",
|
||||
"wide-057",
|
||||
"wide-058",
|
||||
"wide-059",
|
||||
"wide-060",
|
||||
"wide-061",
|
||||
"wide-062",
|
||||
"wide-063",
|
||||
"wide-064",
|
||||
"wide-065",
|
||||
"wide-066",
|
||||
"wide-067",
|
||||
"wide-068",
|
||||
"wide-069",
|
||||
"wide-070",
|
||||
"wide-071",
|
||||
"wide-072",
|
||||
"wide-073",
|
||||
"wide-074",
|
||||
"wide-075",
|
||||
"wide-076",
|
||||
"wide-077",
|
||||
"wide-078",
|
||||
"wide-079",
|
||||
"wide-080",
|
||||
"wide-083",
|
||||
"wide-084",
|
||||
"wide-085",
|
||||
"wide-086",
|
||||
"wide-087",
|
||||
"wide-088",
|
||||
"wide-089",
|
||||
"wide-090",
|
||||
"wide-091",
|
||||
"wide-092",
|
||||
"wide-093",
|
||||
"wide-094",
|
||||
"wide-095",
|
||||
"wide-096",
|
||||
"wide-097",
|
||||
"wide-098",
|
||||
"wide-099",
|
||||
"wide-100",
|
||||
"wide-101",
|
||||
"wide-102",
|
||||
"wide-103",
|
||||
"wide-104",
|
||||
"wide-105",
|
||||
"wide-106",
|
||||
"wide-107",
|
||||
"wide-108",
|
||||
"wide-109",
|
||||
"wide-110",
|
||||
"wide-111",
|
||||
"wide-112",
|
||||
"wide-115",
|
||||
"wide-116",
|
||||
"wide-117",
|
||||
"wide-118",
|
||||
"wide-119",
|
||||
"wide-120",
|
||||
"wide-121",
|
||||
"wide-122",
|
||||
"wide-123",
|
||||
"wide-124",
|
||||
"wide-125",
|
||||
"wide-126",
|
||||
"wide-127",
|
||||
"wide-128",
|
||||
"wide-129",
|
||||
"wide-130",
|
||||
"wide-131",
|
||||
"wide-132",
|
||||
"wide-133",
|
||||
"wide-134",
|
||||
"wide-135",
|
||||
"wide-136",
|
||||
"wide-139",
|
||||
"wide-140",
|
||||
"wide-141",
|
||||
"wide-142",
|
||||
"wide-143",
|
||||
"wide-144",
|
||||
"wide-145",
|
||||
"wide-146",
|
||||
"wide-147",
|
||||
"wide-148",
|
||||
"wide-149",
|
||||
"wide-150",
|
||||
"wide-151",
|
||||
"wide-152",
|
||||
"wide-153",
|
||||
"wide-154",
|
||||
"wide-155",
|
||||
"wide-156",
|
||||
"wide-157",
|
||||
"wide-158",
|
||||
"wide-159",
|
||||
"wide-160",
|
||||
"wide-161",
|
||||
"wide-162",
|
||||
"wide-163",
|
||||
"wide-164",
|
||||
"wide-165",
|
||||
"wide-166",
|
||||
"wide-167",
|
||||
"wide-168",
|
||||
"wide-171",
|
||||
"wide-172",
|
||||
"wide-173",
|
||||
"wide-174",
|
||||
"wide-175",
|
||||
"wide-176",
|
||||
"wide-177",
|
||||
"wide-178",
|
||||
"wide-179",
|
||||
"wide-180",
|
||||
"wide-181",
|
||||
"wide-182",
|
||||
"wide-183",
|
||||
"wide-184",
|
||||
"wide-185",
|
||||
"wide-186",
|
||||
"wide-187",
|
||||
"wide-188",
|
||||
"wide-189",
|
||||
"wide-190",
|
||||
"wide-191",
|
||||
"wide-192",
|
||||
"wide-195",
|
||||
"wide-196",
|
||||
"wide-197",
|
||||
"wide-198",
|
||||
"wide-199",
|
||||
"wide-200",
|
||||
"wide-201",
|
||||
"wide-202",
|
||||
"wide-203",
|
||||
"wide-204",
|
||||
"wide-205",
|
||||
"wide-206",
|
||||
"wide-207",
|
||||
"wide-208",
|
||||
"wide-209",
|
||||
"wide-210",
|
||||
"wide-211",
|
||||
"wide-212",
|
||||
"wide-213",
|
||||
"wide-214",
|
||||
"wide-215",
|
||||
"wide-216",
|
||||
"wide-219",
|
||||
"wide-220",
|
||||
"wide-221",
|
||||
"wide-222",
|
||||
"wide-223",
|
||||
"wide-224",
|
||||
"wide-225",
|
||||
"wide-226",
|
||||
"wide-227",
|
||||
"wide-228",
|
||||
"wide-229",
|
||||
"wide-230",
|
||||
"wide-231",
|
||||
"wide-232",
|
||||
"wide-233",
|
||||
"wide-234",
|
||||
"wide-235",
|
||||
"wide-236",
|
||||
"wide-237",
|
||||
"wide-238",
|
||||
"wide-239",
|
||||
"wide-240",
|
||||
"wide-241",
|
||||
"wide-242",
|
||||
"wide-243",
|
||||
"wide-244",
|
||||
"wide-245",
|
||||
"wide-246",
|
||||
"wide-247",
|
||||
"wide-248",
|
||||
"wide-251",
|
||||
"wide-252",
|
||||
"wide-253",
|
||||
"wide-254",
|
||||
"wide-255",
|
||||
"wide-256",
|
||||
"wide-257",
|
||||
"wide-258",
|
||||
"wide-259",
|
||||
"wide-260",
|
||||
"wide-261",
|
||||
"wide-262",
|
||||
"wide-263",
|
||||
"wide-264",
|
||||
"wide-265",
|
||||
"wide-266",
|
||||
"wide-267",
|
||||
"wide-268",
|
||||
"wide-269",
|
||||
"wide-270",
|
||||
"wide-271",
|
||||
"wide-272",
|
||||
"wide-273",
|
||||
"wide-274",
|
||||
"wide-275",
|
||||
"wide-276",
|
||||
"wide-277",
|
||||
"wide-278",
|
||||
"wide-279",
|
||||
"wide-280",
|
||||
"wide-281",
|
||||
"wide-282",
|
||||
"wide-283",
|
||||
"wide-284",
|
||||
"wide-285",
|
||||
"wide-286",
|
||||
"wide-287",
|
||||
"wide-288",
|
||||
"wide-291",
|
||||
"wide-292",
|
||||
"wide-293",
|
||||
"wide-294",
|
||||
"wide-295",
|
||||
"wide-296",
|
||||
"wide-297",
|
||||
"wide-298",
|
||||
"wide-299",
|
||||
"wide-300",
|
||||
"wide-301",
|
||||
"wide-302",
|
||||
"wide-303",
|
||||
"wide-304",
|
||||
"wide-305",
|
||||
"wide-306",
|
||||
"wide-307",
|
||||
"wide-308",
|
||||
"wide-309",
|
||||
"wide-310",
|
||||
"wide-311",
|
||||
"wide-312",
|
||||
"wide-313",
|
||||
"wide-314",
|
||||
"wide-315",
|
||||
"wide-316",
|
||||
"wide-317",
|
||||
"wide-318",
|
||||
"wide-319",
|
||||
"wide-320"
|
||||
],
|
||||
"dev_count": 39,
|
||||
"test_count": 300,
|
||||
"target_accuracy": 0.92,
|
||||
"selected_split": "regression",
|
||||
"selected_ids": [
|
||||
"wide-001",
|
||||
"wide-002",
|
||||
"wide-003",
|
||||
"wide-004",
|
||||
"wide-005",
|
||||
"wide-006",
|
||||
"wide-007",
|
||||
"wide-008",
|
||||
"wide-009",
|
||||
"wide-010",
|
||||
"wide-011",
|
||||
"wide-012",
|
||||
"wide-013",
|
||||
"wide-014",
|
||||
"wide-015",
|
||||
"wide-016",
|
||||
"wide-017",
|
||||
"wide-018",
|
||||
"wide-019",
|
||||
"wide-020",
|
||||
"wide-021",
|
||||
"wide-022",
|
||||
"wide-023",
|
||||
"wide-024",
|
||||
"wide-025",
|
||||
"wide-026",
|
||||
"wide-027",
|
||||
"wide-028",
|
||||
"wide-029",
|
||||
"wide-030",
|
||||
"wide-031",
|
||||
"wide-032",
|
||||
"wide-033",
|
||||
"wide-034",
|
||||
"wide-035",
|
||||
"wide-036",
|
||||
"wide-037",
|
||||
"wide-038",
|
||||
"wide-039",
|
||||
"wide-040",
|
||||
"wide-041",
|
||||
"wide-042",
|
||||
"wide-043",
|
||||
"wide-044",
|
||||
"wide-045",
|
||||
"wide-046",
|
||||
"wide-047",
|
||||
"wide-048",
|
||||
"wide-049",
|
||||
"wide-050",
|
||||
"wide-051",
|
||||
"wide-052",
|
||||
"wide-053",
|
||||
"wide-054",
|
||||
"wide-055",
|
||||
"wide-056",
|
||||
"wide-057",
|
||||
"wide-058",
|
||||
"wide-059",
|
||||
"wide-060",
|
||||
"wide-061",
|
||||
"wide-062",
|
||||
"wide-063",
|
||||
"wide-064",
|
||||
"wide-065",
|
||||
"wide-066",
|
||||
"wide-067",
|
||||
"wide-068",
|
||||
"wide-069",
|
||||
"wide-070",
|
||||
"wide-071",
|
||||
"wide-072",
|
||||
"wide-073",
|
||||
"wide-074",
|
||||
"wide-075",
|
||||
"wide-076",
|
||||
"wide-077",
|
||||
"wide-078",
|
||||
"wide-079",
|
||||
"wide-080",
|
||||
"wide-081",
|
||||
"wide-082",
|
||||
"wide-083",
|
||||
"wide-084",
|
||||
"wide-085",
|
||||
"wide-086",
|
||||
"wide-087",
|
||||
"wide-088",
|
||||
"wide-089",
|
||||
"wide-090",
|
||||
"wide-091",
|
||||
"wide-092",
|
||||
"wide-093",
|
||||
"wide-094",
|
||||
"wide-095",
|
||||
"wide-096",
|
||||
"wide-097",
|
||||
"wide-098",
|
||||
"wide-099",
|
||||
"wide-100",
|
||||
"wide-101",
|
||||
"wide-102",
|
||||
"wide-103",
|
||||
"wide-104",
|
||||
"wide-105",
|
||||
"wide-106",
|
||||
"wide-107",
|
||||
"wide-108",
|
||||
"wide-109",
|
||||
"wide-110",
|
||||
"wide-111",
|
||||
"wide-112",
|
||||
"wide-113",
|
||||
"wide-114",
|
||||
"wide-115",
|
||||
"wide-116",
|
||||
"wide-117",
|
||||
"wide-118",
|
||||
"wide-119",
|
||||
"wide-120",
|
||||
"wide-121",
|
||||
"wide-122",
|
||||
"wide-123",
|
||||
"wide-124",
|
||||
"wide-125",
|
||||
"wide-126",
|
||||
"wide-127",
|
||||
"wide-128",
|
||||
"wide-129",
|
||||
"wide-130",
|
||||
"wide-131",
|
||||
"wide-132",
|
||||
"wide-133",
|
||||
"wide-134",
|
||||
"wide-135",
|
||||
"wide-136",
|
||||
"wide-137",
|
||||
"wide-138",
|
||||
"wide-139",
|
||||
"wide-140",
|
||||
"wide-141",
|
||||
"wide-142",
|
||||
"wide-143",
|
||||
"wide-144",
|
||||
"wide-145",
|
||||
"wide-146",
|
||||
"wide-147",
|
||||
"wide-148",
|
||||
"wide-149",
|
||||
"wide-150",
|
||||
"wide-151",
|
||||
"wide-152",
|
||||
"wide-153",
|
||||
"wide-154",
|
||||
"wide-155",
|
||||
"wide-156",
|
||||
"wide-157",
|
||||
"wide-158",
|
||||
"wide-159",
|
||||
"wide-160",
|
||||
"wide-161",
|
||||
"wide-162",
|
||||
"wide-163",
|
||||
"wide-164",
|
||||
"wide-165",
|
||||
"wide-166",
|
||||
"wide-167",
|
||||
"wide-168",
|
||||
"wide-169",
|
||||
"wide-170",
|
||||
"wide-171",
|
||||
"wide-172",
|
||||
"wide-173",
|
||||
"wide-174",
|
||||
"wide-175",
|
||||
"wide-176",
|
||||
"wide-177",
|
||||
"wide-178",
|
||||
"wide-179",
|
||||
"wide-180",
|
||||
"wide-181",
|
||||
"wide-182",
|
||||
"wide-183",
|
||||
"wide-184",
|
||||
"wide-185",
|
||||
"wide-186",
|
||||
"wide-187",
|
||||
"wide-188",
|
||||
"wide-189",
|
||||
"wide-190",
|
||||
"wide-191",
|
||||
"wide-192",
|
||||
"wide-193",
|
||||
"wide-194",
|
||||
"wide-195",
|
||||
"wide-196",
|
||||
"wide-197",
|
||||
"wide-198",
|
||||
"wide-199",
|
||||
"wide-200",
|
||||
"wide-201",
|
||||
"wide-202",
|
||||
"wide-203",
|
||||
"wide-204",
|
||||
"wide-205",
|
||||
"wide-206",
|
||||
"wide-207",
|
||||
"wide-208",
|
||||
"wide-209",
|
||||
"wide-210",
|
||||
"wide-211",
|
||||
"wide-212",
|
||||
"wide-213",
|
||||
"wide-214",
|
||||
"wide-215",
|
||||
"wide-216",
|
||||
"wide-217",
|
||||
"wide-218",
|
||||
"wide-219",
|
||||
"wide-220",
|
||||
"wide-221",
|
||||
"wide-222",
|
||||
"wide-223",
|
||||
"wide-224",
|
||||
"wide-225",
|
||||
"wide-226",
|
||||
"wide-227",
|
||||
"wide-228",
|
||||
"wide-229",
|
||||
"wide-230",
|
||||
"wide-231",
|
||||
"wide-232",
|
||||
"wide-233",
|
||||
"wide-234",
|
||||
"wide-235",
|
||||
"wide-236",
|
||||
"wide-237",
|
||||
"wide-238",
|
||||
"wide-239",
|
||||
"wide-240",
|
||||
"wide-241",
|
||||
"wide-242",
|
||||
"wide-243",
|
||||
"wide-244",
|
||||
"wide-245",
|
||||
"wide-246",
|
||||
"wide-247",
|
||||
"wide-248",
|
||||
"wide-249",
|
||||
"wide-250",
|
||||
"wide-251",
|
||||
"wide-252",
|
||||
"wide-253",
|
||||
"wide-254",
|
||||
"wide-255",
|
||||
"wide-256",
|
||||
"wide-257",
|
||||
"wide-258",
|
||||
"wide-259",
|
||||
"wide-260",
|
||||
"wide-261",
|
||||
"wide-262",
|
||||
"wide-263",
|
||||
"wide-264",
|
||||
"wide-265",
|
||||
"wide-266",
|
||||
"wide-267",
|
||||
"wide-268",
|
||||
"wide-269",
|
||||
"wide-270",
|
||||
"wide-271",
|
||||
"wide-272",
|
||||
"wide-273",
|
||||
"wide-274",
|
||||
"wide-275",
|
||||
"wide-276",
|
||||
"wide-277",
|
||||
"wide-278",
|
||||
"wide-279",
|
||||
"wide-280",
|
||||
"wide-281",
|
||||
"wide-282",
|
||||
"wide-283",
|
||||
"wide-284",
|
||||
"wide-285",
|
||||
"wide-286",
|
||||
"wide-287",
|
||||
"wide-288",
|
||||
"wide-289",
|
||||
"wide-290",
|
||||
"wide-291",
|
||||
"wide-292",
|
||||
"wide-293",
|
||||
"wide-294",
|
||||
"wide-295",
|
||||
"wide-296",
|
||||
"wide-297",
|
||||
"wide-298",
|
||||
"wide-299",
|
||||
"wide-300",
|
||||
"wide-301",
|
||||
"wide-302",
|
||||
"wide-303",
|
||||
"wide-304",
|
||||
"wide-305",
|
||||
"wide-306",
|
||||
"wide-307",
|
||||
"wide-308",
|
||||
"wide-309",
|
||||
"wide-310",
|
||||
"wide-311",
|
||||
"wide-312",
|
||||
"wide-313",
|
||||
"wide-314",
|
||||
"wide-315",
|
||||
"wide-316",
|
||||
"wide-317",
|
||||
"wide-318",
|
||||
"wide-319",
|
||||
"wide-320"
|
||||
],
|
||||
"selected_count": 320,
|
||||
"selected_dev_overlap": 39,
|
||||
"format_repair_limit": 1,
|
||||
"repair_policy": "Only JSON/schema failures; same question/context, no gold; retain all attempts.",
|
||||
"dev_results_sha256": "cd9b206a5a89602441e5d3b47c9de2febfd8f34ef4ec32cf20f567079761e619",
|
||||
"policy": "Evaluate every declared regression case, including DEV overlap; retain all failures and stop tuning after this freeze.",
|
||||
"selected_categories": {
|
||||
"shared_keyword_pair": 40,
|
||||
"same_academic_year_pair": 40,
|
||||
"same_start_year_pair": 32,
|
||||
"person_title_year": 24,
|
||||
"person_keyword_title": 32,
|
||||
"document_author_category_multi_hop": 24,
|
||||
"person_multiple_categories": 24,
|
||||
"candidate_set_aggregation": 32,
|
||||
"conjunctive_disambiguation": 40,
|
||||
"negative_lookup": 32
|
||||
},
|
||||
"limitations": [
|
||||
"Known corpus/profiles and templates; model outputs for these 300 questions were not previously observed.",
|
||||
"Harness supplies graph context; native OpenWebUI tool choice and browser UI are outside this experiment.",
|
||||
"Checks structured factual claims, their source support/citations and required prose values; not a general semantic judge of arbitrary prose."
|
||||
]
|
||||
}
|
||||
@ -0,0 +1,40 @@
|
||||
id,category,strict,error,latency_seconds,attempts,first_pass_strict
|
||||
wide-001,shared_keyword_pair,True,,13.102745643991511,1,True
|
||||
wide-002,shared_keyword_pair,True,,8.686387695997837,1,True
|
||||
wide-041,same_academic_year_pair,True,,7.175007558995276,1,True
|
||||
wide-042,same_academic_year_pair,True,,7.3540544569987105,1,True
|
||||
wide-080,same_academic_year_pair,True,,9.493409784001415,1,True
|
||||
wide-081,same_start_year_pair,True,,7.360842023990699,1,True
|
||||
wide-082,same_start_year_pair,True,,9.634056855007657,1,True
|
||||
wide-104,same_start_year_pair,True,,7.5196549139946,1,True
|
||||
wide-113,person_title_year,True,,8.4268134659942,1,True
|
||||
wide-114,person_title_year,True,,6.6590490480011795,1,True
|
||||
wide-119,person_title_year,True,,8.043334904010408,1,True
|
||||
wide-137,person_keyword_title,True,,7.18094556601136,1,True
|
||||
wide-138,person_keyword_title,True,,8.415209711994976,1,True
|
||||
wide-139,person_keyword_title,True,,7.5367714180029,1,True
|
||||
wide-141,person_keyword_title,True,,8.302764993000892,1,True
|
||||
wide-142,person_keyword_title,True,,9.15925429300114,1,True
|
||||
wide-143,person_keyword_title,True,,11.15336542800651,1,True
|
||||
wide-145,person_keyword_title,False,,10.935504723005579,1,False
|
||||
wide-155,person_keyword_title,True,,9.731682198005728,1,True
|
||||
wide-159,person_keyword_title,True,,8.722476019000169,1,True
|
||||
wide-161,person_keyword_title,True,,8.795275380005478,1,True
|
||||
wide-163,person_keyword_title,True,,8.375112182999146,1,True
|
||||
wide-169,document_author_category_multi_hop,True,,7.371920378995128,1,True
|
||||
wide-170,document_author_category_multi_hop,True,,6.7976903180097,1,True
|
||||
wide-178,document_author_category_multi_hop,True,,6.5963496360054705,1,True
|
||||
wide-181,document_author_category_multi_hop,True,,6.7874484959902475,1,True
|
||||
wide-193,person_multiple_categories,True,,5.843567528994754,1,True
|
||||
wide-194,person_multiple_categories,True,,5.834254229994258,1,True
|
||||
wide-209,person_multiple_categories,True,,6.06473808499868,1,True
|
||||
wide-217,candidate_set_aggregation,True,,8.168832301991642,1,True
|
||||
wide-218,candidate_set_aggregation,True,,8.408147340000141,1,True
|
||||
wide-232,candidate_set_aggregation,True,,9.107497649005381,1,True
|
||||
wide-236,candidate_set_aggregation,True,,8.041833495008177,1,True
|
||||
wide-239,candidate_set_aggregation,True,,8.753410860008444,1,True
|
||||
wide-249,conjunctive_disambiguation,True,,6.555928866990143,1,True
|
||||
wide-250,conjunctive_disambiguation,True,,7.249271184002282,1,True
|
||||
wide-283,conjunctive_disambiguation,True,,6.916102559000137,1,True
|
||||
wide-289,negative_lookup,True,,4.995769290995668,1,True
|
||||
wide-290,negative_lookup,True,,4.3209586270095315,1,True
|
||||
|
File diff suppressed because it is too large
Load Diff
@ -0,0 +1,425 @@
|
||||
{
|
||||
"method": "Previously exposed LLM questions; regression, not independent TEST.",
|
||||
"graph_freeze_sha256": "0dc97fdba37557d76392538eb122e2eafd5f58480fee7de347e1f5ca251823d4",
|
||||
"audit_sha256": "091e2ee00a88e9e6a459e91fb54efabd23eec5eb4dd70570aa313c3e51e93410",
|
||||
"generation_files": {
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/evaluate_graph_answers.py": "3b58e210fcd934a5488575e1b0ebb46a2e94ce72ee12f1e1a666c726c66d68af",
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/graph_answer_prompt.txt": "801dcd48be8014b65667ced52810b75b43f9b7c525fdbfcbd08fd8f668673016",
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/answer_format.py": "86a27b4aebc6a5077e13794b81957a1cf063a1f3e070c583120ba53c1788d2f8",
|
||||
"tools/rag/evaluation/rag_runner.py": "a011b29e2b6aa47df9350e74fc358f05780a355170a819dbb1cfd16d2971493b"
|
||||
},
|
||||
"model": "model120-fast",
|
||||
"temperature": 0,
|
||||
"workers": 3,
|
||||
"dev_ids": [
|
||||
"wide-001",
|
||||
"wide-002",
|
||||
"wide-041",
|
||||
"wide-042",
|
||||
"wide-080",
|
||||
"wide-081",
|
||||
"wide-082",
|
||||
"wide-104",
|
||||
"wide-113",
|
||||
"wide-114",
|
||||
"wide-119",
|
||||
"wide-137",
|
||||
"wide-138",
|
||||
"wide-139",
|
||||
"wide-141",
|
||||
"wide-142",
|
||||
"wide-143",
|
||||
"wide-145",
|
||||
"wide-155",
|
||||
"wide-159",
|
||||
"wide-161",
|
||||
"wide-163",
|
||||
"wide-169",
|
||||
"wide-170",
|
||||
"wide-178",
|
||||
"wide-181",
|
||||
"wide-193",
|
||||
"wide-194",
|
||||
"wide-209",
|
||||
"wide-217",
|
||||
"wide-218",
|
||||
"wide-232",
|
||||
"wide-236",
|
||||
"wide-239",
|
||||
"wide-249",
|
||||
"wide-250",
|
||||
"wide-283",
|
||||
"wide-289",
|
||||
"wide-290"
|
||||
],
|
||||
"test_ids": [
|
||||
"wide-003",
|
||||
"wide-004",
|
||||
"wide-005",
|
||||
"wide-006",
|
||||
"wide-007",
|
||||
"wide-008",
|
||||
"wide-009",
|
||||
"wide-010",
|
||||
"wide-011",
|
||||
"wide-012",
|
||||
"wide-013",
|
||||
"wide-014",
|
||||
"wide-015",
|
||||
"wide-016",
|
||||
"wide-017",
|
||||
"wide-018",
|
||||
"wide-019",
|
||||
"wide-020",
|
||||
"wide-021",
|
||||
"wide-022",
|
||||
"wide-023",
|
||||
"wide-024",
|
||||
"wide-025",
|
||||
"wide-026",
|
||||
"wide-027",
|
||||
"wide-028",
|
||||
"wide-029",
|
||||
"wide-030",
|
||||
"wide-031",
|
||||
"wide-032",
|
||||
"wide-033",
|
||||
"wide-034",
|
||||
"wide-035",
|
||||
"wide-036",
|
||||
"wide-037",
|
||||
"wide-038",
|
||||
"wide-039",
|
||||
"wide-040",
|
||||
"wide-043",
|
||||
"wide-044",
|
||||
"wide-045",
|
||||
"wide-046",
|
||||
"wide-047",
|
||||
"wide-048",
|
||||
"wide-049",
|
||||
"wide-050",
|
||||
"wide-051",
|
||||
"wide-052",
|
||||
"wide-053",
|
||||
"wide-054",
|
||||
"wide-055",
|
||||
"wide-056",
|
||||
"wide-057",
|
||||
"wide-058",
|
||||
"wide-059",
|
||||
"wide-060",
|
||||
"wide-061",
|
||||
"wide-062",
|
||||
"wide-063",
|
||||
"wide-064",
|
||||
"wide-065",
|
||||
"wide-066",
|
||||
"wide-067",
|
||||
"wide-068",
|
||||
"wide-069",
|
||||
"wide-070",
|
||||
"wide-071",
|
||||
"wide-072",
|
||||
"wide-073",
|
||||
"wide-074",
|
||||
"wide-075",
|
||||
"wide-076",
|
||||
"wide-077",
|
||||
"wide-078",
|
||||
"wide-079",
|
||||
"wide-080",
|
||||
"wide-083",
|
||||
"wide-084",
|
||||
"wide-085",
|
||||
"wide-086",
|
||||
"wide-087",
|
||||
"wide-088",
|
||||
"wide-089",
|
||||
"wide-090",
|
||||
"wide-091",
|
||||
"wide-092",
|
||||
"wide-093",
|
||||
"wide-094",
|
||||
"wide-095",
|
||||
"wide-096",
|
||||
"wide-097",
|
||||
"wide-098",
|
||||
"wide-099",
|
||||
"wide-100",
|
||||
"wide-101",
|
||||
"wide-102",
|
||||
"wide-103",
|
||||
"wide-104",
|
||||
"wide-105",
|
||||
"wide-106",
|
||||
"wide-107",
|
||||
"wide-108",
|
||||
"wide-109",
|
||||
"wide-110",
|
||||
"wide-111",
|
||||
"wide-112",
|
||||
"wide-115",
|
||||
"wide-116",
|
||||
"wide-117",
|
||||
"wide-118",
|
||||
"wide-119",
|
||||
"wide-120",
|
||||
"wide-121",
|
||||
"wide-122",
|
||||
"wide-123",
|
||||
"wide-124",
|
||||
"wide-125",
|
||||
"wide-126",
|
||||
"wide-127",
|
||||
"wide-128",
|
||||
"wide-129",
|
||||
"wide-130",
|
||||
"wide-131",
|
||||
"wide-132",
|
||||
"wide-133",
|
||||
"wide-134",
|
||||
"wide-135",
|
||||
"wide-136",
|
||||
"wide-139",
|
||||
"wide-140",
|
||||
"wide-141",
|
||||
"wide-142",
|
||||
"wide-143",
|
||||
"wide-144",
|
||||
"wide-145",
|
||||
"wide-146",
|
||||
"wide-147",
|
||||
"wide-148",
|
||||
"wide-149",
|
||||
"wide-150",
|
||||
"wide-151",
|
||||
"wide-152",
|
||||
"wide-153",
|
||||
"wide-154",
|
||||
"wide-155",
|
||||
"wide-156",
|
||||
"wide-157",
|
||||
"wide-158",
|
||||
"wide-159",
|
||||
"wide-160",
|
||||
"wide-161",
|
||||
"wide-162",
|
||||
"wide-163",
|
||||
"wide-164",
|
||||
"wide-165",
|
||||
"wide-166",
|
||||
"wide-167",
|
||||
"wide-168",
|
||||
"wide-171",
|
||||
"wide-172",
|
||||
"wide-173",
|
||||
"wide-174",
|
||||
"wide-175",
|
||||
"wide-176",
|
||||
"wide-177",
|
||||
"wide-178",
|
||||
"wide-179",
|
||||
"wide-180",
|
||||
"wide-181",
|
||||
"wide-182",
|
||||
"wide-183",
|
||||
"wide-184",
|
||||
"wide-185",
|
||||
"wide-186",
|
||||
"wide-187",
|
||||
"wide-188",
|
||||
"wide-189",
|
||||
"wide-190",
|
||||
"wide-191",
|
||||
"wide-192",
|
||||
"wide-195",
|
||||
"wide-196",
|
||||
"wide-197",
|
||||
"wide-198",
|
||||
"wide-199",
|
||||
"wide-200",
|
||||
"wide-201",
|
||||
"wide-202",
|
||||
"wide-203",
|
||||
"wide-204",
|
||||
"wide-205",
|
||||
"wide-206",
|
||||
"wide-207",
|
||||
"wide-208",
|
||||
"wide-209",
|
||||
"wide-210",
|
||||
"wide-211",
|
||||
"wide-212",
|
||||
"wide-213",
|
||||
"wide-214",
|
||||
"wide-215",
|
||||
"wide-216",
|
||||
"wide-219",
|
||||
"wide-220",
|
||||
"wide-221",
|
||||
"wide-222",
|
||||
"wide-223",
|
||||
"wide-224",
|
||||
"wide-225",
|
||||
"wide-226",
|
||||
"wide-227",
|
||||
"wide-228",
|
||||
"wide-229",
|
||||
"wide-230",
|
||||
"wide-231",
|
||||
"wide-232",
|
||||
"wide-233",
|
||||
"wide-234",
|
||||
"wide-235",
|
||||
"wide-236",
|
||||
"wide-237",
|
||||
"wide-238",
|
||||
"wide-239",
|
||||
"wide-240",
|
||||
"wide-241",
|
||||
"wide-242",
|
||||
"wide-243",
|
||||
"wide-244",
|
||||
"wide-245",
|
||||
"wide-246",
|
||||
"wide-247",
|
||||
"wide-248",
|
||||
"wide-251",
|
||||
"wide-252",
|
||||
"wide-253",
|
||||
"wide-254",
|
||||
"wide-255",
|
||||
"wide-256",
|
||||
"wide-257",
|
||||
"wide-258",
|
||||
"wide-259",
|
||||
"wide-260",
|
||||
"wide-261",
|
||||
"wide-262",
|
||||
"wide-263",
|
||||
"wide-264",
|
||||
"wide-265",
|
||||
"wide-266",
|
||||
"wide-267",
|
||||
"wide-268",
|
||||
"wide-269",
|
||||
"wide-270",
|
||||
"wide-271",
|
||||
"wide-272",
|
||||
"wide-273",
|
||||
"wide-274",
|
||||
"wide-275",
|
||||
"wide-276",
|
||||
"wide-277",
|
||||
"wide-278",
|
||||
"wide-279",
|
||||
"wide-280",
|
||||
"wide-281",
|
||||
"wide-282",
|
||||
"wide-283",
|
||||
"wide-284",
|
||||
"wide-285",
|
||||
"wide-286",
|
||||
"wide-287",
|
||||
"wide-288",
|
||||
"wide-291",
|
||||
"wide-292",
|
||||
"wide-293",
|
||||
"wide-294",
|
||||
"wide-295",
|
||||
"wide-296",
|
||||
"wide-297",
|
||||
"wide-298",
|
||||
"wide-299",
|
||||
"wide-300",
|
||||
"wide-301",
|
||||
"wide-302",
|
||||
"wide-303",
|
||||
"wide-304",
|
||||
"wide-305",
|
||||
"wide-306",
|
||||
"wide-307",
|
||||
"wide-308",
|
||||
"wide-309",
|
||||
"wide-310",
|
||||
"wide-311",
|
||||
"wide-312",
|
||||
"wide-313",
|
||||
"wide-314",
|
||||
"wide-315",
|
||||
"wide-316",
|
||||
"wide-317",
|
||||
"wide-318",
|
||||
"wide-319",
|
||||
"wide-320"
|
||||
],
|
||||
"dev_count": 39,
|
||||
"test_count": 300,
|
||||
"target_accuracy": 0.92,
|
||||
"selected_split": "dev",
|
||||
"selected_ids": [
|
||||
"wide-001",
|
||||
"wide-002",
|
||||
"wide-041",
|
||||
"wide-042",
|
||||
"wide-080",
|
||||
"wide-081",
|
||||
"wide-082",
|
||||
"wide-104",
|
||||
"wide-113",
|
||||
"wide-114",
|
||||
"wide-119",
|
||||
"wide-137",
|
||||
"wide-138",
|
||||
"wide-139",
|
||||
"wide-141",
|
||||
"wide-142",
|
||||
"wide-143",
|
||||
"wide-145",
|
||||
"wide-155",
|
||||
"wide-159",
|
||||
"wide-161",
|
||||
"wide-163",
|
||||
"wide-169",
|
||||
"wide-170",
|
||||
"wide-178",
|
||||
"wide-181",
|
||||
"wide-193",
|
||||
"wide-194",
|
||||
"wide-209",
|
||||
"wide-217",
|
||||
"wide-218",
|
||||
"wide-232",
|
||||
"wide-236",
|
||||
"wide-239",
|
||||
"wide-249",
|
||||
"wide-250",
|
||||
"wide-283",
|
||||
"wide-289",
|
||||
"wide-290"
|
||||
],
|
||||
"selected_count": 39,
|
||||
"selected_dev_overlap": 39,
|
||||
"format_repair_limit": 1,
|
||||
"repair_policy": "Only JSON/schema failures; same question/context, no gold; retain all attempts.",
|
||||
"dev_results_sha256": null,
|
||||
"policy": "Evaluate every declared regression case, including DEV overlap; retain all failures and stop tuning after this freeze.",
|
||||
"selected_categories": {
|
||||
"shared_keyword_pair": 2,
|
||||
"same_academic_year_pair": 3,
|
||||
"same_start_year_pair": 3,
|
||||
"person_title_year": 3,
|
||||
"person_keyword_title": 11,
|
||||
"document_author_category_multi_hop": 4,
|
||||
"person_multiple_categories": 3,
|
||||
"candidate_set_aggregation": 5,
|
||||
"conjunctive_disambiguation": 3,
|
||||
"negative_lookup": 2
|
||||
},
|
||||
"limitations": [
|
||||
"Known corpus/profiles and templates; model outputs for these 300 questions were not previously observed.",
|
||||
"Harness supplies graph context; native OpenWebUI tool choice and browser UI are outside this experiment.",
|
||||
"Checks structured factual claims, their source support/citations and required prose values; not a general semantic judge of arbitrary prose."
|
||||
]
|
||||
}
|
||||
@ -0,0 +1,43 @@
|
||||
id,category,strict,error,latency_seconds,attempts,first_pass_strict
|
||||
wide-001,shared_keyword_pair,True,,14.98031888899277,1,True
|
||||
wide-002,shared_keyword_pair,True,,8.397393244013074,1,True
|
||||
wide-041,same_academic_year_pair,True,,6.902643829002045,1,True
|
||||
wide-042,same_academic_year_pair,True,,6.882375492001302,1,True
|
||||
wide-080,same_academic_year_pair,True,,12.271757686001365,1,True
|
||||
wide-081,same_start_year_pair,True,,8.204727490010555,1,True
|
||||
wide-082,same_start_year_pair,True,,13.702611551998416,1,True
|
||||
wide-104,same_start_year_pair,True,,6.501820275996579,1,True
|
||||
wide-113,person_title_year,True,,10.964796315005515,1,True
|
||||
wide-114,person_title_year,True,,7.376625097997021,1,True
|
||||
wide-116,person_title_year,True,,7.847194762012805,1,True
|
||||
wide-119,person_title_year,True,,7.342980269997497,1,True
|
||||
wide-129,person_title_year,True,,8.418876146010007,1,True
|
||||
wide-137,person_keyword_title,True,,9.795194769991213,1,True
|
||||
wide-138,person_keyword_title,True,,8.844560971003375,1,True
|
||||
wide-139,person_keyword_title,True,,9.329334552996443,1,True
|
||||
wide-141,person_keyword_title,True,,9.592877750008483,1,True
|
||||
wide-142,person_keyword_title,True,,5.007802811000147,1,True
|
||||
wide-143,person_keyword_title,True,,11.664019524003379,1,True
|
||||
wide-145,person_keyword_title,True,,3.2914913540007547,1,True
|
||||
wide-155,person_keyword_title,True,,6.680825702002039,1,True
|
||||
wide-159,person_keyword_title,True,,13.560824561005575,1,True
|
||||
wide-161,person_keyword_title,True,,7.287550342996838,1,True
|
||||
wide-163,person_keyword_title,True,,12.33143888199993,1,True
|
||||
wide-165,person_keyword_title,True,,2.5120001080067595,1,True
|
||||
wide-169,document_author_category_multi_hop,True,,6.5130544929997995,1,True
|
||||
wide-170,document_author_category_multi_hop,True,,8.98161977599375,1,True
|
||||
wide-178,document_author_category_multi_hop,True,,6.077633890003199,1,True
|
||||
wide-181,document_author_category_multi_hop,True,,8.441153998006484,1,True
|
||||
wide-193,person_multiple_categories,True,,5.523557033011457,1,True
|
||||
wide-194,person_multiple_categories,True,,8.1642089090019,1,True
|
||||
wide-209,person_multiple_categories,True,,6.1462335319956765,1,True
|
||||
wide-217,candidate_set_aggregation,True,,10.333294509997359,1,True
|
||||
wide-218,candidate_set_aggregation,True,,8.658889918995555,1,True
|
||||
wide-232,candidate_set_aggregation,True,,14.336149934009882,1,True
|
||||
wide-236,candidate_set_aggregation,True,,7.896173950997763,1,True
|
||||
wide-239,candidate_set_aggregation,True,,13.960932583999238,1,True
|
||||
wide-249,conjunctive_disambiguation,True,,5.288597282997216,1,True
|
||||
wide-250,conjunctive_disambiguation,True,,10.146073770010844,1,True
|
||||
wide-283,conjunctive_disambiguation,False,,12.396372432995122,1,False
|
||||
wide-289,negative_lookup,True,,6.812868237000657,1,True
|
||||
wide-290,negative_lookup,True,,6.7916078380076215,1,True
|
||||
|
File diff suppressed because it is too large
Load Diff
@ -0,0 +1,434 @@
|
||||
{
|
||||
"method": "Previously exposed LLM questions; regression, not independent TEST.",
|
||||
"graph_freeze_sha256": "e5c6c01277478b49e10b0ea3daee991b8a20d895b5fb435506a01d8a941535ef",
|
||||
"audit_sha256": "d5922db25b6d40cb7e5dc7df7990e93a3caee263a6e747ae910ab340da340023",
|
||||
"generation_files": {
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/evaluate_graph_answers.py": "2553a0d17e164922b02046416fdf0d5df4496dc443466d8d9a1f4be86415b318",
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/graph_answer_prompt.txt": "c7104ffb08b5b384f38d48fbdad40ccd40de61beace984d8a118cf12bd229860",
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/answer_format.py": "86a27b4aebc6a5077e13794b81957a1cf063a1f3e070c583120ba53c1788d2f8",
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/context_policy.py": "ee3c423772800d3e7368fff9b48bcd464a98a741b87a0c79158398ed22a3dc00",
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/checked_generation.py": "e82b95314b8c0ae9ba82353b98876da7b2a4dce464eb21129ad904bf58b8ef5e",
|
||||
"tools/rag/evaluation/rag_runner.py": "031abf7d5b1a026eb199aa2a579bfb8baaa01175279d0018a364bfe50b76c3c1"
|
||||
},
|
||||
"model": "model120-fast",
|
||||
"temperature": 0,
|
||||
"workers": 3,
|
||||
"dev_ids": [
|
||||
"wide-001",
|
||||
"wide-002",
|
||||
"wide-041",
|
||||
"wide-042",
|
||||
"wide-080",
|
||||
"wide-081",
|
||||
"wide-082",
|
||||
"wide-104",
|
||||
"wide-113",
|
||||
"wide-114",
|
||||
"wide-116",
|
||||
"wide-119",
|
||||
"wide-129",
|
||||
"wide-137",
|
||||
"wide-138",
|
||||
"wide-139",
|
||||
"wide-141",
|
||||
"wide-142",
|
||||
"wide-143",
|
||||
"wide-145",
|
||||
"wide-155",
|
||||
"wide-159",
|
||||
"wide-161",
|
||||
"wide-163",
|
||||
"wide-165",
|
||||
"wide-169",
|
||||
"wide-170",
|
||||
"wide-178",
|
||||
"wide-181",
|
||||
"wide-193",
|
||||
"wide-194",
|
||||
"wide-209",
|
||||
"wide-217",
|
||||
"wide-218",
|
||||
"wide-232",
|
||||
"wide-236",
|
||||
"wide-239",
|
||||
"wide-249",
|
||||
"wide-250",
|
||||
"wide-283",
|
||||
"wide-289",
|
||||
"wide-290"
|
||||
],
|
||||
"test_ids": [
|
||||
"wide-003",
|
||||
"wide-004",
|
||||
"wide-005",
|
||||
"wide-006",
|
||||
"wide-007",
|
||||
"wide-008",
|
||||
"wide-009",
|
||||
"wide-010",
|
||||
"wide-011",
|
||||
"wide-012",
|
||||
"wide-013",
|
||||
"wide-014",
|
||||
"wide-015",
|
||||
"wide-016",
|
||||
"wide-017",
|
||||
"wide-018",
|
||||
"wide-019",
|
||||
"wide-020",
|
||||
"wide-021",
|
||||
"wide-022",
|
||||
"wide-023",
|
||||
"wide-024",
|
||||
"wide-025",
|
||||
"wide-026",
|
||||
"wide-027",
|
||||
"wide-028",
|
||||
"wide-029",
|
||||
"wide-030",
|
||||
"wide-031",
|
||||
"wide-032",
|
||||
"wide-033",
|
||||
"wide-034",
|
||||
"wide-035",
|
||||
"wide-036",
|
||||
"wide-037",
|
||||
"wide-038",
|
||||
"wide-039",
|
||||
"wide-040",
|
||||
"wide-043",
|
||||
"wide-044",
|
||||
"wide-045",
|
||||
"wide-046",
|
||||
"wide-047",
|
||||
"wide-048",
|
||||
"wide-049",
|
||||
"wide-050",
|
||||
"wide-051",
|
||||
"wide-052",
|
||||
"wide-053",
|
||||
"wide-054",
|
||||
"wide-055",
|
||||
"wide-056",
|
||||
"wide-057",
|
||||
"wide-058",
|
||||
"wide-059",
|
||||
"wide-060",
|
||||
"wide-061",
|
||||
"wide-062",
|
||||
"wide-063",
|
||||
"wide-064",
|
||||
"wide-065",
|
||||
"wide-066",
|
||||
"wide-067",
|
||||
"wide-068",
|
||||
"wide-069",
|
||||
"wide-070",
|
||||
"wide-071",
|
||||
"wide-072",
|
||||
"wide-073",
|
||||
"wide-074",
|
||||
"wide-075",
|
||||
"wide-076",
|
||||
"wide-077",
|
||||
"wide-078",
|
||||
"wide-079",
|
||||
"wide-080",
|
||||
"wide-083",
|
||||
"wide-084",
|
||||
"wide-085",
|
||||
"wide-086",
|
||||
"wide-087",
|
||||
"wide-088",
|
||||
"wide-089",
|
||||
"wide-090",
|
||||
"wide-091",
|
||||
"wide-092",
|
||||
"wide-093",
|
||||
"wide-094",
|
||||
"wide-095",
|
||||
"wide-096",
|
||||
"wide-097",
|
||||
"wide-098",
|
||||
"wide-099",
|
||||
"wide-100",
|
||||
"wide-101",
|
||||
"wide-102",
|
||||
"wide-103",
|
||||
"wide-104",
|
||||
"wide-105",
|
||||
"wide-106",
|
||||
"wide-107",
|
||||
"wide-108",
|
||||
"wide-109",
|
||||
"wide-110",
|
||||
"wide-111",
|
||||
"wide-112",
|
||||
"wide-115",
|
||||
"wide-116",
|
||||
"wide-117",
|
||||
"wide-118",
|
||||
"wide-119",
|
||||
"wide-120",
|
||||
"wide-121",
|
||||
"wide-122",
|
||||
"wide-123",
|
||||
"wide-124",
|
||||
"wide-125",
|
||||
"wide-126",
|
||||
"wide-127",
|
||||
"wide-128",
|
||||
"wide-129",
|
||||
"wide-130",
|
||||
"wide-131",
|
||||
"wide-132",
|
||||
"wide-133",
|
||||
"wide-134",
|
||||
"wide-135",
|
||||
"wide-136",
|
||||
"wide-139",
|
||||
"wide-140",
|
||||
"wide-141",
|
||||
"wide-142",
|
||||
"wide-143",
|
||||
"wide-144",
|
||||
"wide-145",
|
||||
"wide-146",
|
||||
"wide-147",
|
||||
"wide-148",
|
||||
"wide-149",
|
||||
"wide-150",
|
||||
"wide-151",
|
||||
"wide-152",
|
||||
"wide-153",
|
||||
"wide-154",
|
||||
"wide-155",
|
||||
"wide-156",
|
||||
"wide-157",
|
||||
"wide-158",
|
||||
"wide-159",
|
||||
"wide-160",
|
||||
"wide-161",
|
||||
"wide-162",
|
||||
"wide-163",
|
||||
"wide-164",
|
||||
"wide-165",
|
||||
"wide-166",
|
||||
"wide-167",
|
||||
"wide-168",
|
||||
"wide-171",
|
||||
"wide-172",
|
||||
"wide-173",
|
||||
"wide-174",
|
||||
"wide-175",
|
||||
"wide-176",
|
||||
"wide-177",
|
||||
"wide-178",
|
||||
"wide-179",
|
||||
"wide-180",
|
||||
"wide-181",
|
||||
"wide-182",
|
||||
"wide-183",
|
||||
"wide-184",
|
||||
"wide-185",
|
||||
"wide-186",
|
||||
"wide-187",
|
||||
"wide-188",
|
||||
"wide-189",
|
||||
"wide-190",
|
||||
"wide-191",
|
||||
"wide-192",
|
||||
"wide-195",
|
||||
"wide-196",
|
||||
"wide-197",
|
||||
"wide-198",
|
||||
"wide-199",
|
||||
"wide-200",
|
||||
"wide-201",
|
||||
"wide-202",
|
||||
"wide-203",
|
||||
"wide-204",
|
||||
"wide-205",
|
||||
"wide-206",
|
||||
"wide-207",
|
||||
"wide-208",
|
||||
"wide-209",
|
||||
"wide-210",
|
||||
"wide-211",
|
||||
"wide-212",
|
||||
"wide-213",
|
||||
"wide-214",
|
||||
"wide-215",
|
||||
"wide-216",
|
||||
"wide-219",
|
||||
"wide-220",
|
||||
"wide-221",
|
||||
"wide-222",
|
||||
"wide-223",
|
||||
"wide-224",
|
||||
"wide-225",
|
||||
"wide-226",
|
||||
"wide-227",
|
||||
"wide-228",
|
||||
"wide-229",
|
||||
"wide-230",
|
||||
"wide-231",
|
||||
"wide-232",
|
||||
"wide-233",
|
||||
"wide-234",
|
||||
"wide-235",
|
||||
"wide-236",
|
||||
"wide-237",
|
||||
"wide-238",
|
||||
"wide-239",
|
||||
"wide-240",
|
||||
"wide-241",
|
||||
"wide-242",
|
||||
"wide-243",
|
||||
"wide-244",
|
||||
"wide-245",
|
||||
"wide-246",
|
||||
"wide-247",
|
||||
"wide-248",
|
||||
"wide-251",
|
||||
"wide-252",
|
||||
"wide-253",
|
||||
"wide-254",
|
||||
"wide-255",
|
||||
"wide-256",
|
||||
"wide-257",
|
||||
"wide-258",
|
||||
"wide-259",
|
||||
"wide-260",
|
||||
"wide-261",
|
||||
"wide-262",
|
||||
"wide-263",
|
||||
"wide-264",
|
||||
"wide-265",
|
||||
"wide-266",
|
||||
"wide-267",
|
||||
"wide-268",
|
||||
"wide-269",
|
||||
"wide-270",
|
||||
"wide-271",
|
||||
"wide-272",
|
||||
"wide-273",
|
||||
"wide-274",
|
||||
"wide-275",
|
||||
"wide-276",
|
||||
"wide-277",
|
||||
"wide-278",
|
||||
"wide-279",
|
||||
"wide-280",
|
||||
"wide-281",
|
||||
"wide-282",
|
||||
"wide-283",
|
||||
"wide-284",
|
||||
"wide-285",
|
||||
"wide-286",
|
||||
"wide-287",
|
||||
"wide-288",
|
||||
"wide-291",
|
||||
"wide-292",
|
||||
"wide-293",
|
||||
"wide-294",
|
||||
"wide-295",
|
||||
"wide-296",
|
||||
"wide-297",
|
||||
"wide-298",
|
||||
"wide-299",
|
||||
"wide-300",
|
||||
"wide-301",
|
||||
"wide-302",
|
||||
"wide-303",
|
||||
"wide-304",
|
||||
"wide-305",
|
||||
"wide-306",
|
||||
"wide-307",
|
||||
"wide-308",
|
||||
"wide-309",
|
||||
"wide-310",
|
||||
"wide-311",
|
||||
"wide-312",
|
||||
"wide-313",
|
||||
"wide-314",
|
||||
"wide-315",
|
||||
"wide-316",
|
||||
"wide-317",
|
||||
"wide-318",
|
||||
"wide-319",
|
||||
"wide-320"
|
||||
],
|
||||
"dev_count": 42,
|
||||
"test_count": 300,
|
||||
"target_accuracy": 0.92,
|
||||
"selected_split": "dev",
|
||||
"selected_ids": [
|
||||
"wide-001",
|
||||
"wide-002",
|
||||
"wide-041",
|
||||
"wide-042",
|
||||
"wide-080",
|
||||
"wide-081",
|
||||
"wide-082",
|
||||
"wide-104",
|
||||
"wide-113",
|
||||
"wide-114",
|
||||
"wide-116",
|
||||
"wide-119",
|
||||
"wide-129",
|
||||
"wide-137",
|
||||
"wide-138",
|
||||
"wide-139",
|
||||
"wide-141",
|
||||
"wide-142",
|
||||
"wide-143",
|
||||
"wide-145",
|
||||
"wide-155",
|
||||
"wide-159",
|
||||
"wide-161",
|
||||
"wide-163",
|
||||
"wide-165",
|
||||
"wide-169",
|
||||
"wide-170",
|
||||
"wide-178",
|
||||
"wide-181",
|
||||
"wide-193",
|
||||
"wide-194",
|
||||
"wide-209",
|
||||
"wide-217",
|
||||
"wide-218",
|
||||
"wide-232",
|
||||
"wide-236",
|
||||
"wide-239",
|
||||
"wide-249",
|
||||
"wide-250",
|
||||
"wide-283",
|
||||
"wide-289",
|
||||
"wide-290"
|
||||
],
|
||||
"selected_count": 42,
|
||||
"selected_dev_overlap": 42,
|
||||
"corrective_request_limit": 1,
|
||||
"format_repair_limit": 1,
|
||||
"repair_policy": "At most one total corrective request for format, citations or retrieval-context violations. Same question/context, no gold; retain all attempts.",
|
||||
"dev_results_sha256": null,
|
||||
"policy": "Evaluate every declared regression case, including DEV overlap; retain all failures and stop tuning after this freeze.",
|
||||
"selected_categories": {
|
||||
"shared_keyword_pair": 2,
|
||||
"same_academic_year_pair": 3,
|
||||
"same_start_year_pair": 3,
|
||||
"person_title_year": 5,
|
||||
"person_keyword_title": 12,
|
||||
"document_author_category_multi_hop": 4,
|
||||
"person_multiple_categories": 3,
|
||||
"candidate_set_aggregation": 5,
|
||||
"conjunctive_disambiguation": 3,
|
||||
"negative_lookup": 2
|
||||
},
|
||||
"limitations": [
|
||||
"All questions and previous model outputs are known; this is historical regression.",
|
||||
"Harness supplies graph context; native OpenWebUI tool choice and browser UI are outside this experiment.",
|
||||
"Checks structured factual claims, their source support/citations and required prose values; not a general semantic judge of arbitrary prose."
|
||||
]
|
||||
}
|
||||
@ -0,0 +1,43 @@
|
||||
id,category,strict,error,latency_seconds,attempts,first_pass_strict
|
||||
wide-001,shared_keyword_pair,True,,9.046294871004648,1,True
|
||||
wide-002,shared_keyword_pair,True,,16.67808335200243,1,True
|
||||
wide-041,same_academic_year_pair,True,,12.044013594000717,1,True
|
||||
wide-042,same_academic_year_pair,True,,16.060333867004374,1,True
|
||||
wide-080,same_academic_year_pair,True,,14.174281418003375,1,True
|
||||
wide-081,same_start_year_pair,True,,16.653584496001713,1,True
|
||||
wide-082,same_start_year_pair,True,,15.326327786999173,1,True
|
||||
wide-104,same_start_year_pair,True,,17.865080415009288,1,True
|
||||
wide-113,person_title_year,True,,14.24573272500129,1,True
|
||||
wide-114,person_title_year,True,,9.858880985004362,1,True
|
||||
wide-116,person_title_year,True,,8.85577247099718,1,True
|
||||
wide-119,person_title_year,True,,8.421206099999836,1,True
|
||||
wide-129,person_title_year,True,,8.982687898998847,1,True
|
||||
wide-137,person_keyword_title,True,,8.925621253001736,1,True
|
||||
wide-138,person_keyword_title,False,InvalidAnswerFormat: two invalid JSON/schema responses,19.134980328992242,2,False
|
||||
wide-139,person_keyword_title,True,,8.484527300999616,1,True
|
||||
wide-141,person_keyword_title,True,,9.90471307298867,1,True
|
||||
wide-142,person_keyword_title,True,,5.409087655993062,1,True
|
||||
wide-143,person_keyword_title,False,InvalidAnswerFormat: two invalid JSON/schema responses,21.20253009199223,2,False
|
||||
wide-145,person_keyword_title,True,,4.431844910999644,1,True
|
||||
wide-155,person_keyword_title,True,,9.433868713997072,1,True
|
||||
wide-159,person_keyword_title,True,,12.901580277000903,1,True
|
||||
wide-161,person_keyword_title,True,,13.279490936998627,1,True
|
||||
wide-163,person_keyword_title,True,,10.156943395006238,1,True
|
||||
wide-165,person_keyword_title,True,,6.284939156001201,1,True
|
||||
wide-169,document_author_category_multi_hop,True,,6.316422595002223,1,True
|
||||
wide-170,document_author_category_multi_hop,True,,6.294689077010844,1,True
|
||||
wide-178,document_author_category_multi_hop,True,,8.572520501009421,1,True
|
||||
wide-181,document_author_category_multi_hop,True,,6.569023182004457,1,True
|
||||
wide-193,person_multiple_categories,True,,8.477885875996435,1,True
|
||||
wide-194,person_multiple_categories,True,,5.930385426996509,1,True
|
||||
wide-209,person_multiple_categories,True,,8.633006432995899,1,True
|
||||
wide-217,candidate_set_aggregation,True,,8.902099704995635,1,True
|
||||
wide-218,candidate_set_aggregation,True,,12.242024114006199,1,True
|
||||
wide-232,candidate_set_aggregation,True,,11.786965720995795,1,True
|
||||
wide-236,candidate_set_aggregation,True,,12.099168748012744,1,True
|
||||
wide-239,candidate_set_aggregation,True,,10.9651905639912,1,True
|
||||
wide-249,conjunctive_disambiguation,True,,9.097645240995917,1,True
|
||||
wide-250,conjunctive_disambiguation,True,,8.975287802997627,1,True
|
||||
wide-283,conjunctive_disambiguation,True,,8.098080616997322,1,True
|
||||
wide-289,negative_lookup,True,,8.07642724798643,1,True
|
||||
wide-290,negative_lookup,True,,5.626124244998209,1,True
|
||||
|
File diff suppressed because it is too large
Load Diff
@ -0,0 +1,434 @@
|
||||
{
|
||||
"method": "Previously exposed LLM questions; regression, not independent TEST.",
|
||||
"graph_freeze_sha256": "54946b476fd713f551414b00cf2b843627566f6a333e3b59ce3efbbdf2328629",
|
||||
"audit_sha256": "d5922db25b6d40cb7e5dc7df7990e93a3caee263a6e747ae910ab340da340023",
|
||||
"generation_files": {
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/evaluate_graph_answers.py": "2553a0d17e164922b02046416fdf0d5df4496dc443466d8d9a1f4be86415b318",
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/graph_answer_prompt.txt": "8c8274a22bf5b44364d8fc8226a8f659b31c232f5a2aba5916d693b559e9f341",
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/answer_format.py": "86a27b4aebc6a5077e13794b81957a1cf063a1f3e070c583120ba53c1788d2f8",
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/context_policy.py": "e7b7c511e5e9cafdef04969eb4007a6a61ac4b99bcc60e9e722945a15bec1f26",
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/checked_generation.py": "7e017471e6281db62b79f270210db3ab14c7e31a4623bbfa3d9a5fd8911b1c20",
|
||||
"tools/rag/evaluation/rag_runner.py": "031abf7d5b1a026eb199aa2a579bfb8baaa01175279d0018a364bfe50b76c3c1"
|
||||
},
|
||||
"model": "model120-fast",
|
||||
"temperature": 0,
|
||||
"workers": 3,
|
||||
"dev_ids": [
|
||||
"wide-001",
|
||||
"wide-002",
|
||||
"wide-041",
|
||||
"wide-042",
|
||||
"wide-080",
|
||||
"wide-081",
|
||||
"wide-082",
|
||||
"wide-104",
|
||||
"wide-113",
|
||||
"wide-114",
|
||||
"wide-116",
|
||||
"wide-119",
|
||||
"wide-129",
|
||||
"wide-137",
|
||||
"wide-138",
|
||||
"wide-139",
|
||||
"wide-141",
|
||||
"wide-142",
|
||||
"wide-143",
|
||||
"wide-145",
|
||||
"wide-155",
|
||||
"wide-159",
|
||||
"wide-161",
|
||||
"wide-163",
|
||||
"wide-165",
|
||||
"wide-169",
|
||||
"wide-170",
|
||||
"wide-178",
|
||||
"wide-181",
|
||||
"wide-193",
|
||||
"wide-194",
|
||||
"wide-209",
|
||||
"wide-217",
|
||||
"wide-218",
|
||||
"wide-232",
|
||||
"wide-236",
|
||||
"wide-239",
|
||||
"wide-249",
|
||||
"wide-250",
|
||||
"wide-283",
|
||||
"wide-289",
|
||||
"wide-290"
|
||||
],
|
||||
"test_ids": [
|
||||
"wide-003",
|
||||
"wide-004",
|
||||
"wide-005",
|
||||
"wide-006",
|
||||
"wide-007",
|
||||
"wide-008",
|
||||
"wide-009",
|
||||
"wide-010",
|
||||
"wide-011",
|
||||
"wide-012",
|
||||
"wide-013",
|
||||
"wide-014",
|
||||
"wide-015",
|
||||
"wide-016",
|
||||
"wide-017",
|
||||
"wide-018",
|
||||
"wide-019",
|
||||
"wide-020",
|
||||
"wide-021",
|
||||
"wide-022",
|
||||
"wide-023",
|
||||
"wide-024",
|
||||
"wide-025",
|
||||
"wide-026",
|
||||
"wide-027",
|
||||
"wide-028",
|
||||
"wide-029",
|
||||
"wide-030",
|
||||
"wide-031",
|
||||
"wide-032",
|
||||
"wide-033",
|
||||
"wide-034",
|
||||
"wide-035",
|
||||
"wide-036",
|
||||
"wide-037",
|
||||
"wide-038",
|
||||
"wide-039",
|
||||
"wide-040",
|
||||
"wide-043",
|
||||
"wide-044",
|
||||
"wide-045",
|
||||
"wide-046",
|
||||
"wide-047",
|
||||
"wide-048",
|
||||
"wide-049",
|
||||
"wide-050",
|
||||
"wide-051",
|
||||
"wide-052",
|
||||
"wide-053",
|
||||
"wide-054",
|
||||
"wide-055",
|
||||
"wide-056",
|
||||
"wide-057",
|
||||
"wide-058",
|
||||
"wide-059",
|
||||
"wide-060",
|
||||
"wide-061",
|
||||
"wide-062",
|
||||
"wide-063",
|
||||
"wide-064",
|
||||
"wide-065",
|
||||
"wide-066",
|
||||
"wide-067",
|
||||
"wide-068",
|
||||
"wide-069",
|
||||
"wide-070",
|
||||
"wide-071",
|
||||
"wide-072",
|
||||
"wide-073",
|
||||
"wide-074",
|
||||
"wide-075",
|
||||
"wide-076",
|
||||
"wide-077",
|
||||
"wide-078",
|
||||
"wide-079",
|
||||
"wide-080",
|
||||
"wide-083",
|
||||
"wide-084",
|
||||
"wide-085",
|
||||
"wide-086",
|
||||
"wide-087",
|
||||
"wide-088",
|
||||
"wide-089",
|
||||
"wide-090",
|
||||
"wide-091",
|
||||
"wide-092",
|
||||
"wide-093",
|
||||
"wide-094",
|
||||
"wide-095",
|
||||
"wide-096",
|
||||
"wide-097",
|
||||
"wide-098",
|
||||
"wide-099",
|
||||
"wide-100",
|
||||
"wide-101",
|
||||
"wide-102",
|
||||
"wide-103",
|
||||
"wide-104",
|
||||
"wide-105",
|
||||
"wide-106",
|
||||
"wide-107",
|
||||
"wide-108",
|
||||
"wide-109",
|
||||
"wide-110",
|
||||
"wide-111",
|
||||
"wide-112",
|
||||
"wide-115",
|
||||
"wide-116",
|
||||
"wide-117",
|
||||
"wide-118",
|
||||
"wide-119",
|
||||
"wide-120",
|
||||
"wide-121",
|
||||
"wide-122",
|
||||
"wide-123",
|
||||
"wide-124",
|
||||
"wide-125",
|
||||
"wide-126",
|
||||
"wide-127",
|
||||
"wide-128",
|
||||
"wide-129",
|
||||
"wide-130",
|
||||
"wide-131",
|
||||
"wide-132",
|
||||
"wide-133",
|
||||
"wide-134",
|
||||
"wide-135",
|
||||
"wide-136",
|
||||
"wide-139",
|
||||
"wide-140",
|
||||
"wide-141",
|
||||
"wide-142",
|
||||
"wide-143",
|
||||
"wide-144",
|
||||
"wide-145",
|
||||
"wide-146",
|
||||
"wide-147",
|
||||
"wide-148",
|
||||
"wide-149",
|
||||
"wide-150",
|
||||
"wide-151",
|
||||
"wide-152",
|
||||
"wide-153",
|
||||
"wide-154",
|
||||
"wide-155",
|
||||
"wide-156",
|
||||
"wide-157",
|
||||
"wide-158",
|
||||
"wide-159",
|
||||
"wide-160",
|
||||
"wide-161",
|
||||
"wide-162",
|
||||
"wide-163",
|
||||
"wide-164",
|
||||
"wide-165",
|
||||
"wide-166",
|
||||
"wide-167",
|
||||
"wide-168",
|
||||
"wide-171",
|
||||
"wide-172",
|
||||
"wide-173",
|
||||
"wide-174",
|
||||
"wide-175",
|
||||
"wide-176",
|
||||
"wide-177",
|
||||
"wide-178",
|
||||
"wide-179",
|
||||
"wide-180",
|
||||
"wide-181",
|
||||
"wide-182",
|
||||
"wide-183",
|
||||
"wide-184",
|
||||
"wide-185",
|
||||
"wide-186",
|
||||
"wide-187",
|
||||
"wide-188",
|
||||
"wide-189",
|
||||
"wide-190",
|
||||
"wide-191",
|
||||
"wide-192",
|
||||
"wide-195",
|
||||
"wide-196",
|
||||
"wide-197",
|
||||
"wide-198",
|
||||
"wide-199",
|
||||
"wide-200",
|
||||
"wide-201",
|
||||
"wide-202",
|
||||
"wide-203",
|
||||
"wide-204",
|
||||
"wide-205",
|
||||
"wide-206",
|
||||
"wide-207",
|
||||
"wide-208",
|
||||
"wide-209",
|
||||
"wide-210",
|
||||
"wide-211",
|
||||
"wide-212",
|
||||
"wide-213",
|
||||
"wide-214",
|
||||
"wide-215",
|
||||
"wide-216",
|
||||
"wide-219",
|
||||
"wide-220",
|
||||
"wide-221",
|
||||
"wide-222",
|
||||
"wide-223",
|
||||
"wide-224",
|
||||
"wide-225",
|
||||
"wide-226",
|
||||
"wide-227",
|
||||
"wide-228",
|
||||
"wide-229",
|
||||
"wide-230",
|
||||
"wide-231",
|
||||
"wide-232",
|
||||
"wide-233",
|
||||
"wide-234",
|
||||
"wide-235",
|
||||
"wide-236",
|
||||
"wide-237",
|
||||
"wide-238",
|
||||
"wide-239",
|
||||
"wide-240",
|
||||
"wide-241",
|
||||
"wide-242",
|
||||
"wide-243",
|
||||
"wide-244",
|
||||
"wide-245",
|
||||
"wide-246",
|
||||
"wide-247",
|
||||
"wide-248",
|
||||
"wide-251",
|
||||
"wide-252",
|
||||
"wide-253",
|
||||
"wide-254",
|
||||
"wide-255",
|
||||
"wide-256",
|
||||
"wide-257",
|
||||
"wide-258",
|
||||
"wide-259",
|
||||
"wide-260",
|
||||
"wide-261",
|
||||
"wide-262",
|
||||
"wide-263",
|
||||
"wide-264",
|
||||
"wide-265",
|
||||
"wide-266",
|
||||
"wide-267",
|
||||
"wide-268",
|
||||
"wide-269",
|
||||
"wide-270",
|
||||
"wide-271",
|
||||
"wide-272",
|
||||
"wide-273",
|
||||
"wide-274",
|
||||
"wide-275",
|
||||
"wide-276",
|
||||
"wide-277",
|
||||
"wide-278",
|
||||
"wide-279",
|
||||
"wide-280",
|
||||
"wide-281",
|
||||
"wide-282",
|
||||
"wide-283",
|
||||
"wide-284",
|
||||
"wide-285",
|
||||
"wide-286",
|
||||
"wide-287",
|
||||
"wide-288",
|
||||
"wide-291",
|
||||
"wide-292",
|
||||
"wide-293",
|
||||
"wide-294",
|
||||
"wide-295",
|
||||
"wide-296",
|
||||
"wide-297",
|
||||
"wide-298",
|
||||
"wide-299",
|
||||
"wide-300",
|
||||
"wide-301",
|
||||
"wide-302",
|
||||
"wide-303",
|
||||
"wide-304",
|
||||
"wide-305",
|
||||
"wide-306",
|
||||
"wide-307",
|
||||
"wide-308",
|
||||
"wide-309",
|
||||
"wide-310",
|
||||
"wide-311",
|
||||
"wide-312",
|
||||
"wide-313",
|
||||
"wide-314",
|
||||
"wide-315",
|
||||
"wide-316",
|
||||
"wide-317",
|
||||
"wide-318",
|
||||
"wide-319",
|
||||
"wide-320"
|
||||
],
|
||||
"dev_count": 42,
|
||||
"test_count": 300,
|
||||
"target_accuracy": 0.92,
|
||||
"selected_split": "dev",
|
||||
"selected_ids": [
|
||||
"wide-001",
|
||||
"wide-002",
|
||||
"wide-041",
|
||||
"wide-042",
|
||||
"wide-080",
|
||||
"wide-081",
|
||||
"wide-082",
|
||||
"wide-104",
|
||||
"wide-113",
|
||||
"wide-114",
|
||||
"wide-116",
|
||||
"wide-119",
|
||||
"wide-129",
|
||||
"wide-137",
|
||||
"wide-138",
|
||||
"wide-139",
|
||||
"wide-141",
|
||||
"wide-142",
|
||||
"wide-143",
|
||||
"wide-145",
|
||||
"wide-155",
|
||||
"wide-159",
|
||||
"wide-161",
|
||||
"wide-163",
|
||||
"wide-165",
|
||||
"wide-169",
|
||||
"wide-170",
|
||||
"wide-178",
|
||||
"wide-181",
|
||||
"wide-193",
|
||||
"wide-194",
|
||||
"wide-209",
|
||||
"wide-217",
|
||||
"wide-218",
|
||||
"wide-232",
|
||||
"wide-236",
|
||||
"wide-239",
|
||||
"wide-249",
|
||||
"wide-250",
|
||||
"wide-283",
|
||||
"wide-289",
|
||||
"wide-290"
|
||||
],
|
||||
"selected_count": 42,
|
||||
"selected_dev_overlap": 42,
|
||||
"corrective_request_limit": 1,
|
||||
"format_repair_limit": 1,
|
||||
"repair_policy": "At most one total corrective request for format, citations or retrieval-context violations. Same question/context, no gold; retain all attempts.",
|
||||
"dev_results_sha256": null,
|
||||
"policy": "Evaluate every declared regression case, including DEV overlap; retain all failures and stop tuning after this freeze.",
|
||||
"selected_categories": {
|
||||
"shared_keyword_pair": 2,
|
||||
"same_academic_year_pair": 3,
|
||||
"same_start_year_pair": 3,
|
||||
"person_title_year": 5,
|
||||
"person_keyword_title": 12,
|
||||
"document_author_category_multi_hop": 4,
|
||||
"person_multiple_categories": 3,
|
||||
"candidate_set_aggregation": 5,
|
||||
"conjunctive_disambiguation": 3,
|
||||
"negative_lookup": 2
|
||||
},
|
||||
"limitations": [
|
||||
"All questions and previous model outputs are known; this is historical regression.",
|
||||
"Harness supplies graph context; native OpenWebUI tool choice and browser UI are outside this experiment.",
|
||||
"Checks structured factual claims, their source support/citations and required prose values; not a general semantic judge of arbitrary prose."
|
||||
]
|
||||
}
|
||||
Some files were not shown because too many files have changed in this diff Show More
Loading…
Reference in New Issue
Block a user