Compare commits
10 Commits
master
...
graphrag-v
| Author | SHA1 | Date | |
|---|---|---|---|
| a3e43eac9c | |||
| 4ff72bb74b | |||
| 9f3483d290 | |||
| 921642a16a | |||
| 043db73ee6 | |||
| f38ebf65f7 | |||
| 9b59994d2c | |||
| 40dc2ba38e | |||
| 4d64ad2b83 | |||
| 78e952dcfb |
@ -25,7 +25,7 @@ RUN python -m pip install --no-cache-dir \
|
|||||||
-r requirements.txt
|
-r requirements.txt
|
||||||
|
|
||||||
COPY app ./app
|
COPY app ./app
|
||||||
COPY scripts ./scripts
|
COPY tools ./tools
|
||||||
|
|
||||||
RUN mkdir -p data
|
RUN mkdir -p data
|
||||||
|
|
||||||
|
|||||||
416
README.md
416
README.md
@ -10,10 +10,12 @@ vytvorená RAG vrstva, ktorá pripravuje kontext, zdroje a pravidlá pre
|
|||||||
odpoveď jazykového modelu. API je integrované so školským OpenWebUI ako
|
odpoveď jazykového modelu. API je integrované so školským OpenWebUI ako
|
||||||
OpenAPI Tool Server.
|
OpenAPI Tool Server.
|
||||||
|
|
||||||
Súčasná hlavná retrieval vetva používa klasický hybridný RAG:
|
Stabilná baseline retrieval vetva používa klasický hybridný RAG:
|
||||||
FTS5/BM25 + embeddingy + RRF. GraphRAG zatiaľ nie je implementovaný;
|
FTS5/BM25 + embeddingy + RRF. Nad týmto baseline sa vo vetve GraphRAG
|
||||||
je preň pripravený samostatný evaluačný dataset a bude sa dopĺňať ako
|
dopĺňa knowledge graph uložený v Neo4j. Aktuálne je implementovaná
|
||||||
ďalšia experimentálna vetva.
|
grafová infraštruktúra, deterministický builder, vizualizácia grafu a
|
||||||
|
samostatné grafové vyhľadávanie. Grafová vrstva má zmrazenú evaluáciu v1; ďalším krokom je zapojenie
|
||||||
|
do OpenWebUI a nová zdrojovo overená verzia benchmarku.
|
||||||
|
|
||||||
## Implementované
|
## Implementované
|
||||||
|
|
||||||
@ -60,6 +62,15 @@ je preň pripravený samostatný evaluačný dataset a bude sa dopĺňať ako
|
|||||||
- atomická výmena databázy po úspešnom reindexovaní,
|
- atomická výmena databázy po úspešnom reindexovaní,
|
||||||
- persistentná Hugging Face cache v Docker volume,
|
- persistentná Hugging Face cache v Docker volume,
|
||||||
- warm-up embeddingového modelu,
|
- warm-up embeddingového modelu,
|
||||||
|
- Neo4j databáza spúšťaná ako samostatná Docker služba,
|
||||||
|
- deterministická tvorba knowledge graphu z `documents.json` a
|
||||||
|
`chunks.json`,
|
||||||
|
- grafové entity `Person`, `Document`, `DocumentAuthor`, `Thesis`,
|
||||||
|
`Work`, `Keyword`, `Topic` a `Category`,
|
||||||
|
- grafové vzťahy pre dokumenty, práce, témy, kategórie a autorstvo,
|
||||||
|
- uniqueness constraints a opakovateľný rebuild GraphRAG grafu,
|
||||||
|
- Neo4j Browser na vizualizáciu a kontrolu vytvoreného grafu,
|
||||||
|
- samostatné grafové vyhľadávanie nad Neo4j s rozpoznaním entít, vzťahov, prác, tém a rokov,
|
||||||
- retrieval evaluácia pre FTS, embeddings a hybridný retrieval,
|
- retrieval evaluácia pre FTS, embeddings a hybridný retrieval,
|
||||||
- answer-level RAG evaluácia cez OpenWebUI model a RAG tool,
|
- answer-level RAG evaluácia cez OpenWebUI model a RAG tool,
|
||||||
- oddelené answer-level overrides bez úpravy frozen retrieval
|
- oddelené answer-level overrides bez úpravy frozen retrieval
|
||||||
@ -113,6 +124,38 @@ jazykový model
|
|||||||
odpoveď + source_url
|
odpoveď + source_url
|
||||||
```
|
```
|
||||||
|
|
||||||
|
GraphRAG vývojová vetva:
|
||||||
|
|
||||||
|
```text
|
||||||
|
documents.json + chunks.json
|
||||||
|
↓
|
||||||
|
graphrag.py
|
||||||
|
↓
|
||||||
|
build_graphrag.py
|
||||||
|
↓
|
||||||
|
Neo4j
|
||||||
|
├── Person
|
||||||
|
├── Document
|
||||||
|
├── Thesis
|
||||||
|
├── Work
|
||||||
|
├── Keyword
|
||||||
|
├── Topic
|
||||||
|
├── Category
|
||||||
|
└── DocumentAuthor
|
||||||
|
↓
|
||||||
|
grafové vzťahy + vizualizácia
|
||||||
|
↓
|
||||||
|
graph_search.py
|
||||||
|
↓
|
||||||
|
grafové entity + cesty + zdrojové dokumenty
|
||||||
|
↓
|
||||||
|
spojenie s klasickým RAG
|
||||||
|
```
|
||||||
|
|
||||||
|
V aktuálnom stave je implementované vytvorenie a uloženie knowledge
|
||||||
|
graphu aj samostatné grafové vyhľadávanie. Jeho zapojenie do `/rag` a
|
||||||
|
OpenWebUI sa ešte dopĺňa.
|
||||||
|
|
||||||
Synchronizačná vetva:
|
Synchronizačná vetva:
|
||||||
|
|
||||||
```text
|
```text
|
||||||
@ -134,7 +177,7 @@ atomická výmena databázy
|
|||||||
Evaluačná vetva:
|
Evaluačná vetva:
|
||||||
|
|
||||||
```text
|
```text
|
||||||
evaluation/json_files/*.json
|
tools/rag/evaluation/json_files/*.json
|
||||||
↓
|
↓
|
||||||
retrieval evaluator / RAG answer evaluator
|
retrieval evaluator / RAG answer evaluator
|
||||||
↓
|
↓
|
||||||
@ -142,11 +185,11 @@ runner
|
|||||||
↓
|
↓
|
||||||
metriky
|
metriky
|
||||||
↓
|
↓
|
||||||
evaluation/results/
|
tools/rag/evaluation/results/
|
||||||
```
|
```
|
||||||
|
|
||||||
`evaluation/results/` nie je v nižšie uvedenom stromčeku, pretože
|
`tools/rag/evaluation/results/` nie je v nižšie uvedenom stromčeku,
|
||||||
obsahuje generované výstupy experimentov.
|
pretože obsahuje generované výstupy experimentov.
|
||||||
|
|
||||||
## Štruktúra projektu
|
## Štruktúra projektu
|
||||||
|
|
||||||
@ -161,34 +204,47 @@ zp-agent/
|
|||||||
│ ├── routes.py
|
│ ├── routes.py
|
||||||
│ └── security.py
|
│ └── security.py
|
||||||
│
|
│
|
||||||
├── scripts/
|
├── tools/
|
||||||
│ ├── common.py
|
│ ├── rag/
|
||||||
│ ├── scan_zpwiki.py
|
│ │ ├── common.py
|
||||||
│ ├── build_chunks.py
|
│ │ ├── scan_zpwiki.py
|
||||||
│ ├── build_sqlite_index.py
|
│ │ ├── build_chunks.py
|
||||||
│ ├── embedding_utils.py
|
│ │ ├── build_sqlite_index.py
|
||||||
│ ├── rag_utils.py
|
│ │ ├── embedding_utils.py
|
||||||
│ ├── rebuild_index.py
|
│ │ ├── rebuild_index.py
|
||||||
│ ├── search_db.py
|
│ │ ├── search_core.py
|
||||||
│ ├── search_core.py
|
│ │ ├── search_utils.py
|
||||||
│ └── search_utils.py
|
│ │ ├── search_db.py
|
||||||
|
│ │ ├── rag_utils.py
|
||||||
|
│ │ ├── rag_document_expansion.py
|
||||||
|
│ │ ├── rag_query_evidence.py
|
||||||
|
│ │ ├── rag_supplemental_expansion.py
|
||||||
|
│ │ ├── run_e5_regression.sh
|
||||||
|
│ │ ├── run_e5_1_regression.sh
|
||||||
|
│ │ ├── evaluation/
|
||||||
|
│ │ │ ├── evaluate_retrieval.py
|
||||||
|
│ │ │ ├── evaluate_rag_answers.py
|
||||||
|
│ │ │ ├── retrieval_runner.py
|
||||||
|
│ │ │ ├── rag_runner.py
|
||||||
|
│ │ │ ├── metrics.py
|
||||||
|
│ │ │ ├── rag_metrics.py
|
||||||
|
│ │ │ └── json_files/
|
||||||
|
│ │ └── tests/
|
||||||
|
│ │
|
||||||
|
│ └── graphrag/
|
||||||
|
│ ├── graph_db.py
|
||||||
|
│ ├── graphrag.py
|
||||||
|
│ ├── build_graphrag.py
|
||||||
|
│ ├── graph_search.py
|
||||||
|
│ ├── neo4j_smoke.py
|
||||||
|
│ ├── evaluation/
|
||||||
|
│ │ └── graphrag_questions.json
|
||||||
|
│ └── tests/
|
||||||
│
|
│
|
||||||
├── evaluation/
|
├── test/
|
||||||
│ ├── evaluate_retrieval.py
|
│ ├── test_api.py
|
||||||
│ ├── retrieval_runner.py
|
│ ├── test_configuration.py
|
||||||
│ ├── metrics.py
|
│ └── test_security.py
|
||||||
│ ├── evaluate_rag_answers.py
|
|
||||||
│ ├── rag_runner.py
|
|
||||||
│ ├── rag_metrics.py
|
|
||||||
│ └── json_files/
|
|
||||||
│ ├── questions.json
|
|
||||||
│ ├── questions_before_ambiguity_cleanup.json
|
|
||||||
│ ├── questions_before_validation.json
|
|
||||||
│ ├── rag_answer_overrides.json
|
|
||||||
│ ├── questions_extended_2000.json
|
|
||||||
│ ├── graphrag_questions.json
|
|
||||||
│ ├── robustness_questions.json
|
|
||||||
│ └── performance_queries.json
|
|
||||||
│
|
│
|
||||||
├── data/
|
├── data/
|
||||||
│ ├── documents.json
|
│ ├── documents.json
|
||||||
@ -240,7 +296,7 @@ vypnuté. Pre integráciu OpenWebUI je dôležitý endpoint:
|
|||||||
- používa bezpečné porovnávanie autentifikačných hodnôt,
|
- používa bezpečné porovnávanie autentifikačných hodnôt,
|
||||||
- validuje očakávaný Gitea repozitár a súvisiacu konfiguráciu.
|
- validuje očakávaný Gitea repozitár a súvisiacu konfiguráciu.
|
||||||
|
|
||||||
### `scripts/`
|
### `tools/rag/`
|
||||||
|
|
||||||
`common.py`
|
`common.py`
|
||||||
|
|
||||||
@ -277,6 +333,42 @@ vyhľadávacou vrstvou.
|
|||||||
- normalizuje vektory,
|
- normalizuje vektory,
|
||||||
- poskytuje utility pre vektorové vyhľadávanie.
|
- poskytuje utility pre vektorové vyhľadávanie.
|
||||||
|
|
||||||
|
### `tools/graphrag/`
|
||||||
|
|
||||||
|
`graph_db.py`
|
||||||
|
|
||||||
|
- načítava konfiguráciu Neo4j,
|
||||||
|
- vytvára Neo4j driver,
|
||||||
|
- poskytuje kontrolu spojenia s grafovou databázou.
|
||||||
|
|
||||||
|
`graphrag.py`
|
||||||
|
|
||||||
|
- pripravuje dátový model knowledge graphu,
|
||||||
|
- normalizuje grafové identifikátory,
|
||||||
|
- extrahuje osoby, práce, roky, témy, kategórie a súvisiace metadata,
|
||||||
|
- pripravuje uzly a vzťahy pre zápis do Neo4j.
|
||||||
|
|
||||||
|
`build_graphrag.py`
|
||||||
|
|
||||||
|
- načíta `documents.json` a `chunks.json`,
|
||||||
|
- vytvorí GraphRAG payload,
|
||||||
|
- vytvorí Neo4j uniqueness constraints,
|
||||||
|
- zapíše uzly a vzťahy,
|
||||||
|
- podporuje opakovateľný rebuild spravovanej časti grafu,
|
||||||
|
- vypíše základné počty uzlov, vzťahov a kvalitu extrakcie názvov prác.
|
||||||
|
|
||||||
|
`graph_search.py`
|
||||||
|
|
||||||
|
- rozpoznáva relevantné osoby a obmedzenia v otázke,
|
||||||
|
- vyhľadáva práce, témy, roky a spoločné vzťahy v Neo4j,
|
||||||
|
- vracia grafové cesty, fakty a zdrojové dokumenty,
|
||||||
|
- slúži ako základ budúceho GraphRAG nástroja pre OpenWebUI.
|
||||||
|
|
||||||
|
`neo4j_smoke.py`
|
||||||
|
|
||||||
|
Jednoduchý smoke test pripojenia k Neo4j používaný pri kontrole Docker
|
||||||
|
prostredia.
|
||||||
|
|
||||||
`search_core.py`
|
`search_core.py`
|
||||||
|
|
||||||
Nízkoúrovňové jadro vyhľadávania:
|
Nízkoúrovňové jadro vyhľadávania:
|
||||||
@ -322,7 +414,7 @@ scan
|
|||||||
→ atomická výmena DB
|
→ atomická výmena DB
|
||||||
```
|
```
|
||||||
|
|
||||||
### `evaluation/`
|
### `tools/rag/evaluation/`
|
||||||
|
|
||||||
`evaluate_retrieval.py`
|
`evaluate_retrieval.py`
|
||||||
|
|
||||||
@ -376,7 +468,7 @@ Počíta answer-level metriky, napríklad:
|
|||||||
- strict pass,
|
- strict pass,
|
||||||
- latency a tokenové údaje.
|
- latency a tokenové údaje.
|
||||||
|
|
||||||
### `evaluation/json_files/`
|
### `tools/rag/evaluation/json_files/`
|
||||||
|
|
||||||
`questions.json`
|
`questions.json`
|
||||||
|
|
||||||
@ -418,35 +510,13 @@ Obsahuje kombináciu:
|
|||||||
Tento dataset je zatiaľ pripravený, ale nemá sa používať na priebežné
|
Tento dataset je zatiaľ pripravený, ale nemá sa používať na priebežné
|
||||||
ladenie frozen benchmarku.
|
ladenie frozen benchmarku.
|
||||||
|
|
||||||
`graphrag_questions.json`
|
GraphRAG benchmark je po oddelení nástrojov uložený samostatne v:
|
||||||
|
|
||||||
Samostatný benchmark pripravený pre budúcu GraphRAG vetvu.
|
|
||||||
|
|
||||||
Obsahuje 500 otázok zameraných na:
|
|
||||||
|
|
||||||
- multi-hop vzťahy,
|
|
||||||
- spoločné témy,
|
|
||||||
- spoločné roky,
|
|
||||||
- person → title → year,
|
|
||||||
- person → topic → title,
|
|
||||||
- person → category → author,
|
|
||||||
- agregácie,
|
|
||||||
- konjunktívnu disambiguáciu,
|
|
||||||
- multi-document reasoning.
|
|
||||||
|
|
||||||
Dataset obsahuje aj GraphRAG metadata ako:
|
|
||||||
|
|
||||||
```text
|
```text
|
||||||
graph.task
|
tools/graphrag/evaluation/graphrag_questions.json
|
||||||
graph.hop_count
|
|
||||||
graph.start_entities
|
|
||||||
graph.expected_entities
|
|
||||||
graph.expected_relations
|
|
||||||
graph.expected_paths
|
|
||||||
```
|
```
|
||||||
|
|
||||||
Dôležité: existencia tohto datasetu neznamená, že je GraphRAG už
|
Obsahuje 500 otázok zameraných na grafové a viacvzťahové dopyty.
|
||||||
implementovaný. Dataset je pripravený na neskorší vývoj a porovnanie.
|
|
||||||
|
|
||||||
`robustness_questions.json`
|
`robustness_questions.json`
|
||||||
|
|
||||||
@ -517,6 +587,12 @@ WEBHOOK_PULL_GIT=false
|
|||||||
# Voliteľné
|
# Voliteľné
|
||||||
EMBEDDING_MODEL=intfloat/multilingual-e5-small
|
EMBEDDING_MODEL=intfloat/multilingual-e5-small
|
||||||
EMBEDDING_BATCH_SIZE=32
|
EMBEDDING_BATCH_SIZE=32
|
||||||
|
|
||||||
|
# GraphRAG / Neo4j
|
||||||
|
NEO4J_URI=bolt://localhost:7687
|
||||||
|
NEO4J_USER=neo4j
|
||||||
|
NEO4J_PASSWORD=<silné lokálne heslo>
|
||||||
|
NEO4J_DATABASE=neo4j
|
||||||
```
|
```
|
||||||
|
|
||||||
Tajomstvá je možné vygenerovať príkazom:
|
Tajomstvá je možné vygenerovať príkazom:
|
||||||
@ -569,13 +645,33 @@ docker compose down
|
|||||||
Hugging Face cache je uložená v persistentnom Docker volume, takže sa
|
Hugging Face cache je uložená v persistentnom Docker volume, takže sa
|
||||||
embeddingový model pri bežnom reštarte kontajnera nemusí znova sťahovať.
|
embeddingový model pri bežnom reštarte kontajnera nemusí znova sťahovať.
|
||||||
|
|
||||||
|
Neo4j je spustené ako samostatná služba v rovnakom Docker Compose
|
||||||
|
prostredí. Stav služieb je možné skontrolovať:
|
||||||
|
|
||||||
|
```bash
|
||||||
|
docker compose ps
|
||||||
|
```
|
||||||
|
|
||||||
|
Neo4j Browser je lokálne dostupný na:
|
||||||
|
|
||||||
|
```text
|
||||||
|
http://127.0.0.1:7474/browser/
|
||||||
|
```
|
||||||
|
|
||||||
|
Kontrola spojenia z API kontajnera:
|
||||||
|
|
||||||
|
```bash
|
||||||
|
docker compose exec zp-agent-api \
|
||||||
|
python -m tools.graphrag.neo4j_smoke
|
||||||
|
```
|
||||||
|
|
||||||
## Reindexovanie
|
## Reindexovanie
|
||||||
|
|
||||||
Celý proces načíta dokumenty, vytvorí chunky, obnoví FTS5 index a
|
Celý proces načíta dokumenty, vytvorí chunky, obnoví FTS5 index a
|
||||||
vytvorí embedding pre každý chunk:
|
vytvorí embedding pre každý chunk:
|
||||||
|
|
||||||
```bash
|
```bash
|
||||||
docker compose run --rm zp-agent-api python scripts/rebuild_index.py
|
docker compose run --rm zp-agent-api python -m tools.rag.rebuild_index
|
||||||
```
|
```
|
||||||
|
|
||||||
Vzniknú súbory:
|
Vzniknú súbory:
|
||||||
@ -623,7 +719,7 @@ Test z terminálu:
|
|||||||
|
|
||||||
```bash
|
```bash
|
||||||
docker compose run --rm zp-agent-api \
|
docker compose run --rm zp-agent-api \
|
||||||
python scripts/search_db.py "rag agent" --limit 5
|
python -m tools.rag.search_db "rag agent" --limit 5
|
||||||
```
|
```
|
||||||
|
|
||||||
Pred volaním API načítaj premenné z `.env`:
|
Pred volaním API načítaj premenné z `.env`:
|
||||||
@ -661,7 +757,7 @@ dokumentu.
|
|||||||
## RAG
|
## RAG
|
||||||
|
|
||||||
Nad hybridným retrievalom je implementovaná RAG vrstva v
|
Nad hybridným retrievalom je implementovaná RAG vrstva v
|
||||||
`scripts/rag_utils.py`.
|
`tools/rag/rag_utils.py`.
|
||||||
|
|
||||||
Endpoint `/rag` vyhľadá relevantné dokumenty a pripraví:
|
Endpoint `/rag` vyhľadá relevantné dokumenty a pripraví:
|
||||||
|
|
||||||
@ -699,6 +795,60 @@ curl -X POST http://127.0.0.1:8000/rag \
|
|||||||
}'
|
}'
|
||||||
```
|
```
|
||||||
|
|
||||||
|
## GraphRAG
|
||||||
|
|
||||||
|
GraphRAG vetva rozširuje existujúci klasický RAG o knowledge graph.
|
||||||
|
Graf sa vytvára deterministicky z už pripravených dokumentov a chunkov
|
||||||
|
a ukladá sa do Neo4j.
|
||||||
|
|
||||||
|
Aktuálne používané hlavné typy uzlov:
|
||||||
|
|
||||||
|
```text
|
||||||
|
Person
|
||||||
|
Document
|
||||||
|
DocumentAuthor
|
||||||
|
Thesis
|
||||||
|
Work
|
||||||
|
Keyword
|
||||||
|
Topic
|
||||||
|
Category
|
||||||
|
```
|
||||||
|
|
||||||
|
Hlavné vzťahy zahŕňajú napríklad:
|
||||||
|
|
||||||
|
```text
|
||||||
|
Person -[:HAS_DOCUMENT]-> Document
|
||||||
|
Person -[:AUTHORED]-> Thesis
|
||||||
|
Person -[:HAS_WORK]-> Work
|
||||||
|
Thesis/Work -[:EVIDENCED_BY]-> Document
|
||||||
|
Document -[:HAS_KEYWORD]-> Keyword
|
||||||
|
Document -[:IN_CATEGORY]-> Category
|
||||||
|
DocumentAuthor -[:AUTHORED_DOCUMENT]-> Document
|
||||||
|
Document -[:DESCRIBES]-> Topic
|
||||||
|
```
|
||||||
|
|
||||||
|
Knowledge graph sa vytvorí príkazom:
|
||||||
|
|
||||||
|
```bash
|
||||||
|
docker compose exec zp-agent-api \
|
||||||
|
python -m tools.graphrag.build_graphrag
|
||||||
|
```
|
||||||
|
|
||||||
|
Builder vytvára constraints, zapisuje uzly a vzťahy a pri štandardnom
|
||||||
|
spustení obnoví iba časť grafu spravovanú ZP Agentom. Opakované
|
||||||
|
spustenie preto nevytvára duplicitné uzly.
|
||||||
|
|
||||||
|
Graf je možné vizuálne kontrolovať v Neo4j Browseri. Samostatné
|
||||||
|
grafové vyhľadávanie je implementované v `tools/graphrag/graph_search.py`.
|
||||||
|
GraphRAG zatiaľ nezasahuje do stabilného klasického `/rag` toku; ďalšia
|
||||||
|
etapa spojí grafové výsledky s klasickým RAG a OpenWebUI nástrojom.
|
||||||
|
|
||||||
|
Zmrazená evaluácia GraphRAG v1: DEV **209/286 (73,08 %)**, TEST
|
||||||
|
**152/214 (71,03 %)**, bez runtime chýb. Audit pred TESTom odhalil
|
||||||
|
137 zdrojových nesúladov v benchmarku; všetky zostávajú zahrnuté
|
||||||
|
v primárnom skóre. Podrobné výsledky, doplnkové metriky a postup
|
||||||
|
reprodukcie sú v [GraphRAG evaluácii](tools/graphrag/evaluation/README.md).
|
||||||
|
|
||||||
## OpenWebUI
|
## OpenWebUI
|
||||||
|
|
||||||
ZP Agent je pripojený do OpenWebUI ako OpenAPI Tool Server.
|
ZP Agent je pripojený do OpenWebUI ako OpenAPI Tool Server.
|
||||||
@ -734,7 +884,7 @@ Výsledná odpoveď má byť grounded v ZP Wiki a má používať relevantný
|
|||||||
Frozen retrieval benchmark sa spúšťa napríklad:
|
Frozen retrieval benchmark sa spúšťa napríklad:
|
||||||
|
|
||||||
```bash
|
```bash
|
||||||
python evaluation/evaluate_retrieval.py \
|
python -m tools.rag.evaluation.evaluate_retrieval \
|
||||||
--split dev \
|
--split dev \
|
||||||
--strict-dataset
|
--strict-dataset
|
||||||
```
|
```
|
||||||
@ -772,7 +922,7 @@ TEST split sa nemá používať na priebežné ladenie retrieval konfigurácie.
|
|||||||
Answer-level evaluácia používa:
|
Answer-level evaluácia používa:
|
||||||
|
|
||||||
```bash
|
```bash
|
||||||
python evaluation/evaluate_rag_answers.py --split dev
|
python -m tools.rag.evaluation.evaluate_rag_answers --split dev
|
||||||
```
|
```
|
||||||
|
|
||||||
Evaluuje kompletný model/tool/RAG tok a od retrieval benchmarku je
|
Evaluuje kompletný model/tool/RAG tok a od retrieval benchmarku je
|
||||||
@ -782,7 +932,7 @@ Ak je pôvodná otázka vhodná pre retrieval, ale nejednoznačná pre
|
|||||||
generatívnu odpoveď, jej answer-level formulácia sa upraví iba cez:
|
generatívnu odpoveď, jej answer-level formulácia sa upraví iba cez:
|
||||||
|
|
||||||
```text
|
```text
|
||||||
evaluation/json_files/rag_answer_overrides.json
|
tools/rag/evaluation/json_files/rag_answer_overrides.json
|
||||||
```
|
```
|
||||||
|
|
||||||
Pôvodný frozen `questions.json` tým ostáva nezmenený.
|
Pôvodný frozen `questions.json` tým ostáva nezmenený.
|
||||||
@ -874,10 +1024,10 @@ Kontrola syntaxe najdôležitejších upravovaných modulov:
|
|||||||
|
|
||||||
```bash
|
```bash
|
||||||
python -m py_compile \
|
python -m py_compile \
|
||||||
scripts/rag_utils.py \
|
tools/rag/rag_utils.py \
|
||||||
evaluation/evaluate_rag_answers.py \
|
tools/rag/evaluation/evaluate_rag_answers.py \
|
||||||
evaluation/rag_runner.py \
|
tools/rag/evaluation/rag_runner.py \
|
||||||
evaluation/rag_metrics.py
|
tools/rag/evaluation/rag_metrics.py
|
||||||
```
|
```
|
||||||
|
|
||||||
Pred checkpointom je vhodné použiť aj:
|
Pred checkpointom je vhodné použiť aj:
|
||||||
@ -891,10 +1041,9 @@ Pevný počet `pytest` výsledkov nie je v README uvádzaný, pretože sa
|
|||||||
s vývojom mení. Aktuálny stav sa má vždy potvrdiť novým spustením testov
|
s vývojom mení. Aktuálny stav sa má vždy potvrdiť novým spustením testov
|
||||||
na konkrétnom commite.
|
na konkrétnom commite.
|
||||||
|
|
||||||
## Pripravené, ale zatiaľ neaktívne experimenty
|
## Experimentálne datasety
|
||||||
|
|
||||||
Nasledujúce datasety sú pripravené, ale nemajú sa teraz používať na
|
Pre ďalšie experimenty sú pripravené:
|
||||||
priebežné ladenie aktuálneho frozen benchmarku:
|
|
||||||
|
|
||||||
```text
|
```text
|
||||||
questions_extended_2000.json
|
questions_extended_2000.json
|
||||||
@ -903,104 +1052,51 @@ robustness_questions.json
|
|||||||
performance_queries.json
|
performance_queries.json
|
||||||
```
|
```
|
||||||
|
|
||||||
Odporúčané poradie ich neskoršieho použitia:
|
`graphrag_questions.json` je aktuálne určený pre vývoj GraphRAG vetvy.
|
||||||
|
Ostatné datasety zostávajú oddelené od priebežného ladenia frozen
|
||||||
```text
|
klasického baseline.
|
||||||
stabilný klasický RAG
|
|
||||||
↓
|
|
||||||
extended benchmark
|
|
||||||
↓
|
|
||||||
robustness benchmark
|
|
||||||
↓
|
|
||||||
GraphRAG implementácia
|
|
||||||
↓
|
|
||||||
GraphRAG benchmark
|
|
||||||
↓
|
|
||||||
performance benchmark
|
|
||||||
↓
|
|
||||||
stress test
|
|
||||||
↓
|
|
||||||
finálne experimenty
|
|
||||||
```
|
|
||||||
|
|
||||||
## Najbližší postup
|
## Najbližší postup
|
||||||
|
|
||||||
Najbližšia vývojová etapa je zámerne menšia a má uzavrieť existujúci
|
Klasický RAG a GraphRAG sú oddelené do samostatných komponentov v
|
||||||
klasický RAG pred otvorením ďalších experimentov.
|
`tools/rag/` a `tools/graphrag/`. Stabilný klasický RAG zostáva
|
||||||
|
referenčným bodom.
|
||||||
|
|
||||||
### 1. Uzavretie retrieval/regresie
|
### 1. GraphRAG dátový model
|
||||||
|
|
||||||
Najprv sa má potvrdiť, že aktuálne zmeny neovplyvnili frozen retrieval
|
Model je implementovaný. Rozlišuje autora dokumentu, študenta, záverečnú
|
||||||
baseline.
|
prácu, projekt, tému a kľúčové slovo. Študijný program sa nedopĺňa bez
|
||||||
|
spoľahlivého zdroja.
|
||||||
|
|
||||||
Postup:
|
### 2. GraphRAG evaluácia
|
||||||
|
|
||||||
```text
|
V1 je zmrazená a vyhodnotená. [Finálna správa](tools/graphrag/evaluation/results/final_2026-10-24/REPORT.md)
|
||||||
py_compile
|
uvádza všetky výsledky aj zostávajúce limity. Pred formálnym porovnaním
|
||||||
↓
|
s klasickým RAG treba pripraviť novú zdrojovo overenú verziu benchmarku.
|
||||||
pytest
|
Zistenia z finálneho TESTu patria do ďalšej verzie s novým holdoutom.
|
||||||
↓
|
|
||||||
frozen retrieval DEV strict
|
|
||||||
↓
|
|
||||||
porovnanie s uloženým baseline
|
|
||||||
↓
|
|
||||||
git diff --check
|
|
||||||
↓
|
|
||||||
retrieval lock
|
|
||||||
```
|
|
||||||
|
|
||||||
Do retrieval scoringu sa potom nemá zasahovať bez nového
|
### 3. OpenWebUI nástroje
|
||||||
experimentálneho dôvodu.
|
|
||||||
|
|
||||||
### 2. Regresia section-lead RAG kontextu
|
Pripraviť samostatne inštalovateľný RAG nástroj a GraphRAG nástroj.
|
||||||
|
Každý komponent bude mať vlastný adresár, rozhranie a testy.
|
||||||
|
|
||||||
Treba potvrdiť, že section-lead expanzia:
|
### 4. Hlavný agent
|
||||||
|
|
||||||
- opravuje prípady, kde primárny chunk chýba o názov/tému/rok,
|
Pridať hlavný prompt/agenta, ktorý podľa otázky vyberie vhodný nástroj a
|
||||||
- nepridáva duplicitný chunk,
|
bude vedieť kombinovať ich výsledky.
|
||||||
- zostáva v rovnakom dokumente a sekcii,
|
|
||||||
- nemení retrieval `max_per_document=1`,
|
|
||||||
- nevytvára zbytočne veľký kontext.
|
|
||||||
|
|
||||||
### 3. `retry + backoff + resume` pre answer evaluator
|
### 5. Git MCP server
|
||||||
|
|
||||||
Pred spustením veľkého DEV answer benchmarku sa má evaluator doplniť
|
Pridať samostatný MCP server pre prácu s Git repozitárom a spúšťať ho v
|
||||||
tak, aby dlhý beh nebol znehodnotený jedným timeoutom alebo dočasnou
|
Dockeri. Následne ho sprístupniť hlavnému agentovi ako ďalší nástroj.
|
||||||
chybou API.
|
|
||||||
|
|
||||||
Plánované správanie:
|
### 6. Spojenie GraphRAG s klasickým RAG
|
||||||
|
|
||||||
```text
|
Po stabilizovaní grafového vyhľadávania spojiť výsledky grafu s
|
||||||
request
|
existujúcim FTS5 + embedding vyhľadávaním a porovnať klasický RAG s
|
||||||
↓
|
GraphRAG variantom.
|
||||||
úspech ───────────────→ uložiť výsledok
|
|
||||||
│
|
|
||||||
└─ timeout / 429 / 5xx
|
|
||||||
↓
|
|
||||||
retry
|
|
||||||
↓
|
|
||||||
exponential backoff
|
|
||||||
↓
|
|
||||||
retry limit
|
|
||||||
```
|
|
||||||
|
|
||||||
Resume mechanizmus má:
|
### 7. Finálne experimenty
|
||||||
|
|
||||||
- priebežne ukladať `.partial.json`,
|
Až po stabilizovaní celého systému vykonať širšie porovnanie embedding
|
||||||
- pri novom spustení načítať existujúci partial výsledok,
|
modelov, robustnosti, výkonu a ostatných finálnych experimentov.
|
||||||
- overiť kompatibilitu modelu/datasetu/splitu,
|
|
||||||
- preskočiť už úspešne dokončené otázky,
|
|
||||||
- pokračovať od ďalšej otázky,
|
|
||||||
- neprepisovať hotové výsledky bez explicitnej voľby,
|
|
||||||
- po úspešnom dokončení vytvoriť finálny JSON/CSV výstup.
|
|
||||||
|
|
||||||
Zároveň je vhodné:
|
|
||||||
|
|
||||||
- rozlišovať retryable a permanentné chyby,
|
|
||||||
- logovať číslo pokusu a dôvod retry,
|
|
||||||
- mať konfigurovateľný maximálny počet pokusov,
|
|
||||||
- mať konfigurovateľný počiatočný backoff,
|
|
||||||
- používať mierny delay medzi otázkami,
|
|
||||||
- validovať typy answer-level datasetových polí,
|
|
||||||
- nenačítavať osobný OpenWebUI API kľúč z fallback súboru, ak má byť
|
|
||||||
podľa bezpečnostnej politiky dostupný iba cez environment.
|
|
||||||
|
|||||||
@ -28,7 +28,7 @@ from app.routes import router
|
|||||||
from app.security import (
|
from app.security import (
|
||||||
validate_security_configuration,
|
validate_security_configuration,
|
||||||
)
|
)
|
||||||
from scripts.embedding_utils import embed_query
|
from tools.rag.embedding_utils import embed_query
|
||||||
|
|
||||||
|
|
||||||
logger = logging.getLogger(__name__)
|
logger = logging.getLogger(__name__)
|
||||||
|
|||||||
@ -36,16 +36,16 @@ from app.security import (
|
|||||||
verify_gitea_signature,
|
verify_gitea_signature,
|
||||||
webhook_should_pull_git,
|
webhook_should_pull_git,
|
||||||
)
|
)
|
||||||
from scripts.common import (
|
from tools.rag.common import (
|
||||||
DB_FILE,
|
DB_FILE,
|
||||||
ZPWIKI_ROOT,
|
ZPWIKI_ROOT,
|
||||||
)
|
)
|
||||||
from scripts.rag_utils import build_rag_context
|
from tools.rag.rag_utils import build_rag_context
|
||||||
from scripts.rebuild_index import (
|
from tools.rag.rebuild_index import (
|
||||||
ReindexInProgressError,
|
ReindexInProgressError,
|
||||||
rebuild_index,
|
rebuild_index,
|
||||||
)
|
)
|
||||||
from scripts.search_utils import search_database
|
from tools.rag.search_utils import search_database
|
||||||
|
|
||||||
|
|
||||||
logger = logging.getLogger(__name__)
|
logger = logging.getLogger(__name__)
|
||||||
|
|||||||
@ -15,6 +15,10 @@ services:
|
|||||||
CHUNK_MIN_TOKENS: "80"
|
CHUNK_MIN_TOKENS: "80"
|
||||||
CHUNK_TOKEN_ENCODING: cl100k_base
|
CHUNK_TOKEN_ENCODING: cl100k_base
|
||||||
HF_HOME: /cache/huggingface
|
HF_HOME: /cache/huggingface
|
||||||
|
NEO4J_URI: bolt://neo4j:7687
|
||||||
|
NEO4J_USER: ${NEO4J_USER:-neo4j}
|
||||||
|
NEO4J_PASSWORD: ${NEO4J_PASSWORD}
|
||||||
|
NEO4J_DATABASE: ${NEO4J_DATABASE:-neo4j}
|
||||||
|
|
||||||
volumes:
|
volumes:
|
||||||
- ./data:/app/data
|
- ./data:/app/data
|
||||||
@ -23,5 +27,35 @@ services:
|
|||||||
|
|
||||||
restart: unless-stopped
|
restart: unless-stopped
|
||||||
|
|
||||||
|
neo4j:
|
||||||
|
image: neo4j:2026.09.0
|
||||||
|
container_name: zp-agent-neo4j
|
||||||
|
|
||||||
|
ports:
|
||||||
|
- "127.0.0.1:7474:7474"
|
||||||
|
- "127.0.0.1:7687:7687"
|
||||||
|
|
||||||
|
environment:
|
||||||
|
NEO4J_AUTH: ${NEO4J_USER:-neo4j}/${NEO4J_PASSWORD}
|
||||||
|
|
||||||
|
volumes:
|
||||||
|
- neo4j-data:/data
|
||||||
|
- neo4j-logs:/logs
|
||||||
|
|
||||||
|
healthcheck:
|
||||||
|
test:
|
||||||
|
[
|
||||||
|
"CMD-SHELL",
|
||||||
|
"u=$${NEO4J_AUTH%%/*}; p=$${NEO4J_AUTH#*/}; cypher-shell -u \"$$u\" -p \"$$p\" 'RETURN 1' >/dev/null 2>&1"
|
||||||
|
]
|
||||||
|
interval: 10s
|
||||||
|
timeout: 5s
|
||||||
|
retries: 10
|
||||||
|
start_period: 20s
|
||||||
|
|
||||||
|
restart: unless-stopped
|
||||||
|
|
||||||
volumes:
|
volumes:
|
||||||
hf-cache:
|
hf-cache:
|
||||||
|
neo4j-data:
|
||||||
|
neo4j-logs:
|
||||||
|
|||||||
@ -6,3 +6,4 @@ tiktoken>=0.8,<1
|
|||||||
uvicorn[standard]==0.48.0
|
uvicorn[standard]==0.48.0
|
||||||
numpy==2.2.6
|
numpy==2.2.6
|
||||||
sentence-transformers==5.7.0
|
sentence-transformers==5.7.0
|
||||||
|
neo4j==6.3.1
|
||||||
|
|||||||
@ -9,7 +9,7 @@ from fastapi.testclient import TestClient
|
|||||||
|
|
||||||
import app.main as main
|
import app.main as main
|
||||||
import app.routes as routes
|
import app.routes as routes
|
||||||
from scripts.rebuild_index import (
|
from tools.rag.rebuild_index import (
|
||||||
ReindexInProgressError,
|
ReindexInProgressError,
|
||||||
)
|
)
|
||||||
|
|
||||||
|
|||||||
@ -81,7 +81,11 @@ def test_runtime_requirements_contain_only_direct_dependencies() -> None:
|
|||||||
|
|
||||||
|
|
||||||
def test_all_application_python_files_compile() -> None:
|
def test_all_application_python_files_compile() -> None:
|
||||||
targets = [PROJECT_ROOT / "app", PROJECT_ROOT / "scripts"]
|
targets = [
|
||||||
|
PROJECT_ROOT / "app",
|
||||||
|
PROJECT_ROOT / "tools" / "rag",
|
||||||
|
PROJECT_ROOT / "tools" / "graphrag",
|
||||||
|
]
|
||||||
|
|
||||||
for directory in targets:
|
for directory in targets:
|
||||||
for path in directory.rglob("*.py"):
|
for path in directory.rglob("*.py"):
|
||||||
|
|||||||
0
tools/graphrag/__init__.py
Normal file
0
tools/graphrag/__init__.py
Normal file
575
tools/graphrag/build_graphrag.py
Normal file
575
tools/graphrag/build_graphrag.py
Normal file
@ -0,0 +1,575 @@
|
|||||||
|
from __future__ import annotations
|
||||||
|
|
||||||
|
import argparse
|
||||||
|
import json
|
||||||
|
from pathlib import Path
|
||||||
|
from typing import Any
|
||||||
|
|
||||||
|
from .graph_db import (
|
||||||
|
create_neo4j_driver,
|
||||||
|
get_neo4j_settings,
|
||||||
|
)
|
||||||
|
from .graphrag import (
|
||||||
|
GRAPH_SCOPE,
|
||||||
|
build_graph_payload,
|
||||||
|
)
|
||||||
|
|
||||||
|
|
||||||
|
PROJECT_ROOT = Path(
|
||||||
|
__file__
|
||||||
|
).resolve().parents[2]
|
||||||
|
|
||||||
|
DOCUMENTS_FILE = (
|
||||||
|
PROJECT_ROOT
|
||||||
|
/ "data"
|
||||||
|
/ "documents.json"
|
||||||
|
)
|
||||||
|
|
||||||
|
CHUNKS_FILE = (
|
||||||
|
PROJECT_ROOT
|
||||||
|
/ "data"
|
||||||
|
/ "chunks.json"
|
||||||
|
)
|
||||||
|
|
||||||
|
|
||||||
|
CONSTRAINTS = (
|
||||||
|
(
|
||||||
|
"zpwiki_document_path_unique",
|
||||||
|
"Document",
|
||||||
|
"path",
|
||||||
|
),
|
||||||
|
(
|
||||||
|
"zpwiki_person_id_unique",
|
||||||
|
"Person",
|
||||||
|
"id",
|
||||||
|
),
|
||||||
|
(
|
||||||
|
"zpwiki_document_author_id_unique",
|
||||||
|
"DocumentAuthor",
|
||||||
|
"id",
|
||||||
|
),
|
||||||
|
(
|
||||||
|
"zpwiki_category_name_unique",
|
||||||
|
"Category",
|
||||||
|
"name",
|
||||||
|
),
|
||||||
|
(
|
||||||
|
"zpwiki_topic_id_unique",
|
||||||
|
"Topic",
|
||||||
|
"id",
|
||||||
|
),
|
||||||
|
(
|
||||||
|
"zpwiki_keyword_id_unique",
|
||||||
|
"Keyword",
|
||||||
|
"id",
|
||||||
|
),
|
||||||
|
(
|
||||||
|
"zpwiki_thesis_id_unique",
|
||||||
|
"Thesis",
|
||||||
|
"id",
|
||||||
|
),
|
||||||
|
(
|
||||||
|
"zpwiki_work_id_unique",
|
||||||
|
"Work",
|
||||||
|
"id",
|
||||||
|
),
|
||||||
|
)
|
||||||
|
|
||||||
|
|
||||||
|
LEGACY_CONSTRAINTS = (
|
||||||
|
"zpwiki_author_id_unique",
|
||||||
|
)
|
||||||
|
|
||||||
|
|
||||||
|
NODE_QUERIES = {
|
||||||
|
"people": """
|
||||||
|
UNWIND $rows AS row
|
||||||
|
MERGE (n:Person {id: row.id})
|
||||||
|
SET n += row
|
||||||
|
""",
|
||||||
|
"document_authors": """
|
||||||
|
UNWIND $rows AS row
|
||||||
|
MERGE (n:DocumentAuthor {id: row.id})
|
||||||
|
SET n += row
|
||||||
|
""",
|
||||||
|
"documents": """
|
||||||
|
UNWIND $rows AS row
|
||||||
|
MERGE (n:Document {path: row.path})
|
||||||
|
SET n += row
|
||||||
|
""",
|
||||||
|
"categories": """
|
||||||
|
UNWIND $rows AS row
|
||||||
|
MERGE (n:Category {name: row.name})
|
||||||
|
SET n += row
|
||||||
|
""",
|
||||||
|
"topics": """
|
||||||
|
UNWIND $rows AS row
|
||||||
|
MERGE (n:Topic {id: row.id})
|
||||||
|
SET n += row
|
||||||
|
""",
|
||||||
|
"keywords": """
|
||||||
|
UNWIND $rows AS row
|
||||||
|
MERGE (n:Keyword {id: row.id})
|
||||||
|
SET n += row
|
||||||
|
""",
|
||||||
|
"theses": """
|
||||||
|
UNWIND $rows AS row
|
||||||
|
MERGE (n:Thesis {id: row.id})
|
||||||
|
SET n += row
|
||||||
|
""",
|
||||||
|
"works": """
|
||||||
|
UNWIND $rows AS row
|
||||||
|
MERGE (n:Work {id: row.id})
|
||||||
|
SET n += row
|
||||||
|
""",
|
||||||
|
}
|
||||||
|
|
||||||
|
|
||||||
|
RELATIONSHIP_QUERIES = {
|
||||||
|
"person_documents": """
|
||||||
|
UNWIND $rows AS row
|
||||||
|
MATCH (a:Person {
|
||||||
|
id: row.person_id
|
||||||
|
})
|
||||||
|
MATCH (b:Document {
|
||||||
|
path: row.document_path
|
||||||
|
})
|
||||||
|
MERGE (a)-[:HAS_DOCUMENT]->(b)
|
||||||
|
""",
|
||||||
|
"document_author_documents": """
|
||||||
|
UNWIND $rows AS row
|
||||||
|
MATCH (a:DocumentAuthor {
|
||||||
|
id: row.document_author_id
|
||||||
|
})
|
||||||
|
MATCH (b:Document {
|
||||||
|
path: row.document_path
|
||||||
|
})
|
||||||
|
MERGE (a)-[:AUTHORED_DOCUMENT]->(b)
|
||||||
|
""",
|
||||||
|
"document_categories": """
|
||||||
|
UNWIND $rows AS row
|
||||||
|
MATCH (a:Document {
|
||||||
|
path: row.document_path
|
||||||
|
})
|
||||||
|
MATCH (b:Category {
|
||||||
|
name: row.category_name
|
||||||
|
})
|
||||||
|
MERGE (a)-[:IN_CATEGORY]->(b)
|
||||||
|
""",
|
||||||
|
"document_keywords": """
|
||||||
|
UNWIND $rows AS row
|
||||||
|
MATCH (a:Document {
|
||||||
|
path: row.document_path
|
||||||
|
})
|
||||||
|
MATCH (b:Keyword {
|
||||||
|
id: row.keyword_id
|
||||||
|
})
|
||||||
|
MERGE (a)-[:HAS_KEYWORD]->(b)
|
||||||
|
""",
|
||||||
|
"document_describes_topics": """
|
||||||
|
UNWIND $rows AS row
|
||||||
|
MATCH (a:Document {
|
||||||
|
path: row.document_path
|
||||||
|
})
|
||||||
|
MATCH (b:Topic {
|
||||||
|
id: row.topic_id
|
||||||
|
})
|
||||||
|
MERGE (a)-[:DESCRIBES]->(b)
|
||||||
|
""",
|
||||||
|
"person_theses": """
|
||||||
|
UNWIND $rows AS row
|
||||||
|
MATCH (a:Person {
|
||||||
|
id: row.person_id
|
||||||
|
})
|
||||||
|
MATCH (b:Thesis {
|
||||||
|
id: row.thesis_id
|
||||||
|
})
|
||||||
|
MERGE (a)-[:AUTHORED]->(b)
|
||||||
|
""",
|
||||||
|
"person_works": """
|
||||||
|
UNWIND $rows AS row
|
||||||
|
MATCH (a:Person {
|
||||||
|
id: row.person_id
|
||||||
|
})
|
||||||
|
MATCH (b:Work {
|
||||||
|
id: row.work_id
|
||||||
|
})
|
||||||
|
MERGE (a)-[:HAS_WORK]->(b)
|
||||||
|
""",
|
||||||
|
"thesis_documents": """
|
||||||
|
UNWIND $rows AS row
|
||||||
|
MATCH (a:Thesis {
|
||||||
|
id: row.thesis_id
|
||||||
|
})
|
||||||
|
MATCH (b:Document {
|
||||||
|
path: row.document_path
|
||||||
|
})
|
||||||
|
MERGE (a)-[:EVIDENCED_BY]->(b)
|
||||||
|
""",
|
||||||
|
"work_documents": """
|
||||||
|
UNWIND $rows AS row
|
||||||
|
MATCH (a:Work {
|
||||||
|
id: row.work_id
|
||||||
|
})
|
||||||
|
MATCH (b:Document {
|
||||||
|
path: row.document_path
|
||||||
|
})
|
||||||
|
MERGE (a)-[:EVIDENCED_BY]->(b)
|
||||||
|
""",
|
||||||
|
}
|
||||||
|
|
||||||
|
|
||||||
|
def load_json(
|
||||||
|
path: Path,
|
||||||
|
) -> list[dict[str, Any]]:
|
||||||
|
if not path.exists():
|
||||||
|
raise FileNotFoundError(
|
||||||
|
f"Missing file: {path}"
|
||||||
|
)
|
||||||
|
|
||||||
|
data = json.loads(
|
||||||
|
path.read_text(
|
||||||
|
encoding="utf-8"
|
||||||
|
)
|
||||||
|
)
|
||||||
|
|
||||||
|
if not isinstance(
|
||||||
|
data,
|
||||||
|
list,
|
||||||
|
):
|
||||||
|
raise ValueError(
|
||||||
|
f"Expected list in {path}"
|
||||||
|
)
|
||||||
|
|
||||||
|
return data
|
||||||
|
|
||||||
|
|
||||||
|
def create_constraints(
|
||||||
|
session,
|
||||||
|
) -> None:
|
||||||
|
for (
|
||||||
|
name,
|
||||||
|
label,
|
||||||
|
property_name,
|
||||||
|
) in CONSTRAINTS:
|
||||||
|
session.run(
|
||||||
|
(
|
||||||
|
f"CREATE CONSTRAINT "
|
||||||
|
f"{name} IF NOT EXISTS "
|
||||||
|
f"FOR (n:{label}) "
|
||||||
|
f"REQUIRE n.{property_name} "
|
||||||
|
f"IS UNIQUE"
|
||||||
|
)
|
||||||
|
).consume()
|
||||||
|
|
||||||
|
|
||||||
|
def drop_legacy_constraints(
|
||||||
|
session,
|
||||||
|
) -> None:
|
||||||
|
for name in LEGACY_CONSTRAINTS:
|
||||||
|
session.run(
|
||||||
|
(
|
||||||
|
f"DROP CONSTRAINT "
|
||||||
|
f"{name} IF EXISTS"
|
||||||
|
)
|
||||||
|
).consume()
|
||||||
|
|
||||||
|
|
||||||
|
def clear_managed_graph(
|
||||||
|
session,
|
||||||
|
) -> None:
|
||||||
|
session.run(
|
||||||
|
"""
|
||||||
|
MATCH (n)
|
||||||
|
WHERE n.graph_scope = $scope
|
||||||
|
DETACH DELETE n
|
||||||
|
""",
|
||||||
|
scope=GRAPH_SCOPE,
|
||||||
|
).consume()
|
||||||
|
|
||||||
|
|
||||||
|
def write_rows(
|
||||||
|
session,
|
||||||
|
query: str,
|
||||||
|
rows: list[dict[str, Any]],
|
||||||
|
) -> None:
|
||||||
|
if not rows:
|
||||||
|
return
|
||||||
|
|
||||||
|
session.run(
|
||||||
|
query,
|
||||||
|
rows=rows,
|
||||||
|
).consume()
|
||||||
|
|
||||||
|
|
||||||
|
def graph_counts(
|
||||||
|
session,
|
||||||
|
) -> tuple[
|
||||||
|
list[tuple[str, int]],
|
||||||
|
list[tuple[str, int]],
|
||||||
|
]:
|
||||||
|
node_rows = session.run(
|
||||||
|
"""
|
||||||
|
MATCH (n)
|
||||||
|
WHERE n.graph_scope = $scope
|
||||||
|
UNWIND labels(n) AS label
|
||||||
|
RETURN
|
||||||
|
label,
|
||||||
|
count(*) AS count
|
||||||
|
ORDER BY label
|
||||||
|
""",
|
||||||
|
scope=GRAPH_SCOPE,
|
||||||
|
)
|
||||||
|
|
||||||
|
nodes = [
|
||||||
|
(
|
||||||
|
str(record["label"]),
|
||||||
|
int(record["count"]),
|
||||||
|
)
|
||||||
|
for record in node_rows
|
||||||
|
]
|
||||||
|
|
||||||
|
relationship_rows = session.run(
|
||||||
|
"""
|
||||||
|
MATCH (a)-[r]->(b)
|
||||||
|
WHERE
|
||||||
|
a.graph_scope = $scope
|
||||||
|
AND b.graph_scope = $scope
|
||||||
|
RETURN
|
||||||
|
type(r) AS relationship,
|
||||||
|
count(*) AS count
|
||||||
|
ORDER BY relationship
|
||||||
|
""",
|
||||||
|
scope=GRAPH_SCOPE,
|
||||||
|
)
|
||||||
|
|
||||||
|
relationships = [
|
||||||
|
(
|
||||||
|
str(
|
||||||
|
record[
|
||||||
|
"relationship"
|
||||||
|
]
|
||||||
|
),
|
||||||
|
int(record["count"]),
|
||||||
|
)
|
||||||
|
for record in relationship_rows
|
||||||
|
]
|
||||||
|
|
||||||
|
return nodes, relationships
|
||||||
|
|
||||||
|
|
||||||
|
def titled_entity_counts(
|
||||||
|
session,
|
||||||
|
label: str,
|
||||||
|
) -> tuple[int, int]:
|
||||||
|
if label not in {
|
||||||
|
"Thesis",
|
||||||
|
"Work",
|
||||||
|
}:
|
||||||
|
raise ValueError(
|
||||||
|
f"Unsupported label: {label}"
|
||||||
|
)
|
||||||
|
|
||||||
|
record = session.run(
|
||||||
|
f"""
|
||||||
|
MATCH (n:{label})
|
||||||
|
WHERE n.graph_scope = $scope
|
||||||
|
RETURN
|
||||||
|
count(n) AS total,
|
||||||
|
count(n.title) AS with_title
|
||||||
|
""",
|
||||||
|
scope=GRAPH_SCOPE,
|
||||||
|
).single()
|
||||||
|
|
||||||
|
if record is None:
|
||||||
|
return 0, 0
|
||||||
|
|
||||||
|
return (
|
||||||
|
int(record["total"]),
|
||||||
|
int(record["with_title"]),
|
||||||
|
)
|
||||||
|
|
||||||
|
|
||||||
|
def print_payload_summary(
|
||||||
|
payload: dict[
|
||||||
|
str,
|
||||||
|
list[dict[str, Any]],
|
||||||
|
],
|
||||||
|
) -> None:
|
||||||
|
print()
|
||||||
|
print("Prepared GraphRAG payload")
|
||||||
|
print("=" * 60)
|
||||||
|
|
||||||
|
for key in (
|
||||||
|
"people",
|
||||||
|
"document_authors",
|
||||||
|
"documents",
|
||||||
|
"categories",
|
||||||
|
"topics",
|
||||||
|
"keywords",
|
||||||
|
"theses",
|
||||||
|
"works",
|
||||||
|
):
|
||||||
|
print(
|
||||||
|
f"{key:<24}"
|
||||||
|
f"{len(payload[key]):>6}"
|
||||||
|
)
|
||||||
|
|
||||||
|
print()
|
||||||
|
print("Relationships")
|
||||||
|
|
||||||
|
for key in (
|
||||||
|
"person_documents",
|
||||||
|
"document_author_documents",
|
||||||
|
"document_categories",
|
||||||
|
"document_keywords",
|
||||||
|
"document_describes_topics",
|
||||||
|
"person_theses",
|
||||||
|
"person_works",
|
||||||
|
"thesis_documents",
|
||||||
|
"work_documents",
|
||||||
|
):
|
||||||
|
print(
|
||||||
|
f"{key:<30}"
|
||||||
|
f"{len(payload[key]):>6}"
|
||||||
|
)
|
||||||
|
|
||||||
|
print("=" * 60)
|
||||||
|
|
||||||
|
|
||||||
|
def print_database_summary(
|
||||||
|
session,
|
||||||
|
) -> None:
|
||||||
|
nodes, relationships = (
|
||||||
|
graph_counts(
|
||||||
|
session
|
||||||
|
)
|
||||||
|
)
|
||||||
|
|
||||||
|
print()
|
||||||
|
print("Neo4j GraphRAG knowledge graph")
|
||||||
|
print("=" * 60)
|
||||||
|
|
||||||
|
print("Nodes")
|
||||||
|
|
||||||
|
for label, count in nodes:
|
||||||
|
print(
|
||||||
|
f" {label:<22}"
|
||||||
|
f"{count:>6}"
|
||||||
|
)
|
||||||
|
|
||||||
|
print()
|
||||||
|
print("Relationships")
|
||||||
|
|
||||||
|
for relationship, count in relationships:
|
||||||
|
print(
|
||||||
|
f" {relationship:<22}"
|
||||||
|
f"{count:>6}"
|
||||||
|
)
|
||||||
|
|
||||||
|
thesis_total, thesis_with_title = (
|
||||||
|
titled_entity_counts(
|
||||||
|
session,
|
||||||
|
"Thesis",
|
||||||
|
)
|
||||||
|
)
|
||||||
|
|
||||||
|
work_total, work_with_title = (
|
||||||
|
titled_entity_counts(
|
||||||
|
session,
|
||||||
|
"Work",
|
||||||
|
)
|
||||||
|
)
|
||||||
|
|
||||||
|
print()
|
||||||
|
print(
|
||||||
|
"Theses with extracted title: "
|
||||||
|
f"{thesis_with_title}/"
|
||||||
|
f"{thesis_total}"
|
||||||
|
)
|
||||||
|
|
||||||
|
print(
|
||||||
|
"Works with extracted title: "
|
||||||
|
f"{work_with_title}/"
|
||||||
|
f"{work_total}"
|
||||||
|
)
|
||||||
|
|
||||||
|
print("=" * 60)
|
||||||
|
|
||||||
|
|
||||||
|
def main() -> None:
|
||||||
|
parser = argparse.ArgumentParser()
|
||||||
|
|
||||||
|
parser.add_argument(
|
||||||
|
"--replace",
|
||||||
|
action=argparse.BooleanOptionalAction,
|
||||||
|
default=True,
|
||||||
|
)
|
||||||
|
|
||||||
|
args = parser.parse_args()
|
||||||
|
|
||||||
|
documents = load_json(
|
||||||
|
DOCUMENTS_FILE
|
||||||
|
)
|
||||||
|
|
||||||
|
chunks = load_json(
|
||||||
|
CHUNKS_FILE
|
||||||
|
)
|
||||||
|
|
||||||
|
payload = build_graph_payload(
|
||||||
|
documents,
|
||||||
|
chunks,
|
||||||
|
)
|
||||||
|
|
||||||
|
print_payload_summary(
|
||||||
|
payload
|
||||||
|
)
|
||||||
|
|
||||||
|
settings = get_neo4j_settings()
|
||||||
|
|
||||||
|
with create_neo4j_driver(
|
||||||
|
settings
|
||||||
|
) as driver:
|
||||||
|
driver.verify_connectivity()
|
||||||
|
|
||||||
|
with driver.session(
|
||||||
|
database=settings.database
|
||||||
|
) as session:
|
||||||
|
drop_legacy_constraints(
|
||||||
|
session
|
||||||
|
)
|
||||||
|
|
||||||
|
create_constraints(
|
||||||
|
session
|
||||||
|
)
|
||||||
|
|
||||||
|
if args.replace:
|
||||||
|
clear_managed_graph(
|
||||||
|
session
|
||||||
|
)
|
||||||
|
|
||||||
|
for key, query in (
|
||||||
|
NODE_QUERIES.items()
|
||||||
|
):
|
||||||
|
write_rows(
|
||||||
|
session,
|
||||||
|
query,
|
||||||
|
payload[key],
|
||||||
|
)
|
||||||
|
|
||||||
|
for key, query in (
|
||||||
|
RELATIONSHIP_QUERIES.items()
|
||||||
|
):
|
||||||
|
write_rows(
|
||||||
|
session,
|
||||||
|
query,
|
||||||
|
payload[key],
|
||||||
|
)
|
||||||
|
|
||||||
|
print_database_summary(
|
||||||
|
session
|
||||||
|
)
|
||||||
|
|
||||||
|
|
||||||
|
if __name__ == "__main__":
|
||||||
|
main()
|
||||||
62
tools/graphrag/evaluation/README.md
Normal file
62
tools/graphrag/evaluation/README.md
Normal file
@ -0,0 +1,62 @@
|
|||||||
|
# GraphRAG evaluácia
|
||||||
|
|
||||||
|
Aktuálny výsledok v1 a obmedzenia: [finálna správa](results/final_2026-10-24/REPORT.md).
|
||||||
|
Primárne skóre: DEV **209/286 (73,08 %)**, TEST **152/214 (71,03 %)**, bez runtime chýb.
|
||||||
|
|
||||||
|
Benchmark má 500 otázok (286 DEV, 214 TEST), schema v2. Statický audit pred finálnym TESTom odhalil 137 nesúladov očakávaní so zdrojmi. Všetky zostávajú zahrnuté v primárnom skóre. Doplnková podmnožina bez zistených nesúladov má DEV 209/209 a TEST 152/154; podrobnosti a dve zostávajúce zlyhania sú v správe.
|
||||||
|
|
||||||
|
## Reprodukcia zmrazenej evaluácie
|
||||||
|
|
||||||
|
Použi rovnaké `data/documents.json`, `data/chunks.json` a rovnaký obsah Neo4j. Odtlačky sú v `frozen_v1.json`; Git revízia wiki je vo výsledkovom JSON. Načítaj vlastné lokálne tajomstvá bez ich výpisu:
|
||||||
|
|
||||||
|
```bash
|
||||||
|
set -a
|
||||||
|
source .env
|
||||||
|
set +a
|
||||||
|
|
||||||
|
python -m tools.graphrag.evaluation.evaluate_graphrag \
|
||||||
|
--split test \
|
||||||
|
--audit tools/graphrag/evaluation/results/final_2026-10-24/source_audit.json \
|
||||||
|
--freeze-manifest tools/graphrag/evaluation/frozen_v1.json \
|
||||||
|
--output-dir /tmp/graphrag-v1-reproduction
|
||||||
|
```
|
||||||
|
|
||||||
|
TEST/all bez manifestu sa odmietne. Overuje sa kód, benchmark, vstupné JSON súbory, obsah grafu, audit aj parametre. Zmenený obsah, neúplný holdout alebo iné parametre beh zablokujú. Výsledky neregeneruj do adresára archivovaného finálneho behu.
|
||||||
|
|
||||||
|
## Nová vývojová verzia
|
||||||
|
|
||||||
|
Ďalší vývoj musí mať vlastné výsledky a nový manifest. Už vyhodnotený TEST nepoužívaj na dolaďovanie deklarované ako nový nezávislý experiment.
|
||||||
|
|
||||||
|
```bash
|
||||||
|
python -m tools.graphrag.evaluation.audit_benchmark \
|
||||||
|
--output /tmp/graphrag-next/source_audit.json
|
||||||
|
|
||||||
|
python -m tools.graphrag.evaluation.evaluate_graphrag \
|
||||||
|
--split dev \
|
||||||
|
--audit /tmp/graphrag-next/source_audit.json \
|
||||||
|
--output-dir /tmp/graphrag-next
|
||||||
|
|
||||||
|
python -m tools.graphrag.evaluation.freeze_graphrag \
|
||||||
|
--dev-results /tmp/graphrag-next/graphrag_dev.json \
|
||||||
|
--audit /tmp/graphrag-next/source_audit.json \
|
||||||
|
--output /tmp/graphrag-next/frozen.json
|
||||||
|
```
|
||||||
|
|
||||||
|
Zmrazenie vyžaduje kompletný DEV bez runtime chýb a súlad s aktuálnymi odtlačkami. Nevyžaduje predstieraných 100 % na chybne anotovanom datasete. Obsahový manifest platí aj pre zmeny, ktoré ešte nemajú commit; Git tag označuje publikovaný checkpoint.
|
||||||
|
|
||||||
|
## Metriky a dôkazy
|
||||||
|
|
||||||
|
Strict kontroluje očakávané hodnoty, typované entity, relácie, vlastnosti, zdrojové dokumenty a URL, presnú množinu pri definovaných prípadoch, správny počet pri agregácii a neorezaný výsledok. Samotné entity rozpoznané z otázky nie sú odpoveďou. `expected_paths` sú opisné anotácie a nehodnotia sa doslovným porovnaním reťazcov.
|
||||||
|
|
||||||
|
Výstup obsahuje JSON aj CSV, metriky podľa kategórie a obtiažnosti, priemer/medián/p95 latencie, čas behu, verziu Pythonu, Git revízie a obsahové odtlačky. Latencia je iba čas vyhľadávania v grafe.
|
||||||
|
|
||||||
|
## Testy
|
||||||
|
|
||||||
|
```bash
|
||||||
|
pytest -q
|
||||||
|
|
||||||
|
# Po načítaní Neo4j konfigurácie z .env:
|
||||||
|
RUN_NEO4J_TESTS=1 pytest -q tools/graphrag/tests/test_graph_search_neo4j.py
|
||||||
|
```
|
||||||
|
|
||||||
|
Neo4j testy používajú unikátny oddelený scope a rollback transakcie. Existujúce wiki dáta nemenia.
|
||||||
0
tools/graphrag/evaluation/__init__.py
Normal file
0
tools/graphrag/evaluation/__init__.py
Normal file
123
tools/graphrag/evaluation/audit_benchmark.py
Normal file
123
tools/graphrag/evaluation/audit_benchmark.py
Normal file
@ -0,0 +1,123 @@
|
|||||||
|
"""Check source consistency without changing questions or consulting search output."""
|
||||||
|
from __future__ import annotations
|
||||||
|
|
||||||
|
import argparse
|
||||||
|
import hashlib
|
||||||
|
import json
|
||||||
|
import re
|
||||||
|
from collections import Counter, defaultdict
|
||||||
|
from pathlib import Path
|
||||||
|
from typing import Any
|
||||||
|
|
||||||
|
from ..graphrag import build_graph_payload
|
||||||
|
from .graphrag_evaluator import normalize_text
|
||||||
|
from .reproducibility import content_fingerprints
|
||||||
|
|
||||||
|
ROOT = Path(__file__).resolve().parents[3]
|
||||||
|
|
||||||
|
|
||||||
|
def audit_questions(questions: list[dict], payload: dict) -> dict[str, Any]:
|
||||||
|
people = {normalize_text(row['name']): row for row in payload['people']}
|
||||||
|
documents = {row['path']: row for row in payload['documents']}
|
||||||
|
person_docs: dict[str, set[str]] = defaultdict(set)
|
||||||
|
for row in payload['person_documents']:
|
||||||
|
person_docs[row['person_id']].add(row['document_path'])
|
||||||
|
doc_keywords: dict[str, set[str]] = defaultdict(set)
|
||||||
|
for row in payload['document_keywords']:
|
||||||
|
doc_keywords[row['document_path']].add(row['keyword_id'])
|
||||||
|
keywords = {normalize_text(row['name']): row['id'] for row in payload['keywords']}
|
||||||
|
keywords.update({normalize_text(row['id']): row['id'] for row in payload['keywords']})
|
||||||
|
academic: dict[str, list[dict]] = defaultdict(list)
|
||||||
|
for row in payload['theses'] + payload['works']:
|
||||||
|
academic[row['source_document']].append(row)
|
||||||
|
rows = []
|
||||||
|
for question in questions:
|
||||||
|
graph = question['graph']
|
||||||
|
issues = []
|
||||||
|
starts = [people.get(normalize_text(item['value']))
|
||||||
|
for item in graph.get('start_entities', []) if item['type'] == 'person']
|
||||||
|
if any(person is None for person in starts):
|
||||||
|
issues.append('unknown_start_person')
|
||||||
|
starts = [person for person in starts if person]
|
||||||
|
expected = graph.get('expected_entities', [])
|
||||||
|
targets = [people.get(normalize_text(item['value'])) for item in expected if item['type'] == 'person']
|
||||||
|
targets = [person for person in targets if person] or starts
|
||||||
|
required_people = starts if question['category'] == 'shared_keyword_pair' else targets
|
||||||
|
for entity in expected:
|
||||||
|
if entity['type'] == 'keyword':
|
||||||
|
key = keywords.get(normalize_text(entity['value']))
|
||||||
|
if key is None:
|
||||||
|
issues.append('keyword_not_in_frontmatter_catalog')
|
||||||
|
elif any(not any(key in doc_keywords[path] for path in person_docs[person['id']])
|
||||||
|
for person in required_people):
|
||||||
|
issues.append('keyword_not_linked_to_expected_person')
|
||||||
|
elif entity['type'] in {'thesis_title', 'work_title'}:
|
||||||
|
records = payload['theses'] if entity['type'] == 'thesis_title' else payload['works']
|
||||||
|
paths = {person['source_document'] for person in starts}
|
||||||
|
if not any(row['source_document'] in paths
|
||||||
|
and normalize_text(row.get('title')) == normalize_text(entity['value'])
|
||||||
|
for row in records):
|
||||||
|
issues.append('title_not_supported_by_source')
|
||||||
|
category = question['category']
|
||||||
|
if category == 'person_multiple_categories' and starts:
|
||||||
|
actual = {normalize_text(cat) for path in person_docs[starts[0]['id']]
|
||||||
|
for cat in documents[path]['categories']}
|
||||||
|
expected_set = {normalize_text(value) for value in graph.get('expected_entity_set', [])}
|
||||||
|
if graph.get('entity_set_mode') == 'exact' and actual != expected_set:
|
||||||
|
issues.append('exact_categories_omit_or_add_source_categories')
|
||||||
|
years = {int(value) for value in re.findall(r'\b20\d{2}\b', question['question'])}
|
||||||
|
if category == 'same_academic_year_pair':
|
||||||
|
expected_years = {int(item['value']) for item in expected if item['type'] == 'year'}
|
||||||
|
if any(not expected_years <= {r['year'] for r in academic[p['source_document']]}
|
||||||
|
for p in starts):
|
||||||
|
issues.append('shared_year_not_supported_by_source')
|
||||||
|
if category == 'person_title_year':
|
||||||
|
expected_years = {int(item['value']) for item in expected if item['type'] == 'year'}
|
||||||
|
titles = {normalize_text(item['value']) for item in expected
|
||||||
|
if item['type'] in {'thesis_title', 'work_title'}}
|
||||||
|
if starts and not any(normalize_text(r.get('title')) in titles and r['year'] in expected_years
|
||||||
|
for p in starts for r in academic[p['source_document']]):
|
||||||
|
issues.append('title_year_pair_not_supported_by_source')
|
||||||
|
if category == 'candidate_set_aggregation':
|
||||||
|
actual = {normalize_text(p['name']) for p in starts
|
||||||
|
if any(r['year'] in years for r in academic[p['source_document']])}
|
||||||
|
expected_set = {normalize_text(value) for value in graph.get('expected_entity_set', [])}
|
||||||
|
if actual != expected_set or len(actual) != graph.get('expected_count'):
|
||||||
|
issues.append('candidate_set_or_count_not_supported_by_source')
|
||||||
|
for path in question.get('expected_documents', []):
|
||||||
|
if path not in documents:
|
||||||
|
issues.append('unknown_expected_document')
|
||||||
|
rows.append({'id': question['id'], 'split': question['split'],
|
||||||
|
'category': category, 'source_consistent': not issues,
|
||||||
|
'issues': sorted(set(issues))})
|
||||||
|
return {
|
||||||
|
'method': 'Static source checks; no retrieval output, question rewriting or alias invention.',
|
||||||
|
'questions': rows,
|
||||||
|
'by_split': {
|
||||||
|
split: {'questions': len(selected),
|
||||||
|
'source_consistent': sum(row['source_consistent'] for row in selected),
|
||||||
|
'issues': dict(Counter(issue for row in selected for issue in row['issues']))}
|
||||||
|
for split in ['dev', 'test']
|
||||||
|
for selected in [[row for row in rows if row['split'] == split]]
|
||||||
|
},
|
||||||
|
}
|
||||||
|
|
||||||
|
|
||||||
|
def main() -> None:
|
||||||
|
parser = argparse.ArgumentParser(description=__doc__)
|
||||||
|
parser.add_argument('--questions', type=Path, default=Path(__file__).parent / 'graphrag_questions.json')
|
||||||
|
parser.add_argument('--output', type=Path, required=True)
|
||||||
|
args = parser.parse_args()
|
||||||
|
questions = json.loads(args.questions.read_text())
|
||||||
|
payload = build_graph_payload(json.loads((ROOT / 'data/documents.json').read_text()),
|
||||||
|
json.loads((ROOT / 'data/chunks.json').read_text()))
|
||||||
|
audit = audit_questions(questions, payload)
|
||||||
|
audit['dataset_sha256'] = hashlib.sha256(args.questions.read_bytes()).hexdigest()
|
||||||
|
audit['inputs'] = content_fingerprints(args.questions)['inputs']
|
||||||
|
args.output.parent.mkdir(parents=True, exist_ok=True)
|
||||||
|
args.output.write_text(json.dumps(audit, ensure_ascii=False, indent=2) + '\n')
|
||||||
|
print(json.dumps(audit['by_split'], ensure_ascii=False, indent=2))
|
||||||
|
|
||||||
|
|
||||||
|
if __name__ == '__main__':
|
||||||
|
main()
|
||||||
517
tools/graphrag/evaluation/benchmark_v2.py
Normal file
517
tools/graphrag/evaluation/benchmark_v2.py
Normal file
@ -0,0 +1,517 @@
|
|||||||
|
"""Build a source-grounded schema-v3 regression set and profile-disjoint holdout.
|
||||||
|
|
||||||
|
This module never imports graph construction/search code and never reads any
|
||||||
|
retrieval output. Legacy cases remain development-only. New TEST subjects are
|
||||||
|
student profiles absent from every legacy start entity. TEST is generated once
|
||||||
|
from raw source facts, before the corrected implementation is evaluated.
|
||||||
|
"""
|
||||||
|
from __future__ import annotations
|
||||||
|
|
||||||
|
import argparse
|
||||||
|
import copy
|
||||||
|
import hashlib
|
||||||
|
import itertools
|
||||||
|
import json
|
||||||
|
import random
|
||||||
|
import re
|
||||||
|
from collections import Counter
|
||||||
|
from pathlib import Path
|
||||||
|
from typing import Any
|
||||||
|
|
||||||
|
from .source_oracle import ROOT, DEFAULT_WIKI, load_source_oracle, norm, supporting_documents
|
||||||
|
|
||||||
|
BASE = Path(__file__).resolve().parent
|
||||||
|
SEED = 20261024
|
||||||
|
|
||||||
|
|
||||||
|
def fingerprint(value: Any) -> str:
|
||||||
|
return hashlib.sha256(json.dumps(value, sort_keys=True, ensure_ascii=False, separators=(',', ':')).encode()).hexdigest()
|
||||||
|
|
||||||
|
|
||||||
|
def people_for(question: dict, oracle: dict) -> list[str]:
|
||||||
|
names = {norm(name): name for name in oracle['people']}
|
||||||
|
return [names[norm(item['value'])] for item in question['graph'].get('start_entities', [])
|
||||||
|
if item['type'] == 'person' and norm(item['value']) in names]
|
||||||
|
|
||||||
|
|
||||||
|
def academics(oracle: dict, person: str, *, title: str | None = None, year: int | None = None,
|
||||||
|
kind: str | None = None) -> list[dict]:
|
||||||
|
rows = oracle['people'][person]['academics']
|
||||||
|
return [row for row in rows if (title is None or norm(row['title']) == norm(title))
|
||||||
|
and (year is None or row['year'] == year) and (kind is None or row['academic_kind'] == kind)]
|
||||||
|
|
||||||
|
|
||||||
|
def has_tag(oracle: dict, person: str, keyword: str) -> bool:
|
||||||
|
return norm(keyword) in {norm(tag) for tag in oracle['people'][person]['tags']}
|
||||||
|
|
||||||
|
|
||||||
|
def academic_binding(person: str, record: dict, *, title: bool = False, keyword: str | None = None) -> dict:
|
||||||
|
binding = {'person': person, 'academic_kind': record['academic_kind'],
|
||||||
|
'academic_type': record['academic_type'], 'year': record['year']}
|
||||||
|
if title:
|
||||||
|
binding['title'] = record['title']
|
||||||
|
if keyword is not None:
|
||||||
|
binding['keyword'] = keyword
|
||||||
|
return {key: value for key, value in binding.items() if value is not None}
|
||||||
|
|
||||||
|
|
||||||
|
def path_patterns(bindings: list[dict]) -> list[dict]:
|
||||||
|
patterns = []
|
||||||
|
for index, binding in enumerate(bindings):
|
||||||
|
if any(key in binding for key in ['year', 'title', 'academic_kind', 'academic_type']):
|
||||||
|
kind = binding.get('academic_kind', 'Academic')
|
||||||
|
relation = 'AUTHORED' if kind == 'Thesis' else 'HAS_WORK' if kind == 'Work' else 'AUTHORED|HAS_WORK'
|
||||||
|
patterns.append({'binding_index': index, 'node_kinds': ['Person', kind, 'Document'],
|
||||||
|
'relationships': [relation, 'EVIDENCED_BY']})
|
||||||
|
for field, kind, relation in [('keyword', 'Keyword', 'HAS_KEYWORD'),
|
||||||
|
('category', 'Category', 'IN_CATEGORY'),
|
||||||
|
('document_author', 'DocumentAuthor', 'AUTHORED_DOCUMENT')]:
|
||||||
|
if field in binding:
|
||||||
|
patterns.append({'binding_index': index, 'node_kinds': ['Person', 'Document', kind],
|
||||||
|
'relationships': ['HAS_DOCUMENT', relation]})
|
||||||
|
return patterns
|
||||||
|
|
||||||
|
|
||||||
|
def binding_source_evidence(binding: dict, oracle: dict) -> list[dict]:
|
||||||
|
person = oracle['people'][binding['person']]
|
||||||
|
evidence = []
|
||||||
|
for field in ['keyword', 'category', 'document_author']:
|
||||||
|
if field not in binding:
|
||||||
|
continue
|
||||||
|
docs = supporting_documents(oracle, binding['person'], **{field: binding[field]})
|
||||||
|
if binding.get('document_path'):
|
||||||
|
docs = [p for p in docs if p == binding['document_path']]
|
||||||
|
for path in docs:
|
||||||
|
evidence.append({'document_path': path, 'sha256': oracle['documents'][path]['sha256'],
|
||||||
|
'field': {'keyword': 'taxonomy.tag', 'category': 'taxonomy.category',
|
||||||
|
'document_author': 'taxonomy.author'}[field], 'value': binding[field]})
|
||||||
|
if any(key in binding for key in ['year', 'title', 'academic_kind', 'academic_type']):
|
||||||
|
rows = academics(oracle, binding['person'], title=binding.get('title'), year=binding.get('year'),
|
||||||
|
kind=binding.get('academic_kind'))
|
||||||
|
for row in rows:
|
||||||
|
if binding.get('academic_type') and row['academic_type'] != binding['academic_type']:
|
||||||
|
continue
|
||||||
|
evidence.append({'document_path': row['document_path'],
|
||||||
|
'sha256': oracle['documents'][row['document_path']]['sha256'],
|
||||||
|
'field': 'academic_record', 'academic_kind': row['academic_kind'],
|
||||||
|
'academic_type': row['academic_type'], 'title': row['title'], 'year': row['year'],
|
||||||
|
'heading_line': row['heading_line'], 'title_line': row['title_line'],
|
||||||
|
'year_basis': row['year_basis']})
|
||||||
|
if 'start_year' in binding:
|
||||||
|
evidence.append({'document_path': person['profile'], 'sha256': oracle['documents'][person['profile']]['sha256'],
|
||||||
|
'field': 'start_year', 'value': binding['start_year']})
|
||||||
|
return evidence
|
||||||
|
|
||||||
|
|
||||||
|
def make_case(case_id: str, split: str, category: str, question: str, names: list[str], oracle: dict,
|
||||||
|
bindings: list[dict], *, no_answer: bool = False, reason: str | None = None,
|
||||||
|
expected_set: list[str] | None = None, set_field: str | None = None,
|
||||||
|
count: int | None = None, context_documents: list[str] | None = None,
|
||||||
|
negative_constraints: dict | None = None) -> dict:
|
||||||
|
known = [name for name in names if name in oracle['people']]
|
||||||
|
profiles = sorted({oracle['people'][name]['profile'] for name in known})
|
||||||
|
paths = set(context_documents or profiles)
|
||||||
|
evidence = [item for binding in bindings for item in binding_source_evidence(binding, oracle)]
|
||||||
|
# Multiple documents can independently prove the same tag/category. Gold
|
||||||
|
# sources are alternatives for each bound proof, not an obligation to cite
|
||||||
|
# every duplicate occurrence. Context profiles still cover all candidates.
|
||||||
|
evidence_choices = []
|
||||||
|
roles = {'taxonomy.tag': 'keyword_document', 'taxonomy.category': 'category_document',
|
||||||
|
'taxonomy.author': 'author_document', 'academic_record': 'academic_document',
|
||||||
|
'start_year': 'person_document'}
|
||||||
|
if not no_answer:
|
||||||
|
for index, binding in enumerate(bindings):
|
||||||
|
per_role: dict[str, set[str]] = {}
|
||||||
|
for item in binding_source_evidence(binding, oracle):
|
||||||
|
per_role.setdefault(roles[item['field']], set()).add(item['document_path'])
|
||||||
|
for role, alternatives in per_role.items():
|
||||||
|
evidence_choices.append({'binding_index': index, 'role': role, 'any_of': [
|
||||||
|
{'document_path': path, 'source_url': oracle['documents'][path]['source_url']}
|
||||||
|
for path in sorted(alternatives)]})
|
||||||
|
expected_values = []
|
||||||
|
expected_entities = []
|
||||||
|
if not no_answer:
|
||||||
|
for binding in bindings:
|
||||||
|
for field in ['person', 'keyword', 'category', 'document_author', 'title', 'year', 'start_year']:
|
||||||
|
if field in binding:
|
||||||
|
value = str(binding[field])
|
||||||
|
expected_values.append(value)
|
||||||
|
kind = ('thesis_title' if binding.get('academic_kind') == 'Thesis' else 'work_title') if field == 'title' else field
|
||||||
|
expected_entities.append({'type': kind, 'value': value})
|
||||||
|
if count is not None:
|
||||||
|
expected_values.append(str(count))
|
||||||
|
graph = {'schema_version': 3, 'task': category, 'start_entities': [{'type': 'person', 'value': name} for name in names],
|
||||||
|
'expected_bindings': bindings if not no_answer else [],
|
||||||
|
'expected_evidence_documents': evidence_choices,
|
||||||
|
'expected_path_patterns': path_patterns(bindings) if not no_answer else [],
|
||||||
|
'expected_no_answer': no_answer, 'expected_status': 'no_answer' if no_answer else 'ok',
|
||||||
|
'expected_entities': expected_entities, 'expected_relations': [], 'expected_properties': [],
|
||||||
|
'source_profiles': profiles}
|
||||||
|
if no_answer:
|
||||||
|
graph['no_answer_basis'] = reason or 'No source record satisfies every requested condition.'
|
||||||
|
graph['negative_constraints'] = negative_constraints or {}
|
||||||
|
# Closed-world negative: retain all original metadata considered, not a fabricated positive fact.
|
||||||
|
evidence = [{'document_path': path, 'sha256': oracle['documents'][path]['sha256'],
|
||||||
|
'field': 'closed_world_metadata', 'tags': oracle['documents'][path]['tags'],
|
||||||
|
'categories': oracle['documents'][path]['categories']}
|
||||||
|
for name in known for path in oracle['people'][name]['documents']]
|
||||||
|
if expected_set is not None:
|
||||||
|
graph.update(expected_entity_set=sorted(expected_set, key=norm), entity_set_mode='exact', entity_set_field=set_field or 'person')
|
||||||
|
if count is not None:
|
||||||
|
graph['expected_count'] = count
|
||||||
|
graph['partition_group'] = fingerprint({'category': category, 'people': sorted(names, key=norm),
|
||||||
|
'bindings': bindings, 'negative': no_answer,
|
||||||
|
'requested': question if no_answer else None})[:20]
|
||||||
|
return {'id': case_id, 'split': split, 'category': category, 'difficulty': 'hard', 'question': question,
|
||||||
|
'should_answer': not no_answer, 'expected_documents': sorted(paths),
|
||||||
|
'expected_source_urls': sorted(oracle['documents'][path]['source_url'] for path in paths),
|
||||||
|
'expected_answer_contains': list(dict.fromkeys(expected_values)), 'graph': graph,
|
||||||
|
'source_evidence': evidence, 'evidence_basis': ['independent_raw_markdown_oracle_v2']}
|
||||||
|
|
||||||
|
|
||||||
|
def correct_legacy(question: dict, oracle: dict) -> dict:
|
||||||
|
names = people_for(question, oracle); cat = question['category']; old = question['graph']
|
||||||
|
entities = old.get('expected_entities', [])
|
||||||
|
keyword = next((item['value'] for item in entities if item['type'] == 'keyword'), None)
|
||||||
|
years = [int(item['value']) for item in entities if item['type'] == 'year']
|
||||||
|
bindings = []; expected_set = None; set_field = None; count = None; reason = None
|
||||||
|
if cat == 'shared_keyword_pair':
|
||||||
|
if keyword and all(has_tag(oracle, name, keyword) for name in names):
|
||||||
|
bindings = [{'person': name, 'keyword': keyword} for name in names]
|
||||||
|
else:
|
||||||
|
reason = 'Requested shared keyword is absent from the raw frontmatter of at least one named person.'
|
||||||
|
elif cat == 'same_start_year_pair':
|
||||||
|
bindings = [{'person': name, 'start_year': oracle['people'][name]['start_year']} for name in names]
|
||||||
|
elif cat == 'same_academic_year_pair':
|
||||||
|
common = set.intersection(*[{row['year'] for row in academics(oracle, name) if row['year'] is not None} for name in names])
|
||||||
|
bindings = [{'person': name, 'year': year} for year in sorted(common) for name in names]
|
||||||
|
if not common:
|
||||||
|
reason = 'No shared academic year is stated in the original sources.'
|
||||||
|
elif cat in {'person_title_year', 'person_keyword_title'}:
|
||||||
|
titles = [item for item in entities if item['type'] in {'thesis_title', 'work_title'}]
|
||||||
|
for item in titles:
|
||||||
|
kind = 'Thesis' if item['type'] == 'thesis_title' else 'Work'
|
||||||
|
rows = academics(oracle, names[0], title=item['value'], kind=kind)
|
||||||
|
if not rows and norm(item['value']) in norm(oracle['documents'][oracle['people'][names[0]]['profile']]['raw_text']):
|
||||||
|
raise RuntimeError(f"Oracle extraction needs review for supported raw title: {question['id']}")
|
||||||
|
if years:
|
||||||
|
rows = [row for row in rows if row['year'] in years]
|
||||||
|
if cat == 'person_keyword_title' and not has_tag(oracle, names[0], keyword or ''):
|
||||||
|
reason = 'Requested keyword is not a raw frontmatter tag of this person.'
|
||||||
|
break
|
||||||
|
for row in rows:
|
||||||
|
binding = academic_binding(names[0], row, title=True, keyword=keyword if cat == 'person_keyword_title' else None)
|
||||||
|
if cat == 'person_keyword_title' and not years:
|
||||||
|
binding.pop('year', None)
|
||||||
|
bindings.append(binding)
|
||||||
|
if not bindings and not reason:
|
||||||
|
reason = 'Requested title/type/year combination is not independently supported by the source.'
|
||||||
|
elif cat == 'document_author_category_multi_hop':
|
||||||
|
category = next(item['value'] for item in entities if item['type'] == 'category')
|
||||||
|
for path in supporting_documents(oracle, names[0], category=category):
|
||||||
|
author = oracle['documents'][path]['author']
|
||||||
|
if author:
|
||||||
|
bindings.append({'person': names[0], 'category': category, 'document_author': author,
|
||||||
|
'document_path': path, 'same_document': True})
|
||||||
|
if not bindings:
|
||||||
|
reason = 'No same document supports both the category and metadata author.'
|
||||||
|
elif cat == 'person_multiple_categories':
|
||||||
|
expected_set = oracle['people'][names[0]]['categories']; set_field = 'category'
|
||||||
|
bindings = [{'person': names[0], 'category': category} for category in expected_set]
|
||||||
|
elif cat == 'candidate_set_aggregation':
|
||||||
|
query_years = [int(x) for x in re.findall(r'\b20\d{2}\b', question['question'])]
|
||||||
|
year = query_years[-1]
|
||||||
|
matches = [name for name in names if academics(oracle, name, year=year)]
|
||||||
|
bindings = [{'person': name, 'year': year} for name in matches]
|
||||||
|
expected_set = matches; set_field = 'person'; count = len(matches)
|
||||||
|
elif cat == 'conjunctive_disambiguation':
|
||||||
|
year = years[0]
|
||||||
|
matches = [name for name in names if has_tag(oracle, name, keyword) and academics(oracle, name, year=year)]
|
||||||
|
bindings = [{'person': name, 'keyword': keyword, 'year': year} for name in matches]
|
||||||
|
if not matches:
|
||||||
|
reason = 'No named person satisfies both raw frontmatter keyword and academic year.'
|
||||||
|
else:
|
||||||
|
raise ValueError(f'Unsupported legacy category: {cat}')
|
||||||
|
case = make_case(question['id'], 'dev', cat, question['question'], names, oracle, bindings,
|
||||||
|
no_answer=reason is not None, reason=reason, expected_set=expected_set,
|
||||||
|
set_field=set_field, count=count,
|
||||||
|
negative_constraints=({'keyword': keyword, 'require_all_people': True} if cat == 'shared_keyword_pair'
|
||||||
|
else {'keyword': keyword} if cat == 'person_keyword_title'
|
||||||
|
else {'keyword': keyword, 'year': years[0]} if cat == 'conjunctive_disambiguation'
|
||||||
|
else {'shared_academic_year': True} if cat == 'same_academic_year_pair'
|
||||||
|
else {}))
|
||||||
|
case['legacy_split'] = question['split']
|
||||||
|
case['legacy_role'] = 'previously_seen_regression_only'
|
||||||
|
return case
|
||||||
|
|
||||||
|
|
||||||
|
def independent_pool(oracle: dict, names: list[str]) -> dict[str, list[dict]]:
|
||||||
|
pool: dict[str, list[dict]] = {category: [] for category in [
|
||||||
|
'shared_keyword_pair', 'same_academic_year_pair', 'same_start_year_pair', 'person_title_year',
|
||||||
|
'person_keyword_title', 'document_author_category_multi_hop', 'person_multiple_categories',
|
||||||
|
'candidate_set_aggregation', 'conjunctive_disambiguation']}
|
||||||
|
def add(category: str, text: str, people: list[str], bindings: list[dict], **kwargs):
|
||||||
|
pool[category].append(make_case('', 'test', category, text, people, oracle, bindings, **kwargs))
|
||||||
|
for left, right in itertools.combinations(names, 2):
|
||||||
|
common_tags = sorted({norm(tag): tag for tag in oracle['people'][left]['tags']
|
||||||
|
if has_tag(oracle, right, tag)}.values(), key=norm)
|
||||||
|
for tag in common_tags:
|
||||||
|
add('shared_keyword_pair', f'Over spoločné kľúčové slovo {tag} pri osobách {left} a {right}.',
|
||||||
|
[left, right], [{'person': name, 'keyword': tag} for name in [left, right]])
|
||||||
|
shared_years = {row['year'] for row in academics(oracle, left)} & {row['year'] for row in academics(oracle, right)} - {None}
|
||||||
|
# A query for an unspecified shared year expects all supported intersections.
|
||||||
|
if shared_years:
|
||||||
|
add('same_academic_year_pair', f'Aké spoločné roky práce spájajú osoby {left} a {right}?',
|
||||||
|
[left, right], [{'person': name, 'year': year} for year in sorted(shared_years) for name in [left, right]])
|
||||||
|
start_l, start_r = oracle['people'][left]['start_year'], oracle['people'][right]['start_year']
|
||||||
|
if start_l is not None and start_l == start_r:
|
||||||
|
add('same_start_year_pair', f'Porovnaj rovnaký rok začiatku štúdia osôb {left} a {right}.',
|
||||||
|
[left, right], [{'person': name, 'start_year': start_l} for name in [left, right]])
|
||||||
|
for name in names:
|
||||||
|
person = oracle['people'][name]
|
||||||
|
if person['categories']:
|
||||||
|
add('person_multiple_categories', f'Vypíš všetky kategórie dokumentov osoby {name}.', [name],
|
||||||
|
[{'person': name, 'category': cat} for cat in person['categories']],
|
||||||
|
expected_set=person['categories'], set_field='category')
|
||||||
|
for category in person['categories']:
|
||||||
|
for path in supporting_documents(oracle, name, category=category):
|
||||||
|
author = oracle['documents'][path]['author']
|
||||||
|
if author:
|
||||||
|
add('document_author_category_multi_hop',
|
||||||
|
f'Kto je autor dokumentu osoby {name}, ktorý patrí do kategórie {category}?', [name],
|
||||||
|
[{'person': name, 'category': category, 'document_author': author,
|
||||||
|
'document_path': path, 'same_document': True}])
|
||||||
|
# Title-year cases use only explicit, nonconflicting title records.
|
||||||
|
for record in person['academics']:
|
||||||
|
if not record['title'] or record['year'] is None or record in person['year_conflicts']:
|
||||||
|
continue
|
||||||
|
year = record['year']
|
||||||
|
kind_label = 'diplomového projektu' if record['academic_type'] == 'diploma_project' else 'práce'
|
||||||
|
add('person_title_year', f'Aký názov {kind_label} a rok práce sú pri osobe {name} uvedené pre rok {year}?',
|
||||||
|
[name], [academic_binding(name, record, title=True)])
|
||||||
|
for tag in person['tags']:
|
||||||
|
binding = academic_binding(name, record, title=True, keyword=tag)
|
||||||
|
# Pin the academic year in the question as the independent source can contain several titles.
|
||||||
|
add('person_keyword_title', f'Aký názov práce osoby {name} v roku {year} súvisí s kľúčovým slovom {tag}?',
|
||||||
|
[name], [binding])
|
||||||
|
# Candidate groups are source-derived; the query mentions every candidate.
|
||||||
|
for year in sorted({row['year'] for name in names for row in academics(oracle, name) if row['year'] is not None}):
|
||||||
|
matching = [name for name in names if academics(oracle, name, year=year)]
|
||||||
|
other = [name for name in names if name not in matching]
|
||||||
|
for selected in itertools.islice(itertools.combinations(matching, 2), 12):
|
||||||
|
if other:
|
||||||
|
candidates = list(selected) + [other[0]]
|
||||||
|
add('candidate_set_aggregation',
|
||||||
|
f'Z kandidátov {", ".join(candidates)} vyber osoby s prácou v roku {year}. Koľko ich je?',
|
||||||
|
candidates, [{'person': name, 'year': year} for name in selected],
|
||||||
|
expected_set=list(selected), set_field='person', count=len(selected))
|
||||||
|
for name in names:
|
||||||
|
person = oracle['people'][name]
|
||||||
|
for year in sorted({record['year'] for record in person['academics'] if record['year'] is not None}):
|
||||||
|
for tag in person['tags']:
|
||||||
|
distractors = [other for other in names if other != name
|
||||||
|
and (has_tag(oracle, other, tag) != bool(academics(oracle, other, year=year)))]
|
||||||
|
for other in distractors[:2]:
|
||||||
|
candidates = [name, other]
|
||||||
|
add('conjunctive_disambiguation',
|
||||||
|
f'Ktorá z osôb {name} a {other} má kľúčové slovo {tag} a jej práca je z roku {year}?',
|
||||||
|
candidates, [{'person': name, 'keyword': tag, 'year': year}])
|
||||||
|
return pool
|
||||||
|
|
||||||
|
|
||||||
|
def necessary_negatives(oracle: dict, names: list[str], split: str) -> list[dict]:
|
||||||
|
cases = []
|
||||||
|
prefix = 'dev' if split == 'dev' else 'holdout'
|
||||||
|
for i, name in enumerate(names[:4]):
|
||||||
|
tag = next(iter(oracle['people'][name]['tags']), 'nlp')
|
||||||
|
cases.append(make_case(f'{prefix}-negative-year-{i}', split, 'negative_lookup',
|
||||||
|
f'Aký názov práce má osoba {name}, ak jej práca je z roku 2099 a jej dokument obsahuje kľúčové slovo {tag}?',
|
||||||
|
[name], oracle, [], no_answer=True, reason='No source academic record has year 2099.',
|
||||||
|
negative_constraints={'year': 2099, 'keyword': tag}))
|
||||||
|
for i, name in enumerate(names[4:6]):
|
||||||
|
cases.append(make_case(f'{prefix}-negative-tag-{i}', split, 'negative_lookup',
|
||||||
|
f'Aký názov práce má osoba {name}, ak jej dokument obsahuje kľúčové slovo neexistujucitagvzor?',
|
||||||
|
[name], oracle, [], no_answer=True, reason='Requested tag absent from complete raw frontmatter catalog.',
|
||||||
|
negative_constraints={'keyword': 'neexistujucitagvzor'}))
|
||||||
|
for i, unknown in enumerate(['Zuzana Neexistujúca Vzorová', 'Roman Neskutočný Testovací'] if split == 'dev'
|
||||||
|
else ['Tibor Neexistujúci Skúšobný', 'Lenka Neskutočná Vzorová']):
|
||||||
|
cases.append(make_case(f'{prefix}-negative-person-{i}', split, 'negative_lookup',
|
||||||
|
f'Aký názov diplomovej práce má osoba {unknown}?', [unknown], oracle, [],
|
||||||
|
no_answer=True, reason='Explicit full name absent from all raw profile frontmatter titles.',
|
||||||
|
negative_constraints={'unknown_person': unknown}))
|
||||||
|
candidates = names[:3]
|
||||||
|
cases.append(make_case(f'{prefix}-zero-count', split, 'candidate_set_aggregation',
|
||||||
|
f'Z kandidátov {", ".join(candidates)} vyber osoby s prácou v roku 2099. Koľko ich je?',
|
||||||
|
candidates, oracle, [], expected_set=[], set_field='person', count=0))
|
||||||
|
return cases
|
||||||
|
|
||||||
|
|
||||||
|
def validate_case(case: dict, oracle: dict) -> list[str]:
|
||||||
|
issues = []
|
||||||
|
graph = case['graph']
|
||||||
|
names = people_for(case, oracle)
|
||||||
|
if set(graph.get('source_profiles', [])) != {oracle['people'][name]['profile'] for name in names}:
|
||||||
|
issues.append('incorrect_source_profile_partition')
|
||||||
|
for binding in graph.get('expected_bindings', []):
|
||||||
|
person = binding['person']
|
||||||
|
if person not in oracle['people']:
|
||||||
|
issues.append('unknown_bound_person'); continue
|
||||||
|
if 'start_year' in binding and oracle['people'][person]['start_year'] != binding['start_year']:
|
||||||
|
issues.append('wrong_start_year')
|
||||||
|
metadata = {key: binding[key] for key in ['keyword', 'category', 'document_author'] if key in binding}
|
||||||
|
if binding.get('same_document') and not supporting_documents(oracle, person, **metadata):
|
||||||
|
issues.append('metadata_not_connected_in_same_document')
|
||||||
|
for key, value in metadata.items():
|
||||||
|
if not supporting_documents(oracle, person, **{key: value}):
|
||||||
|
issues.append('unsupported_' + key)
|
||||||
|
if any(key in binding for key in ['title', 'year', 'academic_type', 'academic_kind']):
|
||||||
|
records = academics(oracle, person, title=binding.get('title'), year=binding.get('year'), kind=binding.get('academic_kind'))
|
||||||
|
if binding.get('academic_type'):
|
||||||
|
records = [r for r in records if r['academic_type'] == binding['academic_type']]
|
||||||
|
if not records:
|
||||||
|
issues.append('unsupported_academic_binding')
|
||||||
|
if graph.get('expected_no_answer'):
|
||||||
|
if graph.get('expected_bindings') or case.get('expected_answer_contains') or graph.get('expected_entities'):
|
||||||
|
issues.append('negative_contains_positive_expectations')
|
||||||
|
constraints = graph.get('negative_constraints', {})
|
||||||
|
names = people_for(case, oracle)
|
||||||
|
if constraints.get('unknown_person'):
|
||||||
|
if norm(constraints['unknown_person']) in {norm(name) for name in oracle['people']}:
|
||||||
|
issues.append('negative_person_actually_exists')
|
||||||
|
elif constraints.get('shared_academic_year'):
|
||||||
|
year_sets = [{r['year'] for r in academics(oracle, name) if r['year'] is not None} for name in names]
|
||||||
|
if year_sets and set.intersection(*year_sets):
|
||||||
|
issues.append('negative_shared_year_actually_exists')
|
||||||
|
elif constraints.get('require_all_people'):
|
||||||
|
if not names or all(has_tag(oracle, name, constraints.get('keyword', '')) for name in names):
|
||||||
|
issues.append('negative_shared_keyword_actually_exists')
|
||||||
|
elif constraints:
|
||||||
|
matching = []
|
||||||
|
for name in names:
|
||||||
|
valid = not constraints.get('keyword') or has_tag(oracle, name, constraints['keyword'])
|
||||||
|
if any(key in constraints for key in ['year', 'title', 'academic_kind']):
|
||||||
|
valid = valid and bool(academics(oracle, name, year=constraints.get('year'),
|
||||||
|
title=constraints.get('title'), kind=constraints.get('academic_kind')))
|
||||||
|
if valid:
|
||||||
|
matching.append(name)
|
||||||
|
if matching:
|
||||||
|
issues.append('negative_conjunction_actually_satisfied')
|
||||||
|
else:
|
||||||
|
issues.append('negative_without_machine_verifiable_false_premise')
|
||||||
|
if graph.get('expected_entity_set') is not None and graph.get('entity_set_field') == 'category':
|
||||||
|
names = people_for(case, oracle)
|
||||||
|
if names and set(graph['expected_entity_set']) != set(oracle['people'][names[0]]['categories']):
|
||||||
|
issues.append('incomplete_category_set')
|
||||||
|
if graph.get('expected_count') is not None:
|
||||||
|
years = re.findall(r'\b20\d{2}\b', case['question'])
|
||||||
|
if not years:
|
||||||
|
issues.append('count_without_supported_year_constraint')
|
||||||
|
else:
|
||||||
|
matches = {name for name in names if academics(oracle, name, year=int(years[-1]))}
|
||||||
|
if matches != set(graph.get('expected_entity_set', [])) or len(matches) != graph['expected_count']:
|
||||||
|
issues.append('incorrect_candidate_set_or_count')
|
||||||
|
return sorted(set(issues))
|
||||||
|
|
||||||
|
|
||||||
|
def audit_dataset(questions: list[dict], oracle: dict, dataset_path: Path) -> dict:
|
||||||
|
rows = [{'id': question['id'], 'split': question['split'], 'source_consistent': not (issues := validate_case(question, oracle)),
|
||||||
|
'issues': issues, 'category': question['category']} for question in questions]
|
||||||
|
inputs = {name: hashlib.sha256((ROOT / name).read_bytes()).hexdigest() for name in ['data/documents.json', 'data/chunks.json']}
|
||||||
|
return {'method': 'Independent original Markdown frontmatter/heading/title oracle; no graph parser, chunks or retrieval results used for labels.',
|
||||||
|
'dataset_sha256': hashlib.sha256(dataset_path.read_bytes()).hexdigest(),
|
||||||
|
'inputs': inputs, 'source_corpus': oracle['source_corpus'], 'questions': rows,
|
||||||
|
'by_split': {split: {'questions': len(selected), 'source_consistent': sum(row['source_consistent'] for row in selected),
|
||||||
|
'issues': dict(Counter(issue for row in selected for issue in row['issues']))}
|
||||||
|
for split in ['dev', 'test'] for selected in [[row for row in rows if row['split'] == split]]}}
|
||||||
|
|
||||||
|
|
||||||
|
def write_json(path: Path, value: Any) -> None:
|
||||||
|
path.parent.mkdir(parents=True, exist_ok=True)
|
||||||
|
path.write_text(json.dumps(value, ensure_ascii=False, indent=2) + '\n')
|
||||||
|
|
||||||
|
|
||||||
|
def main() -> None:
|
||||||
|
parser = argparse.ArgumentParser(description=__doc__)
|
||||||
|
parser.add_argument('--wiki-root', type=Path, default=DEFAULT_WIKI)
|
||||||
|
parser.add_argument('--legacy', type=Path, default=BASE / 'graphrag_questions.json')
|
||||||
|
parser.add_argument('--output', type=Path, default=BASE / 'graphrag_questions_v2.json')
|
||||||
|
parser.add_argument('--artifacts', type=Path, default=BASE / 'results/v2_preparation')
|
||||||
|
args = parser.parse_args()
|
||||||
|
oracle = load_source_oracle(args.wiki_root)
|
||||||
|
legacy = json.loads(args.legacy.read_text())
|
||||||
|
corrected = [correct_legacy(question, oracle) for question in legacy]
|
||||||
|
legacy_names = {name for question in legacy for name in people_for(question, oracle)}
|
||||||
|
exposed_path = BASE / 'results/final_2026-10-24/holdout_failures.json'
|
||||||
|
previously_exposed = set()
|
||||||
|
if exposed_path.exists():
|
||||||
|
for row in json.loads(exposed_path.read_text()).get('questions', []):
|
||||||
|
previously_exposed.update(set(row.get('actual_documents', [])) - set(row.get('expected_documents', [])))
|
||||||
|
reserved_names = sorted([name for name, person in oracle['people'].items()
|
||||||
|
if name not in legacy_names and person['profile'] not in previously_exposed
|
||||||
|
and person['profile'].startswith('pages/students/')], key=norm)
|
||||||
|
dev_negatives = necessary_negatives(oracle, sorted(legacy_names, key=norm), 'dev')
|
||||||
|
test_pool = independent_pool(oracle, reserved_names)
|
||||||
|
rng = random.Random(SEED)
|
||||||
|
holdout = []
|
||||||
|
for category, cases in test_pool.items():
|
||||||
|
unique = {case['graph']['partition_group']: case for case in cases}
|
||||||
|
candidates = list(unique.values()); rng.shuffle(candidates)
|
||||||
|
if len(candidates) < 8:
|
||||||
|
raise RuntimeError(f'Insufficient independent source cases for {category}: {len(candidates)}')
|
||||||
|
for case in candidates[:8]:
|
||||||
|
case['id'] = f'h{len(holdout)+1:04d}'
|
||||||
|
holdout.append(case)
|
||||||
|
negative_cases = necessary_negatives(oracle, reserved_names, 'test')
|
||||||
|
# A zero-result count is an answerable numeric result, not a no-answer.
|
||||||
|
zero_count = negative_cases.pop()
|
||||||
|
count_index = next(i for i, case in enumerate(holdout) if case['category'] == 'candidate_set_aggregation')
|
||||||
|
zero_count['id'] = holdout[count_index]['id']
|
||||||
|
holdout[count_index] = zero_count
|
||||||
|
holdout.extend(negative_cases)
|
||||||
|
dev = corrected + dev_negatives
|
||||||
|
questions = dev + holdout
|
||||||
|
all_issues = {case['id']: validate_case(case, oracle) for case in questions if validate_case(case, oracle)}
|
||||||
|
if all_issues:
|
||||||
|
raise RuntimeError(f'Source consistency issues: {all_issues}')
|
||||||
|
dev_profiles = {p for case in dev for p in case['graph']['source_profiles']}
|
||||||
|
test_profiles = {p for case in holdout for p in case['graph']['source_profiles']}
|
||||||
|
assert not dev_profiles & test_profiles
|
||||||
|
assert not ({case['graph']['partition_group'] for case in dev} & {case['graph']['partition_group'] for case in holdout})
|
||||||
|
write_json(args.output, questions)
|
||||||
|
corrections = []
|
||||||
|
old_audit_path = BASE / 'results/final_2026-10-24/source_audit.json'
|
||||||
|
old_issues = {row['id']: row['issues'] for row in json.loads(old_audit_path.read_text())['questions'] if row['issues']}
|
||||||
|
for old, new in zip(legacy, corrected):
|
||||||
|
corrections.append({'id': old['id'], 'legacy_split': old['split'], 'new_split': 'dev',
|
||||||
|
'v1_source_audit_issues': old_issues.get(old['id'], []),
|
||||||
|
'old_should_answer': old.get('should_answer', True), 'new_should_answer': new['should_answer'],
|
||||||
|
'old_expected_values': old['expected_answer_contains'], 'new_expected_values': new['expected_answer_contains'],
|
||||||
|
'new_expected_bindings': new['graph']['expected_bindings'],
|
||||||
|
'no_answer_basis': new['graph'].get('no_answer_basis'),
|
||||||
|
'source_evidence': new['source_evidence']})
|
||||||
|
write_json(args.artifacts / 'legacy_corrections.json', {'legacy_count': len(legacy), 'v1_flagged_count': len(old_issues),
|
||||||
|
'resolved_v1_flagged_count': sum(not validate_case(new, oracle) for new in corrected if new['id'] in old_issues),
|
||||||
|
'negative_count': sum(not case['should_answer'] for case in corrected), 'questions': corrections})
|
||||||
|
write_json(args.artifacts / 'source_audit.json', audit_dataset(questions, oracle, args.output))
|
||||||
|
partition = {'seed': SEED, 'strategy': 'All previously seen 500 cases are DEV regression. TEST profiles never appeared in legacy start_entities; all real candidate profiles are disjoint.',
|
||||||
|
'dev_count': len(dev), 'test_count': len(holdout), 'previously_exposed_profiles_excluded_from_test': sorted(previously_exposed),
|
||||||
|
'dev_profiles': sorted(dev_profiles), 'test_profiles': sorted(test_profiles),
|
||||||
|
'dev_groups': sorted({case['graph']['partition_group'] for case in dev}),
|
||||||
|
'test_groups': sorted({case['graph']['partition_group'] for case in holdout}),
|
||||||
|
'dev_categories': dict(Counter(case['category'] for case in dev)),
|
||||||
|
'test_categories': dict(Counter(case['category'] for case in holdout)),
|
||||||
|
'source_corpus': oracle['source_corpus'],
|
||||||
|
'dataset_sha256': hashlib.sha256(args.output.read_bytes()).hexdigest(),
|
||||||
|
'limitations': ['Same source corpus and shared tag/category/author vocabulary.',
|
||||||
|
'Template families are known; TEST persons and their fact groups are withheld.',
|
||||||
|
'Oracle is independent of graph extraction but still rule-based; provenance permits human review.']}
|
||||||
|
write_json(args.artifacts / 'partition.json', partition)
|
||||||
|
print(json.dumps({'dataset': str(args.output), 'dev': len(dev), 'test': len(holdout),
|
||||||
|
'reserved_profile_count': len(test_profiles), 'source_issues': 0,
|
||||||
|
'corrected_legacy_negatives': sum(not q['should_answer'] for q in corrected),
|
||||||
|
'resolved_original_issues': len(old_issues),
|
||||||
|
'test_categories': partition['test_categories']}, ensure_ascii=False, indent=2))
|
||||||
|
|
||||||
|
|
||||||
|
if __name__ == '__main__':
|
||||||
|
main()
|
||||||
674
tools/graphrag/evaluation/evaluate_graphrag.py
Normal file
674
tools/graphrag/evaluation/evaluate_graphrag.py
Normal file
@ -0,0 +1,674 @@
|
|||||||
|
from __future__ import annotations
|
||||||
|
|
||||||
|
import argparse
|
||||||
|
import csv
|
||||||
|
import json
|
||||||
|
import time
|
||||||
|
from datetime import datetime, timezone
|
||||||
|
from pathlib import Path
|
||||||
|
from typing import Any
|
||||||
|
|
||||||
|
from ..graph_db import (
|
||||||
|
create_neo4j_driver,
|
||||||
|
get_neo4j_settings,
|
||||||
|
)
|
||||||
|
from ..graph_search import (
|
||||||
|
DEFAULT_LIMIT,
|
||||||
|
DEFAULT_MAX_ENTITIES,
|
||||||
|
search_graph_with_session,
|
||||||
|
)
|
||||||
|
from .graphrag_evaluator import (
|
||||||
|
aggregate_by_field,
|
||||||
|
aggregate_rows,
|
||||||
|
evaluate_result,
|
||||||
|
filter_questions,
|
||||||
|
load_questions,
|
||||||
|
)
|
||||||
|
from .reproducibility import graph_fingerprint, run_metadata, sha256_file, verify_freeze
|
||||||
|
|
||||||
|
|
||||||
|
EVALUATION_DIR = Path(
|
||||||
|
__file__
|
||||||
|
).resolve().parent
|
||||||
|
|
||||||
|
QUESTIONS_PATH = (
|
||||||
|
EVALUATION_DIR
|
||||||
|
/ "graphrag_questions_v2.json"
|
||||||
|
)
|
||||||
|
|
||||||
|
RESULTS_DIR = (
|
||||||
|
EVALUATION_DIR
|
||||||
|
/ "results"
|
||||||
|
)
|
||||||
|
|
||||||
|
|
||||||
|
def parse_args() -> argparse.Namespace:
|
||||||
|
parser = argparse.ArgumentParser(
|
||||||
|
description=(
|
||||||
|
"Vyhodnotenie GraphRAG vyhľadávania "
|
||||||
|
"proti graphrag_questions.json."
|
||||||
|
)
|
||||||
|
)
|
||||||
|
|
||||||
|
parser.add_argument(
|
||||||
|
"--questions",
|
||||||
|
type=Path,
|
||||||
|
default=QUESTIONS_PATH,
|
||||||
|
)
|
||||||
|
|
||||||
|
parser.add_argument(
|
||||||
|
"--output-dir",
|
||||||
|
type=Path,
|
||||||
|
default=RESULTS_DIR / 'development_v2',
|
||||||
|
)
|
||||||
|
|
||||||
|
parser.add_argument(
|
||||||
|
"--split",
|
||||||
|
choices=(
|
||||||
|
"dev",
|
||||||
|
"test",
|
||||||
|
"all",
|
||||||
|
),
|
||||||
|
default="dev",
|
||||||
|
help=(
|
||||||
|
"Predvolene sa vyhodnocuje iba DEV. "
|
||||||
|
"TEST používaj až po zmrazení GraphRAG."
|
||||||
|
),
|
||||||
|
)
|
||||||
|
|
||||||
|
parser.add_argument(
|
||||||
|
"--limit",
|
||||||
|
type=int,
|
||||||
|
default=DEFAULT_LIMIT,
|
||||||
|
)
|
||||||
|
|
||||||
|
parser.add_argument(
|
||||||
|
"--max-entities",
|
||||||
|
type=int,
|
||||||
|
default=DEFAULT_MAX_ENTITIES,
|
||||||
|
)
|
||||||
|
|
||||||
|
parser.add_argument(
|
||||||
|
"--ids",
|
||||||
|
type=str,
|
||||||
|
default="",
|
||||||
|
help=(
|
||||||
|
"Voliteľný zoznam ID oddelených čiarkou."
|
||||||
|
),
|
||||||
|
)
|
||||||
|
|
||||||
|
parser.add_argument(
|
||||||
|
"--max-questions",
|
||||||
|
type=int,
|
||||||
|
default=None,
|
||||||
|
help=(
|
||||||
|
"Voliteľne vyhodnotí iba prvých N "
|
||||||
|
"otázok z vybraného splitu."
|
||||||
|
),
|
||||||
|
)
|
||||||
|
|
||||||
|
parser.add_argument('--audit', type=Path, help='Predeclared source-consistency audit.')
|
||||||
|
parser.add_argument('--freeze-manifest', type=Path,
|
||||||
|
help='Required for TEST/all; verifies code, data, graph and parameters.')
|
||||||
|
parser.add_argument('--overwrite', action='store_true',
|
||||||
|
help='Replace a previous DEV output; frozen TEST outputs are immutable.')
|
||||||
|
args = parser.parse_args()
|
||||||
|
if args.split in {'test', 'all'} and args.freeze_manifest is None:
|
||||||
|
parser.error('TEST/all requires --freeze-manifest after complete DEV evaluation.')
|
||||||
|
if args.split in {'test', 'all'} and (args.ids or args.max_questions):
|
||||||
|
parser.error('Frozen holdout evaluation must cover the complete selected split.')
|
||||||
|
if args.split in {'test', 'all'} and args.overwrite:
|
||||||
|
parser.error('Use a fresh output directory to reproduce a frozen holdout.')
|
||||||
|
|
||||||
|
if args.limit < 1:
|
||||||
|
parser.error(
|
||||||
|
"--limit musí byť aspoň 1."
|
||||||
|
)
|
||||||
|
|
||||||
|
if args.max_entities < 1:
|
||||||
|
parser.error(
|
||||||
|
"--max-entities musí byť aspoň 1."
|
||||||
|
)
|
||||||
|
|
||||||
|
if (
|
||||||
|
args.max_questions
|
||||||
|
is not None
|
||||||
|
and args.max_questions < 1
|
||||||
|
):
|
||||||
|
parser.error(
|
||||||
|
"--max-questions musí byť aspoň 1."
|
||||||
|
)
|
||||||
|
|
||||||
|
return args
|
||||||
|
|
||||||
|
|
||||||
|
def save_json(
|
||||||
|
path: Path,
|
||||||
|
payload: dict[str, Any],
|
||||||
|
) -> None:
|
||||||
|
path.parent.mkdir(
|
||||||
|
parents=True,
|
||||||
|
exist_ok=True,
|
||||||
|
)
|
||||||
|
|
||||||
|
path.write_text(
|
||||||
|
json.dumps(
|
||||||
|
payload,
|
||||||
|
ensure_ascii=False,
|
||||||
|
indent=2,
|
||||||
|
)
|
||||||
|
+ "\n",
|
||||||
|
encoding="utf-8",
|
||||||
|
)
|
||||||
|
|
||||||
|
|
||||||
|
def save_csv(
|
||||||
|
path: Path,
|
||||||
|
rows: list[
|
||||||
|
dict[str, Any]
|
||||||
|
],
|
||||||
|
) -> None:
|
||||||
|
path.parent.mkdir(
|
||||||
|
parents=True,
|
||||||
|
exist_ok=True,
|
||||||
|
)
|
||||||
|
|
||||||
|
fieldnames = [
|
||||||
|
"complete",
|
||||||
|
"answerability_ok",
|
||||||
|
"bindings_ok",
|
||||||
|
"binding_score",
|
||||||
|
"paths_ok",
|
||||||
|
"path_score",
|
||||||
|
"count_ok",
|
||||||
|
"expected_count",
|
||||||
|
"actual_count",
|
||||||
|
"id",
|
||||||
|
"split",
|
||||||
|
"category",
|
||||||
|
"difficulty",
|
||||||
|
"strict",
|
||||||
|
"value_score",
|
||||||
|
"entity_score",
|
||||||
|
"relation_score",
|
||||||
|
"property_score",
|
||||||
|
"relation_choice_score",
|
||||||
|
"document_recall",
|
||||||
|
"source_recall",
|
||||||
|
"entity_set_ok",
|
||||||
|
"latency_seconds",
|
||||||
|
"error",
|
||||||
|
"question",
|
||||||
|
"expected_values",
|
||||||
|
"matched_values",
|
||||||
|
"expected_relations",
|
||||||
|
"actual_relations",
|
||||||
|
"expected_documents",
|
||||||
|
"actual_documents",
|
||||||
|
"expected_source_urls",
|
||||||
|
"actual_source_urls",
|
||||||
|
"fact_types",
|
||||||
|
"strategies",
|
||||||
|
"binding_results",
|
||||||
|
"path_results",
|
||||||
|
]
|
||||||
|
|
||||||
|
with path.open(
|
||||||
|
"w",
|
||||||
|
encoding="utf-8",
|
||||||
|
newline="",
|
||||||
|
) as file:
|
||||||
|
writer = csv.DictWriter(
|
||||||
|
file,
|
||||||
|
fieldnames=fieldnames,
|
||||||
|
lineterminator='\n',
|
||||||
|
)
|
||||||
|
|
||||||
|
writer.writeheader()
|
||||||
|
|
||||||
|
for row in rows:
|
||||||
|
output = {}
|
||||||
|
|
||||||
|
for field in fieldnames:
|
||||||
|
value = row.get(
|
||||||
|
field
|
||||||
|
)
|
||||||
|
|
||||||
|
if isinstance(
|
||||||
|
value,
|
||||||
|
(
|
||||||
|
list,
|
||||||
|
dict,
|
||||||
|
),
|
||||||
|
):
|
||||||
|
value = json.dumps(
|
||||||
|
value,
|
||||||
|
ensure_ascii=False,
|
||||||
|
)
|
||||||
|
|
||||||
|
output[
|
||||||
|
field
|
||||||
|
] = value
|
||||||
|
|
||||||
|
writer.writerow(
|
||||||
|
output
|
||||||
|
)
|
||||||
|
|
||||||
|
|
||||||
|
def print_summary(
|
||||||
|
summary: dict[str, Any],
|
||||||
|
*,
|
||||||
|
split: str,
|
||||||
|
) -> None:
|
||||||
|
print()
|
||||||
|
print(
|
||||||
|
"=" * 78
|
||||||
|
)
|
||||||
|
|
||||||
|
print(
|
||||||
|
"GRAPHRAG EVALUATION"
|
||||||
|
)
|
||||||
|
|
||||||
|
print(
|
||||||
|
"=" * 78
|
||||||
|
)
|
||||||
|
|
||||||
|
print(
|
||||||
|
f"Split: {split}"
|
||||||
|
)
|
||||||
|
|
||||||
|
print(
|
||||||
|
f"Questions: "
|
||||||
|
f"{summary['questions']}"
|
||||||
|
)
|
||||||
|
|
||||||
|
print(
|
||||||
|
f"Strict: "
|
||||||
|
f"{summary['strict_count']}/"
|
||||||
|
f"{summary['questions']} "
|
||||||
|
f"({summary['strict_accuracy']:.3%})"
|
||||||
|
)
|
||||||
|
|
||||||
|
print(
|
||||||
|
f"Errors: "
|
||||||
|
f"{summary['error_count']}"
|
||||||
|
)
|
||||||
|
|
||||||
|
print(
|
||||||
|
f"Value score: "
|
||||||
|
f"{summary['value_score']:.3f}"
|
||||||
|
)
|
||||||
|
|
||||||
|
print(
|
||||||
|
f"Entity score: "
|
||||||
|
f"{summary['entity_score']:.3f}"
|
||||||
|
)
|
||||||
|
|
||||||
|
print(
|
||||||
|
f"Relation score: "
|
||||||
|
f"{summary['relation_score']:.3f}"
|
||||||
|
)
|
||||||
|
|
||||||
|
print(
|
||||||
|
f"Property score: "
|
||||||
|
f"{summary['property_score']:.3f}"
|
||||||
|
)
|
||||||
|
|
||||||
|
print(
|
||||||
|
f"Relation choices: "
|
||||||
|
f"{summary['relation_choice_score']:.3f}"
|
||||||
|
)
|
||||||
|
|
||||||
|
print(
|
||||||
|
f"Document recall: "
|
||||||
|
f"{summary['document_recall']:.3f}"
|
||||||
|
)
|
||||||
|
|
||||||
|
print(
|
||||||
|
f"Source recall: "
|
||||||
|
f"{summary['source_recall']:.3f}"
|
||||||
|
)
|
||||||
|
|
||||||
|
print(
|
||||||
|
f"Latency mean: "
|
||||||
|
f"{summary['latency_mean_seconds']:.4f} s"
|
||||||
|
)
|
||||||
|
|
||||||
|
print(
|
||||||
|
f"Latency median: "
|
||||||
|
f"{summary['latency_median_seconds']:.4f} s"
|
||||||
|
)
|
||||||
|
|
||||||
|
print(
|
||||||
|
f"Latency p95: "
|
||||||
|
f"{summary['latency_p95_seconds']:.4f} s"
|
||||||
|
)
|
||||||
|
|
||||||
|
print(
|
||||||
|
"=" * 78
|
||||||
|
)
|
||||||
|
|
||||||
|
|
||||||
|
def validate_output_destination(args: argparse.Namespace) -> None:
|
||||||
|
suffix = args.split
|
||||||
|
if args.ids:
|
||||||
|
suffix += '_selected'
|
||||||
|
elif args.max_questions:
|
||||||
|
suffix += f'_first{args.max_questions}'
|
||||||
|
if not args.overwrite:
|
||||||
|
for extension in ('json', 'csv'):
|
||||||
|
path = args.output_dir / f'graphrag_{suffix}.{extension}'
|
||||||
|
if path.exists():
|
||||||
|
raise RuntimeError(f'Results already exist; use a fresh output directory: {path}')
|
||||||
|
elif (any(part.startswith(('final_', 'archive_')) for part in args.output_dir.parts)
|
||||||
|
or any((args.output_dir / name).exists() for name in ('REPORT.md', 'summary.json', 'freeze.json'))):
|
||||||
|
raise RuntimeError('Archived/final results are immutable; choose a fresh DEV directory.')
|
||||||
|
|
||||||
|
|
||||||
|
def main() -> None:
|
||||||
|
args = parse_args()
|
||||||
|
validate_output_destination(args)
|
||||||
|
metadata = run_metadata(args.questions)
|
||||||
|
audit = json.loads(args.audit.read_text()) if args.audit else None
|
||||||
|
if audit and (audit['dataset_sha256'] != metadata['fingerprints']['dataset_sha256']
|
||||||
|
or audit['inputs'] != metadata['fingerprints']['inputs']):
|
||||||
|
raise RuntimeError('Source audit does not match current benchmark and inputs.')
|
||||||
|
if audit and audit.get('source_corpus') is not None and (
|
||||||
|
audit['source_corpus'] != metadata['fingerprints']['source_corpus']):
|
||||||
|
raise RuntimeError('Independent source audit does not match original Markdown.')
|
||||||
|
|
||||||
|
all_questions = load_questions(
|
||||||
|
args.questions
|
||||||
|
)
|
||||||
|
|
||||||
|
ids = {
|
||||||
|
value.strip()
|
||||||
|
for value in args.ids.split(
|
||||||
|
","
|
||||||
|
)
|
||||||
|
if value.strip()
|
||||||
|
}
|
||||||
|
|
||||||
|
questions = filter_questions(
|
||||||
|
all_questions,
|
||||||
|
split=args.split,
|
||||||
|
ids=(
|
||||||
|
ids
|
||||||
|
if ids
|
||||||
|
else None
|
||||||
|
),
|
||||||
|
max_questions=(
|
||||||
|
args.max_questions
|
||||||
|
),
|
||||||
|
)
|
||||||
|
|
||||||
|
if not questions:
|
||||||
|
raise RuntimeError(
|
||||||
|
"Pre zadaný výber sa nenašli otázky."
|
||||||
|
)
|
||||||
|
|
||||||
|
print()
|
||||||
|
print(
|
||||||
|
"GraphRAG dataset"
|
||||||
|
)
|
||||||
|
|
||||||
|
print(
|
||||||
|
"=" * 60
|
||||||
|
)
|
||||||
|
|
||||||
|
print(
|
||||||
|
f"File: {args.questions}"
|
||||||
|
)
|
||||||
|
|
||||||
|
print(
|
||||||
|
f"Total: {len(all_questions)}"
|
||||||
|
)
|
||||||
|
|
||||||
|
print(
|
||||||
|
f"Split: {args.split}"
|
||||||
|
)
|
||||||
|
|
||||||
|
print(
|
||||||
|
f"Selected: {len(questions)}"
|
||||||
|
)
|
||||||
|
|
||||||
|
print(
|
||||||
|
f"Limit: {args.limit}"
|
||||||
|
)
|
||||||
|
|
||||||
|
print(
|
||||||
|
f"Entities: {args.max_entities}"
|
||||||
|
)
|
||||||
|
|
||||||
|
print(
|
||||||
|
"=" * 60
|
||||||
|
)
|
||||||
|
|
||||||
|
settings = (
|
||||||
|
get_neo4j_settings()
|
||||||
|
)
|
||||||
|
|
||||||
|
rows: list[
|
||||||
|
dict[str, Any]
|
||||||
|
] = []
|
||||||
|
|
||||||
|
with create_neo4j_driver(
|
||||||
|
settings
|
||||||
|
) as driver:
|
||||||
|
driver.verify_connectivity()
|
||||||
|
|
||||||
|
with driver.session(
|
||||||
|
database=settings.database
|
||||||
|
) as session:
|
||||||
|
metadata['graph'] = graph_fingerprint(session)
|
||||||
|
if args.freeze_manifest:
|
||||||
|
verify_freeze(json.loads(args.freeze_manifest.read_text()), metadata, metadata['graph'],
|
||||||
|
limit=args.limit, max_entities=args.max_entities, audit=args.audit)
|
||||||
|
total = len(
|
||||||
|
questions
|
||||||
|
)
|
||||||
|
|
||||||
|
for index, question in enumerate(
|
||||||
|
questions,
|
||||||
|
start=1,
|
||||||
|
):
|
||||||
|
question_id = str(
|
||||||
|
question[
|
||||||
|
"id"
|
||||||
|
]
|
||||||
|
)
|
||||||
|
|
||||||
|
print(
|
||||||
|
f"[{index:04d}/{total:04d}] "
|
||||||
|
f"{question_id}: "
|
||||||
|
f"{question['question']}"
|
||||||
|
)
|
||||||
|
|
||||||
|
started = (
|
||||||
|
time.perf_counter()
|
||||||
|
)
|
||||||
|
|
||||||
|
error = None
|
||||||
|
|
||||||
|
try:
|
||||||
|
result = (
|
||||||
|
search_graph_with_session(
|
||||||
|
session,
|
||||||
|
str(
|
||||||
|
question[
|
||||||
|
"question"
|
||||||
|
]
|
||||||
|
),
|
||||||
|
limit=args.limit,
|
||||||
|
max_entities=(
|
||||||
|
args.max_entities
|
||||||
|
),
|
||||||
|
)
|
||||||
|
)
|
||||||
|
|
||||||
|
except Exception as exc:
|
||||||
|
result = {
|
||||||
|
"strategies": [],
|
||||||
|
"resolved_entities": [],
|
||||||
|
"paths": [],
|
||||||
|
"facts": [],
|
||||||
|
"documents": [],
|
||||||
|
}
|
||||||
|
|
||||||
|
error = (
|
||||||
|
f"{type(exc).__name__}: "
|
||||||
|
f"{exc}"
|
||||||
|
)
|
||||||
|
|
||||||
|
latency = (
|
||||||
|
time.perf_counter()
|
||||||
|
- started
|
||||||
|
)
|
||||||
|
|
||||||
|
row = evaluate_result(
|
||||||
|
question,
|
||||||
|
result,
|
||||||
|
latency_seconds=(
|
||||||
|
latency
|
||||||
|
),
|
||||||
|
error=error,
|
||||||
|
)
|
||||||
|
|
||||||
|
rows.append(
|
||||||
|
row
|
||||||
|
)
|
||||||
|
|
||||||
|
state = (
|
||||||
|
"OK"
|
||||||
|
if row["strict"]
|
||||||
|
else "FAIL"
|
||||||
|
)
|
||||||
|
|
||||||
|
print(
|
||||||
|
f" {state} | "
|
||||||
|
f"value={row['value_score']:.2f} "
|
||||||
|
f"entity={row['entity_score']:.2f} "
|
||||||
|
f"rel={row['relation_score']:.2f} "
|
||||||
|
f"doc={row['document_recall']:.2f} "
|
||||||
|
f"{row['latency_seconds']:.4f}s"
|
||||||
|
)
|
||||||
|
|
||||||
|
if graph_fingerprint(session) != metadata['graph']:
|
||||||
|
raise RuntimeError('Graph changed during evaluation; results discarded.')
|
||||||
|
|
||||||
|
if run_metadata(args.questions)['fingerprints'] != metadata['fingerprints']:
|
||||||
|
raise RuntimeError('Code or input data changed during evaluation; results discarded.')
|
||||||
|
metadata['completed_at_utc'] = datetime.now(timezone.utc).isoformat()
|
||||||
|
if args.freeze_manifest:
|
||||||
|
metadata['freeze_sha256'] = sha256_file(args.freeze_manifest)
|
||||||
|
if args.audit:
|
||||||
|
metadata['audit_sha256'] = sha256_file(args.audit)
|
||||||
|
|
||||||
|
summary = aggregate_rows(
|
||||||
|
rows
|
||||||
|
)
|
||||||
|
|
||||||
|
by_category = aggregate_by_field(
|
||||||
|
rows,
|
||||||
|
"category",
|
||||||
|
)
|
||||||
|
|
||||||
|
by_difficulty = (
|
||||||
|
aggregate_by_field(
|
||||||
|
rows,
|
||||||
|
"difficulty",
|
||||||
|
)
|
||||||
|
)
|
||||||
|
|
||||||
|
payload = {
|
||||||
|
'evaluation_schema_version': 4,
|
||||||
|
'run_metadata': metadata,
|
||||||
|
"configuration": {
|
||||||
|
"questions_file": str(
|
||||||
|
args.questions
|
||||||
|
),
|
||||||
|
"split": args.split,
|
||||||
|
"dataset_question_count": len(
|
||||||
|
all_questions
|
||||||
|
),
|
||||||
|
"selected_question_count": len(
|
||||||
|
questions
|
||||||
|
),
|
||||||
|
"limit": args.limit,
|
||||||
|
"max_entities": (
|
||||||
|
args.max_entities
|
||||||
|
),
|
||||||
|
"ids": sorted(
|
||||||
|
ids
|
||||||
|
),
|
||||||
|
"max_questions": (
|
||||||
|
args.max_questions
|
||||||
|
),
|
||||||
|
},
|
||||||
|
"summary": summary,
|
||||||
|
"by_category": by_category,
|
||||||
|
"by_difficulty": (
|
||||||
|
by_difficulty
|
||||||
|
),
|
||||||
|
"questions": rows,
|
||||||
|
}
|
||||||
|
if audit:
|
||||||
|
consistent_ids = {row['id'] for row in audit['questions'] if row['source_consistent']}
|
||||||
|
consistent = [row for row in rows if row['id'] in consistent_ids]
|
||||||
|
payload['source_consistent_summary'] = aggregate_rows(consistent)
|
||||||
|
payload['source_consistent_by_category'] = aggregate_by_field(consistent, 'category')
|
||||||
|
payload['source_inconsistent_ids'] = [row['id'] for row in rows if row['id'] not in consistent_ids]
|
||||||
|
|
||||||
|
suffix = args.split
|
||||||
|
|
||||||
|
if ids:
|
||||||
|
suffix += "_selected"
|
||||||
|
|
||||||
|
elif args.max_questions:
|
||||||
|
suffix += (
|
||||||
|
f"_first"
|
||||||
|
f"{args.max_questions}"
|
||||||
|
)
|
||||||
|
|
||||||
|
json_path = (
|
||||||
|
args.output_dir
|
||||||
|
/ f"graphrag_{suffix}.json"
|
||||||
|
)
|
||||||
|
|
||||||
|
csv_path = (
|
||||||
|
args.output_dir
|
||||||
|
/ f"graphrag_{suffix}.csv"
|
||||||
|
)
|
||||||
|
|
||||||
|
save_json(
|
||||||
|
json_path,
|
||||||
|
payload,
|
||||||
|
)
|
||||||
|
|
||||||
|
save_csv(
|
||||||
|
csv_path,
|
||||||
|
rows,
|
||||||
|
)
|
||||||
|
|
||||||
|
print_summary(
|
||||||
|
summary,
|
||||||
|
split=args.split,
|
||||||
|
)
|
||||||
|
if audit:
|
||||||
|
print_summary(payload['source_consistent_summary'],
|
||||||
|
split=f'{args.split} — source-consistent subset (supplementary)')
|
||||||
|
print(f"Source-inconsistent annotations: {len(payload['source_inconsistent_ids'])}; "
|
||||||
|
'included in the primary score above.')
|
||||||
|
|
||||||
|
print()
|
||||||
|
print(
|
||||||
|
f"JSON: {json_path}"
|
||||||
|
)
|
||||||
|
|
||||||
|
print(
|
||||||
|
f"CSV: {csv_path}"
|
||||||
|
)
|
||||||
|
|
||||||
|
|
||||||
|
if __name__ == "__main__":
|
||||||
|
main()
|
||||||
370
tools/graphrag/evaluation/evidence_contract.py
Normal file
370
tools/graphrag/evaluation/evidence_contract.py
Normal file
@ -0,0 +1,370 @@
|
|||||||
|
"""Connected, typed evidence checks shared by GraphRAG evaluation versions.
|
||||||
|
|
||||||
|
Facts are structured records emitted by fixed Cypher queries. They are expanded
|
||||||
|
into the very paths those query contracts establish; query text, resolved aliases
|
||||||
|
and context-only documents never create edges. Ordered paths must have compatible
|
||||||
|
endpoint types. Bindings are satisfied by one connected witness, not a bag of
|
||||||
|
independently occurring values.
|
||||||
|
"""
|
||||||
|
from __future__ import annotations
|
||||||
|
|
||||||
|
import itertools
|
||||||
|
import re
|
||||||
|
import unicodedata
|
||||||
|
from collections import defaultdict
|
||||||
|
from typing import Any
|
||||||
|
|
||||||
|
|
||||||
|
RELATION_ENDPOINTS = {
|
||||||
|
'AUTHORED': ('Person', 'Thesis'),
|
||||||
|
'HAS_WORK': ('Person', 'Work'),
|
||||||
|
'HAS_DOCUMENT': ('Person', 'Document'),
|
||||||
|
'EVIDENCED_BY': ('Academic', 'Document'),
|
||||||
|
'HAS_KEYWORD': ('Document', 'Keyword'),
|
||||||
|
'IN_CATEGORY': ('Document', 'Category'),
|
||||||
|
'AUTHORED_DOCUMENT': ('DocumentAuthor', 'Document'),
|
||||||
|
'DESCRIBES': ('Document', 'Topic'),
|
||||||
|
}
|
||||||
|
|
||||||
|
|
||||||
|
def canonical(value: Any) -> str:
|
||||||
|
raw = unicodedata.normalize('NFKD', str(value if value is not None else ''))
|
||||||
|
return re.sub(r'\s+', ' ', re.sub(r'[^a-z0-9]+', ' ', ''.join(
|
||||||
|
character for character in raw.casefold() if not unicodedata.combining(character)))).strip()
|
||||||
|
|
||||||
|
|
||||||
|
def kind_matches(actual: str, expected: str) -> bool:
|
||||||
|
return actual in {'Thesis', 'Work'} if expected in {'Academic', 'Thesis|Work'} else actual in expected.split('|')
|
||||||
|
|
||||||
|
|
||||||
|
class EvidenceGraph:
|
||||||
|
def __init__(self, result: dict[str, Any]):
|
||||||
|
self.nodes: dict[tuple[str, str], dict] = {}
|
||||||
|
self.conflicts: set[tuple[str, str]] = set()
|
||||||
|
self.adjacency: dict[tuple[str, str], set[tuple[str, tuple[str, str]]]] = defaultdict(set)
|
||||||
|
for path in result.get('paths', []):
|
||||||
|
if not isinstance(path, dict):
|
||||||
|
continue
|
||||||
|
nodes, relationships = path.get('nodes', []), path.get('relationships', [])
|
||||||
|
if not isinstance(nodes, list) or len(relationships) != max(0, len(nodes) - 1):
|
||||||
|
continue
|
||||||
|
keys = [self.node(row.get('kind', ''), row) for row in nodes if isinstance(row, dict)]
|
||||||
|
if len(keys) != len(nodes):
|
||||||
|
continue
|
||||||
|
for left, relation, right in zip(keys, relationships, keys[1:]):
|
||||||
|
self.edge(left, relation, right)
|
||||||
|
for fact in result.get('facts', []):
|
||||||
|
if isinstance(fact, dict):
|
||||||
|
self.add_fact(fact)
|
||||||
|
|
||||||
|
def node(self, kind: str, properties: dict) -> tuple[str, str]:
|
||||||
|
properties = {key: value for key, value in properties.items() if value is not None}
|
||||||
|
if kind == 'Document':
|
||||||
|
identity = properties.get('path') or properties.get('document_path')
|
||||||
|
else:
|
||||||
|
identity = properties.get('element_id') or properties.get('id')
|
||||||
|
if not identity:
|
||||||
|
if kind in {'Thesis', 'Work'}:
|
||||||
|
identity = repr((properties.get('person'), properties.get('title'),
|
||||||
|
properties.get('year'), properties.get('document_path')))
|
||||||
|
else:
|
||||||
|
identity = canonical(properties.get('name'))
|
||||||
|
key = (kind, str(identity))
|
||||||
|
current = self.nodes.setdefault(key, {'kind': kind})
|
||||||
|
for field in {'name', 'title', 'year', 'start_year', 'thesis_type', 'work_type', 'path', 'source_url'}:
|
||||||
|
if field in current and field in properties and canonical(current[field]) != canonical(properties[field]):
|
||||||
|
self.conflicts.add(key)
|
||||||
|
for field, value in properties.items():
|
||||||
|
current.setdefault(field, value)
|
||||||
|
return key
|
||||||
|
|
||||||
|
def edge(self, left: tuple[str, str], relation: str, right: tuple[str, str]) -> None:
|
||||||
|
expected = RELATION_ENDPOINTS.get(relation)
|
||||||
|
if expected is None:
|
||||||
|
return
|
||||||
|
if kind_matches(left[0], expected[0]) and kind_matches(right[0], expected[1]):
|
||||||
|
pass
|
||||||
|
elif kind_matches(right[0], expected[0]) and kind_matches(left[0], expected[1]):
|
||||||
|
left, right = right, left
|
||||||
|
else:
|
||||||
|
return
|
||||||
|
self.adjacency[left].add((relation, right))
|
||||||
|
self.adjacency[right].add((relation, left))
|
||||||
|
|
||||||
|
def neighbors(self, key: tuple[str, str], relation: str, kind: str) -> list[tuple[str, str]]:
|
||||||
|
return [target for edge, target in self.adjacency.get(key, ())
|
||||||
|
if key not in self.conflicts and target not in self.conflicts
|
||||||
|
and edge in relation.split('|') and kind_matches(target[0], kind)]
|
||||||
|
|
||||||
|
def add_fact(self, fact: dict) -> None:
|
||||||
|
kind = fact.get('fact_type')
|
||||||
|
if kind in {'shared_keyword', 'shared_category', 'shared_document_author'}:
|
||||||
|
singular = {'shared_keyword': 'person_keyword', 'shared_category': 'person_category',
|
||||||
|
'shared_document_author': 'person_document_author'}[kind]
|
||||||
|
for side in ('left', 'right'):
|
||||||
|
self.add_fact({**fact, 'fact_type': singular, 'person': fact.get(side + '_person'),
|
||||||
|
'person_element_id': fact.get(side + '_person_element_id'),
|
||||||
|
'document_path': fact.get(side + '_document_path'),
|
||||||
|
'source_url': fact.get(side + '_source_url')})
|
||||||
|
return
|
||||||
|
if kind not in {'person_thesis', 'person_work', 'person_start_year', 'person_keyword',
|
||||||
|
'person_category', 'person_document_author'} or not fact.get('person'):
|
||||||
|
return
|
||||||
|
person = self.node('Person', {'name': fact['person'], 'element_id': fact.get('person_element_id'),
|
||||||
|
'start_year': fact.get('start_year') if kind == 'person_start_year' else None})
|
||||||
|
path = fact.get('document_path')
|
||||||
|
document = self.node('Document', {'path': path, 'source_url': fact.get('source_url')}) if path else None
|
||||||
|
if kind in {'person_thesis', 'person_work'}:
|
||||||
|
academic_kind = 'Thesis' if kind == 'person_thesis' else 'Work'
|
||||||
|
prefix = 'thesis' if academic_kind == 'Thesis' else 'work'
|
||||||
|
academic = self.node(academic_kind, {
|
||||||
|
'element_id': fact.get(prefix + '_element_id'), 'id': fact.get(prefix + '_id'),
|
||||||
|
'person': fact['person'], 'document_path': path, 'title': fact.get('title'),
|
||||||
|
'year': fact.get('year'), prefix + '_type': fact.get(prefix + '_type')})
|
||||||
|
self.edge(person, 'AUTHORED' if academic_kind == 'Thesis' else 'HAS_WORK', academic)
|
||||||
|
if document:
|
||||||
|
self.edge(academic, 'EVIDENCED_BY', document)
|
||||||
|
elif document:
|
||||||
|
self.edge(person, 'HAS_DOCUMENT', document)
|
||||||
|
if kind == 'person_keyword' and fact.get('keyword'):
|
||||||
|
target = self.node('Keyword', {'name': fact['keyword'], 'id': fact.get('keyword_id'),
|
||||||
|
'element_id': fact.get('keyword_element_id')})
|
||||||
|
self.edge(document, 'HAS_KEYWORD', target)
|
||||||
|
elif kind == 'person_category' and fact.get('category'):
|
||||||
|
target = self.node('Category', {'name': fact['category'],
|
||||||
|
'element_id': fact.get('category_element_id')})
|
||||||
|
self.edge(document, 'IN_CATEGORY', target)
|
||||||
|
elif kind == 'person_document_author' and fact.get('document_author'):
|
||||||
|
target = self.node('DocumentAuthor', {'name': fact['document_author'],
|
||||||
|
'id': fact.get('document_author_id'), 'element_id': fact.get('document_author_element_id')})
|
||||||
|
self.edge(target, 'AUTHORED_DOCUMENT', document)
|
||||||
|
if fact.get('category'):
|
||||||
|
category = self.node('Category', {'name': fact['category'],
|
||||||
|
'element_id': fact.get('category_element_id')})
|
||||||
|
self.edge(document, 'IN_CATEGORY', category)
|
||||||
|
|
||||||
|
def metadata_choices(self, person: tuple[str, str], binding: dict, field: str,
|
||||||
|
relation: str, kind: str) -> list[tuple[Any, Any]]:
|
||||||
|
if field not in binding:
|
||||||
|
return [(None, None)]
|
||||||
|
return [(document, node)
|
||||||
|
for document in self.neighbors(person, 'HAS_DOCUMENT', 'Document')
|
||||||
|
for node in self.neighbors(document, relation, kind)
|
||||||
|
if canonical(self.nodes[node].get('name')) == canonical(binding[field])]
|
||||||
|
|
||||||
|
def witnesses(self, binding: dict, *, require_provenance: bool) -> list[dict]:
|
||||||
|
people = [key for key, row in self.nodes.items() if key[0] == 'Person' and key not in self.conflicts
|
||||||
|
and ('person' not in binding or canonical(row.get('name')) == canonical(binding['person']))]
|
||||||
|
academic_required = any(field in binding for field in ['academic_kind', 'academic_type', 'title', 'year'])
|
||||||
|
witnesses = []
|
||||||
|
for person in people:
|
||||||
|
if 'start_year' in binding and canonical(self.nodes[person].get('start_year')) != canonical(binding['start_year']):
|
||||||
|
continue
|
||||||
|
academics = []
|
||||||
|
if academic_required:
|
||||||
|
for relation, kind in [('AUTHORED', 'Thesis'), ('HAS_WORK', 'Work')]:
|
||||||
|
for academic in self.neighbors(person, relation, kind):
|
||||||
|
row = self.nodes[academic]
|
||||||
|
if 'academic_kind' in binding and not kind_matches(kind, binding['academic_kind']):
|
||||||
|
continue
|
||||||
|
if any(canonical(row.get(field)) != canonical(binding[field])
|
||||||
|
for field in ['title', 'year'] if field in binding):
|
||||||
|
continue
|
||||||
|
type_field = 'thesis_type' if kind == 'Thesis' else 'work_type'
|
||||||
|
if 'academic_type' in binding and canonical(row.get(type_field)) != canonical(binding['academic_type']):
|
||||||
|
continue
|
||||||
|
docs = self.neighbors(academic, 'EVIDENCED_BY', 'Document')
|
||||||
|
academics.extend((academic, doc) for doc in docs)
|
||||||
|
if not docs and not require_provenance:
|
||||||
|
academics.append((academic, None))
|
||||||
|
else:
|
||||||
|
academics = [(None, None)]
|
||||||
|
choices = [self.metadata_choices(person, binding, *arguments) for arguments in [
|
||||||
|
('keyword', 'HAS_KEYWORD', 'Keyword'), ('category', 'IN_CATEGORY', 'Category'),
|
||||||
|
('document_author', 'AUTHORED_DOCUMENT', 'DocumentAuthor')]]
|
||||||
|
person_docs = self.neighbors(person, 'HAS_DOCUMENT', 'Document') if (
|
||||||
|
require_provenance and ('start_year' in binding or not academic_required
|
||||||
|
and not any(field in binding for field in ['keyword', 'category', 'document_author']))
|
||||||
|
) else [None]
|
||||||
|
for (academic, academic_document), keyword, category, author, person_document in itertools.product(academics, *choices, person_docs):
|
||||||
|
docs = [doc for doc in [academic_document, keyword[0], category[0], author[0], person_document] if doc]
|
||||||
|
if binding.get('same_document') and len(set(docs)) > 1:
|
||||||
|
continue
|
||||||
|
if category[0] and author[0] and category[0] != author[0]:
|
||||||
|
continue
|
||||||
|
if 'document_path' in binding and any(
|
||||||
|
self.nodes[doc].get('path') != binding['document_path'] for doc in docs
|
||||||
|
):
|
||||||
|
continue
|
||||||
|
witnesses.append({'person': person, 'academic': academic, 'academic_document': academic_document,
|
||||||
|
'person_document': person_document,
|
||||||
|
'keyword': keyword[1], 'keyword_document': keyword[0],
|
||||||
|
'category': category[1], 'category_document': category[0],
|
||||||
|
'document_author': author[1], 'author_document': author[0]})
|
||||||
|
return witnesses
|
||||||
|
|
||||||
|
def pattern_path(self, witness: dict, pattern: dict) -> list[dict] | None:
|
||||||
|
kinds, relations = pattern.get('node_kinds', []), pattern.get('relationships', [])
|
||||||
|
if not kinds or len(relations) != len(kinds) - 1 or not kind_matches('Person', kinds[0]):
|
||||||
|
return None
|
||||||
|
target_roles = {'Keyword': 'keyword', 'Category': 'category', 'DocumentAuthor': 'document_author',
|
||||||
|
'Thesis': 'academic', 'Work': 'academic', 'Academic': 'academic', 'Thesis|Work': 'academic'}
|
||||||
|
allowed = {key for key in witness.values() if key is not None}
|
||||||
|
required_target = witness.get(target_roles.get(kinds[-1], ''))
|
||||||
|
|
||||||
|
def visit(key, index, path):
|
||||||
|
if index == len(relations):
|
||||||
|
return path if required_target is None or key == required_target else None
|
||||||
|
for next_key in self.neighbors(key, relations[index], kinds[index + 1]):
|
||||||
|
if next_key not in allowed:
|
||||||
|
continue
|
||||||
|
result = visit(next_key, index + 1, path + [next_key])
|
||||||
|
if result:
|
||||||
|
return result
|
||||||
|
return None
|
||||||
|
|
||||||
|
found = visit(witness['person'], 0, [witness['person']])
|
||||||
|
return [self.nodes[key] for key in found] if found else None
|
||||||
|
|
||||||
|
|
||||||
|
def implicit_patterns(binding: dict, index: int) -> list[dict]:
|
||||||
|
patterns = []
|
||||||
|
if 'start_year' in binding or not any(field in binding for field in [
|
||||||
|
'academic_kind', 'academic_type', 'title', 'year', 'keyword', 'category', 'document_author'
|
||||||
|
]):
|
||||||
|
patterns.append({'binding_index': index, 'node_kinds': ['Person', 'Document'],
|
||||||
|
'relationships': ['HAS_DOCUMENT']})
|
||||||
|
if any(field in binding for field in ['academic_kind', 'academic_type', 'title', 'year']):
|
||||||
|
kind = binding.get('academic_kind', 'Academic')
|
||||||
|
relationships = ['AUTHORED'] if kind == 'Thesis' else ['HAS_WORK'] if kind == 'Work' else ['AUTHORED|HAS_WORK']
|
||||||
|
patterns.append({'binding_index': index, 'node_kinds': ['Person', kind, 'Document'],
|
||||||
|
'relationships': relationships + ['EVIDENCED_BY']})
|
||||||
|
for field, kind, relation in [('keyword', 'Keyword', 'HAS_KEYWORD'),
|
||||||
|
('category', 'Category', 'IN_CATEGORY'),
|
||||||
|
('document_author', 'DocumentAuthor', 'AUTHORED_DOCUMENT')]:
|
||||||
|
if field in binding:
|
||||||
|
patterns.append({'binding_index': index, 'node_kinds': ['Person', 'Document', kind],
|
||||||
|
'relationships': ['HAS_DOCUMENT', relation]})
|
||||||
|
return patterns
|
||||||
|
|
||||||
|
|
||||||
|
def legacy_bindings(question: dict) -> list[dict]:
|
||||||
|
"""Best-effort semantic conversion of schema2 annotations, never result data."""
|
||||||
|
graph = question.get('graph', {})
|
||||||
|
entities = defaultdict(list)
|
||||||
|
for row in graph.get('expected_entities', []):
|
||||||
|
entities[row.get('type')].append(row.get('value'))
|
||||||
|
people = entities['person'] or [row['value'] for row in graph.get('start_entities', []) if row['type'] == 'person']
|
||||||
|
people = people or [None]
|
||||||
|
years = entities['year']
|
||||||
|
properties = graph.get('expected_properties', [])
|
||||||
|
start_year = any(prop == 'Person.start_year' for prop in properties)
|
||||||
|
if not years and any('.year' in prop for prop in properties) and not start_year:
|
||||||
|
years = re.findall(r'\b20\d{2}\b', question.get('question', ''))
|
||||||
|
bindings = []
|
||||||
|
for person in people:
|
||||||
|
common = {'person': person} if person else {}
|
||||||
|
if len(years) == 1:
|
||||||
|
common['start_year' if start_year else 'year'] = years[0]
|
||||||
|
for field, entity_type in [('keyword', 'keyword'), ('category', 'category'), ('document_author', 'document_author')]:
|
||||||
|
if len(entities[entity_type]) == 1:
|
||||||
|
common[field] = entities[entity_type][0]
|
||||||
|
titles = [('Thesis', value) for value in entities['thesis_title']] + [('Work', value) for value in entities['work_title']]
|
||||||
|
if titles:
|
||||||
|
bindings.extend({**common, 'academic_kind': kind, 'title': title} for kind, title in titles)
|
||||||
|
elif len(entities['category']) > 1:
|
||||||
|
bindings.extend({**common, 'category': value} for value in entities['category'])
|
||||||
|
elif any(key != 'person' for key in common):
|
||||||
|
bindings.append(common)
|
||||||
|
return bindings
|
||||||
|
|
||||||
|
|
||||||
|
def positive_answer_facts(result: dict) -> list[dict]:
|
||||||
|
facts = []
|
||||||
|
for row in result.get('facts', []):
|
||||||
|
if not isinstance(row, dict):
|
||||||
|
facts.append(row)
|
||||||
|
continue
|
||||||
|
kind = row.get('fact_type', '')
|
||||||
|
if kind == 'academic_year_comparison' and row.get('same_academic_year') is False and not row.get('shared_years'):
|
||||||
|
continue
|
||||||
|
if kind == 'start_year_comparison' and row.get('same_start_year') is False and row.get('shared_start_year') is None:
|
||||||
|
continue
|
||||||
|
facts.append(row)
|
||||||
|
return facts
|
||||||
|
|
||||||
|
|
||||||
|
def evaluate_contract(question: dict, result: dict) -> dict:
|
||||||
|
graph = question.get('graph', {})
|
||||||
|
schema = graph.get('schema_version', 2)
|
||||||
|
negative = bool(graph.get('expected_no_answer') or question.get('should_answer') is False)
|
||||||
|
expected_status = graph.get('expected_status')
|
||||||
|
if negative:
|
||||||
|
status = result.get('status')
|
||||||
|
no_positive = not positive_answer_facts(result) and not result.get('paths')
|
||||||
|
aggregation = result.get('aggregation') or {}
|
||||||
|
if schema >= 3 and expected_status is None:
|
||||||
|
expected_status = 'no_answer'
|
||||||
|
status_ok = status == expected_status if expected_status else status in {'no_answer', 'ambiguous'}
|
||||||
|
reason = result.get('reason')
|
||||||
|
ok = bool(status_ok and isinstance(reason, str) and reason.strip()
|
||||||
|
and no_positive and not aggregation.get('count'))
|
||||||
|
return {'answerability_ok': ok, 'bindings_ok': True, 'binding_score': 1.0,
|
||||||
|
'paths_ok': True, 'path_score': 1.0, 'binding_results': [], 'path_results': [],
|
||||||
|
'expected_no_answer': True, 'actual_status': status}
|
||||||
|
status_ok = (result.get('status') == 'ok' if schema >= 3
|
||||||
|
else result.get('status') not in {'no_answer', 'ambiguous', 'error'})
|
||||||
|
bindings = graph.get('expected_bindings')
|
||||||
|
if bindings is None:
|
||||||
|
bindings = legacy_bindings(question)
|
||||||
|
empty_count_answer = (graph.get('expected_count') == 0 and graph.get('expected_entity_set') == []
|
||||||
|
and (result.get('aggregation') or {}).get('count') == 0
|
||||||
|
and (result.get('aggregation') or {}).get('complete') is True)
|
||||||
|
if schema >= 3 and not bindings and not empty_count_answer:
|
||||||
|
status_ok = False
|
||||||
|
evidence = EvidenceGraph(result)
|
||||||
|
explicit_patterns = graph.get('expected_path_patterns', [])
|
||||||
|
source_choices = graph.get('expected_evidence_documents', [])
|
||||||
|
binding_results, path_results = [], []
|
||||||
|
for index, binding in enumerate(bindings):
|
||||||
|
candidates = evidence.witnesses(binding, require_provenance=schema >= 3)
|
||||||
|
patterns = [p for p in explicit_patterns if p.get('binding_index') == index]
|
||||||
|
if not patterns and schema >= 3:
|
||||||
|
patterns = implicit_patterns(binding, index)
|
||||||
|
winner = None
|
||||||
|
for candidate in candidates:
|
||||||
|
checks = [evidence.pattern_path(candidate, pattern) for pattern in patterns]
|
||||||
|
source_ok = True
|
||||||
|
for choice in source_choices:
|
||||||
|
if choice.get('binding_index') != index:
|
||||||
|
continue
|
||||||
|
document = evidence.nodes.get(candidate.get(choice.get('role')), {})
|
||||||
|
if not any(document.get('path') == option.get('document_path')
|
||||||
|
and document.get('source_url') == option.get('source_url')
|
||||||
|
for option in choice.get('any_of', [])):
|
||||||
|
source_ok = False
|
||||||
|
break
|
||||||
|
if source_ok and all(check is not None for check in checks):
|
||||||
|
winner = checks
|
||||||
|
break
|
||||||
|
binding_results.append({'binding': binding, 'matched': bool(candidates) and winner is not None})
|
||||||
|
for pattern_index, pattern in enumerate(patterns):
|
||||||
|
path_results.append({'pattern': pattern, 'matched': winner is not None,
|
||||||
|
'witness': winner[pattern_index] if winner is not None else []})
|
||||||
|
bindings_ok = all(row['matched'] for row in binding_results)
|
||||||
|
paths_ok = all(row['matched'] for row in path_results)
|
||||||
|
# A malformed pattern referencing a nonexistent binding must not vanish.
|
||||||
|
if any(not isinstance(p.get('binding_index'), int) or p['binding_index'] not in range(len(bindings))
|
||||||
|
for p in explicit_patterns):
|
||||||
|
paths_ok = False
|
||||||
|
if any(not isinstance(p.get('binding_index'), int) or p['binding_index'] not in range(len(bindings))
|
||||||
|
or p.get('role') not in {'academic_document', 'keyword_document', 'category_document',
|
||||||
|
'author_document', 'person_document'} or not p.get('any_of')
|
||||||
|
for p in source_choices):
|
||||||
|
bindings_ok = False
|
||||||
|
return {'answerability_ok': status_ok, 'bindings_ok': bindings_ok,
|
||||||
|
'binding_score': sum(row['matched'] for row in binding_results) / len(binding_results) if binding_results else 1.0,
|
||||||
|
'paths_ok': paths_ok,
|
||||||
|
'path_score': sum(row['matched'] for row in path_results) / len(path_results) if path_results else float(paths_ok),
|
||||||
|
'binding_results': binding_results, 'path_results': path_results,
|
||||||
|
'expected_no_answer': False, 'actual_status': result.get('status', 'ok')}
|
||||||
70
tools/graphrag/evaluation/freeze_graphrag.py
Normal file
70
tools/graphrag/evaluation/freeze_graphrag.py
Normal file
@ -0,0 +1,70 @@
|
|||||||
|
"""Freeze the exact code, data, graph and parameters after complete DEV evaluation."""
|
||||||
|
from __future__ import annotations
|
||||||
|
|
||||||
|
import argparse
|
||||||
|
import json
|
||||||
|
from datetime import datetime, timezone
|
||||||
|
from pathlib import Path
|
||||||
|
|
||||||
|
from .reproducibility import content_fingerprints, sha256_file
|
||||||
|
|
||||||
|
|
||||||
|
def make_freeze(dev: dict, questions: list[dict], fingerprints: dict, audit: dict) -> dict:
|
||||||
|
expected_ids = {q['id'] for q in questions if q['split'] == 'dev'}
|
||||||
|
actual_ids = [row['id'] for row in dev['questions']]
|
||||||
|
if dev['configuration']['split'] != 'dev' or set(actual_ids) != expected_ids or len(actual_ids) != len(expected_ids):
|
||||||
|
raise RuntimeError('Freeze requires the complete DEV split, without duplicates.')
|
||||||
|
if dev['summary']['error_count'] or any(row.get('error') for row in dev['questions']):
|
||||||
|
raise RuntimeError('Freeze requires DEV without runtime errors.')
|
||||||
|
if dev['run_metadata']['fingerprints'] != fingerprints:
|
||||||
|
raise RuntimeError('Code or data changed after DEV; rerun DEV before freezing.')
|
||||||
|
if audit['dataset_sha256'] != fingerprints['dataset_sha256'] or audit['inputs'] != fingerprints['inputs']:
|
||||||
|
raise RuntimeError('Source audit does not match the benchmark and inputs.')
|
||||||
|
if len(audit['questions']) != len(questions) or {r['id'] for r in audit['questions']} != {q['id'] for q in questions}:
|
||||||
|
raise RuntimeError('Source audit must cover every question exactly once.')
|
||||||
|
schema3 = any(question.get('graph', {}).get('schema_version') == 3 for question in questions)
|
||||||
|
partition = None
|
||||||
|
if schema3:
|
||||||
|
if audit.get('source_corpus') != fingerprints.get('source_corpus'):
|
||||||
|
raise RuntimeError('Independent audit does not match original Markdown sources.')
|
||||||
|
if any(not row.get('source_consistent') for row in audit['questions']):
|
||||||
|
raise RuntimeError('Resolve source-inconsistent annotations before freezing v2.')
|
||||||
|
profiles = {split: {profile for question in questions if question['split'] == split
|
||||||
|
for profile in question.get('graph', {}).get('source_profiles', [])}
|
||||||
|
for split in ('dev', 'test')}
|
||||||
|
if profiles['dev'] & profiles['test']:
|
||||||
|
raise RuntimeError('DEV/TEST source profiles overlap; independent holdout refused.')
|
||||||
|
if not profiles['dev'] or not profiles['test']:
|
||||||
|
raise RuntimeError('Primary v2 freeze requires declared DEV and TEST source profiles.')
|
||||||
|
partition = {'method': 'disjoint source profiles',
|
||||||
|
'dev_profile_count': len(profiles['dev']),
|
||||||
|
'test_profile_count': len(profiles['test']), 'overlap': 0}
|
||||||
|
return {'schema_version': 2 if schema3 else 1,
|
||||||
|
'partition': partition, 'frozen_at_utc': datetime.now(timezone.utc).isoformat(),
|
||||||
|
'fingerprints': fingerprints, 'graph': dev['run_metadata']['graph'],
|
||||||
|
'parameters': {key: dev['configuration'][key] for key in ['limit', 'max_entities']},
|
||||||
|
'dev_summary': dev['summary'], 'source_audit_summary': audit['by_split'],
|
||||||
|
'policy': 'Report all questions including negatives. No exclusions or holdout tuning.'}
|
||||||
|
|
||||||
|
|
||||||
|
def main() -> None:
|
||||||
|
parser = argparse.ArgumentParser(description=__doc__)
|
||||||
|
parser.add_argument('--dev-results', type=Path, required=True)
|
||||||
|
parser.add_argument('--questions', type=Path, default=Path(__file__).parent / 'graphrag_questions_v2.json')
|
||||||
|
parser.add_argument('--audit', type=Path, required=True)
|
||||||
|
parser.add_argument('--output', type=Path, required=True)
|
||||||
|
args = parser.parse_args()
|
||||||
|
if args.output.exists():
|
||||||
|
parser.error('Freeze manifest already exists; choose a new version/output path.')
|
||||||
|
manifest = make_freeze(json.loads(args.dev_results.read_text()), json.loads(args.questions.read_text()),
|
||||||
|
content_fingerprints(args.questions), json.loads(args.audit.read_text()))
|
||||||
|
manifest.update({'dev_results_sha256': sha256_file(args.dev_results),
|
||||||
|
'audit_sha256': sha256_file(args.audit)})
|
||||||
|
args.output.parent.mkdir(parents=True, exist_ok=True)
|
||||||
|
with args.output.open('x', encoding='utf-8') as output:
|
||||||
|
output.write(json.dumps(manifest, ensure_ascii=False, indent=2) + '\n')
|
||||||
|
print(f'Frozen GraphRAG: {args.output}')
|
||||||
|
|
||||||
|
|
||||||
|
if __name__ == '__main__':
|
||||||
|
main()
|
||||||
82
tools/graphrag/evaluation/frozen_v1.json
Normal file
82
tools/graphrag/evaluation/frozen_v1.json
Normal file
@ -0,0 +1,82 @@
|
|||||||
|
{
|
||||||
|
"schema_version": 1,
|
||||||
|
"frozen_at_utc": "2026-10-24T19:03:18.603604+00:00",
|
||||||
|
"fingerprints": {
|
||||||
|
"implementation": {
|
||||||
|
"tools/graphrag/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||||
|
"tools/graphrag/build_graphrag.py": "81f6e9f5c9e71b588f8bed1968c1e900e29e484ba81d23b6a3a68e7220ad75a5",
|
||||||
|
"tools/graphrag/evaluation/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||||
|
"tools/graphrag/evaluation/audit_benchmark.py": "6619c818a52fc284e87ed6c48a503a54a3c9dd95447463ed78f075b7c58bad80",
|
||||||
|
"tools/graphrag/evaluation/evaluate_graphrag.py": "6bdf68307b6bb90731fe09a89955e96eee76fec13bdf82281a96715dd168680e",
|
||||||
|
"tools/graphrag/evaluation/freeze_graphrag.py": "32198eca7642f39a8ad33deefe0eea396d38fcc0f5bc5814cbb64ab6d3443b9e",
|
||||||
|
"tools/graphrag/evaluation/graphrag_evaluator.py": "267d4e9942b7767a78a3689e8f7c9d6ed49f025389b043b69449b2d225651160",
|
||||||
|
"tools/graphrag/evaluation/reproducibility.py": "5c28d8aa37ec6a973fa494f7e528c19af2f1326422ea7fd05912e01aa1af6725",
|
||||||
|
"tools/graphrag/graph_db.py": "a6fce68000065d328139829c5ca894623f6ed5828c74a869663366c2ad7b5ea2",
|
||||||
|
"tools/graphrag/graph_search.py": "20f466e8d9eef6a38e41860e9be9ebc719c93f38bcfa6f60aca0e1b56c7d6bca",
|
||||||
|
"tools/graphrag/graphrag.py": "bee2eb1f86d8df8e978495a61107edf723df2dc2e0468e3ecf844719ec635e1d",
|
||||||
|
"tools/graphrag/neo4j_smoke.py": "fb5244c72c29ef2acf96d1e7f54335ff168eed4119db1692025eb1b99194b7bb",
|
||||||
|
"tools/graphrag/tests/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||||
|
"tools/graphrag/tests/test_graph_search.py": "d5c95b5de2a0962857331929522764aa46a1222e550a3eb1aaca2148f9d58748",
|
||||||
|
"tools/graphrag/tests/test_graph_search_neo4j.py": "fec2bf72de8f752f17c9164fee5754bdb2e153828855e47efbf0000dbe82cf3b",
|
||||||
|
"tools/graphrag/tests/test_graph_search_regressions.py": "9db7779aeb8ed9e8c0f92c1657011a81080aff3c928649e811358e3009a18c48",
|
||||||
|
"tools/graphrag/tests/test_graphrag.py": "6379335110f05668beca87ca7e486442071b2f666dbd651408d5f3a8d5723f0e",
|
||||||
|
"tools/graphrag/tests/test_graphrag_evaluator.py": "1c6d08aeec9ae56ac4123239a5aed12a0081d66cc3f34b2047d95764579d7298",
|
||||||
|
"tools/graphrag/tests/test_graphrag_freeze.py": "c4b760baf4c7ebf13b16bd4cd3c51874f5512eef3b4c61470dc4d428b0303d9f",
|
||||||
|
"tools/graphrag/tests/test_graphrag_root_title.py": "085651fe6e6081521a5dde9554abfee93456250108cf15978df25378d886a46c",
|
||||||
|
"requirements.txt": "26a6d097727eba03c1b6c71cd02b06373ef01ce03e567dd2bc4357ae330e5a1a"
|
||||||
|
},
|
||||||
|
"dataset_sha256": "b5c96e423fc9a5bcee0dcca38fdeac86b2f7cd1efebfcb0d7cd4cfb7fed0620e",
|
||||||
|
"inputs": {
|
||||||
|
"data/documents.json": "0542af2a373771cf7c4a95f93d14f4f687f6a0187846892c959aa6efc4bade52",
|
||||||
|
"data/chunks.json": "437dde589be46e0c30842dd330de22d96a0173d2dbaff9c5f129568cb2bca4c9"
|
||||||
|
}
|
||||||
|
},
|
||||||
|
"graph": {
|
||||||
|
"sha256": "0637d9ebb106c65d9aaa73d0634b28db81135e6a6c7503ea6b06c4a922e7e1e3",
|
||||||
|
"nodes": 422,
|
||||||
|
"relationships": 829
|
||||||
|
},
|
||||||
|
"parameters": {
|
||||||
|
"limit": 40,
|
||||||
|
"max_entities": 8
|
||||||
|
},
|
||||||
|
"dev_summary": {
|
||||||
|
"questions": 286,
|
||||||
|
"strict_count": 209,
|
||||||
|
"strict_accuracy": 0.730769,
|
||||||
|
"error_count": 0,
|
||||||
|
"value_score": 0.751748,
|
||||||
|
"entity_score": 0.751748,
|
||||||
|
"relation_score": 0.751748,
|
||||||
|
"property_score": 0.835664,
|
||||||
|
"relation_choice_score": 0.968531,
|
||||||
|
"document_recall": 1.0,
|
||||||
|
"source_recall": 1.0,
|
||||||
|
"latency_mean_seconds": 0.032786,
|
||||||
|
"latency_median_seconds": 0.03221,
|
||||||
|
"latency_p95_seconds": 0.041831
|
||||||
|
},
|
||||||
|
"source_audit_summary": {
|
||||||
|
"dev": {
|
||||||
|
"questions": 286,
|
||||||
|
"source_consistent": 209,
|
||||||
|
"issues": {
|
||||||
|
"keyword_not_in_frontmatter_catalog": 66,
|
||||||
|
"keyword_not_linked_to_expected_person": 5,
|
||||||
|
"exact_categories_omit_or_add_source_categories": 6
|
||||||
|
}
|
||||||
|
},
|
||||||
|
"test": {
|
||||||
|
"questions": 214,
|
||||||
|
"source_consistent": 154,
|
||||||
|
"issues": {
|
||||||
|
"keyword_not_in_frontmatter_catalog": 46,
|
||||||
|
"keyword_not_linked_to_expected_person": 11,
|
||||||
|
"exact_categories_omit_or_add_source_categories": 3
|
||||||
|
}
|
||||||
|
}
|
||||||
|
},
|
||||||
|
"policy": "Report all questions. Source-consistent subset is supplementary. No holdout tuning.",
|
||||||
|
"dev_results_sha256": "768d6795cf49b59a59a405276950afd4c48b22357cb682b9820f747d2a9e2be9",
|
||||||
|
"audit_sha256": "4fbc8ea8090caaf275cac384e3c3c8ed7c3743b49523086bee3f0970e11d9276"
|
||||||
|
}
|
||||||
211
tools/graphrag/evaluation/frozen_v2.json
Normal file
211
tools/graphrag/evaluation/frozen_v2.json
Normal file
@ -0,0 +1,211 @@
|
|||||||
|
{
|
||||||
|
"schema_version": 2,
|
||||||
|
"partition": {
|
||||||
|
"method": "disjoint source profiles",
|
||||||
|
"dev_profile_count": 45,
|
||||||
|
"test_profile_count": 24,
|
||||||
|
"overlap": 0
|
||||||
|
},
|
||||||
|
"frozen_at_utc": "2026-10-25T01:03:09.186759+00:00",
|
||||||
|
"fingerprints": {
|
||||||
|
"implementation": {
|
||||||
|
"tools/graphrag/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||||
|
"tools/graphrag/build_graphrag.py": "81f6e9f5c9e71b588f8bed1968c1e900e29e484ba81d23b6a3a68e7220ad75a5",
|
||||||
|
"tools/graphrag/evaluation/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||||
|
"tools/graphrag/evaluation/audit_benchmark.py": "6619c818a52fc284e87ed6c48a503a54a3c9dd95447463ed78f075b7c58bad80",
|
||||||
|
"tools/graphrag/evaluation/benchmark_v2.py": "3e66d8e20d049758ac6df393355c0b5038f09c6ba97c96acc2087d61cfb4ad26",
|
||||||
|
"tools/graphrag/evaluation/evaluate_graphrag.py": "f9ef7e2fc681033cf1cb164581589f6f01acecf3d28e0cbfaba5c9ba72f24b23",
|
||||||
|
"tools/graphrag/evaluation/evidence_contract.py": "78e24264c176e163e1782fef1634b6c45c7f31bd4692726d02a30ab45a06648e",
|
||||||
|
"tools/graphrag/evaluation/freeze_graphrag.py": "0c330358beae2c5409e2dcd26be718c6b9534d5db9f2340f0390fe3be45cb60c",
|
||||||
|
"tools/graphrag/evaluation/graphrag_evaluator.py": "3afe014e126b6ad90c8e408284d2c1979f54d6cf5dd19fd67f9249708fbed2d3",
|
||||||
|
"tools/graphrag/evaluation/reproducibility.py": "b707d4c410cbf7d6769a6afdadfe79ef3bbd699a0323f0e0d2ab180ef7498680",
|
||||||
|
"tools/graphrag/evaluation/source_oracle.py": "02a44584bf4fa0e8e9faa7e13b85873a1b00671e0abe556abec8a274621d666c",
|
||||||
|
"tools/graphrag/graph_db.py": "a6fce68000065d328139829c5ca894623f6ed5828c74a869663366c2ad7b5ea2",
|
||||||
|
"tools/graphrag/graph_search.py": "d08eaaa8c395e993cf6416f90226b16ea1fcefca4719304be4b64c61a174b98b",
|
||||||
|
"tools/graphrag/graphrag.py": "71a13cb5aeef0e1b8247840d76f845af46b9c58b6bd9ba1b9ef210b468ad6805",
|
||||||
|
"tools/graphrag/neo4j_smoke.py": "fb5244c72c29ef2acf96d1e7f54335ff168eed4119db1692025eb1b99194b7bb",
|
||||||
|
"tools/graphrag/tests/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||||
|
"tools/graphrag/tests/test_evaluation_pipeline_v2.py": "63d1b3e80ae3c7b563374fd7ab4aa5ffad3c614eafbd15142c577abd7f756bf9",
|
||||||
|
"tools/graphrag/tests/test_evaluator_connected_v2.py": "29d7c9838ed1ff37ea3276df6feb1b6142158c43a0525712f490b648181882de",
|
||||||
|
"tools/graphrag/tests/test_graph_search.py": "d5c95b5de2a0962857331929522764aa46a1222e550a3eb1aaca2148f9d58748",
|
||||||
|
"tools/graphrag/tests/test_graph_search_entity_v2.py": "639d9ac307589de6788ef8145a4e7f73d97a1531445294424e0fc8ba83f99a1c",
|
||||||
|
"tools/graphrag/tests/test_graph_search_neo4j.py": "fec2bf72de8f752f17c9164fee5754bdb2e153828855e47efbf0000dbe82cf3b",
|
||||||
|
"tools/graphrag/tests/test_graph_search_regressions.py": "9db7779aeb8ed9e8c0f92c1657011a81080aff3c928649e811358e3009a18c48",
|
||||||
|
"tools/graphrag/tests/test_graphrag.py": "6379335110f05668beca87ca7e486442071b2f666dbd651408d5f3a8d5723f0e",
|
||||||
|
"tools/graphrag/tests/test_graphrag_evaluator.py": "1c6d08aeec9ae56ac4123239a5aed12a0081d66cc3f34b2047d95764579d7298",
|
||||||
|
"tools/graphrag/tests/test_graphrag_freeze.py": "c4b760baf4c7ebf13b16bd4cd3c51874f5512eef3b4c61470dc4d428b0303d9f",
|
||||||
|
"tools/graphrag/tests/test_graphrag_research_v2.py": "19ebf4a6fd622aaebc8f8b7e17c2aeda83ba17e7f04f155ee70817fa3c14fe03",
|
||||||
|
"tools/graphrag/tests/test_graphrag_root_title.py": "085651fe6e6081521a5dde9554abfee93456250108cf15978df25378d886a46c",
|
||||||
|
"tools/graphrag/tests/test_source_oracle_v2.py": "eea11c98f477764fd0826b0c26396d3617a21ffec76ef15809e74ed27e53ff3b",
|
||||||
|
"requirements.txt": "26a6d097727eba03c1b6c71cd02b06373ef01ce03e567dd2bc4357ae330e5a1a"
|
||||||
|
},
|
||||||
|
"dataset_sha256": "fd9835adee93cacf2c45806dfe93463c2e9a58ccedb5f073876ad176039ad734",
|
||||||
|
"inputs": {
|
||||||
|
"data/documents.json": "0542af2a373771cf7c4a95f93d14f4f687f6a0187846892c959aa6efc4bade52",
|
||||||
|
"data/chunks.json": "437dde589be46e0c30842dd330de22d96a0173d2dbaff9c5f129568cb2bca4c9"
|
||||||
|
},
|
||||||
|
"source_corpus": {
|
||||||
|
"sha256": "440da12a7a991824e923f70cada7c616c3fb3b0f12767ec7d75039a6a3231b10",
|
||||||
|
"document_count": 114,
|
||||||
|
"documents": {
|
||||||
|
"pages/interns/bogdan_paul_chis/README.md": "3b4b946eb3c10e9f9a4092e6cffa01c5080e7579aded2f6ed3120c41ed62b647",
|
||||||
|
"pages/interns/cesar_gutierrez/README.md": "b0be60576eed28d4b1920e9acf198684519373dfc13171567247c853b3ed699e",
|
||||||
|
"pages/interns/oliver_pejic/README.md": "0470f3c8465be8f02204b08e4c75ef47f68c7e4ad1038faa5641cdf1811f33d5",
|
||||||
|
"pages/interns/sevval_bulburu/README.md": "ff2a9d66253802f1af0fdfd74832e40fae41b6df23c5e61dc266f6cd0cc16c4d",
|
||||||
|
"pages/interns/yussef_ressaissi/README.md": "f997a65699da0db3222ef7a3c37652d05dfc3419ad4ec74683bafc2c897bb987",
|
||||||
|
"pages/students/2016/darius_lindvai/README.md": "fcaa47bb9708a6439eec5c4b7f7b4ed6c7359e423e1d940e1aed9f44957e6d62",
|
||||||
|
"pages/students/2016/darius_lindvai/dp2021/README.md": "be3d0fea2a6d592b225eecabd9b19445c2fce62b8289c07ab6af93835db12970",
|
||||||
|
"pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md": "352162de1b1e192228fa5d26506c028ac47e567e90df53b1bbaa6ad736ec4766",
|
||||||
|
"pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md": "b4a81ff457624b089d618e4479afb1e3d748f6724f72104ef5518e535ae02fe5",
|
||||||
|
"pages/students/2016/dominik_nagy/README.md": "1c4037a158d84c45fa705a0c38e47142a9d46e226f0c138bc2d56d7c38f6d74d",
|
||||||
|
"pages/students/2016/dominik_nagy/timovy_projekt/README.md": "b81a4dab7316f7b846dcf36515f6aa9d44035c86f46f0e07b7a43308bcd31458",
|
||||||
|
"pages/students/2016/ediz_morochovic/README.md": "045e5eb9a3df2b84140808fbca0c3163266ad0efa144bc42d9d5c597881c6ac6",
|
||||||
|
"pages/students/2016/jakub_maruniak/README.md": "6734c41a95b9d0c1e3d226b393ad109ee4a7b82ebfffa73df2d7e0a743fefa14",
|
||||||
|
"pages/students/2016/jakub_maruniak/dp2021/README.md": "9cd884aec70705cdb2aaa0f514b513f16de263c37b749ced7f92916cd2f91c39",
|
||||||
|
"pages/students/2016/jakub_maruniak/dp2021/annotation/README.md": "debae0c50aea1accef0840912b9b1f37b2138f856002bb50e91d7ea2dbbe7963",
|
||||||
|
"pages/students/2016/jakub_maruniak/dp2021/train_experiments/README.md": "01dff38b37043414fa1db204394ddbe7aade00e14d02d495572b65c85d09b194",
|
||||||
|
"pages/students/2016/jakub_maruniak/timovy_projekt/README.md": "04114b1f3d84664aad5bdba5a0b614c5a6f23392be3c31fd9123d63db1be0a35",
|
||||||
|
"pages/students/2016/jan_holp/README.md": "80d6a8492766e5bfa61673a372e5f059d30c8e335de39842866c51485960e4d3",
|
||||||
|
"pages/students/2016/jan_holp/dp2021/README.md": "a62acb74009376766c7e2f9856ee01d21f84593eb9b3ce85cf2e6032aa412476",
|
||||||
|
"pages/students/2016/jan_holp/dp2021/zdrojove_subory/README.md": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||||
|
"pages/students/2016/jan_holp/timovy_projekt/README.md": "79eebdfd3af7e8d5c279077e285a580731b1cf8cc9b4454f6596796e9915f70c",
|
||||||
|
"pages/students/2016/lukas_pokryvka/README.md": "f279456c5c277ff1ee0dd89a3464ed9f9f67b44bc185a5da9811ef5cfb675002",
|
||||||
|
"pages/students/2016/lukas_pokryvka/dp2021/README.md": "39b61376ce108e4a930f926ab2d6a997207457121bccfcf617129a3b210a15cf",
|
||||||
|
"pages/students/2016/lukas_pokryvka/timovy_projekt/README.md": "4de4b6c8cfed17b6c60090f82df1d55a66be70a79d3013850689b2baebdd801b",
|
||||||
|
"pages/students/2016/mark_feher/README.md": "bec37c0319fe0869a0377d771db23d090dbda93c27328f5697cdaeb3bbccfe9b",
|
||||||
|
"pages/students/2016/maros_harahus/README.md": "0da150e91918632c9e8cd1443f04da403595a372517e254928ce9f76c9d5033d",
|
||||||
|
"pages/students/2016/maros_harahus/timovy_projekt/README.md": "75af19f7c68f4b646fa1dbae75f3f3dfc52633a9f9da1400d21808bb20be0d83",
|
||||||
|
"pages/students/2016/patrik_pavlisin/README.md": "dc1c648d7cd9b0f0e021c57f9b98189e37c100871439e7e304390715913f2763",
|
||||||
|
"pages/students/2016/patrik_pavlisin/dp21/README.md": "ac1eb0fd0360ad34aa21b7c8da5bb010a6edf10be5721f28dedc3986cd1d8c54",
|
||||||
|
"pages/students/2016/patrik_pavlisin/dp22/README.md": "f2a8c619a812b99abab618ae388eb672407950e1f33fb8d7da7a528c4de81d50",
|
||||||
|
"pages/students/2016/patrik_pavlisin/tp20/README.md": "ae9c771f27e7e093bc29c6888c8d0b27ed61fb41519fd0d7e7f4f6cbb4626edc",
|
||||||
|
"pages/students/2016/tomas_kucharik/README.md": "6a1a215433eb1857660177b4cb2ecec03c6a86743d3a04cd6d5c9d9682c9e63b",
|
||||||
|
"pages/students/2017/dmytro_ushatenko/README.md": "65f4ac177d492162b08ca5da3d9eb048bd088a3c117a28a662113b7e4bc3a4ec",
|
||||||
|
"pages/students/2017/martin_jancura/README.md": "6a0a18d5095dcfb12abfdd72c9cfd8025d714fb5e29a7858cd2b285e4cb986b9",
|
||||||
|
"pages/students/2017/stanislav_matsunych/README.md": "90ffa11eff4a4360b0252dbc53a116c3a5777b3d5dd86ce5c89c02bdd2051c73",
|
||||||
|
"pages/students/2017/than_trung_thanh/README.md": "2150519b8580e7337520db4de64d2d1c82d2634380537d019f41c506dbf2979d",
|
||||||
|
"pages/students/2018/NaN1name_buday/README.md": "23c8c58090bdc954347e36f141bea91f43c8d5b1d777e346864a2ebe84c0bcce",
|
||||||
|
"pages/students/2018/adrian_remias/README.md": "e5bfe1d5d4e626beaa636a02d34ec58cf2cff9b0e57833905af35b80bf1465a2",
|
||||||
|
"pages/students/2018/david_ilas/README.md": "96c45ff9c5a821ddcb1a2fc86d487bd8f4729d1b76887914b0f5fbf99af45af0",
|
||||||
|
"pages/students/2018/david_omasta/README.md": "4164051870e1e1cf8949ed18a74196e9ea789dfbe4fee24bdeb736ca42848327",
|
||||||
|
"pages/students/2018/martin_wencel/README.md": "0e6a7a981689f22304f8baa5de97d4315c0695c94c9277de7851943eb012253b",
|
||||||
|
"pages/students/2018/oleh_bilykh/README.md": "4072c62dd8ee753a0c8fa43fdfbbdf566e394c2df13e6a79d08a302e332710b1",
|
||||||
|
"pages/students/2018/ondrej_megela/README.md": "969ff2e1a436b8f957e7168cf5eb678196b99aeda17701c502b016441f644065",
|
||||||
|
"pages/students/2018/samuel_sirotnik/README.md": "cc230ede67b6e8632511c92a5ed6d1e9deb42e70819280222bdfd369ee77fc70",
|
||||||
|
"pages/students/2019/alina_vitko/README.md": "9b071fe2aff470c275ae027be236fe836f741f774cabb9cbbb55304a8d5102cd",
|
||||||
|
"pages/students/2019/artem_yatsenko/README.md": "328b101e46c51c959e792cf7ca226942f81d2ab8fe9648ad6d0ecd07016429e2",
|
||||||
|
"pages/students/2019/david_stromp/README.md": "e46ca8691d5ec894128f6f6f2ed33e2c7bd141f80719bb0449b20f10f30cca09",
|
||||||
|
"pages/students/2019/dmytro_mural/README.md": "e881a47d847c3ef8d680844113fdbfbb87553b28982bf9eef4936f6d30923e93",
|
||||||
|
"pages/students/2019/filip_tomas/README.md": "75a1fe7b921e4bff0fdf9e2a957b4adad4b4a57aa7ebdffbb73dd82c02123f94",
|
||||||
|
"pages/students/2019/kristian_sopkovic/README.md": "3286960fb30f584df35455f9b6dfae81ca4827a1d711d2bcd6e48c3f150c9279",
|
||||||
|
"pages/students/2019/michal_stromko/README.md": "3ae1dd9b6638a6a249a94be3f3846286555666aefa225bb3a2c7288b35900ce7",
|
||||||
|
"pages/students/2019/michal_stromko/vp2021/README.md": "feb2e093fdd6461239e79b1e1f96e65a1c8cd96e8a2b70535ae556a9c198046a",
|
||||||
|
"pages/students/2019/michal_stromko/vp2021/tutorials/README.md": "40e3fa448c7329ef863e705435e23fe6b4788de440710f066fe0eed92d132bad",
|
||||||
|
"pages/students/2019/michal_stromko/vp2021/tutorials/img/README.md": "e8d3ac160b17dfdee2c3e996bf6a03af7a6f16f9140bf5cf7ee343a82dd1865f",
|
||||||
|
"pages/students/2019/patrik_pokrivcak/README.md": "3e3957ad0f7aca59d6eb64c38a3f5e21d8fd953200825d0d0e5cacabfbc35a7d",
|
||||||
|
"pages/students/2019/samuel_horani/README.md": "86e6959ccc612b069687b57996fa3f61660075d6a0d65bfec64f423d39a0a999",
|
||||||
|
"pages/students/2020/david_kostilnik/README.md": "2927524b75da59a64120fc364a0fc374986fa4d364d54e52c36800762c203264",
|
||||||
|
"pages/students/2020/jakub_kristian_lukas/README.md": "f139d9b1ebf5a3f45612f3df5703ecdd935b90701763c27c7c529044c0b0455a",
|
||||||
|
"pages/students/2020/kamil_tomcufcik/README.md": "9d865adf538bc6d7992ee4f4882713447da5c936fca17c43ca0f576072537048",
|
||||||
|
"pages/students/2020/matej_kobylan/README.md": "3d7b289e17b8f25678a07e9ee0e6741688485a0ccb1e50940a6a6acc6312a547",
|
||||||
|
"pages/students/2020/matus_suchanic/README.md": "770ca49538cca22df35f8e7ba736ee97483e4fe5788c221496553592b4e78dc6",
|
||||||
|
"pages/students/2020/pavol_hudak/README.md": "33d06fccc6451e5f19b27b0cad001a34e81635b4ea294a01dec7771c823abc40",
|
||||||
|
"pages/students/2020/vladyslav_krupko/README.md": "4c28e6d38651bb2cafcbf4a18e35210cd369aef2caff6c5b0aa52fac38f0fe7d",
|
||||||
|
"pages/students/2021/artur_hyrenko/README.md": "0568261f4ade4de5472edcfeb1ffed9abae18dc67e4050f4ce2ad088839a2bb3",
|
||||||
|
"pages/students/2021/eduard_matovka/README.md": "de2a7ae38ec87110e347956b37d0605a298ed2847f972961cc9b977da8221d43",
|
||||||
|
"pages/students/2021/manohar_gowdru_shridharu/README.md": "c00ceb620ed7087ead5d9448d476bbb98d273d1d9e7bf1bc4355c367b26c7a6b",
|
||||||
|
"pages/students/2021/martin_sarissky/README.md": "8e97b45a253745faa55f63c844e0b5dfe680aeaf6eb01fb8f9d06ac6e8ee8bcf",
|
||||||
|
"pages/students/2021/matej_novotny/README.md": "b083a7cadde532e3428dc9a57bc61456fcc5905bda91e011b96033d42bf5d9cb",
|
||||||
|
"pages/students/2021/matej_scislak/README.md": "b9a32cce8605e044a4f2828ff2d91a2995a62ef3a841e62f0a225c97221f0cc8",
|
||||||
|
"pages/students/2021/nikita_bodnar/README.md": "2016c0dd923c0f8e561d5cea42ac81da3610fdcc54a4527f56d078e34e53ce90",
|
||||||
|
"pages/students/2021/oleksandr_hryshchenko/README.md": "4b073992b715b6c75b79fd2c8f850a69f940966e3a61a82c625c32c945a93036",
|
||||||
|
"pages/students/2021/vladimir_ferko/README.md": "68e7d311896eda2171e5eec1ec3a8da90d326ed91acaace8058f68664a50d271",
|
||||||
|
"pages/students/2022/andrii_pervashov/README.md": "319dcaa1cc2e29dd7e3a710bab26cb3ac6944ab71b0b97e1de076b1199122334",
|
||||||
|
"pages/students/2022/daniil_huzenko/README.md": "390782fbff6220a9462060ce1a62959f2a2b88f42d06e2c51d1f406b75d73f2c",
|
||||||
|
"pages/students/2022/jakub_schwarc/README.md": "f541a8852c2b0f6f9d7182e01a34c4e3beee9bfa55427a06b331638b11eb8be6",
|
||||||
|
"pages/students/2022/jan_malinovsky/README.md": "8af021bfb131fa005a7aec3e2f2f12fc17fa5dc14e2675311adbbfc445a4bcab",
|
||||||
|
"pages/students/2022/jan_ptak/README.md": "131cf053764fd5423541ebe672c3b4f5da875cfb8e4b821f1335ddb967282282",
|
||||||
|
"pages/students/2022/oleh_poiasnik/README.md": "c2f7dc3f61f8b4a5b43ded1e3ae4c7d3e7f874439ee6b17dd9c8d45dabc25bc8",
|
||||||
|
"pages/students/2022/samuel_vasil/README.md": "67c807049147aacd04f3050f4ff0233a8b3f0a239ab173b430e13dfe113ad0a5",
|
||||||
|
"pages/students/2022/serhii_yemets/README.md": "ffbeac893947acafe855d576322a8826f9d4f87ac344cb31f8ceeefa244b9133",
|
||||||
|
"pages/students/2022/tetiana_mohorian/README.md": "c9efdc632bf1ca89a0bfde0dc00be7aaac8a85da3d92e2ce8506236c73e93cfb",
|
||||||
|
"pages/students/2022/valerii_kutsenko/README.md": "dc764c609ad3c1df59cfea997d4db82a591b1b1e0764453e319d841115507e4f",
|
||||||
|
"pages/students/2022/vladyslav_yanchenko/README.md": "4d1ce216e3b526ee437ddbc658e51d7bb83530087e43628c096a569a3854a47f",
|
||||||
|
"pages/students/2022/yevhenii_leonov/README.md": "b90e41db0cec2451027020a9102d32a24d777e8a38b604ccca87b36cd6b3a292",
|
||||||
|
"pages/students/2023/denis_le_thanh/README.md": "2cb83f942d86a02712b0c58778e46dc2211346d1a6eba606471dfa832245db61",
|
||||||
|
"pages/students/2023/maksym_zatirka/README.md": "7a7d2cbe276c352dacfbc6ba6de5f15303d30ecf34845ff8da8d085f3d67c3dd",
|
||||||
|
"pages/students/2023/oleksandr_dorybohov/README.md": "c24d6f941de0dafb4459cea8259cf147821cafc86ba65be5b528f419f734bc18",
|
||||||
|
"pages/students/2023/ronald_zalacko/README.md": "724b0f8e6e641236dba9bddbd77f4546e09514076c7dfb151807aaf4b882c96f",
|
||||||
|
"pages/students/2023/rostyslav_rodzhuk/README.md": "de356dd7427c8a0716c165a0f88ae47b691a86ee7a388f60e2d2e9306298415c",
|
||||||
|
"pages/students/2023/samuel_dzurina/README.md": "4818191d044b91219c796a35010c95da5cf2093e050d494f30b219b91e13fa0e",
|
||||||
|
"pages/students/2023/simona_bobrovcanova/README.md": "e473a1911dae10ab40e2cf6696a8be616a58c22aaf09af5953fbac475791a35e",
|
||||||
|
"pages/students/2023/yevhenii_medushivskyi/README.md": "5710ebf91c893a12fe6d19f5372311938d1e7c7bbdf203f2dc8ed2fe7c4f5a24",
|
||||||
|
"pages/topics/akopisat/README.md": "c7245e1fbfa4160618502c0baf8cc6bc47cd9a82b8a85bc1c645314829a7b76a",
|
||||||
|
"pages/topics/bert/README.md": "35e507f7ec2ad1d3526e2a15f94ea085ee25f680a02daf6df62fd429bd9c25c9",
|
||||||
|
"pages/topics/chatbot/README.md": "6f2f83ffb80109be47f9750cca9d3036ec3645abef9f2b590bd6825780c7c48a",
|
||||||
|
"pages/topics/faq/README.md": "15cfbd9c2a1649c80a7a58922e2b66dadab5c86a5ef33ef16c82bebd4d2dbf06",
|
||||||
|
"pages/topics/hatespeech/README.md": "364df94e70dd740c63544e2586ba7b957780f714fc0c941d1b04b02233e6cbc5",
|
||||||
|
"pages/topics/legal/README.md": "003bb9bfe1e0ca21652091c2d11496312eb04e0689fe459e14c2d5a738e8eeea",
|
||||||
|
"pages/topics/morphology/README.md": "e242cc5ff1a4cc98e227566c0ead999bbc95937b7c20be62cb2afb773d0d35c0",
|
||||||
|
"pages/topics/named-entity/README.md": "66b2e25f70211d432d596e377d552b3b8f0c525b14c31e3bc9c956c3aeadca84",
|
||||||
|
"pages/topics/named-entity/navod/README.md": "1ff87079a98411de0414754c60241e08d2214ddcd63ddf974e4340cce2ce5b02",
|
||||||
|
"pages/topics/nlp/README.md": "6f90abf9dc3f0ff33475283c13b4a08561abf631425ec2daacb076155a9e02c2",
|
||||||
|
"pages/topics/otvorene/README.md": "cd5544925553fe3840c0ea6f8ef60ab756e26ab6757bf810025c948d8d4f98fc",
|
||||||
|
"pages/topics/prodigy/README.md": "5e4f691f2754c2ec4afbaab2f41e6db77feb5b322dd9344465eb40c35f116499",
|
||||||
|
"pages/topics/python/README.md": "2ef073adba672142c39e9a59fa2e00a98ab52bda54233d46fbe6940ee23f9fcc",
|
||||||
|
"pages/topics/question/README.md": "408078a2a67cea2699e12359e85ab641136231e6104c2afdf874a705879525df",
|
||||||
|
"pages/topics/question/navod/README.md": "061e737c69184b2bd244316ca7ba841f7186fe01ee80ee993742a733dcad3ecd",
|
||||||
|
"pages/topics/question/nezodpovedatelne/README.md": "b6703d9690f4599b973efb27595ce157773ae0fc0d55cf2c0a09d9f50e8e4c92",
|
||||||
|
"pages/topics/question/validacie/README.md": "3216a7127abdfc6da50ed116f44ff2d6785e7da4af70d23aceda774e745ad562",
|
||||||
|
"pages/topics/resources/README.md": "09405397387f00cbcc5680f7d655f2d861e4d92e5df792a62d9dfd04f3534f48",
|
||||||
|
"pages/topics/seq2seq/README.md": "969d15c03a63a3f8d5edc9017fe5a0fb7311fdf4de4a3473a08266241f92c1e2",
|
||||||
|
"pages/topics/spacy/README.md": "f504e5db77cb8694f08a57fb8636e522d59a0e669216f4bc8273bc3c5f375f87",
|
||||||
|
"pages/topics/steel/README.md": "b4068cef2ed197711467ac47630d5b2064fdc8828f898f7af99664e94d833330",
|
||||||
|
"pages/topics/translation/README.md": "a7d4289e72199b307dc5ad8fc69cda39c1a33c27a6c7447af70aa9c3cc6b8635"
|
||||||
|
}
|
||||||
|
}
|
||||||
|
},
|
||||||
|
"graph": {
|
||||||
|
"sha256": "a7b95c647eb9a4eff6060f6e7e8be2b74a8246095f3c8c98d4611f4be545f51a",
|
||||||
|
"nodes": 429,
|
||||||
|
"relationships": 843
|
||||||
|
},
|
||||||
|
"parameters": {
|
||||||
|
"limit": 40,
|
||||||
|
"max_entities": 8
|
||||||
|
},
|
||||||
|
"dev_summary": {
|
||||||
|
"questions": 509,
|
||||||
|
"strict_count": 509,
|
||||||
|
"strict_accuracy": 1.0,
|
||||||
|
"error_count": 0,
|
||||||
|
"value_score": 1.0,
|
||||||
|
"entity_score": 1.0,
|
||||||
|
"relation_score": 1.0,
|
||||||
|
"property_score": 1.0,
|
||||||
|
"relation_choice_score": 1.0,
|
||||||
|
"document_recall": 1.0,
|
||||||
|
"source_recall": 1.0,
|
||||||
|
"binding_score": 1.0,
|
||||||
|
"path_score": 1.0,
|
||||||
|
"answerability_accuracy": 1.0,
|
||||||
|
"latency_mean_seconds": 0.042799,
|
||||||
|
"latency_median_seconds": 0.040359,
|
||||||
|
"latency_p95_seconds": 0.061584
|
||||||
|
},
|
||||||
|
"source_audit_summary": {
|
||||||
|
"dev": {
|
||||||
|
"questions": 509,
|
||||||
|
"source_consistent": 509,
|
||||||
|
"issues": {}
|
||||||
|
},
|
||||||
|
"test": {
|
||||||
|
"questions": 80,
|
||||||
|
"source_consistent": 80,
|
||||||
|
"issues": {}
|
||||||
|
}
|
||||||
|
},
|
||||||
|
"policy": "Report all questions including negatives. No exclusions or holdout tuning.",
|
||||||
|
"dev_results_sha256": "3bcb4bed1370975c47de2d34ea00f80c87d4832eee395cfde0d69130d5716be6",
|
||||||
|
"audit_sha256": "6000c6a14cedaa31dd8c1b35b7f95c142a4233cd8508542f84235bceaf6c6cdf"
|
||||||
|
}
|
||||||
1459
tools/graphrag/evaluation/graphrag_evaluator.py
Normal file
1459
tools/graphrag/evaluation/graphrag_evaluator.py
Normal file
File diff suppressed because it is too large
Load Diff
File diff suppressed because it is too large
Load Diff
71956
tools/graphrag/evaluation/graphrag_questions_v2.json
Normal file
71956
tools/graphrag/evaluation/graphrag_questions_v2.json
Normal file
File diff suppressed because it is too large
Load Diff
83
tools/graphrag/evaluation/reproducibility.py
Normal file
83
tools/graphrag/evaluation/reproducibility.py
Normal file
@ -0,0 +1,83 @@
|
|||||||
|
"""Content fingerprints used to freeze retrieval before holdout evaluation."""
|
||||||
|
from __future__ import annotations
|
||||||
|
|
||||||
|
import hashlib
|
||||||
|
import json
|
||||||
|
import os
|
||||||
|
import platform
|
||||||
|
import subprocess
|
||||||
|
from datetime import datetime, timezone
|
||||||
|
from pathlib import Path
|
||||||
|
from typing import Any
|
||||||
|
|
||||||
|
ROOT = Path(__file__).resolve().parents[3]
|
||||||
|
|
||||||
|
|
||||||
|
def sha256_file(path: Path) -> str:
|
||||||
|
return hashlib.sha256(path.read_bytes()).hexdigest()
|
||||||
|
|
||||||
|
|
||||||
|
def source_corpus_fingerprint(root: Path = ROOT) -> dict[str, Any]:
|
||||||
|
"""Bind independent expectations to the original Markdown, not graph output."""
|
||||||
|
wiki = Path(os.getenv('ZPWIKI_ROOT', str(root.parent / 'zpwiki')))
|
||||||
|
pages = wiki / 'pages'
|
||||||
|
if not pages.is_dir():
|
||||||
|
raise RuntimeError(f'Original ZP Wiki Markdown directory is missing: {pages}')
|
||||||
|
documents = {str(path.relative_to(wiki)): sha256_file(path)
|
||||||
|
for path in sorted(pages.rglob('README.md')) if path.is_file()}
|
||||||
|
serialized = json.dumps(documents, sort_keys=True, separators=(',', ':')).encode()
|
||||||
|
return {'sha256': hashlib.sha256(serialized).hexdigest(),
|
||||||
|
'document_count': len(documents), 'documents': documents}
|
||||||
|
|
||||||
|
|
||||||
|
def content_fingerprints(questions: Path, root: Path = ROOT) -> dict[str, Any]:
|
||||||
|
files = sorted((root / 'tools/graphrag').rglob('*.py'))
|
||||||
|
# requirements.txt and tools/ are present both in the checkout and image.
|
||||||
|
files.append(root / 'requirements.txt')
|
||||||
|
return {
|
||||||
|
'implementation': {str(path.relative_to(root)): sha256_file(path) for path in files},
|
||||||
|
'dataset_sha256': sha256_file(questions),
|
||||||
|
'inputs': {name: sha256_file(root / name) for name in ['data/documents.json', 'data/chunks.json']},
|
||||||
|
'source_corpus': source_corpus_fingerprint(root),
|
||||||
|
}
|
||||||
|
|
||||||
|
|
||||||
|
def graph_fingerprint(session: Any) -> dict[str, Any]:
|
||||||
|
nodes = session.run(
|
||||||
|
'MATCH (n) WHERE n.graph_scope = $scope '
|
||||||
|
'RETURN labels(n) AS labels, properties(n) AS properties', scope='zpwiki'
|
||||||
|
).data()
|
||||||
|
edges = session.run(
|
||||||
|
'MATCH (a)-[r]->(b) WHERE a.graph_scope = $scope AND b.graph_scope = $scope '
|
||||||
|
'RETURN labels(a) AS source_labels, coalesce(a.id, a.path, a.name) AS source, '
|
||||||
|
'type(r) AS type, properties(r) AS properties, labels(b) AS target_labels, '
|
||||||
|
'coalesce(b.id, b.path, b.name) AS target', scope='zpwiki'
|
||||||
|
).data()
|
||||||
|
# elementId and row order are deliberately excluded: they change on rebuild.
|
||||||
|
canonical = lambda rows: sorted(json.dumps(row, sort_keys=True, ensure_ascii=False, default=str) for row in rows)
|
||||||
|
content = json.dumps({'nodes': canonical(nodes), 'relationships': canonical(edges)}, ensure_ascii=False)
|
||||||
|
return {'sha256': hashlib.sha256(content.encode()).hexdigest(),
|
||||||
|
'nodes': len(nodes), 'relationships': len(edges)}
|
||||||
|
|
||||||
|
|
||||||
|
def run_metadata(questions: Path) -> dict[str, Any]:
|
||||||
|
def revision(path: Path) -> str | None:
|
||||||
|
result = subprocess.run(['git', '-C', str(path), 'rev-parse', 'HEAD'],
|
||||||
|
text=True, capture_output=True, check=False)
|
||||||
|
return result.stdout.strip() if result.returncode == 0 else None
|
||||||
|
return {'started_at_utc': datetime.now(timezone.utc).isoformat(),
|
||||||
|
'python': platform.python_version(), 'git_head': revision(ROOT),
|
||||||
|
'wiki_git_head': revision(Path(os.getenv('ZPWIKI_ROOT', str(ROOT.parent / 'zpwiki')))),
|
||||||
|
'fingerprints': content_fingerprints(questions)}
|
||||||
|
|
||||||
|
|
||||||
|
def verify_freeze(manifest: dict, metadata: dict, graph: dict, *, limit: int, max_entities: int,
|
||||||
|
audit: Path | None) -> None:
|
||||||
|
if manifest['fingerprints'] != metadata['fingerprints']:
|
||||||
|
raise RuntimeError('Frozen implementation, benchmark or inputs changed. TEST refused.')
|
||||||
|
if manifest['graph'] != graph:
|
||||||
|
raise RuntimeError('Neo4j graph changed since DEV freeze. TEST refused.')
|
||||||
|
if manifest['parameters'] != {'limit': limit, 'max_entities': max_entities}:
|
||||||
|
raise RuntimeError('Retrieval parameters differ from DEV freeze. TEST refused.')
|
||||||
|
if audit is None or sha256_file(audit) != manifest['audit_sha256']:
|
||||||
|
raise RuntimeError('Source audit differs from DEV freeze. TEST refused.')
|
||||||
@ -0,0 +1,3 @@
|
|||||||
|
# Historický GraphRAG DEV beh
|
||||||
|
|
||||||
|
Pôvodný celý DEV beh pred dokončením evaluácie v1. Zachovaný pre históriu vývoja a analýzu chýb. Nemá obsahové odtlačky ani totožné anotačné pravidlá s novšími verziami, preto jeho skóre nemožno bez ďalšieho vydávať za priamo porovnateľný finálny benchmark. Autoritatívne merania sú v adresároch `final_*`.
|
||||||
@ -0,0 +1,287 @@
|
|||||||
|
id,split,category,difficulty,strict,value_score,entity_score,relation_score,property_score,relation_choice_score,document_recall,source_recall,entity_set_ok,latency_seconds,error,question,expected_values,matched_values,expected_relations,actual_relations,expected_documents,actual_documents,fact_types,strategies
|
||||||
|
g0001,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.063046,,Sú osoby Maroš Harahus a Jakub Maruniak v ZP Wiki prepojené cez kľúčové slovo Spacy? Uveď spoločné kľúčové slovo.,"[""Maroš Harahus"", ""Jakub Maruniak"", ""Spacy""]","[""Maroš Harahus"", ""Jakub Maruniak"", ""Spacy""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
g0002,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.036015,,Over prepojenie osôb Maroš Harahus a Jakub Maruniak cez kľúčové slovo Spacy a pomenuj spoločné kľúčové slovo.,"[""Maroš Harahus"", ""Jakub Maruniak"", ""Spacy""]","[""Maroš Harahus"", ""Jakub Maruniak"", ""Spacy""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
g0003,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.036391,,Sú osoby Maroš Harahus a Kristián Sopkovič v ZP Wiki prepojené cez kľúčové slovo Spacy? Uveď spoločné kľúčové slovo.,"[""Maroš Harahus"", ""Kristián Sopkovič"", ""Spacy""]","[""Maroš Harahus"", ""Kristián Sopkovič"", ""Spacy""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
g0004,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.035624,,Over prepojenie osôb Maroš Harahus a Kristián Sopkovič cez kľúčové slovo Spacy a pomenuj spoločné kľúčové slovo.,"[""Maroš Harahus"", ""Kristián Sopkovič"", ""Spacy""]","[""Maroš Harahus"", ""Kristián Sopkovič"", ""Spacy""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
g0005,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.037143,,Sú osoby Maroš Harahus a Artem Yatsenko v ZP Wiki prepojené cez kľúčové slovo Spacy? Uveď spoločné kľúčové slovo.,"[""Maroš Harahus"", ""Artem Yatsenko"", ""Spacy""]","[""Maroš Harahus"", ""Artem Yatsenko"", ""Spacy""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
g0006,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.035419,,Over prepojenie osôb Maroš Harahus a Artem Yatsenko cez kľúčové slovo Spacy a pomenuj spoločné kľúčové slovo.,"[""Maroš Harahus"", ""Artem Yatsenko"", ""Spacy""]","[""Maroš Harahus"", ""Artem Yatsenko"", ""Spacy""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
g0007,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031962,,Sú osoby Jakub Maruniak a Kristián Sopkovič v ZP Wiki prepojené cez kľúčové slovo Spacy? Uveď spoločné kľúčové slovo.,"[""Jakub Maruniak"", ""Kristián Sopkovič"", ""Spacy""]","[""Jakub Maruniak"", ""Kristián Sopkovič"", ""Spacy""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
g0008,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.034931,,Over prepojenie osôb Jakub Maruniak a Kristián Sopkovič cez kľúčové slovo Spacy a pomenuj spoločné kľúčové slovo.,"[""Jakub Maruniak"", ""Kristián Sopkovič"", ""Spacy""]","[""Jakub Maruniak"", ""Kristián Sopkovič"", ""Spacy""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
g0009,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.035871,,Sú osoby Jakub Maruniak a Artem Yatsenko v ZP Wiki prepojené cez kľúčové slovo Spacy? Uveď spoločné kľúčové slovo.,"[""Jakub Maruniak"", ""Artem Yatsenko"", ""Spacy""]","[""Jakub Maruniak"", ""Artem Yatsenko"", ""Spacy""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
g0010,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.039036,,Over prepojenie osôb Jakub Maruniak a Artem Yatsenko cez kľúčové slovo Spacy a pomenuj spoločné kľúčové slovo.,"[""Jakub Maruniak"", ""Artem Yatsenko"", ""Spacy""]","[""Jakub Maruniak"", ""Artem Yatsenko"", ""Spacy""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
g0011,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.036217,,Sú osoby Kristián Sopkovič a Artem Yatsenko v ZP Wiki prepojené cez kľúčové slovo Spacy? Uveď spoločné kľúčové slovo.,"[""Kristián Sopkovič"", ""Artem Yatsenko"", ""Spacy""]","[""Kristián Sopkovič"", ""Artem Yatsenko"", ""Spacy""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
g0012,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032562,,Over prepojenie osôb Kristián Sopkovič a Artem Yatsenko cez kľúčové slovo Spacy a pomenuj spoločné kľúčové slovo.,"[""Kristián Sopkovič"", ""Artem Yatsenko"", ""Spacy""]","[""Kristián Sopkovič"", ""Artem Yatsenko"", ""Spacy""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
g0013,dev,shared_keyword_pair,hard,False,1.0,1.0,0.0,1.0,1.0,1.0,0.0,True,0.033693,,Sú osoby Tomáš Kuchárik a Dávid Omasta v ZP Wiki prepojené cez kľúčové slovo Question Answering? Uveď spoločné kľúčové slovo.,"[""Tomáš Kuchárik"", ""Dávid Omasta"", ""Question Answering""]","[""Tomáš Kuchárik"", ""Dávid Omasta"", ""Question Answering""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2018/david_omasta/README.md""]","[""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2018/david_omasta/README.md""]",[],"[""entity_resolution""]"
|
||||||
|
g0014,dev,shared_keyword_pair,hard,False,1.0,1.0,0.0,1.0,1.0,1.0,0.0,True,0.033675,,Over prepojenie osôb Tomáš Kuchárik a Dávid Omasta cez kľúčové slovo Question Answering a pomenuj spoločné kľúčové slovo.,"[""Tomáš Kuchárik"", ""Dávid Omasta"", ""Question Answering""]","[""Tomáš Kuchárik"", ""Dávid Omasta"", ""Question Answering""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2018/david_omasta/README.md""]","[""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2018/david_omasta/README.md""]",[],"[""entity_resolution""]"
|
||||||
|
g0015,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.035715,,Sú osoby Tomáš Kuchárik a Dominik Nagy v ZP Wiki prepojené cez kľúčové slovo strojový preklad? Uveď spoločné kľúčové slovo.,"[""Tomáš Kuchárik"", ""Dominik Nagy"", ""strojový preklad""]","[""Tomáš Kuchárik"", ""Dominik Nagy"", ""strojový preklad""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
g0016,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032819,,Over prepojenie osôb Tomáš Kuchárik a Dominik Nagy cez kľúčové slovo strojový preklad a pomenuj spoločné kľúčové slovo.,"[""Tomáš Kuchárik"", ""Dominik Nagy"", ""strojový preklad""]","[""Tomáš Kuchárik"", ""Dominik Nagy"", ""strojový preklad""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
g0017,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030312,,Sú osoby Tomáš Kuchárik a Patrik Pavlišin v ZP Wiki prepojené cez kľúčové slovo strojový preklad? Uveď spoločné kľúčové slovo.,"[""Tomáš Kuchárik"", ""Patrik Pavlišin"", ""strojový preklad""]","[""Tomáš Kuchárik"", ""Patrik Pavlišin"", ""strojový preklad""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
g0018,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.029774,,Over prepojenie osôb Tomáš Kuchárik a Patrik Pavlišin cez kľúčové slovo strojový preklad a pomenuj spoločné kľúčové slovo.,"[""Tomáš Kuchárik"", ""Patrik Pavlišin"", ""strojový preklad""]","[""Tomáš Kuchárik"", ""Patrik Pavlišin"", ""strojový preklad""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
g0019,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030291,,Sú osoby Dominik Nagy a Patrik Pavlišin v ZP Wiki prepojené cez kľúčové slovo strojový preklad? Uveď spoločné kľúčové slovo.,"[""Dominik Nagy"", ""Patrik Pavlišin"", ""strojový preklad""]","[""Dominik Nagy"", ""Patrik Pavlišin"", ""strojový preklad""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
g0020,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031971,,Over prepojenie osôb Dominik Nagy a Patrik Pavlišin cez kľúčové slovo strojový preklad a pomenuj spoločné kľúčové slovo.,"[""Dominik Nagy"", ""Patrik Pavlišin"", ""strojový preklad""]","[""Dominik Nagy"", ""Patrik Pavlišin"", ""strojový preklad""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
g0021,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031225,,Sú osoby Jakub Maruniak a Artem Yatsenko v ZP Wiki prepojené cez kľúčové slovo pomenované entity? Uveď spoločné kľúčové slovo.,"[""Jakub Maruniak"", ""Artem Yatsenko"", ""pomenované entity""]","[""Jakub Maruniak"", ""Artem Yatsenko"", ""pomenované entity""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
g0022,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030097,,Over prepojenie osôb Jakub Maruniak a Artem Yatsenko cez kľúčové slovo pomenované entity a pomenuj spoločné kľúčové slovo.,"[""Jakub Maruniak"", ""Artem Yatsenko"", ""pomenované entity""]","[""Jakub Maruniak"", ""Artem Yatsenko"", ""pomenované entity""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
g0023,dev,shared_keyword_pair,hard,False,0.666667,0.0,1.0,1.0,1.0,1.0,1.0,True,0.029967,,Sú osoby Ondrej Megela a Matej Novotný v ZP Wiki prepojené cez kľúčové slovo jazykové modelovanie? Uveď spoločné kľúčové slovo.,"[""Ondrej Megela"", ""Matej Novotný"", ""jazykové modelovanie""]","[""Ondrej Megela"", ""Matej Novotný""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2021/matej_novotny/README.md""]","[""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2021/matej_novotny/README.md""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
g0024,dev,shared_keyword_pair,hard,False,0.666667,0.0,1.0,1.0,1.0,1.0,1.0,True,0.029622,,Over prepojenie osôb Ondrej Megela a Matej Novotný cez kľúčové slovo jazykové modelovanie a pomenuj spoločné kľúčové slovo.,"[""Ondrej Megela"", ""Matej Novotný"", ""jazykové modelovanie""]","[""Ondrej Megela"", ""Matej Novotný""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2021/matej_novotny/README.md""]","[""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2021/matej_novotny/README.md""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
g0025,dev,shared_keyword_pair,hard,False,0.666667,0.0,0.0,1.0,1.0,1.0,0.0,True,0.029428,,Sú osoby Dávid Omasta a Kristián Sopkovič v ZP Wiki prepojené cez kľúčové slovo slovenčina? Uveď spoločné kľúčové slovo.,"[""Dávid Omasta"", ""Kristián Sopkovič"", ""slovenčina""]","[""Dávid Omasta"", ""Kristián Sopkovič""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2018/david_omasta/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2018/david_omasta/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]",[],"[""entity_resolution""]"
|
||||||
|
g0026,dev,shared_keyword_pair,hard,False,0.666667,0.0,0.0,1.0,1.0,1.0,0.0,True,0.028187,,Over prepojenie osôb Dávid Omasta a Kristián Sopkovič cez kľúčové slovo slovenčina a pomenuj spoločné kľúčové slovo.,"[""Dávid Omasta"", ""Kristián Sopkovič"", ""slovenčina""]","[""Dávid Omasta"", ""Kristián Sopkovič""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2018/david_omasta/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2018/david_omasta/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]",[],"[""entity_resolution""]"
|
||||||
|
g0027,dev,shared_keyword_pair,hard,False,0.666667,0.0,1.0,1.0,1.0,1.0,1.0,True,0.029022,,Sú osoby Michal Stromko a Matej Ščišľak v ZP Wiki prepojené cez kľúčové slovo FAISS? Uveď spoločné kľúčové slovo.,"[""Michal Stromko"", ""Matej Ščišľak"", ""FAISS""]","[""Michal Stromko"", ""Matej Ščišľak""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
g0028,dev,shared_keyword_pair,hard,False,0.666667,0.0,1.0,1.0,1.0,1.0,1.0,True,0.029569,,Over prepojenie osôb Michal Stromko a Matej Ščišľak cez kľúčové slovo FAISS a pomenuj spoločné kľúčové slovo.,"[""Michal Stromko"", ""Matej Ščišľak"", ""FAISS""]","[""Michal Stromko"", ""Matej Ščišľak""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
g0031,dev,shared_keyword_pair,hard,False,0.666667,0.0,1.0,1.0,1.0,1.0,1.0,True,0.029093,,Sú osoby Artem Yatsenko a Vladimír Ferko v ZP Wiki prepojené cez kľúčové slovo anotácia? Uveď spoločné kľúčové slovo.,"[""Artem Yatsenko"", ""Vladimír Ferko"", ""anotácia""]","[""Artem Yatsenko"", ""Vladimír Ferko""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
g0032,dev,shared_keyword_pair,hard,False,0.666667,0.0,1.0,1.0,1.0,1.0,1.0,True,0.030074,,Over prepojenie osôb Artem Yatsenko a Vladimír Ferko cez kľúčové slovo anotácia a pomenuj spoločné kľúčové slovo.,"[""Artem Yatsenko"", ""Vladimír Ferko"", ""anotácia""]","[""Artem Yatsenko"", ""Vladimír Ferko""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
g0035,dev,shared_keyword_pair,hard,False,0.666667,0.0,1.0,1.0,1.0,1.0,1.0,True,0.03039,,Sú osoby Matej Ščišľak a Valerii Kutsenko v ZP Wiki prepojené cez kľúčové slovo GraphRAG? Uveď spoločné kľúčové slovo.,"[""Matej Ščišľak"", ""Valerii Kutsenko"", ""GraphRAG""]","[""Matej Ščišľak"", ""Valerii Kutsenko""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
g0036,dev,shared_keyword_pair,hard,False,0.666667,0.0,1.0,1.0,1.0,1.0,1.0,True,0.028497,,Over prepojenie osôb Matej Ščišľak a Valerii Kutsenko cez kľúčové slovo GraphRAG a pomenuj spoločné kľúčové slovo.,"[""Matej Ščišľak"", ""Valerii Kutsenko"", ""GraphRAG""]","[""Matej Ščišľak"", ""Valerii Kutsenko""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
g0037,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028966,,Sú osoby Vladimír Ferko a Tetiana Mohorian v ZP Wiki prepojené cez kľúčové slovo hate speech? Uveď spoločné kľúčové slovo.,"[""Vladimír Ferko"", ""Tetiana Mohorian"", ""hate speech""]","[""Vladimír Ferko"", ""Tetiana Mohorian"", ""hate speech""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
g0038,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.029405,,Over prepojenie osôb Vladimír Ferko a Tetiana Mohorian cez kľúčové slovo hate speech a pomenuj spoločné kľúčové slovo.,"[""Vladimír Ferko"", ""Tetiana Mohorian"", ""hate speech""]","[""Vladimír Ferko"", ""Tetiana Mohorian"", ""hate speech""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
g0041,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030224,,Sú osoby Valerii Kutsenko a Ján Pták v ZP Wiki prepojené cez kľúčové slovo RAG? Uveď spoločné kľúčové slovo.,"[""Valerii Kutsenko"", ""Ján Pták"", ""RAG""]","[""Valerii Kutsenko"", ""Ján Pták"", ""RAG""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
g0042,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030849,,Over prepojenie osôb Valerii Kutsenko a Ján Pták cez kľúčové slovo RAG a pomenuj spoločné kľúčové slovo.,"[""Valerii Kutsenko"", ""Ján Pták"", ""RAG""]","[""Valerii Kutsenko"", ""Ján Pták"", ""RAG""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
g0049,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030437,,Sú osoby Tetiana Mohorian a Rostyslav Rodzhuk v ZP Wiki prepojené cez kľúčové slovo LLM? Uveď spoločné kľúčové slovo.,"[""Tetiana Mohorian"", ""Rostyslav Rodzhuk"", ""LLM""]","[""Tetiana Mohorian"", ""Rostyslav Rodzhuk"", ""LLM""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2022/tetiana_mohorian/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""pages/students/2022/tetiana_mohorian/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
g0050,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031021,,Over prepojenie osôb Tetiana Mohorian a Rostyslav Rodzhuk cez kľúčové slovo LLM a pomenuj spoločné kľúčové slovo.,"[""Tetiana Mohorian"", ""Rostyslav Rodzhuk"", ""LLM""]","[""Tetiana Mohorian"", ""Rostyslav Rodzhuk"", ""LLM""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2022/tetiana_mohorian/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""pages/students/2022/tetiana_mohorian/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
g0053,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032008,,Sú osoby Rostyslav Rodzhuk a Samuel Džurina v ZP Wiki prepojené cez kľúčové slovo agent? Uveď spoločné kľúčové slovo.,"[""Rostyslav Rodzhuk"", ""Samuel Džurina"", ""agent""]","[""Rostyslav Rodzhuk"", ""Samuel Džurina"", ""agent""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
g0054,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032767,,Over prepojenie osôb Rostyslav Rodzhuk a Samuel Džurina cez kľúčové slovo agent a pomenuj spoločné kľúčové slovo.,"[""Rostyslav Rodzhuk"", ""Samuel Džurina"", ""agent""]","[""Rostyslav Rodzhuk"", ""Samuel Džurina"", ""agent""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
g0058,dev,same_academic_year_pair,hard,False,0.666667,0.0,1.0,0.0,0.0,1.0,1.0,True,0.326215,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Pták a Samuel Džurina?,"[""Ján Pták"", ""Samuel Džurina"", ""2026""]","[""Ján Pták"", ""Samuel Džurina""]",[],"[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0060,dev,same_academic_year_pair,hard,False,0.666667,0.0,1.0,0.0,0.0,1.0,1.0,True,0.045514,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Pták a Matej Novotný?,"[""Ján Pták"", ""Matej Novotný"", ""2026""]","[""Ján Pták"", ""Matej Novotný""]",[],"[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0063,dev,same_academic_year_pair,hard,False,1.0,1.0,1.0,0.0,0.0,1.0,1.0,True,0.047759,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Rostyslav Rodzhuk a Samuel Džurina?,"[""Rostyslav Rodzhuk"", ""Samuel Džurina"", ""2026""]","[""Rostyslav Rodzhuk"", ""Samuel Džurina"", ""2026""]",[],"[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""IN_CATEGORY""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0064,dev,same_academic_year_pair,hard,False,0.666667,0.0,1.0,0.0,0.0,1.0,1.0,True,0.03498,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Novotný a Samuel Džurina?,"[""Matej Novotný"", ""Samuel Džurina"", ""2026""]","[""Matej Novotný"", ""Samuel Džurina""]",[],"[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0066,dev,same_academic_year_pair,hard,False,0.666667,0.0,1.0,0.0,0.0,1.0,1.0,True,0.037241,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Ščišľak a Samuel Džurina?,"[""Matej Ščišľak"", ""Samuel Džurina"", ""2026""]","[""Matej Ščišľak"", ""Samuel Džurina""]",[],"[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0068,dev,same_academic_year_pair,hard,False,1.0,1.0,1.0,0.0,0.0,1.0,1.0,True,0.037597,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Artem Yatsenko a Kristián Sopkovič?,"[""Artem Yatsenko"", ""Kristián Sopkovič"", ""2022""]","[""Artem Yatsenko"", ""Kristián Sopkovič"", ""2022""]",[],"[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""IN_CATEGORY""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0071,dev,same_academic_year_pair,hard,False,1.0,1.0,1.0,0.0,0.0,1.0,1.0,True,0.038063,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Samuel Džurina a Simona Bobrovčanová?,"[""Samuel Džurina"", ""Simona Bobrovčanová"", ""2026""]","[""Samuel Džurina"", ""Simona Bobrovčanová"", ""2026""]",[],"[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""IN_CATEGORY""]","[""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0072,dev,same_academic_year_pair,hard,False,0.666667,0.0,1.0,0.0,0.0,1.0,1.0,True,0.033881,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Pták a Rostyslav Rodzhuk?,"[""Ján Pták"", ""Rostyslav Rodzhuk"", ""2026""]","[""Ján Pták"", ""Rostyslav Rodzhuk""]",[],"[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0074,dev,same_academic_year_pair,hard,False,1.0,1.0,1.0,0.0,0.0,1.0,1.0,True,0.03506,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Holp a Maroš Harahus?,"[""Ján Holp"", ""Maroš Harahus"", ""2021""]","[""Ján Holp"", ""Maroš Harahus"", ""2021""]",[],"[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""IN_CATEGORY""]","[""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0075,dev,same_academic_year_pair,hard,False,0.666667,0.0,1.0,0.0,0.0,1.0,1.0,True,0.036204,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Artem Yatsenko a Tomáš Kuchárik?,"[""Artem Yatsenko"", ""Tomáš Kuchárik"", ""2022""]","[""Artem Yatsenko"", ""Tomáš Kuchárik""]",[],"[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0076,dev,same_academic_year_pair,hard,False,0.666667,0.0,1.0,0.0,0.0,1.0,1.0,True,0.043746,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Dávid Omasta a Vladimír Ferko?,"[""Dávid Omasta"", ""Vladimír Ferko"", ""2024""]","[""Dávid Omasta"", ""Vladimír Ferko""]",[],"[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2018/david_omasta/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""pages/students/2018/david_omasta/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0078,dev,same_academic_year_pair,hard,False,1.0,1.0,1.0,0.0,0.0,1.0,1.0,True,0.03638,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Kristián Sopkovič a Michal Stromko?,"[""Kristián Sopkovič"", ""Michal Stromko"", ""2022""]","[""Kristián Sopkovič"", ""Michal Stromko"", ""2022""]",[],"[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""IN_CATEGORY""]","[""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0079,dev,same_academic_year_pair,hard,False,1.0,1.0,1.0,0.0,0.0,1.0,1.0,True,0.042447,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Artem Yatsenko a Michal Stromko?,"[""Artem Yatsenko"", ""Michal Stromko"", ""2022""]","[""Artem Yatsenko"", ""Michal Stromko"", ""2022""]",[],"[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""IN_CATEGORY""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0081,dev,same_academic_year_pair,hard,False,0.666667,0.0,1.0,0.0,0.0,1.0,1.0,True,0.039379,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Pták a Yevhenii Medushivskyi?,"[""Ján Pták"", ""Yevhenii Medushivskyi"", ""2026""]","[""Ján Pták"", ""Yevhenii Medushivskyi""]",[],"[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md"", ""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0084,dev,same_academic_year_pair,hard,False,0.666667,0.0,1.0,0.0,0.0,1.0,1.0,True,0.039061,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Ščišľak a Yevhenii Medushivskyi?,"[""Matej Ščišľak"", ""Yevhenii Medushivskyi"", ""2026""]","[""Matej Ščišľak"", ""Yevhenii Medushivskyi""]",[],"[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md"", ""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0086,dev,same_academic_year_pair,hard,False,0.666667,0.0,1.0,0.0,0.0,1.0,1.0,True,0.038478,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ondrej Megela a Patrik Pavlišin?,"[""Ondrej Megela"", ""Patrik Pavlišin"", ""2020""]","[""Ondrej Megela"", ""Patrik Pavlišin""]",[],"[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2018/ondrej_megela/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0087,dev,same_academic_year_pair,hard,False,1.0,1.0,1.0,0.0,0.0,1.0,1.0,True,0.042367,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Jakub Maruniak a Maroš Harahus?,"[""Jakub Maruniak"", ""Maroš Harahus"", ""2021""]","[""Jakub Maruniak"", ""Maroš Harahus"", ""2021""]",[],"[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""IN_CATEGORY""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0088,dev,same_academic_year_pair,hard,False,0.666667,0.0,1.0,0.0,0.0,1.0,1.0,True,0.035924,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Novotný a Simona Bobrovčanová?,"[""Matej Novotný"", ""Simona Bobrovčanová"", ""2026""]","[""Matej Novotný"", ""Simona Bobrovčanová""]",[],"[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0089,dev,same_academic_year_pair,hard,False,0.666667,0.0,1.0,0.0,0.0,1.0,1.0,True,0.036101,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Dominik Nagy a Kristián Sopkovič?,"[""Dominik Nagy"", ""Kristián Sopkovič"", ""2022""]","[""Dominik Nagy"", ""Kristián Sopkovič""]",[],"[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/dominik_nagy/timovy_projekt/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0091,dev,same_academic_year_pair,hard,False,1.0,1.0,1.0,0.0,0.0,1.0,1.0,True,0.039618,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Rostyslav Rodzhuk a Simona Bobrovčanová?,"[""Rostyslav Rodzhuk"", ""Simona Bobrovčanová"", ""2026""]","[""Rostyslav Rodzhuk"", ""Simona Bobrovčanová"", ""2026""]",[],"[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""IN_CATEGORY""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0092,dev,same_academic_year_pair,hard,False,1.0,1.0,1.0,0.0,0.0,1.0,1.0,True,0.034234,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Simona Bobrovčanová a Yevhenii Medushivskyi?,"[""Simona Bobrovčanová"", ""Yevhenii Medushivskyi"", ""2026""]","[""Simona Bobrovčanová"", ""Yevhenii Medushivskyi"", ""2026""]",[],"[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""IN_CATEGORY""]","[""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md"", ""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0093,dev,same_academic_year_pair,hard,False,0.666667,0.0,1.0,0.0,0.0,1.0,1.0,True,0.035771,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Kristián Sopkovič a Tomáš Kuchárik?,"[""Kristián Sopkovič"", ""Tomáš Kuchárik"", ""2022""]","[""Kristián Sopkovič"", ""Tomáš Kuchárik""]",[],"[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0095,dev,same_academic_year_pair,hard,False,0.666667,0.0,1.0,0.0,0.0,1.0,1.0,True,0.039008,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Dominik Nagy a Michal Stromko?,"[""Dominik Nagy"", ""Michal Stromko"", ""2022""]","[""Dominik Nagy"", ""Michal Stromko""]",[],"[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/dominik_nagy/timovy_projekt/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0097,dev,same_academic_year_pair,hard,False,0.666667,0.0,1.0,0.0,0.0,1.0,1.0,True,0.035442,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Artem Yatsenko a Dominik Nagy?,"[""Artem Yatsenko"", ""Dominik Nagy"", ""2022""]","[""Artem Yatsenko"", ""Dominik Nagy""]",[],"[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/dominik_nagy/timovy_projekt/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0098,dev,same_academic_year_pair,hard,False,0.666667,0.0,1.0,0.0,0.0,1.0,1.0,True,0.035625,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Michal Stromko a Tomáš Kuchárik?,"[""Michal Stromko"", ""Tomáš Kuchárik"", ""2022""]","[""Michal Stromko"", ""Tomáš Kuchárik""]",[],"[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0099,dev,same_academic_year_pair,hard,False,0.666667,0.0,1.0,0.0,0.0,1.0,1.0,True,0.035747,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Ščišľak a Rostyslav Rodzhuk?,"[""Matej Ščišľak"", ""Rostyslav Rodzhuk"", ""2026""]","[""Matej Ščišľak"", ""Rostyslav Rodzhuk""]",[],"[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0100,dev,same_academic_year_pair,hard,False,1.0,1.0,1.0,0.0,0.0,1.0,1.0,True,0.037048,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Rostyslav Rodzhuk a Yevhenii Medushivskyi?,"[""Rostyslav Rodzhuk"", ""Yevhenii Medushivskyi"", ""2026""]","[""Rostyslav Rodzhuk"", ""Yevhenii Medushivskyi"", ""2026""]",[],"[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""IN_CATEGORY""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md"", ""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0104,dev,same_academic_year_pair,hard,False,0.666667,0.0,1.0,0.0,0.0,1.0,1.0,True,0.037044,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Pták a Matej Ščišľak?,"[""Ján Pták"", ""Matej Ščišľak"", ""2026""]","[""Ján Pták"", ""Matej Ščišľak""]",[],"[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0105,dev,same_academic_year_pair,hard,False,1.0,1.0,1.0,0.0,0.0,1.0,1.0,True,0.04225,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Dominik Nagy a Tomáš Kuchárik?,"[""Dominik Nagy"", ""Tomáš Kuchárik"", ""2022""]","[""Dominik Nagy"", ""Tomáš Kuchárik"", ""2022""]",[],"[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""IN_CATEGORY""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/dominik_nagy/timovy_projekt/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0107,dev,same_academic_year_pair,hard,False,0.666667,0.0,1.0,0.0,0.0,1.0,1.0,True,0.034766,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Novotný a Yevhenii Medushivskyi?,"[""Matej Novotný"", ""Yevhenii Medushivskyi"", ""2026""]","[""Matej Novotný"", ""Yevhenii Medushivskyi""]",[],"[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md"", ""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0108,dev,same_academic_year_pair,hard,False,0.666667,0.0,1.0,0.0,0.0,1.0,1.0,True,0.03365,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Pták a Simona Bobrovčanová?,"[""Ján Pták"", ""Simona Bobrovčanová"", ""2026""]","[""Ján Pták"", ""Simona Bobrovčanová""]",[],"[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0110,dev,same_academic_year_pair,hard,False,1.0,1.0,1.0,0.0,0.0,1.0,1.0,True,0.033225,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Novotný a Matej Ščišľak?,"[""Matej Novotný"", ""Matej Ščišľak"", ""2026""]","[""Matej Novotný"", ""Matej Ščišľak"", ""2026""]",[],"[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""IN_CATEGORY""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0111,dev,same_academic_year_pair,hard,False,1.0,1.0,1.0,0.0,0.0,1.0,1.0,True,0.035255,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Jakub Maruniak a Ján Holp?,"[""Jakub Maruniak"", ""Ján Holp"", ""2021""]","[""Jakub Maruniak"", ""Ján Holp"", ""2021""]",[],"[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""IN_CATEGORY""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md"", ""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0114,dev,same_academic_year_pair,hard,False,0.666667,0.0,1.0,0.0,0.0,1.0,1.0,True,0.034397,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Ščišľak a Simona Bobrovčanová?,"[""Matej Ščišľak"", ""Simona Bobrovčanová"", ""2026""]","[""Matej Ščišľak"", ""Simona Bobrovčanová""]",[],"[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0115,dev,same_academic_year_pair,hard,False,0.666667,0.0,1.0,0.0,0.0,1.0,1.0,True,0.035404,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Novotný a Rostyslav Rodzhuk?,"[""Matej Novotný"", ""Rostyslav Rodzhuk"", ""2026""]","[""Matej Novotný"", ""Rostyslav Rodzhuk""]",[],"[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0116,dev,same_academic_year_pair,hard,False,1.0,1.0,1.0,0.0,0.0,1.0,1.0,True,0.036028,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Daniil Huzenko a Tetiana Mohorian?,"[""Daniil Huzenko"", ""Tetiana Mohorian"", ""2025""]","[""Daniil Huzenko"", ""Tetiana Mohorian"", ""2025""]",[],"[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""IN_CATEGORY""]","[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md"", ""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0118,dev,same_academic_year_pair,hard,False,1.0,1.0,1.0,0.0,0.0,1.0,1.0,True,0.034085,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Samuel Džurina a Yevhenii Medushivskyi?,"[""Samuel Džurina"", ""Yevhenii Medushivskyi"", ""2026""]","[""Samuel Džurina"", ""Yevhenii Medushivskyi"", ""2026""]",[],"[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""IN_CATEGORY""]","[""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md"", ""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0122,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.314119,,Aký rok práce spája osoby Ján Pták a Samuel Džurina?,"[""Ján Pták"", ""Samuel Džurina"", ""2026""]","[""Ján Pták"", ""Samuel Džurina"", ""2026""]",[],"[""AUTHORED"", ""AUTHORED_DOCUMENT"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_WORK"", ""IN_CATEGORY""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0124,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.042532,,Aký rok práce spája osoby Ján Pták a Matej Novotný?,"[""Ján Pták"", ""Matej Novotný"", ""2026""]","[""Ján Pták"", ""Matej Novotný"", ""2026""]",[],"[""AUTHORED"", ""AUTHORED_DOCUMENT"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_WORK"", ""IN_CATEGORY""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2022/jan_ptak/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0127,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.043993,,Aký rok práce spája osoby Rostyslav Rodzhuk a Samuel Džurina?,"[""Rostyslav Rodzhuk"", ""Samuel Džurina"", ""2026""]","[""Rostyslav Rodzhuk"", ""Samuel Džurina"", ""2026""]",[],"[""AUTHORED"", ""AUTHORED_DOCUMENT"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""IN_CATEGORY""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0128,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.041612,,Aký rok práce spája osoby Matej Novotný a Samuel Džurina?,"[""Matej Novotný"", ""Samuel Džurina"", ""2026""]","[""Matej Novotný"", ""Samuel Džurina"", ""2026""]",[],"[""AUTHORED"", ""AUTHORED_DOCUMENT"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""IN_CATEGORY""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0130,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.038918,,Aký rok práce spája osoby Matej Ščišľak a Samuel Džurina?,"[""Matej Ščišľak"", ""Samuel Džurina"", ""2026""]","[""Matej Ščišľak"", ""Samuel Džurina"", ""2026""]",[],"[""AUTHORED"", ""AUTHORED_DOCUMENT"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_WORK"", ""IN_CATEGORY""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0132,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.044022,,Aký rok práce spája osoby Artem Yatsenko a Kristián Sopkovič?,"[""Artem Yatsenko"", ""Kristián Sopkovič"", ""2022""]","[""Artem Yatsenko"", ""Kristián Sopkovič"", ""2022""]",[],"[""AUTHORED"", ""AUTHORED_DOCUMENT"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_WORK"", ""IN_CATEGORY""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0135,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.043537,,Aký rok práce spája osoby Samuel Džurina a Simona Bobrovčanová?,"[""Samuel Džurina"", ""Simona Bobrovčanová"", ""2026""]","[""Samuel Džurina"", ""Simona Bobrovčanová"", ""2026""]",[],"[""AUTHORED"", ""AUTHORED_DOCUMENT"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""IN_CATEGORY""]","[""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0136,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.037103,,Aký rok práce spája osoby Ján Pták a Rostyslav Rodzhuk?,"[""Ján Pták"", ""Rostyslav Rodzhuk"", ""2026""]","[""Ján Pták"", ""Rostyslav Rodzhuk"", ""2026""]",[],"[""AUTHORED"", ""AUTHORED_DOCUMENT"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_WORK"", ""IN_CATEGORY""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0138,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.039548,,Aký rok práce spája osoby Ján Holp a Maroš Harahus?,"[""Ján Holp"", ""Maroš Harahus"", ""2021""]","[""Ján Holp"", ""Maroš Harahus"", ""2021""]",[],"[""AUTHORED"", ""AUTHORED_DOCUMENT"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_WORK"", ""IN_CATEGORY""]","[""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/jan_holp/dp2021/README.md"", ""pages/students/2016/jan_holp/dp2021/zdrojove_subory/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0139,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.038119,,Aký rok práce spája osoby Artem Yatsenko a Tomáš Kuchárik?,"[""Artem Yatsenko"", ""Tomáš Kuchárik"", ""2022""]","[""Artem Yatsenko"", ""Tomáš Kuchárik"", ""2022""]",[],"[""AUTHORED"", ""AUTHORED_DOCUMENT"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_WORK"", ""IN_CATEGORY""]","[""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0140,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.052175,,Aký rok práce spája osoby Dávid Omasta a Vladimír Ferko?,"[""Dávid Omasta"", ""Vladimír Ferko"", ""2024""]","[""Dávid Omasta"", ""Vladimír Ferko"", ""2024""]",[],"[""AUTHORED"", ""AUTHORED_DOCUMENT"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""IN_CATEGORY""]","[""pages/students/2018/david_omasta/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""pages/students/2018/david_omasta/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0142,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.037983,,Aký rok práce spája osoby Kristián Sopkovič a Michal Stromko?,"[""Kristián Sopkovič"", ""Michal Stromko"", ""2022""]","[""Kristián Sopkovič"", ""Michal Stromko"", ""2022""]",[],"[""AUTHORED"", ""AUTHORED_DOCUMENT"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_WORK"", ""IN_CATEGORY""]","[""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2019/michal_stromko/vp2021/README.md"", ""pages/students/2019/michal_stromko/vp2021/tutorials/README.md"", ""pages/students/2019/michal_stromko/vp2021/tutorials/img/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0143,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03978,,Aký rok práce spája osoby Artem Yatsenko a Michal Stromko?,"[""Artem Yatsenko"", ""Michal Stromko"", ""2022""]","[""Artem Yatsenko"", ""Michal Stromko"", ""2022""]",[],"[""AUTHORED"", ""AUTHORED_DOCUMENT"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_WORK"", ""IN_CATEGORY""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2019/michal_stromko/vp2021/README.md"", ""pages/students/2019/michal_stromko/vp2021/tutorials/README.md"", ""pages/students/2019/michal_stromko/vp2021/tutorials/img/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0145,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033649,,Aký rok práce spája osoby Ján Pták a Yevhenii Medushivskyi?,"[""Ján Pták"", ""Yevhenii Medushivskyi"", ""2026""]","[""Ján Pták"", ""Yevhenii Medushivskyi"", ""2026""]",[],"[""AUTHORED"", ""AUTHORED_DOCUMENT"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_WORK"", ""IN_CATEGORY""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0148,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.035866,,Aký rok práce spája osoby Matej Ščišľak a Yevhenii Medushivskyi?,"[""Matej Ščišľak"", ""Yevhenii Medushivskyi"", ""2026""]","[""Matej Ščišľak"", ""Yevhenii Medushivskyi"", ""2026""]",[],"[""AUTHORED"", ""AUTHORED_DOCUMENT"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_WORK"", ""IN_CATEGORY""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0150,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.037791,,Aký rok práce spája osoby Ondrej Megela a Patrik Pavlišin?,"[""Ondrej Megela"", ""Patrik Pavlišin"", ""2020""]","[""Ondrej Megela"", ""Patrik Pavlišin"", ""2020""]",[],"[""AUTHORED"", ""AUTHORED_DOCUMENT"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_WORK"", ""IN_CATEGORY""]","[""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2018/ondrej_megela/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2016/patrik_pavlisin/dp21/README.md"", ""pages/students/2016/patrik_pavlisin/dp22/README.md"", ""pages/students/2016/patrik_pavlisin/tp20/README.md"", ""pages/students/2018/ondrej_megela/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0151,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.037581,,Aký rok práce spája osoby Jakub Maruniak a Maroš Harahus?,"[""Jakub Maruniak"", ""Maroš Harahus"", ""2021""]","[""Jakub Maruniak"", ""Maroš Harahus"", ""2021""]",[],"[""AUTHORED"", ""AUTHORED_DOCUMENT"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_WORK"", ""IN_CATEGORY""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/annotation/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/train_experiments/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0152,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033323,,Aký rok práce spája osoby Matej Novotný a Simona Bobrovčanová?,"[""Matej Novotný"", ""Simona Bobrovčanová"", ""2026""]","[""Matej Novotný"", ""Simona Bobrovčanová"", ""2026""]",[],"[""AUTHORED"", ""AUTHORED_DOCUMENT"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""IN_CATEGORY""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0153,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.036312,,Aký rok práce spája osoby Dominik Nagy a Kristián Sopkovič?,"[""Dominik Nagy"", ""Kristián Sopkovič"", ""2022""]","[""Dominik Nagy"", ""Kristián Sopkovič"", ""2022""]",[],"[""AUTHORED"", ""AUTHORED_DOCUMENT"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_WORK"", ""IN_CATEGORY""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/dominik_nagy/timovy_projekt/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0155,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.156704,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Tetiana Mohorian a Valerii Kutsenko?,"[""Tetiana Mohorian"", ""Valerii Kutsenko"", ""2022""]","[""Tetiana Mohorian"", ""Valerii Kutsenko"", ""2022""]",[],[],"[""pages/students/2022/tetiana_mohorian/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/tetiana_mohorian/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
g0156,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031287,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Ján Pták a Tetiana Mohorian?,"[""Ján Pták"", ""Tetiana Mohorian"", ""2022""]","[""Ján Pták"", ""Tetiana Mohorian"", ""2022""]",[],[],"[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
g0160,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.029445,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Samuel Džurina a Yevhenii Medushivskyi?,"[""Samuel Džurina"", ""Yevhenii Medushivskyi"", ""2023""]","[""Samuel Džurina"", ""Yevhenii Medushivskyi"", ""2023""]",[],[],"[""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
g0162,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.029386,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Ján Pták a Valerii Kutsenko?,"[""Ján Pták"", ""Valerii Kutsenko"", ""2022""]","[""Ján Pták"", ""Valerii Kutsenko"", ""2022""]",[],[],"[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
g0163,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.029811,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Rostyslav Rodzhuk a Simona Bobrovčanová?,"[""Rostyslav Rodzhuk"", ""Simona Bobrovčanová"", ""2023""]","[""Rostyslav Rodzhuk"", ""Simona Bobrovčanová"", ""2023""]",[],[],"[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
g0164,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031109,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Simona Bobrovčanová a Yevhenii Medushivskyi?,"[""Simona Bobrovčanová"", ""Yevhenii Medushivskyi"", ""2023""]","[""Simona Bobrovčanová"", ""Yevhenii Medushivskyi"", ""2023""]",[],[],"[""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
g0165,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030314,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Matej Novotný a Matej Ščišľak?,"[""Matej Novotný"", ""Matej Ščišľak"", ""2021""]","[""Matej Novotný"", ""Matej Ščišľak"", ""2021""]",[],[],"[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
g0167,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028205,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Rostyslav Rodzhuk a Yevhenii Medushivskyi?,"[""Rostyslav Rodzhuk"", ""Yevhenii Medushivskyi"", ""2023""]","[""Rostyslav Rodzhuk"", ""Yevhenii Medushivskyi"", ""2023""]",[],[],"[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
g0168,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027895,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Jakub Maruniak a Ján Holp?,"[""Jakub Maruniak"", ""Ján Holp"", ""2016""]","[""Jakub Maruniak"", ""Ján Holp"", ""2016""]",[],[],"[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
g0172,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030614,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Rostyslav Rodzhuk a Samuel Džurina?,"[""Rostyslav Rodzhuk"", ""Samuel Džurina"", ""2023""]","[""Rostyslav Rodzhuk"", ""Samuel Džurina"", ""2023""]",[],[],"[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
g0174,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.037061,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Daniil Huzenko a Tetiana Mohorian?,"[""Daniil Huzenko"", ""Tetiana Mohorian"", ""2022""]","[""Daniil Huzenko"", ""Tetiana Mohorian"", ""2022""]",[],[],"[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
g0177,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.029442,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Daniil Huzenko a Ján Pták?,"[""Daniil Huzenko"", ""Ján Pták"", ""2022""]","[""Daniil Huzenko"", ""Ján Pták"", ""2022""]",[],[],"[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
g0182,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028835,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Daniil Huzenko a Valerii Kutsenko?,"[""Daniil Huzenko"", ""Valerii Kutsenko"", ""2022""]","[""Daniil Huzenko"", ""Valerii Kutsenko"", ""2022""]",[],[],"[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
g0185,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028201,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Matej Novotný a Vladimír Ferko?,"[""Matej Novotný"", ""Vladimír Ferko"", ""2021""]","[""Matej Novotný"", ""Vladimír Ferko"", ""2021""]",[],[],"[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
g0186,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.026734,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Samuel Džurina a Simona Bobrovčanová?,"[""Samuel Džurina"", ""Simona Bobrovčanová"", ""2023""]","[""Samuel Džurina"", ""Simona Bobrovčanová"", ""2023""]",[],[],"[""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
g0188,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028172,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Matej Ščišľak a Vladimír Ferko?,"[""Matej Ščišľak"", ""Vladimír Ferko"", ""2021""]","[""Matej Ščišľak"", ""Vladimír Ferko"", ""2021""]",[],[],"[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
g0189,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027563,,Cez ktorý rok začiatku štúdia sú prepojené osoby Tetiana Mohorian a Valerii Kutsenko?,"[""Tetiana Mohorian"", ""Valerii Kutsenko"", ""2022""]","[""Tetiana Mohorian"", ""Valerii Kutsenko"", ""2022""]",[],[],"[""pages/students/2022/tetiana_mohorian/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/tetiana_mohorian/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
g0190,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.02763,,Cez ktorý rok začiatku štúdia sú prepojené osoby Ján Pták a Tetiana Mohorian?,"[""Ján Pták"", ""Tetiana Mohorian"", ""2022""]","[""Ján Pták"", ""Tetiana Mohorian"", ""2022""]",[],[],"[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
g0194,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027621,,Cez ktorý rok začiatku štúdia sú prepojené osoby Samuel Džurina a Yevhenii Medushivskyi?,"[""Samuel Džurina"", ""Yevhenii Medushivskyi"", ""2023""]","[""Samuel Džurina"", ""Yevhenii Medushivskyi"", ""2023""]",[],[],"[""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
g0196,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027581,,Cez ktorý rok začiatku štúdia sú prepojené osoby Ján Pták a Valerii Kutsenko?,"[""Ján Pták"", ""Valerii Kutsenko"", ""2022""]","[""Ján Pták"", ""Valerii Kutsenko"", ""2022""]",[],[],"[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
g0197,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027399,,Cez ktorý rok začiatku štúdia sú prepojené osoby Rostyslav Rodzhuk a Simona Bobrovčanová?,"[""Rostyslav Rodzhuk"", ""Simona Bobrovčanová"", ""2023""]","[""Rostyslav Rodzhuk"", ""Simona Bobrovčanová"", ""2023""]",[],[],"[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
g0198,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028125,,Cez ktorý rok začiatku štúdia sú prepojené osoby Simona Bobrovčanová a Yevhenii Medushivskyi?,"[""Simona Bobrovčanová"", ""Yevhenii Medushivskyi"", ""2023""]","[""Simona Bobrovčanová"", ""Yevhenii Medushivskyi"", ""2023""]",[],[],"[""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
g0199,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027786,,Cez ktorý rok začiatku štúdia sú prepojené osoby Matej Novotný a Matej Ščišľak?,"[""Matej Novotný"", ""Matej Ščišľak"", ""2021""]","[""Matej Novotný"", ""Matej Ščišľak"", ""2021""]",[],[],"[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
g0201,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027179,,Cez ktorý rok začiatku štúdia sú prepojené osoby Rostyslav Rodzhuk a Yevhenii Medushivskyi?,"[""Rostyslav Rodzhuk"", ""Yevhenii Medushivskyi"", ""2023""]","[""Rostyslav Rodzhuk"", ""Yevhenii Medushivskyi"", ""2023""]",[],[],"[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
g0202,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031599,,Cez ktorý rok začiatku štúdia sú prepojené osoby Jakub Maruniak a Ján Holp?,"[""Jakub Maruniak"", ""Ján Holp"", ""2016""]","[""Jakub Maruniak"", ""Ján Holp"", ""2016""]",[],[],"[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
g0206,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028117,,Cez ktorý rok začiatku štúdia sú prepojené osoby Rostyslav Rodzhuk a Samuel Džurina?,"[""Rostyslav Rodzhuk"", ""Samuel Džurina"", ""2023""]","[""Rostyslav Rodzhuk"", ""Samuel Džurina"", ""2023""]",[],[],"[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
g0208,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027458,,Cez ktorý rok začiatku štúdia sú prepojené osoby Daniil Huzenko a Tetiana Mohorian?,"[""Daniil Huzenko"", ""Tetiana Mohorian"", ""2022""]","[""Daniil Huzenko"", ""Tetiana Mohorian"", ""2022""]",[],[],"[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
g0211,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027008,,Cez ktorý rok začiatku štúdia sú prepojené osoby Daniil Huzenko a Ján Pták?,"[""Daniil Huzenko"", ""Ján Pták"", ""2022""]","[""Daniil Huzenko"", ""Ján Pták"", ""2022""]",[],[],"[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
g0219,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.738815,,Aký názov práce a aký rok práce sú uvedené pri osobe Artem Yatsenko?,"[""Artem Yatsenko"", ""Rozpoznávanie pomenovaných entít v slovenskom jazyku"", ""2022""]","[""Artem Yatsenko"", ""Rozpoznávanie pomenovaných entít v slovenskom jazyku"", ""2022""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2019/artem_yatsenko/README.md""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
g0220,dev,person_title_year,medium,False,0.333333,0.0,0.0,0.0,1.0,1.0,0.0,True,0.160803,,"Prepoj osobu Artem Yatsenko s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Artem Yatsenko"", ""Rozpoznávanie pomenovaných entít v slovenskom jazyku"", ""2022""]","[""Artem Yatsenko""]","[""AUTHORED""]",[],"[""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2019/artem_yatsenko/README.md""]",[],"[""entity_resolution""]"
|
||||||
|
g0221,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.035894,,Aký názov práce a aký rok práce sú uvedené pri osobe Daniil Huzenko?,"[""Daniil Huzenko"", ""Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia"", ""2025""]","[""Daniil Huzenko"", ""Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia"", ""2025""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2022/daniil_huzenko/README.md""]","[""pages/students/2022/daniil_huzenko/README.md""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
g0222,dev,person_title_year,medium,False,0.333333,0.0,0.0,0.0,1.0,1.0,0.0,True,0.027485,,"Prepoj osobu Daniil Huzenko s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Daniil Huzenko"", ""Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia"", ""2025""]","[""Daniil Huzenko""]","[""AUTHORED""]",[],"[""pages/students/2022/daniil_huzenko/README.md""]","[""pages/students/2022/daniil_huzenko/README.md""]",[],"[""entity_resolution""]"
|
||||||
|
g0227,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.037204,,Aký názov práce a aký rok práce sú uvedené pri osobe Dominik Nagy?,"[""Dominik Nagy"", ""Neurónový strojový preklad pomocou knižnice Fairseq"", ""2022""]","[""Dominik Nagy"", ""Neurónový strojový preklad pomocou knižnice Fairseq"", ""2022""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/dominik_nagy/README.md""]","[""pages/students/2016/dominik_nagy/README.md""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
g0228,dev,person_title_year,medium,False,0.333333,0.0,0.0,0.0,1.0,1.0,0.0,True,0.029531,,"Prepoj osobu Dominik Nagy s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Dominik Nagy"", ""Neurónový strojový preklad pomocou knižnice Fairseq"", ""2022""]","[""Dominik Nagy""]","[""AUTHORED""]",[],"[""pages/students/2016/dominik_nagy/README.md""]","[""pages/students/2016/dominik_nagy/README.md""]",[],"[""entity_resolution""]"
|
||||||
|
g0231,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03794,,Aký názov práce a aký rok práce sú uvedené pri osobe Dávid Omasta?,"[""Dávid Omasta"", ""Generatívne modely pre automatické odpovede na otázky v slovenskom jazyku"", ""2024""]","[""Dávid Omasta"", ""Generatívne modely pre automatické odpovede na otázky v slovenskom jazyku"", ""2024""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2018/david_omasta/README.md""]","[""pages/students/2018/david_omasta/README.md""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
g0232,dev,person_title_year,medium,False,0.333333,0.0,0.0,0.0,1.0,1.0,0.0,True,0.027993,,"Prepoj osobu Dávid Omasta s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Dávid Omasta"", ""Generatívne modely pre automatické odpovede na otázky v slovenskom jazyku"", ""2024""]","[""Dávid Omasta""]","[""AUTHORED""]",[],"[""pages/students/2018/david_omasta/README.md""]","[""pages/students/2018/david_omasta/README.md""]",[],"[""entity_resolution""]"
|
||||||
|
g0237,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.037383,,Aký názov práce a aký rok práce sú uvedené pri osobe Jakub Maruniak?,"[""Jakub Maruniak"", ""Anotácia a rozpoznávanie pomenovaných entít v slovenskom jazyku"", ""2021""]","[""Jakub Maruniak"", ""Anotácia a rozpoznávanie pomenovaných entít v slovenskom jazyku"", ""2021""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/jakub_maruniak/README.md""]","[""pages/students/2016/jakub_maruniak/README.md""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
g0238,dev,person_title_year,medium,False,0.333333,0.0,0.0,0.0,1.0,1.0,0.0,True,0.028729,,"Prepoj osobu Jakub Maruniak s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Jakub Maruniak"", ""Anotácia a rozpoznávanie pomenovaných entít v slovenskom jazyku"", ""2021""]","[""Jakub Maruniak""]","[""AUTHORED""]",[],"[""pages/students/2016/jakub_maruniak/README.md""]","[""pages/students/2016/jakub_maruniak/README.md""]",[],"[""entity_resolution""]"
|
||||||
|
g0239,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.036596,,Aký názov práce a aký rok práce sú uvedené pri osobe Ján Holp?,"[""Ján Holp"", ""Systém získavania informácií v slovenskom jazyku"", ""2021""]","[""Ján Holp"", ""Systém získavania informácií v slovenskom jazyku"", ""2021""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
g0240,dev,person_title_year,medium,False,0.333333,0.0,0.0,0.0,1.0,1.0,0.0,True,0.027055,,"Prepoj osobu Ján Holp s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Ján Holp"", ""Systém získavania informácií v slovenskom jazyku"", ""2021""]","[""Ján Holp""]","[""AUTHORED""]",[],"[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md""]",[],"[""entity_resolution""]"
|
||||||
|
g0243,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.034115,,Aký názov práce a aký rok práce sú uvedené pri osobe Ján Pták?,"[""Ján Pták"", ""Agent pre manažment záverečných prác"", ""2026""]","[""Ján Pták"", ""Agent pre manažment záverečných prác"", ""2026""]","[""HAS_WORK""]","[""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2022/jan_ptak/README.md""]","[""person_work""]","[""entity_resolution"", ""graph_traversal"", ""work_constraints""]"
|
||||||
|
g0244,dev,person_title_year,medium,False,0.333333,0.0,0.0,0.0,1.0,1.0,0.0,True,0.02687,,"Prepoj osobu Ján Pták s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Ján Pták"", ""Agent pre manažment záverečných prác"", ""2026""]","[""Ján Pták""]","[""HAS_WORK""]",[],"[""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2022/jan_ptak/README.md""]",[],"[""entity_resolution""]"
|
||||||
|
g0245,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.037103,,Aký názov práce a aký rok práce sú uvedené pri osobe Kristián Sopkovič?,"[""Kristián Sopkovič"", ""Model Spacy pre spracovanie prirodzeného jazyka v slovenčine"", ""2022""]","[""Kristián Sopkovič"", ""Model Spacy pre spracovanie prirodzeného jazyka v slovenčine"", ""2022""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2019/kristian_sopkovic/README.md""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
g0246,dev,person_title_year,medium,False,0.333333,0.0,0.0,0.0,1.0,1.0,0.0,True,0.028026,,"Prepoj osobu Kristián Sopkovič s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Kristián Sopkovič"", ""Model Spacy pre spracovanie prirodzeného jazyka v slovenčine"", ""2022""]","[""Kristián Sopkovič""]","[""AUTHORED""]",[],"[""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2019/kristian_sopkovic/README.md""]",[],"[""entity_resolution""]"
|
||||||
|
g0251,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.038041,,Aký názov práce a aký rok práce sú uvedené pri osobe Maroš Harahus?,"[""Maroš Harahus"", ""Neurónová morfologická anotácia slovenského jazyka"", ""2021""]","[""Maroš Harahus"", ""Neurónová morfologická anotácia slovenského jazyka"", ""2021""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/maros_harahus/README.md""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
g0252,dev,person_title_year,medium,False,0.333333,0.0,0.0,0.0,1.0,1.0,0.0,True,0.027095,,"Prepoj osobu Maroš Harahus s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Maroš Harahus"", ""Neurónová morfologická anotácia slovenského jazyka"", ""2021""]","[""Maroš Harahus""]","[""AUTHORED""]",[],"[""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/maros_harahus/README.md""]",[],"[""entity_resolution""]"
|
||||||
|
g0257,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03388,,Aký názov práce a aký rok práce sú uvedené pri osobe Matej Novotný?,"[""Matej Novotný"", ""Klasifikácia webových dát pre lepšie jazykové modelovanie"", ""2026""]","[""Matej Novotný"", ""Klasifikácia webových dát pre lepšie jazykové modelovanie"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/matej_novotny/README.md""]","[""pages/students/2021/matej_novotny/README.md""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
g0258,dev,person_title_year,medium,False,0.333333,0.0,0.0,0.0,1.0,1.0,0.0,True,0.027635,,"Prepoj osobu Matej Novotný s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Matej Novotný"", ""Klasifikácia webových dát pre lepšie jazykové modelovanie"", ""2026""]","[""Matej Novotný""]","[""AUTHORED""]",[],"[""pages/students/2021/matej_novotny/README.md""]","[""pages/students/2021/matej_novotny/README.md""]",[],"[""entity_resolution""]"
|
||||||
|
g0259,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.062665,,Aký názov práce a aký rok práce sú uvedené pri osobe Matej Ščišľak?,"[""Matej Ščišľak"", ""Znalostné grafy pre zlepšenie vyhľadávania právnych informácií"", ""2026""]","[""Matej Ščišľak"", ""Znalostné grafy pre zlepšenie vyhľadávania právnych informácií"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2021/matej_scislak/README.md""]","[""pages/students/2021/matej_scislak/README.md""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
g0260,dev,person_title_year,medium,False,0.333333,0.0,0.0,0.0,1.0,1.0,0.0,True,0.04293,,"Prepoj osobu Matej Ščišľak s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Matej Ščišľak"", ""Znalostné grafy pre zlepšenie vyhľadávania právnych informácií"", ""2026""]","[""Matej Ščišľak""]","[""AUTHORED""]",[],"[""pages/students/2021/matej_scislak/README.md""]","[""pages/students/2021/matej_scislak/README.md""]",[],"[""entity_resolution""]"
|
||||||
|
g0261,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.036226,,Aký názov práce a aký rok práce sú uvedené pri osobe Michal Stromko?,"[""Michal Stromko"", ""Indexovanie slovenského textu pomocou Elasticsearch"", ""2022""]","[""Michal Stromko"", ""Indexovanie slovenského textu pomocou Elasticsearch"", ""2022""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2019/michal_stromko/README.md""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
g0262,dev,person_title_year,medium,False,0.333333,0.0,0.0,0.0,1.0,1.0,0.0,True,0.026963,,"Prepoj osobu Michal Stromko s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Michal Stromko"", ""Indexovanie slovenského textu pomocou Elasticsearch"", ""2022""]","[""Michal Stromko""]","[""AUTHORED""]",[],"[""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2019/michal_stromko/README.md""]",[],"[""entity_resolution""]"
|
||||||
|
g0269,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.035653,,Aký názov práce a aký rok práce sú uvedené pri osobe Ondrej Megela?,"[""Ondrej Megela"", ""Neurónové jazykové modelovanie typu BERT"", ""2020""]","[""Ondrej Megela"", ""Neurónové jazykové modelovanie typu BERT"", ""2020""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2018/ondrej_megela/README.md""]","[""pages/students/2018/ondrej_megela/README.md""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
g0270,dev,person_title_year,medium,False,0.333333,0.0,0.0,0.0,1.0,1.0,0.0,True,0.026788,,"Prepoj osobu Ondrej Megela s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Ondrej Megela"", ""Neurónové jazykové modelovanie typu BERT"", ""2020""]","[""Ondrej Megela""]","[""AUTHORED""]",[],"[""pages/students/2018/ondrej_megela/README.md""]","[""pages/students/2018/ondrej_megela/README.md""]",[],"[""entity_resolution""]"
|
||||||
|
g0271,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.035479,,Aký názov práce a aký rok práce sú uvedené pri osobe Patrik Pavlišin?,"[""Patrik Pavlišin"", ""Metódy automatického prekladu"", ""2020""]","[""Patrik Pavlišin"", ""Metódy automatického prekladu"", ""2020""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
g0272,dev,person_title_year,medium,False,0.333333,0.0,0.0,0.0,1.0,1.0,0.0,True,0.027238,,"Prepoj osobu Patrik Pavlišin s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Patrik Pavlišin"", ""Metódy automatického prekladu"", ""2020""]","[""Patrik Pavlišin""]","[""AUTHORED""]",[],"[""pages/students/2016/patrik_pavlisin/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md""]",[],"[""entity_resolution""]"
|
||||||
|
g0275,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033405,,Aký názov práce a aký rok práce sú uvedené pri osobe Rostyslav Rodzhuk?,"[""Rostyslav Rodzhuk"", ""Inteligentný agent pre podporu práce špeciálneho pedagóga"", ""2026""]","[""Rostyslav Rodzhuk"", ""Inteligentný agent pre podporu práce špeciálneho pedagóga"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
g0276,dev,person_title_year,medium,False,0.333333,0.0,0.0,0.0,1.0,1.0,0.0,True,0.027071,,"Prepoj osobu Rostyslav Rodzhuk s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Rostyslav Rodzhuk"", ""Inteligentný agent pre podporu práce špeciálneho pedagóga"", ""2026""]","[""Rostyslav Rodzhuk""]","[""AUTHORED""]",[],"[""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md""]",[],"[""entity_resolution""]"
|
||||||
|
g0277,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.034401,,Aký názov práce a aký rok práce sú uvedené pri osobe Samuel Džurina?,"[""Samuel Džurina"", ""Dialógový systém pre podporu firemných procesov"", ""2026""]","[""Samuel Džurina"", ""Dialógový systém pre podporu firemných procesov"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2023/samuel_dzurina/README.md""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
g0278,dev,person_title_year,medium,False,0.333333,0.0,0.0,0.0,1.0,1.0,0.0,True,0.027647,,"Prepoj osobu Samuel Džurina s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Samuel Džurina"", ""Dialógový systém pre podporu firemných procesov"", ""2026""]","[""Samuel Džurina""]","[""AUTHORED""]",[],"[""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2023/samuel_dzurina/README.md""]",[],"[""entity_resolution""]"
|
||||||
|
g0281,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.034291,,Aký názov práce a aký rok práce sú uvedené pri osobe Simona Bobrovčanová?,"[""Simona Bobrovčanová"", ""Automatická sumarizácia slovenského textu"", ""2026""]","[""Simona Bobrovčanová"", ""Automatická sumarizácia slovenského textu"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2023/simona_bobrovcanova/README.md""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
g0282,dev,person_title_year,medium,False,0.333333,0.0,0.0,0.0,1.0,1.0,0.0,True,0.02729,,"Prepoj osobu Simona Bobrovčanová s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Simona Bobrovčanová"", ""Automatická sumarizácia slovenského textu"", ""2026""]","[""Simona Bobrovčanová""]","[""AUTHORED""]",[],"[""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2023/simona_bobrovcanova/README.md""]",[],"[""entity_resolution""]"
|
||||||
|
g0283,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.034086,,Aký názov práce a aký rok práce sú uvedené pri osobe Tetiana Mohorian?,"[""Tetiana Mohorian"", ""Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov"", ""2025""]","[""Tetiana Mohorian"", ""Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov"", ""2025""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2022/tetiana_mohorian/README.md""]","[""pages/students/2022/tetiana_mohorian/README.md""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
g0284,dev,person_title_year,medium,False,0.333333,0.0,0.0,0.0,1.0,1.0,0.0,True,0.027715,,"Prepoj osobu Tetiana Mohorian s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Tetiana Mohorian"", ""Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov"", ""2025""]","[""Tetiana Mohorian""]","[""AUTHORED""]",[],"[""pages/students/2022/tetiana_mohorian/README.md""]","[""pages/students/2022/tetiana_mohorian/README.md""]",[],"[""entity_resolution""]"
|
||||||
|
g0285,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.037974,,Aký názov práce a aký rok práce sú uvedené pri osobe Tomáš Kuchárik?,"[""Tomáš Kuchárik"", ""Tvorba korpusu otázok a odpovedí v slovenskom jazyku pomocou strojového prekladu"", ""2022""]","[""Tomáš Kuchárik"", ""Tvorba korpusu otázok a odpovedí v slovenskom jazyku pomocou strojového prekladu"", ""2022""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/tomas_kucharik/README.md""]","[""pages/students/2016/tomas_kucharik/README.md""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
g0286,dev,person_title_year,medium,False,0.333333,0.0,0.0,0.0,1.0,1.0,0.0,True,0.027182,,"Prepoj osobu Tomáš Kuchárik s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Tomáš Kuchárik"", ""Tvorba korpusu otázok a odpovedí v slovenskom jazyku pomocou strojového prekladu"", ""2022""]","[""Tomáš Kuchárik""]","[""AUTHORED""]",[],"[""pages/students/2016/tomas_kucharik/README.md""]","[""pages/students/2016/tomas_kucharik/README.md""]",[],"[""entity_resolution""]"
|
||||||
|
g0287,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.036198,,Aký názov práce a aký rok práce sú uvedené pri osobe Valerii Kutsenko?,"[""Valerii Kutsenko"", ""Zlepšenie vyhľadávania pomocou znalostných grafov"", ""2027""]","[""Valerii Kutsenko"", ""Zlepšenie vyhľadávania pomocou znalostných grafov"", ""2027""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
g0288,dev,person_title_year,medium,False,0.333333,0.0,0.0,0.0,1.0,1.0,0.0,True,0.027675,,"Prepoj osobu Valerii Kutsenko s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Valerii Kutsenko"", ""Zlepšenie vyhľadávania pomocou znalostných grafov"", ""2027""]","[""Valerii Kutsenko""]","[""AUTHORED""]",[],"[""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/valerii_kutsenko/README.md""]",[],"[""entity_resolution""]"
|
||||||
|
g0289,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.037566,,Aký názov práce a aký rok práce sú uvedené pri osobe Vladimír Ferko?,"[""Vladimír Ferko"", ""Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči"", ""2024""]","[""Vladimír Ferko"", ""Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči"", ""2024""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/vladimir_ferko/README.md""]","[""pages/students/2021/vladimir_ferko/README.md""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
g0290,dev,person_title_year,medium,False,0.333333,0.0,0.0,0.0,1.0,1.0,0.0,True,0.02733,,"Prepoj osobu Vladimír Ferko s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Vladimír Ferko"", ""Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči"", ""2024""]","[""Vladimír Ferko""]","[""AUTHORED""]",[],"[""pages/students/2021/vladimir_ferko/README.md""]","[""pages/students/2021/vladimir_ferko/README.md""]",[],"[""entity_resolution""]"
|
||||||
|
g0293,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033531,,Aký názov práce a aký rok práce sú uvedené pri osobe Yevhenii Medushivskyi?,"[""Yevhenii Medushivskyi"", ""Získavanie textu z webových stránok"", ""2026""]","[""Yevhenii Medushivskyi"", ""Získavanie textu z webových stránok"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
g0294,dev,person_title_year,medium,False,0.333333,0.0,0.0,0.0,1.0,1.0,0.0,True,0.027276,,"Prepoj osobu Yevhenii Medushivskyi s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Yevhenii Medushivskyi"", ""Získavanie textu z webových stránok"", ""2026""]","[""Yevhenii Medushivskyi""]","[""AUTHORED""]",[],"[""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2023/yevhenii_medushivskyi/README.md""]",[],"[""entity_resolution""]"
|
||||||
|
g0296,dev,person_keyword_title,hard,False,0.333333,0.0,0.666667,0.0,1.0,1.0,1.0,True,0.174414,,"Aká je téma práce osoby Simona Bobrovčanová, ak jej dokument zároveň obsahuje kľúčové slovo slovenský text?","[""Simona Bobrovčanová"", ""slovenský text"", ""Automatická sumarizácia slovenského textu""]","[""Simona Bobrovčanová""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2023/simona_bobrovcanova/README.md""]","[""person_keyword""]","[""entity_resolution"", ""person_keyword_constraints""]"
|
||||||
|
g0297,dev,person_keyword_title,hard,False,0.333333,0.0,0.666667,0.0,1.0,1.0,1.0,True,0.039665,,"Aká je téma práce osoby Kristián Sopkovič, ak jej dokument zároveň obsahuje kľúčové slovo transformery?","[""Kristián Sopkovič"", ""transformery"", ""Model Spacy pre spracovanie prirodzeného jazyka v slovenčine""]","[""Kristián Sopkovič""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2019/kristian_sopkovic/README.md""]","[""person_keyword""]","[""entity_resolution"", ""person_keyword_constraints""]"
|
||||||
|
g0298,dev,person_keyword_title,hard,False,0.666667,0.5,0.0,0.0,1.0,1.0,0.0,True,0.027131,,"Aká je téma práce osoby Tetiana Mohorian, ak jej dokument zároveň obsahuje kľúčové slovo hate speech?","[""Tetiana Mohorian"", ""hate speech"", ""Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov""]","[""Tetiana Mohorian"", ""hate speech""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2022/tetiana_mohorian/README.md""]","[""pages/students/2022/tetiana_mohorian/README.md""]",[],"[""entity_resolution""]"
|
||||||
|
g0299,dev,person_keyword_title,hard,False,0.333333,0.0,0.666667,0.0,1.0,1.0,1.0,True,0.028946,,"Aká je téma práce osoby Matej Ščišľak, ak jej dokument zároveň obsahuje kľúčové slovo FAISS?","[""Matej Ščišľak"", ""FAISS"", ""Znalostné grafy pre zlepšenie vyhľadávania právnych informácií""]","[""Matej Ščišľak""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2021/matej_scislak/README.md""]","[""pages/students/2021/matej_scislak/README.md""]","[""person_keyword""]","[""entity_resolution"", ""person_keyword_constraints""]"
|
||||||
|
g0300,dev,person_keyword_title,hard,False,0.333333,0.0,0.666667,0.0,1.0,1.0,1.0,True,0.029375,,"Aká je téma práce osoby Ján Pták, ak jej dokument zároveň obsahuje kľúčové slovo OpenWebUI?","[""Ján Pták"", ""OpenWebUI"", ""Agent pre manažment záverečných prác""]","[""Ján Pták""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_WORK""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2022/jan_ptak/README.md""]","[""person_keyword""]","[""entity_resolution"", ""person_keyword_constraints""]"
|
||||||
|
g0301,dev,person_keyword_title,hard,False,0.333333,0.0,0.666667,0.0,1.0,1.0,1.0,True,0.030051,,"Aká je téma práce osoby Matej Ščišľak, ak jej dokument zároveň obsahuje kľúčové slovo Neo4J?","[""Matej Ščišľak"", ""Neo4J"", ""Znalostné grafy pre zlepšenie vyhľadávania právnych informácií""]","[""Matej Ščišľak""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2021/matej_scislak/README.md""]","[""pages/students/2021/matej_scislak/README.md""]","[""person_keyword""]","[""entity_resolution"", ""person_keyword_constraints""]"
|
||||||
|
g0302,dev,person_keyword_title,hard,False,0.333333,0.0,0.666667,0.0,1.0,1.0,1.0,True,0.029151,,"Aká je téma práce osoby Tetiana Mohorian, ak jej dokument zároveň obsahuje kľúčové slovo prompting?","[""Tetiana Mohorian"", ""prompting"", ""Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov""]","[""Tetiana Mohorian""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2022/tetiana_mohorian/README.md""]","[""pages/students/2022/tetiana_mohorian/README.md""]","[""person_keyword""]","[""entity_resolution"", ""person_keyword_constraints""]"
|
||||||
|
g0303,dev,person_keyword_title,hard,False,0.333333,0.0,0.666667,0.0,1.0,1.0,1.0,True,0.028988,,"Aká je téma práce osoby Maroš Harahus, ak jej dokument zároveň obsahuje kľúčové slovo morfologická anotácia?","[""Maroš Harahus"", ""morfologická anotácia"", ""Neurónová morfologická anotácia slovenského jazyka""]","[""Maroš Harahus""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/maros_harahus/README.md""]","[""person_keyword""]","[""entity_resolution"", ""person_keyword_constraints""]"
|
||||||
|
g0304,dev,person_keyword_title,hard,False,0.333333,0.0,0.666667,0.0,1.0,1.0,1.0,True,0.02986,,"Aká je téma práce osoby Tomáš Kuchárik, ak jej dokument zároveň obsahuje kľúčové slovo SQuAD?","[""Tomáš Kuchárik"", ""SQuAD"", ""Tvorba korpusu otázok a odpovedí v slovenskom jazyku pomocou strojového prekladu""]","[""Tomáš Kuchárik""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/tomas_kucharik/README.md""]","[""pages/students/2016/tomas_kucharik/README.md""]","[""person_keyword""]","[""entity_resolution"", ""person_keyword_constraints""]"
|
||||||
|
g0305,dev,person_keyword_title,hard,False,0.333333,0.0,0.666667,0.0,1.0,1.0,1.0,True,0.029205,,"Aká je téma práce osoby Ján Pták, ak jej dokument zároveň obsahuje kľúčové slovo Docker?","[""Ján Pták"", ""Docker"", ""Agent pre manažment záverečných prác""]","[""Ján Pták""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_WORK""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2022/jan_ptak/README.md""]","[""person_keyword""]","[""entity_resolution"", ""person_keyword_constraints""]"
|
||||||
|
g0309,dev,person_keyword_title,hard,False,0.333333,0.0,0.666667,0.0,1.0,1.0,1.0,True,0.029096,,"Aká je téma práce osoby Patrik Pavlišin, ak jej dokument zároveň obsahuje kľúčové slovo automatický preklad?","[""Patrik Pavlišin"", ""automatický preklad"", ""Metódy automatického prekladu""]","[""Patrik Pavlišin""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""person_keyword""]","[""entity_resolution"", ""person_keyword_constraints""]"
|
||||||
|
g0314,dev,person_keyword_title,hard,False,0.333333,0.0,0.666667,0.0,1.0,1.0,1.0,True,0.144461,,"Aká je téma práce osoby Samuel Džurina, ak jej dokument zároveň obsahuje kľúčové slovo zásielková spoločnosť?","[""Samuel Džurina"", ""zásielková spoločnosť"", ""Dialógový systém pre podporu firemných procesov""]","[""Samuel Džurina""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2023/samuel_dzurina/README.md""]",[],"[""entity_resolution"", ""graph_traversal""]"
|
||||||
|
g0316,dev,person_keyword_title,hard,False,0.333333,0.0,0.666667,0.0,1.0,1.0,1.0,True,0.036669,,"Aká je téma práce osoby Valerii Kutsenko, ak jej dokument zároveň obsahuje kľúčové slovo znalostný graf?","[""Valerii Kutsenko"", ""znalostný graf"", ""Zlepšenie vyhľadávania pomocou znalostných grafov""]","[""Valerii Kutsenko""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""person_keyword""]","[""entity_resolution"", ""person_keyword_constraints""]"
|
||||||
|
g0319,dev,person_keyword_title,hard,False,0.333333,0.0,0.666667,0.0,1.0,1.0,1.0,True,0.028833,,"Aká je téma práce osoby Maroš Harahus, ak jej dokument zároveň obsahuje kľúčové slovo grafové neurónové siete?","[""Maroš Harahus"", ""grafové neurónové siete"", ""Neurónová morfologická anotácia slovenského jazyka""]","[""Maroš Harahus""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/maros_harahus/README.md""]","[""person_keyword""]","[""entity_resolution"", ""person_keyword_constraints""]"
|
||||||
|
g0322,dev,person_keyword_title,hard,False,0.333333,0.0,0.666667,0.0,1.0,1.0,1.0,True,0.028991,,"Aká je téma práce osoby Artem Yatsenko, ak jej dokument zároveň obsahuje kľúčové slovo anotácia?","[""Artem Yatsenko"", ""anotácia"", ""Rozpoznávanie pomenovaných entít v slovenskom jazyku""]","[""Artem Yatsenko""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2019/artem_yatsenko/README.md""]","[""person_keyword""]","[""entity_resolution"", ""person_keyword_constraints""]"
|
||||||
|
g0323,dev,person_keyword_title,hard,False,0.333333,0.0,0.666667,0.0,1.0,1.0,1.0,True,0.028623,,"Aká je téma práce osoby Simona Bobrovčanová, ak jej dokument zároveň obsahuje kľúčové slovo sumarizácia?","[""Simona Bobrovčanová"", ""sumarizácia"", ""Automatická sumarizácia slovenského textu""]","[""Simona Bobrovčanová""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2023/simona_bobrovcanova/README.md""]","[""person_keyword""]","[""entity_resolution"", ""person_keyword_constraints""]"
|
||||||
|
g0324,dev,person_keyword_title,hard,False,0.666667,0.5,0.666667,0.0,1.0,1.0,1.0,True,0.029455,,"Aká je téma práce osoby Patrik Pavlišin, ak jej dokument zároveň obsahuje kľúčové slovo strojový preklad?","[""Patrik Pavlišin"", ""strojový preklad"", ""Metódy automatického prekladu""]","[""Patrik Pavlišin"", ""strojový preklad""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""person_keyword""]","[""entity_resolution"", ""person_keyword_constraints""]"
|
||||||
|
g0327,dev,person_keyword_title,hard,False,0.333333,0.0,0.666667,0.0,1.0,1.0,1.0,True,0.029086,,"Aká je téma práce osoby Ján Holp, ak jej dokument zároveň obsahuje kľúčové slovo získavanie informácií?","[""Ján Holp"", ""získavanie informácií"", ""Systém získavania informácií v slovenskom jazyku""]","[""Ján Holp""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md""]","[""person_keyword""]","[""entity_resolution"", ""person_keyword_constraints""]"
|
||||||
|
g0328,dev,person_keyword_title,hard,False,0.333333,0.0,0.666667,0.0,1.0,1.0,1.0,True,0.029132,,"Aká je téma práce osoby Rostyslav Rodzhuk, ak jej dokument zároveň obsahuje kľúčové slovo špeciálny pedagóg?","[""Rostyslav Rodzhuk"", ""špeciálny pedagóg"", ""Inteligentný agent pre podporu práce špeciálneho pedagóga""]","[""Rostyslav Rodzhuk""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""person_keyword""]","[""entity_resolution"", ""person_keyword_constraints""]"
|
||||||
|
g0329,dev,person_keyword_title,hard,False,0.333333,0.0,0.666667,0.0,1.0,1.0,1.0,True,0.029413,,"Aká je téma práce osoby Valerii Kutsenko, ak jej dokument zároveň obsahuje kľúčové slovo GraphRAG?","[""Valerii Kutsenko"", ""GraphRAG"", ""Zlepšenie vyhľadávania pomocou znalostných grafov""]","[""Valerii Kutsenko""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""person_keyword""]","[""entity_resolution"", ""person_keyword_constraints""]"
|
||||||
|
g0330,dev,person_keyword_title,hard,False,0.666667,0.5,0.0,0.0,1.0,1.0,0.0,True,0.027409,,"Aká je téma práce osoby Tetiana Mohorian, ak jej dokument zároveň obsahuje kľúčové slovo LLM?","[""Tetiana Mohorian"", ""LLM"", ""Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov""]","[""Tetiana Mohorian"", ""LLM""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2022/tetiana_mohorian/README.md""]","[""pages/students/2022/tetiana_mohorian/README.md""]",[],"[""entity_resolution""]"
|
||||||
|
g0331,dev,person_keyword_title,hard,False,0.333333,0.0,0.666667,0.0,1.0,1.0,1.0,True,0.028483,,"Aká je téma práce osoby Yevhenii Medushivskyi, ak jej dokument zároveň obsahuje kľúčové slovo deduplikácia?","[""Yevhenii Medushivskyi"", ""deduplikácia"", ""Získavanie textu z webových stránok""]","[""Yevhenii Medushivskyi""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""person_keyword""]","[""entity_resolution"", ""person_keyword_constraints""]"
|
||||||
|
g0333,dev,person_keyword_title,hard,False,0.666667,0.5,0.0,0.0,1.0,1.0,0.0,True,0.028027,,"Aká je téma práce osoby Rostyslav Rodzhuk, ak jej dokument zároveň obsahuje kľúčové slovo LLM?","[""Rostyslav Rodzhuk"", ""LLM"", ""Inteligentný agent pre podporu práce špeciálneho pedagóga""]","[""Rostyslav Rodzhuk"", ""LLM""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md""]",[],"[""entity_resolution""]"
|
||||||
|
g0336,dev,person_keyword_title,hard,False,0.666667,0.5,0.666667,0.0,1.0,1.0,1.0,True,0.029159,,"Aká je téma práce osoby Artem Yatsenko, ak jej dokument zároveň obsahuje kľúčové slovo pomenované entity?","[""Artem Yatsenko"", ""pomenované entity"", ""Rozpoznávanie pomenovaných entít v slovenskom jazyku""]","[""Artem Yatsenko"", ""pomenované entity""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2019/artem_yatsenko/README.md""]","[""person_keyword""]","[""entity_resolution"", ""person_keyword_constraints""]"
|
||||||
|
g0337,dev,person_keyword_title,hard,False,0.333333,0.0,0.666667,0.0,1.0,1.0,1.0,True,0.029656,,"Aká je téma práce osoby Ján Holp, ak jej dokument zároveň obsahuje kľúčové slovo slovenský internet?","[""Ján Holp"", ""slovenský internet"", ""Systém získavania informácií v slovenskom jazyku""]","[""Ján Holp""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md""]","[""person_keyword""]","[""entity_resolution"", ""person_keyword_constraints""]"
|
||||||
|
g0340,dev,person_keyword_title,hard,False,0.333333,0.0,0.666667,0.0,1.0,1.0,1.0,True,0.030095,,"Aká je téma práce osoby Matej Ščišľak, ak jej dokument zároveň obsahuje kľúčové slovo GraphRAG?","[""Matej Ščišľak"", ""GraphRAG"", ""Znalostné grafy pre zlepšenie vyhľadávania právnych informácií""]","[""Matej Ščišľak""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2021/matej_scislak/README.md""]","[""pages/students/2021/matej_scislak/README.md""]","[""person_keyword""]","[""entity_resolution"", ""person_keyword_constraints""]"
|
||||||
|
g0341,dev,person_keyword_title,hard,False,0.333333,0.0,0.666667,0.0,1.0,1.0,1.0,True,0.029634,,"Aká je téma práce osoby Michal Stromko, ak jej dokument zároveň obsahuje kľúčové slovo Elasticsearch?","[""Michal Stromko"", ""Elasticsearch"", ""Indexovanie slovenského textu pomocou Elasticsearch""]","[""Michal Stromko""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2019/michal_stromko/README.md""]","[""person_keyword""]","[""entity_resolution"", ""person_keyword_constraints""]"
|
||||||
|
g0343,dev,person_keyword_title,hard,False,0.333333,0.0,0.666667,0.0,1.0,1.0,1.0,True,0.028785,,"Aká je téma práce osoby Yevhenii Medushivskyi, ak jej dokument zároveň obsahuje kľúčové slovo crawler?","[""Yevhenii Medushivskyi"", ""crawler"", ""Získavanie textu z webových stránok""]","[""Yevhenii Medushivskyi""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""person_keyword""]","[""entity_resolution"", ""person_keyword_constraints""]"
|
||||||
|
g0344,dev,person_keyword_title,hard,False,0.666667,0.5,0.0,0.0,1.0,1.0,0.0,True,0.028391,,"Aká je téma práce osoby Vladimír Ferko, ak jej dokument zároveň obsahuje kľúčové slovo hate speech?","[""Vladimír Ferko"", ""hate speech"", ""Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči""]","[""Vladimír Ferko"", ""hate speech""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2021/vladimir_ferko/README.md""]","[""pages/students/2021/vladimir_ferko/README.md""]",[],"[""entity_resolution""]"
|
||||||
|
g0345,dev,person_keyword_title,hard,False,0.666667,0.5,0.666667,0.0,1.0,1.0,1.0,True,0.027662,,"Aká je téma práce osoby Maroš Harahus, ak jej dokument zároveň obsahuje kľúčové slovo Spacy?","[""Maroš Harahus"", ""Spacy"", ""Neurónová morfologická anotácia slovenského jazyka""]","[""Maroš Harahus"", ""Spacy""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/maros_harahus/README.md""]","[""person_keyword""]","[""entity_resolution"", ""person_keyword_constraints""]"
|
||||||
|
g0346,dev,person_keyword_title,hard,False,0.666667,0.5,0.666667,0.0,1.0,1.0,1.0,True,0.027414,,"Aká je téma práce osoby Valerii Kutsenko, ak jej dokument zároveň obsahuje kľúčové slovo RAG?","[""Valerii Kutsenko"", ""RAG"", ""Zlepšenie vyhľadávania pomocou znalostných grafov""]","[""Valerii Kutsenko"", ""RAG""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""person_keyword""]","[""entity_resolution"", ""person_keyword_constraints""]"
|
||||||
|
g0347,dev,person_keyword_title,hard,False,0.333333,0.0,0.666667,0.0,1.0,1.0,1.0,True,0.028609,,"Aká je téma práce osoby Patrik Pavlišin, ak jej dokument zároveň obsahuje kľúčové slovo paralelný korpus?","[""Patrik Pavlišin"", ""paralelný korpus"", ""Metódy automatického prekladu""]","[""Patrik Pavlišin""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""person_keyword""]","[""entity_resolution"", ""person_keyword_constraints""]"
|
||||||
|
g0348,dev,person_keyword_title,hard,False,0.333333,0.0,0.666667,0.0,1.0,1.0,1.0,True,0.02798,,"Aká je téma práce osoby Vladimír Ferko, ak jej dokument zároveň obsahuje kľúčové slovo SlovakBERT?","[""Vladimír Ferko"", ""SlovakBERT"", ""Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči""]","[""Vladimír Ferko""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2021/vladimir_ferko/README.md""]","[""pages/students/2021/vladimir_ferko/README.md""]","[""person_keyword""]","[""entity_resolution"", ""person_keyword_constraints""]"
|
||||||
|
g0349,dev,person_keyword_title,hard,False,0.333333,0.0,0.666667,0.0,1.0,1.0,1.0,True,0.029793,,"Aká je téma práce osoby Vladimír Ferko, ak jej dokument zároveň obsahuje kľúčové slovo anotácia?","[""Vladimír Ferko"", ""anotácia"", ""Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči""]","[""Vladimír Ferko""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2021/vladimir_ferko/README.md""]","[""pages/students/2021/vladimir_ferko/README.md""]","[""person_keyword""]","[""entity_resolution"", ""person_keyword_constraints""]"
|
||||||
|
g0353,dev,person_keyword_title,hard,False,0.666667,0.5,0.666667,0.0,1.0,1.0,1.0,True,0.031294,,"Aká je téma práce osoby Dominik Nagy, ak jej dokument zároveň obsahuje kľúčové slovo strojový preklad?","[""Dominik Nagy"", ""strojový preklad"", ""Neurónový strojový preklad pomocou knižnice Fairseq""]","[""Dominik Nagy"", ""strojový preklad""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/dominik_nagy/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/dominik_nagy/timovy_projekt/README.md""]","[""person_keyword""]","[""entity_resolution"", ""person_keyword_constraints""]"
|
||||||
|
g0354,dev,person_keyword_title,hard,False,0.666667,0.5,0.666667,0.0,1.0,1.0,1.0,True,0.028929,,"Aká je téma práce osoby Ondrej Megela, ak jej dokument zároveň obsahuje kľúčové slovo BERT?","[""Ondrej Megela"", ""BERT"", ""Neurónové jazykové modelovanie typu BERT""]","[""Ondrej Megela"", ""BERT""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2018/ondrej_megela/README.md""]","[""pages/students/2018/ondrej_megela/README.md""]","[""person_keyword""]","[""entity_resolution"", ""person_keyword_constraints""]"
|
||||||
|
g0355,dev,person_keyword_title,hard,False,0.666667,0.5,0.666667,0.0,1.0,1.0,1.0,True,0.028717,,"Aká je téma práce osoby Ján Holp, ak jej dokument zároveň obsahuje kľúčové slovo PageRank?","[""Ján Holp"", ""PageRank"", ""Systém získavania informácií v slovenskom jazyku""]","[""Ján Holp"", ""PageRank""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md""]","[""person_keyword""]","[""entity_resolution"", ""person_keyword_constraints""]"
|
||||||
|
g0359,dev,person_keyword_title,hard,False,0.333333,0.0,0.666667,0.0,1.0,1.0,1.0,True,0.028991,,"Aká je téma práce osoby Simona Bobrovčanová, ak jej dokument zároveň obsahuje kľúčové slovo právne dokumenty?","[""Simona Bobrovčanová"", ""právne dokumenty"", ""Automatická sumarizácia slovenského textu""]","[""Simona Bobrovčanová""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2023/simona_bobrovcanova/README.md""]","[""person_keyword""]","[""entity_resolution"", ""person_keyword_constraints""]"
|
||||||
|
g0361,dev,person_keyword_title,hard,False,0.333333,0.0,0.666667,0.0,1.0,1.0,1.0,True,0.028392,,"Aká je téma práce osoby Michal Stromko, ak jej dokument zároveň obsahuje kľúčové slovo FAISS?","[""Michal Stromko"", ""FAISS"", ""Indexovanie slovenského textu pomocou Elasticsearch""]","[""Michal Stromko""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2019/michal_stromko/README.md""]","[""person_keyword""]","[""entity_resolution"", ""person_keyword_constraints""]"
|
||||||
|
g0364,dev,person_keyword_title,hard,False,0.333333,0.0,0.666667,0.0,1.0,1.0,1.0,True,0.029142,,"Aká je téma práce osoby Daniil Huzenko, ak jej dokument zároveň obsahuje kľúčové slovo Kubernetes?","[""Daniil Huzenko"", ""Kubernetes"", ""Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia""]","[""Daniil Huzenko""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2022/daniil_huzenko/README.md""]","[""pages/students/2022/daniil_huzenko/README.md""]","[""person_keyword""]","[""entity_resolution"", ""person_keyword_constraints""]"
|
||||||
|
g0366,dev,person_keyword_title,hard,False,0.333333,0.0,0.666667,0.0,1.0,1.0,1.0,True,0.028938,,"Aká je téma práce osoby Ondrej Megela, ak jej dokument zároveň obsahuje kľúčové slovo jazykové modelovanie?","[""Ondrej Megela"", ""jazykové modelovanie"", ""Neurónové jazykové modelovanie typu BERT""]","[""Ondrej Megela""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2018/ondrej_megela/README.md""]","[""pages/students/2018/ondrej_megela/README.md""]","[""person_keyword""]","[""entity_resolution"", ""person_keyword_constraints""]"
|
||||||
|
g0368,dev,person_keyword_title,hard,False,0.333333,0.0,0.666667,0.0,1.0,1.0,1.0,True,0.028228,,"Aká je téma práce osoby Daniil Huzenko, ak jej dokument zároveň obsahuje kľúčové slovo Raspberry Pi?","[""Daniil Huzenko"", ""Raspberry Pi"", ""Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia""]","[""Daniil Huzenko""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2022/daniil_huzenko/README.md""]","[""pages/students/2022/daniil_huzenko/README.md""]","[""person_keyword""]","[""entity_resolution"", ""person_keyword_constraints""]"
|
||||||
|
g0375,dev,document_author_category_multi_hop,hard,False,0.666667,0.5,0.666667,1.0,1.0,1.0,1.0,True,0.153796,,Ktorý autor dokumentu je pri osobe Michal Stromko spojený s kategóriou bp2022?,"[""Daniel Hladek"", ""bp2022"", ""Michal Stromko""]","[""bp2022"", ""Michal Stromko""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2019/michal_stromko/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0376,dev,document_author_category_multi_hop,hard,False,0.666667,0.5,0.666667,1.0,1.0,1.0,1.0,True,0.028261,,Ktorý autor dokumentu je pri osobe Yevhenii Medushivskyi spojený s kategóriou bp2026?,"[""Daniel Hladek"", ""bp2026"", ""Yevhenii Medushivskyi""]","[""bp2026"", ""Yevhenii Medushivskyi""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0379,dev,document_author_category_multi_hop,hard,False,0.666667,0.5,0.666667,1.0,1.0,1.0,1.0,True,0.027673,,Ktorý autor dokumentu je pri osobe Kristián Sopkovič spojený s kategóriou bp2022?,"[""Daniel Hladek"", ""bp2022"", ""Kristián Sopkovič""]","[""bp2022"", ""Kristián Sopkovič""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2019/kristian_sopkovic/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0380,dev,document_author_category_multi_hop,hard,False,0.666667,0.5,0.666667,1.0,1.0,1.0,1.0,True,0.028244,,Ktorý autor dokumentu je pri osobe Michal Stromko spojený s kategóriou dp2024?,"[""Daniel Hladek"", ""dp2024"", ""Michal Stromko""]","[""dp2024"", ""Michal Stromko""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2019/michal_stromko/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0381,dev,document_author_category_multi_hop,hard,False,0.666667,0.5,0.666667,1.0,1.0,1.0,1.0,True,0.027295,,Ktorý autor dokumentu je pri osobe Dominik Nagy spojený s kategóriou bp2019?,"[""Daniel Hladek"", ""bp2019"", ""Dominik Nagy""]","[""bp2019"", ""Dominik Nagy""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/dominik_nagy/README.md""]","[""pages/students/2016/dominik_nagy/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0382,dev,document_author_category_multi_hop,hard,False,0.666667,0.5,0.666667,1.0,1.0,1.0,1.0,True,0.028747,,Ktorý autor dokumentu je pri osobe Rostyslav Rodzhuk spojený s kategóriou vp2025?,"[""Daniel Hladek"", ""vp2025"", ""Rostyslav Rodzhuk""]","[""vp2025"", ""Rostyslav Rodzhuk""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0385,dev,document_author_category_multi_hop,hard,False,0.666667,0.5,0.666667,1.0,1.0,1.0,1.0,True,0.027602,,Ktorý autor dokumentu je pri osobe Oliver Pejic spojený s kategóriou iaeste?,"[""Daniel Hladek"", ""iaeste"", ""Oliver Pejic""]","[""iaeste"", ""Oliver Pejic""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/interns/oliver_pejic/README.md""]","[""pages/interns/oliver_pejic/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0386,dev,document_author_category_multi_hop,hard,False,0.666667,0.5,0.666667,1.0,1.0,1.0,1.0,True,0.028223,,Ktorý autor dokumentu je pri osobe Vladimír Ferko spojený s kategóriou bp2024?,"[""Daniel Hladek"", ""bp2024"", ""Vladimír Ferko""]","[""bp2024"", ""Vladimír Ferko""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2021/vladimir_ferko/README.md""]","[""pages/students/2021/vladimir_ferko/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0387,dev,document_author_category_multi_hop,hard,False,0.666667,0.5,0.666667,1.0,1.0,1.0,1.0,True,0.028469,,Ktorý autor dokumentu je pri osobe Jakub Maruniak spojený s kategóriou bp2019?,"[""Daniel Hladek"", ""bp2019"", ""Jakub Maruniak""]","[""bp2019"", ""Jakub Maruniak""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/jakub_maruniak/README.md""]","[""pages/students/2016/jakub_maruniak/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0388,dev,document_author_category_multi_hop,hard,False,0.666667,0.5,0.666667,1.0,1.0,1.0,1.0,True,0.027666,,Ktorý autor dokumentu je pri osobe Ondrej Megela spojený s kategóriou dp2023?,"[""Daniel Hladek"", ""dp2023"", ""Ondrej Megela""]","[""dp2023"", ""Ondrej Megela""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2018/ondrej_megela/README.md""]","[""pages/students/2018/ondrej_megela/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0389,dev,document_author_category_multi_hop,hard,False,0.666667,0.5,0.666667,1.0,1.0,1.0,1.0,True,0.036295,,Ktorý autor dokumentu je pri osobe Dávid Omasta spojený s kategóriou dp2024?,"[""Daniel Hladek"", ""dp2024"", ""Dávid Omasta""]","[""dp2024"", ""Dávid Omasta""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2018/david_omasta/README.md""]","[""pages/students/2018/david_omasta/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0390,dev,document_author_category_multi_hop,hard,False,0.666667,0.5,0.666667,1.0,1.0,1.0,1.0,True,0.027595,,Ktorý autor dokumentu je pri osobe Tomáš Kuchárik spojený s kategóriou dp2021?,"[""Daniel Hladek"", ""dp2021"", ""Tomáš Kuchárik""]","[""dp2021"", ""Tomáš Kuchárik""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/tomas_kucharik/README.md""]","[""pages/students/2016/tomas_kucharik/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0392,dev,document_author_category_multi_hop,hard,False,0.666667,0.5,0.666667,1.0,1.0,1.0,1.0,True,0.028893,,Ktorý autor dokumentu je pri osobe Dominik Nagy spojený s kategóriou dp2022?,"[""Daniel Hladek"", ""dp2022"", ""Dominik Nagy""]","[""dp2022"", ""Dominik Nagy""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/dominik_nagy/README.md""]","[""pages/students/2016/dominik_nagy/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0393,dev,document_author_category_multi_hop,hard,False,0.666667,0.5,0.666667,1.0,1.0,1.0,1.0,True,0.027134,,Ktorý autor dokumentu je pri osobe Matej Novotný spojený s kategóriou dp2026?,"[""Daniel Hladek"", ""dp2026"", ""Matej Novotný""]","[""dp2026"", ""Matej Novotný""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2021/matej_novotny/README.md""]","[""pages/students/2021/matej_novotny/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0394,dev,document_author_category_multi_hop,hard,False,0.666667,0.5,0.666667,1.0,1.0,1.0,1.0,True,0.028299,,Ktorý autor dokumentu je pri osobe Simona Bobrovčanová spojený s kategóriou bp2026?,"[""Daniel Hladek"", ""bp2026"", ""Simona Bobrovčanová""]","[""bp2026"", ""Simona Bobrovčanová""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2023/simona_bobrovcanova/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0396,dev,document_author_category_multi_hop,hard,False,0.666667,0.5,0.666667,1.0,1.0,1.0,1.0,True,0.027544,,Ktorý autor dokumentu je pri osobe Maroš Harahus spojený s kategóriou bp2019?,"[""Daniel Hladek"", ""bp2019"", ""Maroš Harahus""]","[""bp2019"", ""Maroš Harahus""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/maros_harahus/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0397,dev,document_author_category_multi_hop,hard,False,0.666667,0.5,0.666667,1.0,1.0,1.0,1.0,True,0.027524,,Ktorý autor dokumentu je pri osobe Valerii Kutsenko spojený s kategóriou bp2025?,"[""Daniel Hladek"", ""bp2025"", ""Valerii Kutsenko""]","[""bp2025"", ""Valerii Kutsenko""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0398,dev,document_author_category_multi_hop,hard,False,0.666667,0.5,0.666667,1.0,1.0,1.0,1.0,True,0.027538,,Ktorý autor dokumentu je pri osobe Patrik Pavlišin spojený s kategóriou bp2020?,"[""Daniel Hladek"", ""bp2020"", ""Patrik Pavlišin""]","[""bp2020"", ""Patrik Pavlišin""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0400,dev,document_author_category_multi_hop,hard,False,0.666667,0.5,0.666667,1.0,1.0,1.0,1.0,True,0.026552,,Ktorý autor dokumentu je pri osobe Ján Holp spojený s kategóriou bp2019?,"[""Daniel Hladek"", ""bp2019"", ""Ján Holp""]","[""bp2019"", ""Ján Holp""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0405,dev,document_author_category_multi_hop,hard,False,0.666667,0.5,0.666667,1.0,1.0,1.0,1.0,True,0.027752,,Ktorý autor dokumentu je pri osobe Matej Ščišľak spojený s kategóriou bp2024?,"[""Daniel Hladek"", ""bp2024"", ""Matej Ščišľak""]","[""bp2024"", ""Matej Ščišľak""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2021/matej_scislak/README.md""]","[""pages/students/2021/matej_scislak/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0407,dev,document_author_category_multi_hop,hard,False,0.666667,0.5,0.666667,1.0,1.0,1.0,1.0,True,0.027891,,Ktorý autor dokumentu je pri osobe Samuel Džurina spojený s kategóriou bp2026?,"[""Daniel Hladek"", ""bp2026"", ""Samuel Džurina""]","[""bp2026"", ""Samuel Džurina""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2023/samuel_dzurina/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0408,dev,document_author_category_multi_hop,hard,False,0.666667,0.5,0.666667,1.0,1.0,1.0,1.0,True,0.028494,,Ktorý autor dokumentu je pri osobe Patrik Pavlišin spojený s kategóriou dp2022?,"[""Daniel Hladek"", ""dp2022"", ""Patrik Pavlišin""]","[""dp2022"", ""Patrik Pavlišin""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0410,dev,document_author_category_multi_hop,hard,False,0.666667,0.5,0.666667,1.0,1.0,1.0,1.0,True,0.028488,,Ktorý autor dokumentu je pri osobe Bogdan Paul Chiș spojený s kategóriou erasmus?,"[""Daniel Hladek"", ""erasmus"", ""Bogdan Paul Chiș""]","[""erasmus"", ""Bogdan Paul Chiș""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/interns/bogdan_paul_chis/README.md""]","[""pages/interns/bogdan_paul_chis/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0411,dev,document_author_category_multi_hop,hard,False,0.666667,0.5,0.666667,1.0,1.0,1.0,1.0,True,0.031137,,Ktorý autor dokumentu je pri osobe Ján Holp spojený s kategóriou dp2021?,"[""Daniel Hladek"", ""dp2021"", ""Ján Holp""]","[""dp2021"", ""Ján Holp""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0412,dev,document_author_category_multi_hop,hard,False,0.666667,0.5,0.666667,1.0,1.0,1.0,1.0,True,0.027863,,Ktorý autor dokumentu je pri osobe Ján Pták spojený s kategóriou dp2027?,"[""Daniel Hladek"", ""dp2027"", ""Ján Pták""]","[""dp2027"", ""Ján Pták""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2022/jan_ptak/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0415,dev,document_author_category_multi_hop,hard,False,0.666667,0.5,0.666667,1.0,1.0,1.0,1.0,True,0.027939,,Ktorý autor dokumentu je pri osobe Cesar Abascal Gutierrez spojený s kategóriou iaeste?,"[""Daniel Hladek"", ""iaeste"", ""Cesar Abascal Gutierrez""]","[""iaeste"", ""Cesar Abascal Gutierrez""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/interns/cesar_gutierrez/README.md""]","[""pages/interns/cesar_gutierrez/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0416,dev,document_author_category_multi_hop,hard,False,0.666667,0.5,0.666667,1.0,1.0,1.0,1.0,True,0.028572,,Ktorý autor dokumentu je pri osobe Ondrej Megela spojený s kategóriou bp2021?,"[""Daniel Hladek"", ""bp2021"", ""Ondrej Megela""]","[""bp2021"", ""Ondrej Megela""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2018/ondrej_megela/README.md""]","[""pages/students/2018/ondrej_megela/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0417,dev,document_author_category_multi_hop,hard,False,0.666667,0.5,0.666667,1.0,1.0,1.0,1.0,True,0.029142,,Ktorý autor dokumentu je pri osobe Tomáš Kuchárik spojený s kategóriou dp2022?,"[""Daniel Hladek"", ""dp2022"", ""Tomáš Kuchárik""]","[""dp2022"", ""Tomáš Kuchárik""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/tomas_kucharik/README.md""]","[""pages/students/2016/tomas_kucharik/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0420,dev,document_author_category_multi_hop,hard,False,0.666667,0.5,0.666667,1.0,1.0,1.0,1.0,True,0.029065,,Ktorý autor dokumentu je pri osobe Michal Stromko spojený s kategóriou vp2021?,"[""Daniel Hladek"", ""vp2021"", ""Michal Stromko""]","[""vp2021"", ""Michal Stromko""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2019/michal_stromko/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0422,dev,document_author_category_multi_hop,hard,False,0.666667,0.5,0.666667,1.0,1.0,1.0,1.0,True,0.028352,,Ktorý autor dokumentu je pri osobe Rostyslav Rodzhuk spojený s kategóriou bp2026?,"[""Daniel Hladek"", ""bp2026"", ""Rostyslav Rodzhuk""]","[""bp2026"", ""Rostyslav Rodzhuk""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0424,dev,document_author_category_multi_hop,hard,False,0.666667,0.5,0.666667,1.0,1.0,1.0,1.0,True,0.028834,,Ktorý autor dokumentu je pri osobe Valerii Kutsenko spojený s kategóriou vp2024?,"[""Daniel Hladek"", ""vp2024"", ""Valerii Kutsenko""]","[""vp2024"", ""Valerii Kutsenko""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0425,dev,document_author_category_multi_hop,hard,False,0.666667,0.5,0.666667,1.0,1.0,1.0,1.0,True,0.028966,,Ktorý autor dokumentu je pri osobe Kristián Sopkovič spojený s kategóriou dp2024?,"[""Daniel Hladek"", ""dp2024"", ""Kristián Sopkovič""]","[""dp2024"", ""Kristián Sopkovič""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2019/kristian_sopkovic/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0426,dev,document_author_category_multi_hop,hard,False,0.666667,0.5,0.666667,1.0,1.0,1.0,1.0,True,0.029325,,Ktorý autor dokumentu je pri osobe Artem Yatsenko spojený s kategóriou bp2022?,"[""Daniel Hladek"", ""bp2022"", ""Artem Yatsenko""]","[""bp2022"", ""Artem Yatsenko""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2019/artem_yatsenko/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0427,dev,document_author_category_multi_hop,hard,False,0.666667,0.5,0.666667,1.0,1.0,1.0,1.0,True,0.029179,,Ktorý autor dokumentu je pri osobe Maroš Harahus spojený s kategóriou dp2021?,"[""Daniel Hladek"", ""dp2021"", ""Maroš Harahus""]","[""dp2021"", ""Maroš Harahus""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/maros_harahus/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0433,dev,document_author_category_multi_hop,hard,False,0.666667,0.5,0.666667,1.0,1.0,1.0,1.0,True,0.029357,,Ktorý autor dokumentu je pri osobe Daniil Huzenko spojený s kategóriou bp2025?,"[""Daniel Hladek"", ""bp2025"", ""Daniil Huzenko""]","[""bp2025"", ""Daniil Huzenko""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2022/daniil_huzenko/README.md""]","[""pages/students/2022/daniil_huzenko/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0435,dev,person_multiple_categories,hard,False,0.75,0.666667,0.666667,1.0,1.0,1.0,1.0,True,0.184065,,V ktorých kategóriách sa nachádzajú dokumenty osoby Dávid Omasta?,"[""Dávid Omasta"", ""dp2023"", ""dp2024"", ""Daniel Hladek""]","[""Dávid Omasta"", ""dp2023"", ""dp2024""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2018/david_omasta/README.md""]","[""pages/students/2018/david_omasta/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0436,dev,person_multiple_categories,hard,False,0.75,0.666667,0.666667,1.0,1.0,1.0,1.0,True,0.031751,,V ktorých kategóriách sa nachádzajú dokumenty osoby Ondrej Megela?,"[""Ondrej Megela"", ""bp2021"", ""dp2023"", ""Daniel Hladek""]","[""Ondrej Megela"", ""bp2021"", ""dp2023""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2018/ondrej_megela/README.md""]","[""pages/students/2018/ondrej_megela/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0438,dev,person_multiple_categories,hard,False,0.75,0.666667,0.666667,1.0,1.0,1.0,1.0,False,0.03025,,V ktorých kategóriách sa nachádzajú dokumenty osoby Dominik Nagy?,"[""Dominik Nagy"", ""bp2019"", ""dp2022"", ""Daniel Hladek""]","[""Dominik Nagy"", ""bp2019"", ""dp2022""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/dominik_nagy/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/dominik_nagy/timovy_projekt/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0439,dev,person_multiple_categories,hard,False,0.75,0.666667,0.666667,1.0,1.0,1.0,1.0,False,0.03103,,V ktorých kategóriách sa nachádzajú dokumenty osoby Maroš Harahus?,"[""Maroš Harahus"", ""bp2019"", ""dp2021"", ""Daniel Hladek""]","[""Maroš Harahus"", ""bp2019"", ""dp2021""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0440,dev,person_multiple_categories,hard,False,0.8,0.75,0.666667,1.0,1.0,1.0,1.0,True,0.028708,,V ktorých kategóriách sa nachádzajú dokumenty osoby Valerii Kutsenko?,"[""Valerii Kutsenko"", ""bp2025"", ""dp2027"", ""vp2024"", ""Daniel Hladek""]","[""Valerii Kutsenko"", ""bp2025"", ""dp2027"", ""vp2024""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0442,dev,person_multiple_categories,hard,False,0.8,0.75,0.666667,1.0,1.0,1.0,1.0,True,0.029985,,V ktorých kategóriách sa nachádzajú dokumenty osoby Patrik Pavlišin?,"[""Patrik Pavlišin"", ""bp2020"", ""dp2022"", ""tp2021"", ""Daniel Hladek""]","[""Patrik Pavlišin"", ""bp2020"", ""dp2022"", ""tp2021""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0443,dev,person_multiple_categories,hard,False,0.75,0.666667,0.666667,1.0,1.0,1.0,1.0,True,0.029173,,V ktorých kategóriách sa nachádzajú dokumenty osoby Kristián Sopkovič?,"[""Kristián Sopkovič"", ""bp2022"", ""dp2024"", ""Daniel Hladek""]","[""Kristián Sopkovič"", ""bp2022"", ""dp2024""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2019/kristian_sopkovic/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0445,dev,person_multiple_categories,hard,False,0.75,0.666667,0.666667,1.0,1.0,1.0,1.0,True,0.029604,,V ktorých kategóriách sa nachádzajú dokumenty osoby Tomáš Kuchárik?,"[""Tomáš Kuchárik"", ""dp2021"", ""dp2022"", ""Daniel Hladek""]","[""Tomáš Kuchárik"", ""dp2021"", ""dp2022""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/tomas_kucharik/README.md""]","[""pages/students/2016/tomas_kucharik/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0447,dev,person_multiple_categories,hard,False,0.75,0.666667,0.666667,1.0,1.0,1.0,1.0,False,0.02739,,V ktorých kategóriách sa nachádzajú dokumenty osoby Ján Holp?,"[""Ján Holp"", ""bp2019"", ""dp2021"", ""Daniel Hladek""]","[""Ján Holp"", ""bp2019"", ""dp2021""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0449,dev,person_multiple_categories,hard,False,0.75,0.666667,0.666667,1.0,1.0,1.0,1.0,False,0.028133,,V ktorých kategóriách sa nachádzajú dokumenty osoby Jakub Maruniak?,"[""Jakub Maruniak"", ""bp2019"", ""dp2021"", ""Daniel Hladek""]","[""Jakub Maruniak"", ""bp2019"", ""dp2021""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/jakub_maruniak/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0450,dev,person_multiple_categories,hard,False,0.8,0.75,0.666667,1.0,1.0,1.0,1.0,True,0.035036,,V ktorých kategóriách sa nachádzajú dokumenty osoby Michal Stromko?,"[""Michal Stromko"", ""bp2022"", ""dp2024"", ""vp2021"", ""Daniel Hladek""]","[""Michal Stromko"", ""bp2022"", ""dp2024"", ""vp2021""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2019/michal_stromko/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0452,dev,person_multiple_categories,hard,False,0.75,0.666667,0.666667,1.0,1.0,1.0,1.0,True,0.02772,,V ktorých kategóriách sa nachádzajú dokumenty osoby Matej Ščišľak?,"[""Matej Ščišľak"", ""bp2024"", ""dp2026"", ""Daniel Hladek""]","[""Matej Ščišľak"", ""bp2024"", ""dp2026""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2021/matej_scislak/README.md""]","[""pages/students/2021/matej_scislak/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0453,dev,person_multiple_categories,hard,False,0.75,0.666667,0.666667,1.0,1.0,1.0,1.0,True,0.030173,,V ktorých kategóriách sa nachádzajú dokumenty osoby Rostyslav Rodzhuk?,"[""Rostyslav Rodzhuk"", ""bp2026"", ""vp2025"", ""Daniel Hladek""]","[""Rostyslav Rodzhuk"", ""bp2026"", ""vp2025""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0454,dev,person_multiple_categories,hard,False,0.75,0.666667,0.666667,1.0,1.0,1.0,1.0,True,0.028498,,V ktorých kategóriách sa nachádzajú dokumenty osoby Dávid Omasta?,"[""Dávid Omasta"", ""dp2023"", ""dp2024"", ""Daniel Hladek""]","[""Dávid Omasta"", ""dp2023"", ""dp2024""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2018/david_omasta/README.md""]","[""pages/students/2018/david_omasta/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0455,dev,person_multiple_categories,hard,False,0.75,0.666667,0.666667,1.0,1.0,1.0,1.0,True,0.028798,,V ktorých kategóriách sa nachádzajú dokumenty osoby Ondrej Megela?,"[""Ondrej Megela"", ""bp2021"", ""dp2023"", ""Daniel Hladek""]","[""Ondrej Megela"", ""bp2021"", ""dp2023""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2018/ondrej_megela/README.md""]","[""pages/students/2018/ondrej_megela/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0457,dev,person_multiple_categories,hard,False,0.75,0.666667,0.666667,1.0,1.0,1.0,1.0,False,0.028697,,V ktorých kategóriách sa nachádzajú dokumenty osoby Dominik Nagy?,"[""Dominik Nagy"", ""bp2019"", ""dp2022"", ""Daniel Hladek""]","[""Dominik Nagy"", ""bp2019"", ""dp2022""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/dominik_nagy/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/dominik_nagy/timovy_projekt/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0458,dev,person_multiple_categories,hard,False,0.75,0.666667,0.666667,1.0,1.0,1.0,1.0,False,0.028939,,V ktorých kategóriách sa nachádzajú dokumenty osoby Maroš Harahus?,"[""Maroš Harahus"", ""bp2019"", ""dp2021"", ""Daniel Hladek""]","[""Maroš Harahus"", ""bp2019"", ""dp2021""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0459,dev,person_multiple_categories,hard,False,0.8,0.75,0.666667,1.0,1.0,1.0,1.0,True,0.028236,,V ktorých kategóriách sa nachádzajú dokumenty osoby Valerii Kutsenko?,"[""Valerii Kutsenko"", ""bp2025"", ""dp2027"", ""vp2024"", ""Daniel Hladek""]","[""Valerii Kutsenko"", ""bp2025"", ""dp2027"", ""vp2024""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0461,dev,person_multiple_categories,hard,False,0.8,0.75,0.666667,1.0,1.0,1.0,1.0,True,0.028675,,V ktorých kategóriách sa nachádzajú dokumenty osoby Patrik Pavlišin?,"[""Patrik Pavlišin"", ""bp2020"", ""dp2022"", ""tp2021"", ""Daniel Hladek""]","[""Patrik Pavlišin"", ""bp2020"", ""dp2022"", ""tp2021""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0462,dev,person_multiple_categories,hard,False,0.75,0.666667,0.666667,1.0,1.0,1.0,1.0,True,0.029873,,V ktorých kategóriách sa nachádzajú dokumenty osoby Kristián Sopkovič?,"[""Kristián Sopkovič"", ""bp2022"", ""dp2024"", ""Daniel Hladek""]","[""Kristián Sopkovič"", ""bp2022"", ""dp2024""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2019/kristian_sopkovic/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0464,dev,person_multiple_categories,hard,False,0.75,0.666667,0.666667,1.0,1.0,1.0,1.0,True,0.028317,,V ktorých kategóriách sa nachádzajú dokumenty osoby Tomáš Kuchárik?,"[""Tomáš Kuchárik"", ""dp2021"", ""dp2022"", ""Daniel Hladek""]","[""Tomáš Kuchárik"", ""dp2021"", ""dp2022""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/tomas_kucharik/README.md""]","[""pages/students/2016/tomas_kucharik/README.md""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
g0465,dev,candidate_set_aggregation,hard,False,1.0,1.0,1.0,1.0,1.0,1.0,0.75,True,0.545304,,"Z kandidátov Jakub Maruniak, Ján Holp, Maroš Harahus, Artem Yatsenko vyber všetky osoby, pri ktorých je práca uvedená v roku 2021. Koľko ich je?","[""Jakub Maruniak"", ""Ján Holp"", ""Maroš Harahus"", ""3"", ""2021""]","[""Jakub Maruniak"", ""Ján Holp"", ""Maroš Harahus"", ""3"", ""2021""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
g0466,dev,candidate_set_aggregation,hard,False,1.0,1.0,1.0,1.0,1.0,1.0,0.75,True,0.036384,,"Z kandidátov Artem Yatsenko, Dominik Nagy, Kristián Sopkovič, Daniil Huzenko vyber všetky osoby, pri ktorých je práca uvedená v roku 2022. Koľko ich je?","[""Artem Yatsenko"", ""Dominik Nagy"", ""Kristián Sopkovič"", ""3"", ""2022""]","[""Artem Yatsenko"", ""Dominik Nagy"", ""Kristián Sopkovič"", ""3"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2022/daniil_huzenko/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2022/daniil_huzenko/README.md""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
g0469,dev,candidate_set_aggregation,hard,False,1.0,1.0,1.0,1.0,1.0,1.0,0.666667,True,0.038695,,"Z kandidátov Ondrej Megela, Patrik Pavlišin, Artem Yatsenko vyber všetky osoby, pri ktorých je práca uvedená v roku 2020. Koľko ich je?","[""Ondrej Megela"", ""Patrik Pavlišin"", ""2"", ""2020""]","[""Ondrej Megela"", ""Patrik Pavlišin"", ""2"", ""2020""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
g0471,dev,candidate_set_aggregation,hard,False,1.0,1.0,1.0,1.0,1.0,1.0,0.666667,True,0.036198,,"Z kandidátov Dávid Omasta, Vladimír Ferko, Artem Yatsenko vyber všetky osoby, pri ktorých je práca uvedená v roku 2024. Koľko ich je?","[""Dávid Omasta"", ""Vladimír Ferko"", ""2"", ""2024""]","[""Dávid Omasta"", ""Vladimír Ferko"", ""2"", ""2024""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2018/david_omasta/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""pages/students/2018/david_omasta/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
g0473,dev,candidate_set_aggregation,hard,False,1.0,1.0,1.0,1.0,1.0,1.0,0.75,True,0.036599,,"Z kandidátov Ján Pták, Matej Novotný, Matej Ščišľak, Artem Yatsenko vyber všetky osoby, pri ktorých je práca uvedená v roku 2026. Koľko ich je?","[""Ján Pták"", ""Matej Novotný"", ""Matej Ščišľak"", ""3"", ""2026""]","[""Ján Pták"", ""Matej Novotný"", ""Matej Ščišľak"", ""3"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
g0475,dev,candidate_set_aggregation,hard,False,1.0,1.0,1.0,1.0,1.0,1.0,0.666667,True,0.035993,,"Z kandidátov Daniil Huzenko, Tetiana Mohorian, Artem Yatsenko vyber všetky osoby, pri ktorých je práca uvedená v roku 2025. Koľko ich je?","[""Daniil Huzenko"", ""Tetiana Mohorian"", ""2"", ""2025""]","[""Daniil Huzenko"", ""Tetiana Mohorian"", ""2"", ""2025""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
g0476,dev,candidate_set_aggregation,hard,False,1.0,1.0,1.0,1.0,1.0,1.0,0.75,True,0.036956,,"Ktoré osoby zo zoznamu Jakub Maruniak, Ján Holp, Maroš Harahus, Artem Yatsenko zdieľajú rok práce 2021? Uveď aj ich počet.","[""Jakub Maruniak"", ""Ján Holp"", ""Maroš Harahus"", ""3"", ""2021""]","[""Jakub Maruniak"", ""Ján Holp"", ""Maroš Harahus"", ""3"", ""2021""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
g0477,dev,candidate_set_aggregation,hard,False,1.0,1.0,1.0,1.0,1.0,1.0,0.75,True,0.03636,,"Ktoré osoby zo zoznamu Artem Yatsenko, Dominik Nagy, Kristián Sopkovič, Daniil Huzenko zdieľajú rok práce 2022? Uveď aj ich počet.","[""Artem Yatsenko"", ""Dominik Nagy"", ""Kristián Sopkovič"", ""3"", ""2022""]","[""Artem Yatsenko"", ""Dominik Nagy"", ""Kristián Sopkovič"", ""3"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2022/daniil_huzenko/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2022/daniil_huzenko/README.md""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
g0480,dev,candidate_set_aggregation,hard,False,1.0,1.0,1.0,1.0,1.0,1.0,0.666667,True,0.035403,,"Ktoré osoby zo zoznamu Ondrej Megela, Patrik Pavlišin, Artem Yatsenko zdieľajú rok práce 2020? Uveď aj ich počet.","[""Ondrej Megela"", ""Patrik Pavlišin"", ""2"", ""2020""]","[""Ondrej Megela"", ""Patrik Pavlišin"", ""2"", ""2020""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
g0484,dev,conjunctive_disambiguation,hard,False,0.666667,0.666667,1.0,1.0,1.0,1.0,1.0,True,0.13348,,Ktorá z osôb Ján Pták a Matej Novotný spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo OpenWebUI a jej práca je uvedená v roku 2026?,"[""Ján Pták"", ""OpenWebUI"", ""2026""]","[""Ján Pták"", ""2026""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_WORK""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""person_keyword"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints"", ""person_keyword_constraints""]"
|
||||||
|
g0485,dev,conjunctive_disambiguation,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.082219,,Ktorá z osôb Michal Stromko a Artem Yatsenko spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo Elasticsearch a jej práca je uvedená v roku 2022?,"[""Michal Stromko"", ""Elasticsearch"", ""2022""]","[""Michal Stromko"", ""Elasticsearch"", ""2022""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""person_keyword"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""person_keyword_constraints""]"
|
||||||
|
g0486,dev,conjunctive_disambiguation,hard,False,1.0,1.0,0.0,1.0,1.0,1.0,1.0,True,0.144909,,Ktorá z osôb Tetiana Mohorian a Daniil Huzenko spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo LLM a jej práca je uvedená v roku 2025?,"[""Tetiana Mohorian"", ""LLM"", ""2025""]","[""Tetiana Mohorian"", ""LLM"", ""2025""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
g0488,dev,conjunctive_disambiguation,hard,False,0.666667,0.666667,1.0,1.0,1.0,1.0,1.0,True,0.037351,,Ktorá z osôb Michal Stromko a Artem Yatsenko spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo FAISS a jej práca je uvedená v roku 2022?,"[""Michal Stromko"", ""FAISS"", ""2022""]","[""Michal Stromko"", ""2022""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""person_keyword"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""person_keyword_constraints""]"
|
||||||
|
g0490,dev,conjunctive_disambiguation,hard,False,0.666667,0.666667,1.0,1.0,1.0,1.0,1.0,True,0.049448,,Ktorá z osôb Tetiana Mohorian a Daniil Huzenko spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo prompting a jej práca je uvedená v roku 2025?,"[""Tetiana Mohorian"", ""prompting"", ""2025""]","[""Tetiana Mohorian"", ""2025""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""person_keyword"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""person_keyword_constraints""]"
|
||||||
|
g0492,dev,conjunctive_disambiguation,hard,False,0.666667,0.666667,1.0,1.0,1.0,1.0,1.0,True,0.036791,,Ktorá z osôb Yevhenii Medushivskyi a Ján Pták spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo webový korpus a jej práca je uvedená v roku 2026?,"[""Yevhenii Medushivskyi"", ""webový korpus"", ""2026""]","[""Yevhenii Medushivskyi"", ""2026""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_WORK""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""person_keyword"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints"", ""person_keyword_constraints""]"
|
||||||
|
g0493,dev,conjunctive_disambiguation,hard,False,0.666667,0.666667,1.0,1.0,1.0,1.0,1.0,True,0.038163,,Ktorá z osôb Simona Bobrovčanová a Ján Pták spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo právne dokumenty a jej práca je uvedená v roku 2026?,"[""Simona Bobrovčanová"", ""právne dokumenty"", ""2026""]","[""Simona Bobrovčanová"", ""2026""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_WORK""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""person_keyword"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints"", ""person_keyword_constraints""]"
|
||||||
|
g0495,dev,conjunctive_disambiguation,hard,False,0.666667,0.666667,1.0,1.0,1.0,1.0,1.0,True,0.039789,,Ktorá z osôb Kristián Sopkovič a Artem Yatsenko spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo slovenčina a jej práca je uvedená v roku 2022?,"[""Kristián Sopkovič"", ""slovenčina"", ""2022""]","[""Kristián Sopkovič"", ""2022""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""person_keyword"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""person_keyword_constraints""]"
|
||||||
|
g0498,dev,conjunctive_disambiguation,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.038549,,Ktorá z osôb Maroš Harahus a Artem Yatsenko spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo Spacy a jej práca je uvedená v roku 2021?,"[""Maroš Harahus"", ""Spacy"", ""2021""]","[""Maroš Harahus"", ""Spacy"", ""2021""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""person_keyword"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""person_keyword_constraints""]"
|
||||||
|
g0499,dev,conjunctive_disambiguation,hard,False,0.666667,0.666667,1.0,1.0,1.0,1.0,1.0,True,0.037694,,Ktorá z osôb Ján Holp a Jakub Maruniak spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo slovenský internet a jej práca je uvedená v roku 2021?,"[""Ján Holp"", ""slovenský internet"", ""2021""]","[""Ján Holp"", ""2021""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""person_keyword"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""person_keyword_constraints""]"
|
||||||
|
g0500,dev,conjunctive_disambiguation,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.039232,,Ktorá z osôb Kristián Sopkovič a Dominik Nagy spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo Spacy a jej práca je uvedená v roku 2022?,"[""Kristián Sopkovič"", ""Spacy"", ""2022""]","[""Kristián Sopkovič"", ""Spacy"", ""2022""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""person_keyword"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""person_keyword_constraints""]"
|
||||||
|
26938
tools/graphrag/evaluation/results/archive_pre_v1/graphrag_dev.json
Normal file
26938
tools/graphrag/evaluation/results/archive_pre_v1/graphrag_dev.json
Normal file
File diff suppressed because it is too large
Load Diff
68
tools/graphrag/evaluation/results/final_2026-10-24/REPORT.md
Normal file
68
tools/graphrag/evaluation/results/final_2026-10-24/REPORT.md
Normal file
@ -0,0 +1,68 @@
|
|||||||
|
# GraphRAG: finálna evaluácia v1 — 24. 10. 2026
|
||||||
|
|
||||||
|
Vyhľadávanie bolo ladené na DEV, potom zmrazené pomocou `../../frozen_v1.json` a až následne vyhodnotené na celom TESTe. Po finálnom TESTe sa implementácia, evaluator, benchmark ani audit nemenili.
|
||||||
|
|
||||||
|
## Výsledky
|
||||||
|
|
||||||
|
| Beh | Strict | Úspešnosť | Runtime chyby | Priemer | Medián | p95 |
|
||||||
|
|---|---:|---:|---:|---:|---:|---:|
|
||||||
|
| Pôvodné vyhľadávanie, aktuálny evaluator (DEV) | 106/286 | 37.06 % | 0 | 29.99 ms | 28.12 ms | 41.82 ms |
|
||||||
|
| Finálny DEV | 209/286 | 73.08 % | 0 | 32.79 ms | 32.21 ms | 41.83 ms |
|
||||||
|
| Finálny TEST | 152/214 | 71.03 % | 0 | 29.58 ms | 29.33 ms | 33.78 ms |
|
||||||
|
|
||||||
|
Pôvodné vyhľadávanie pochádza z commitu `9f3483d`; jeho odtlačok je v `baseline_dev.json`. Porovnanie používa rovnaký benchmark, graf, parametre a aktuálny sprísnený evaluator. Historický baseline 127/286 = 44,41 % používal starší evaluator; priamo porovnateľný baseline je 106/286 = 37,06 %.
|
||||||
|
|
||||||
|
Latencie merajú samotné grafové vyhľadávanie. Neobsahujú tvorbu odpovede LLM, volanie OpenWebUI ani úvodný odtlačok celého grafu. Nie sú porovnateľné s približne 19 sekundami celého klasického RAG toku.
|
||||||
|
|
||||||
|
## Nesúlady benchmarku so zdrojmi
|
||||||
|
|
||||||
|
Pred TESTom vznikol statický audit všetkých 500 otázok priamo proti vstupným dokumentom, tagom a deterministickému grafovému payloadu. Audit nepoužíva výstup vyhľadávania. Pôvodný benchmark zostal od začiatku tejto úpravy nezmenený bajt po bajte. Primárne skóre vyššie zahŕňa aj všetky problémové anotácie.
|
||||||
|
|
||||||
|
| Zistený nesúlad | DEV | TEST |
|
||||||
|
|---|---:|---:|
|
||||||
|
| Očakávané kľúčové slovo nie je vo frontmatter katalógu | 66 | 46 |
|
||||||
|
| Tag existuje, ale nie je prepojený s očakávanou osobou | 5 | 11 |
|
||||||
|
| Presná očakávaná množina kategórií nezodpovedá aj poddokumentom | 6 | 3 |
|
||||||
|
| Spolu otázok so zisteným nesúladom | 77 | 60 |
|
||||||
|
|
||||||
|
Textová zmienka o OpenWebUI alebo Elasticsearch v tele stránky sa podľa súčasného modelu nestáva uzlom `Keyword`. Rovnako sa automaticky nestotožňujú rôzne tagy alebo preklady. Vymyslenie grafového faktu na splnenie takýchto očakávaní by bolo nesprávne.
|
||||||
|
|
||||||
|
Doplnkové výsledky pre podmnožinu bez zistených zdrojových nesúladov:
|
||||||
|
|
||||||
|
| Sada | Strict | Úspešnosť |
|
||||||
|
|---|---:|---:|
|
||||||
|
| DEV | 209/209 | 100.00 % |
|
||||||
|
| TEST | 152/154 | 98.70 % |
|
||||||
|
|
||||||
|
Toto je doplnková analýza, nie náhrada primárneho skóre ani dôkaz bezchybnosti všetkých ostatných anotácií. Pravidlá auditu a zoznam otázok boli uložené pred finálnym TESTom a overujú sa odtlačkom vo freeze manifeste.
|
||||||
|
|
||||||
|
## Kategórie
|
||||||
|
|
||||||
|
| Kategória | DEV strict | TEST strict |
|
||||||
|
|---|---:|---:|
|
||||||
|
| `candidate_set_aggregation` | 9/9 | 7/7 |
|
||||||
|
| `conjunctive_disambiguation` | 2/11 | 1/9 |
|
||||||
|
| `document_author_category_multi_hop` | 35/35 | 25/25 |
|
||||||
|
| `person_keyword_title` | 4/42 | 3/38 |
|
||||||
|
| `person_multiple_categories` | 15/21 | 6/9 |
|
||||||
|
| `person_title_year` | 44/44 | 36/36 |
|
||||||
|
| `same_academic_year_pair` | 56/56 | 42/44 |
|
||||||
|
| `same_start_year_pair` | 28/28 | 32/32 |
|
||||||
|
| `shared_keyword_pair` | 16/40 | 0/14 |
|
||||||
|
|
||||||
|
Kompletné metriky hodnôt, typovaných entít, relácií, vlastností, množín, zdrojov, kategórií, obtiažností a latencií obsahujú JSON a CSV súbory. Document recall a source recall dosiahli v oboch finálnych behoch 1,0; recall kontextových zdrojov sám osebe neznamená správnu odpoveď.
|
||||||
|
|
||||||
|
## Overenie a zostávajúce limity
|
||||||
|
|
||||||
|
- Celá testovacia sada: **359 passed, 4 skipped**. Desiatich nových Neo4j integračných prípadov sa týka skutočné vykonanie Cypher dotazov v oddelených transakciách s rollbackom.
|
||||||
|
- Opravené sú skloňovanie názvu, otázky na spoločný rok bez číselného roku v otázke, spojenie názvu/tagu a roku/tagu pri tej istej osobe, autor/kategória pri tom istom dokumente a URL zdrojov vrátane zamietnutých kandidátov.
|
||||||
|
- Počítanie sa vykonáva pred prezentačným limitom. Orezaný výsledok nemôže prejsť strict hodnotením.
|
||||||
|
- Evaluator neuznáva názov ani inú hodnotu iba preto, že sa rozpoznala z otázky. Entity sa hodnotia podľa typu a pri agregácii sa kontroluje aj počet.
|
||||||
|
- Vo finálnom TESTe ostali **g0065 a g0129**, dve formulácie otázky na spoločný rok pri rovnakej dvojici osôb. Podklady obsahujú navyše dokument Martina Jančuru; pravdepodobnou príčinou je príliš široké fuzzy rozpoznávanie mena. Detaily sú v `holdout_failures.json`. Po tomto zistení sa kód neupravoval.
|
||||||
|
- V budúcej verzii treba túto nejednoznačnosť riešiť na samostatných vývojových prípadoch a pripraviť nový nezávislý holdout. Aktuálny TEST už nemá slúžiť ako nový nedotknutý test pre takto ladenú verziu.
|
||||||
|
- `expected_paths` sú opisné anotácie. Strict vyhodnocuje typované fakty, relácie a vlastnosti, nie doslovnú zhodu týchto textových reťazcov s cestou.
|
||||||
|
- Meria sa grafová retrieval vrstva, nie kvalita odpovede LLM. Otázky zdieľajú wiki a formulárové šablóny medzi DEV/TEST; výsledky nemožno vydávať za všeobecnú presnosť na ľubovoľných otázkach.
|
||||||
|
|
||||||
|
## Rozhodnutie o stave
|
||||||
|
|
||||||
|
Vývojový beh 3.3 je uzavretý pre v1, verzia 3.4 je obsahovo zmrazená, TEST 3.5 prebehol a metriky 3.6 sú uložené. Audit 3.1 odhalil 137 zdrojových nesúladov, ktoré sú explicitne zaznamenané. Finálny benchmark potrebuje novú zdrojovo overenú verziu pred formálnym porovnaním RAG a GraphRAG. Táto evaluácia ich nezakrýva úpravou otázok po TESTe.
|
||||||
28460
tools/graphrag/evaluation/results/final_2026-10-24/baseline_dev.json
Normal file
28460
tools/graphrag/evaluation/results/final_2026-10-24/baseline_dev.json
Normal file
File diff suppressed because it is too large
Load Diff
@ -0,0 +1,287 @@
|
|||||||
|
complete,count_ok,expected_count,actual_count,id,split,category,difficulty,strict,value_score,entity_score,relation_score,property_score,relation_choice_score,document_recall,source_recall,entity_set_ok,latency_seconds,error,question,expected_values,matched_values,expected_relations,actual_relations,expected_documents,actual_documents,expected_source_urls,actual_source_urls,fact_types,strategies
|
||||||
|
True,True,,,g0001,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.037433,,Sú osoby Maroš Harahus a Jakub Maruniak v ZP Wiki prepojené cez kľúčové slovo Spacy? Uveď spoločné kľúčové slovo.,"[""Maroš Harahus"", ""Jakub Maruniak"", ""Spacy""]","[""Maroš Harahus"", ""Jakub Maruniak"", ""Spacy""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
True,True,,,g0002,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.035416,,Over prepojenie osôb Maroš Harahus a Jakub Maruniak cez kľúčové slovo Spacy a pomenuj spoločné kľúčové slovo.,"[""Maroš Harahus"", ""Jakub Maruniak"", ""Spacy""]","[""Maroš Harahus"", ""Jakub Maruniak"", ""Spacy""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
True,True,,,g0003,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031317,,Sú osoby Maroš Harahus a Kristián Sopkovič v ZP Wiki prepojené cez kľúčové slovo Spacy? Uveď spoločné kľúčové slovo.,"[""Maroš Harahus"", ""Kristián Sopkovič"", ""Spacy""]","[""Maroš Harahus"", ""Kristián Sopkovič"", ""Spacy""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
True,True,,,g0004,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.029606,,Over prepojenie osôb Maroš Harahus a Kristián Sopkovič cez kľúčové slovo Spacy a pomenuj spoločné kľúčové slovo.,"[""Maroš Harahus"", ""Kristián Sopkovič"", ""Spacy""]","[""Maroš Harahus"", ""Kristián Sopkovič"", ""Spacy""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
True,True,,,g0005,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031042,,Sú osoby Maroš Harahus a Artem Yatsenko v ZP Wiki prepojené cez kľúčové slovo Spacy? Uveď spoločné kľúčové slovo.,"[""Maroš Harahus"", ""Artem Yatsenko"", ""Spacy""]","[""Maroš Harahus"", ""Artem Yatsenko"", ""Spacy""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
True,True,,,g0006,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.029576,,Over prepojenie osôb Maroš Harahus a Artem Yatsenko cez kľúčové slovo Spacy a pomenuj spoločné kľúčové slovo.,"[""Maroš Harahus"", ""Artem Yatsenko"", ""Spacy""]","[""Maroš Harahus"", ""Artem Yatsenko"", ""Spacy""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
True,True,,,g0007,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028865,,Sú osoby Jakub Maruniak a Kristián Sopkovič v ZP Wiki prepojené cez kľúčové slovo Spacy? Uveď spoločné kľúčové slovo.,"[""Jakub Maruniak"", ""Kristián Sopkovič"", ""Spacy""]","[""Jakub Maruniak"", ""Kristián Sopkovič"", ""Spacy""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
True,True,,,g0008,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.029412,,Over prepojenie osôb Jakub Maruniak a Kristián Sopkovič cez kľúčové slovo Spacy a pomenuj spoločné kľúčové slovo.,"[""Jakub Maruniak"", ""Kristián Sopkovič"", ""Spacy""]","[""Jakub Maruniak"", ""Kristián Sopkovič"", ""Spacy""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
True,True,,,g0009,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028867,,Sú osoby Jakub Maruniak a Artem Yatsenko v ZP Wiki prepojené cez kľúčové slovo Spacy? Uveď spoločné kľúčové slovo.,"[""Jakub Maruniak"", ""Artem Yatsenko"", ""Spacy""]","[""Jakub Maruniak"", ""Artem Yatsenko"", ""Spacy""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
True,True,,,g0010,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.029123,,Over prepojenie osôb Jakub Maruniak a Artem Yatsenko cez kľúčové slovo Spacy a pomenuj spoločné kľúčové slovo.,"[""Jakub Maruniak"", ""Artem Yatsenko"", ""Spacy""]","[""Jakub Maruniak"", ""Artem Yatsenko"", ""Spacy""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
True,True,,,g0011,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.029002,,Sú osoby Kristián Sopkovič a Artem Yatsenko v ZP Wiki prepojené cez kľúčové slovo Spacy? Uveď spoločné kľúčové slovo.,"[""Kristián Sopkovič"", ""Artem Yatsenko"", ""Spacy""]","[""Kristián Sopkovič"", ""Artem Yatsenko"", ""Spacy""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
True,True,,,g0012,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027919,,Over prepojenie osôb Kristián Sopkovič a Artem Yatsenko cez kľúčové slovo Spacy a pomenuj spoločné kľúčové slovo.,"[""Kristián Sopkovič"", ""Artem Yatsenko"", ""Spacy""]","[""Kristián Sopkovič"", ""Artem Yatsenko"", ""Spacy""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
True,True,,,g0013,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.027892,,Sú osoby Tomáš Kuchárik a Dávid Omasta v ZP Wiki prepojené cez kľúčové slovo Question Answering? Uveď spoločné kľúčové slovo.,"[""Tomáš Kuchárik"", ""Dávid Omasta"", ""Question Answering""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2018/david_omasta/README.md""]","[""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2018/david_omasta/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0014,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.029358,,Over prepojenie osôb Tomáš Kuchárik a Dávid Omasta cez kľúčové slovo Question Answering a pomenuj spoločné kľúčové slovo.,"[""Tomáš Kuchárik"", ""Dávid Omasta"", ""Question Answering""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2018/david_omasta/README.md""]","[""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2018/david_omasta/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0015,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.02587,,Sú osoby Tomáš Kuchárik a Dominik Nagy v ZP Wiki prepojené cez kľúčové slovo strojový preklad? Uveď spoločné kľúčové slovo.,"[""Tomáš Kuchárik"", ""Dominik Nagy"", ""strojový preklad""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0016,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.028411,,Over prepojenie osôb Tomáš Kuchárik a Dominik Nagy cez kľúčové slovo strojový preklad a pomenuj spoločné kľúčové slovo.,"[""Tomáš Kuchárik"", ""Dominik Nagy"", ""strojový preklad""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0017,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.027256,,Sú osoby Tomáš Kuchárik a Patrik Pavlišin v ZP Wiki prepojené cez kľúčové slovo strojový preklad? Uveď spoločné kľúčové slovo.,"[""Tomáš Kuchárik"", ""Patrik Pavlišin"", ""strojový preklad""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0018,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.026018,,Over prepojenie osôb Tomáš Kuchárik a Patrik Pavlišin cez kľúčové slovo strojový preklad a pomenuj spoločné kľúčové slovo.,"[""Tomáš Kuchárik"", ""Patrik Pavlišin"", ""strojový preklad""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0019,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.028044,,Sú osoby Dominik Nagy a Patrik Pavlišin v ZP Wiki prepojené cez kľúčové slovo strojový preklad? Uveď spoločné kľúčové slovo.,"[""Dominik Nagy"", ""Patrik Pavlišin"", ""strojový preklad""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0020,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.030635,,Over prepojenie osôb Dominik Nagy a Patrik Pavlišin cez kľúčové slovo strojový preklad a pomenuj spoločné kľúčové slovo.,"[""Dominik Nagy"", ""Patrik Pavlišin"", ""strojový preklad""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0021,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.030589,,Sú osoby Jakub Maruniak a Artem Yatsenko v ZP Wiki prepojené cez kľúčové slovo pomenované entity? Uveď spoločné kľúčové slovo.,"[""Jakub Maruniak"", ""Artem Yatsenko"", ""pomenované entity""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0022,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.034683,,Over prepojenie osôb Jakub Maruniak a Artem Yatsenko cez kľúčové slovo pomenované entity a pomenuj spoločné kľúčové slovo.,"[""Jakub Maruniak"", ""Artem Yatsenko"", ""pomenované entity""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0023,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.02886,,Sú osoby Ondrej Megela a Matej Novotný v ZP Wiki prepojené cez kľúčové slovo jazykové modelovanie? Uveď spoločné kľúčové slovo.,"[""Ondrej Megela"", ""Matej Novotný"", ""jazykové modelovanie""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2021/matej_novotny/README.md""]","[""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2021/matej_novotny/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny""]","[""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0024,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.031182,,Over prepojenie osôb Ondrej Megela a Matej Novotný cez kľúčové slovo jazykové modelovanie a pomenuj spoločné kľúčové slovo.,"[""Ondrej Megela"", ""Matej Novotný"", ""jazykové modelovanie""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2021/matej_novotny/README.md""]","[""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2021/matej_novotny/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny""]","[""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0025,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.038696,,Sú osoby Dávid Omasta a Kristián Sopkovič v ZP Wiki prepojené cez kľúčové slovo slovenčina? Uveď spoločné kľúčové slovo.,"[""Dávid Omasta"", ""Kristián Sopkovič"", ""slovenčina""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2018/david_omasta/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2018/david_omasta/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0026,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.041906,,Over prepojenie osôb Dávid Omasta a Kristián Sopkovič cez kľúčové slovo slovenčina a pomenuj spoločné kľúčové slovo.,"[""Dávid Omasta"", ""Kristián Sopkovič"", ""slovenčina""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2018/david_omasta/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2018/david_omasta/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0027,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.031662,,Sú osoby Michal Stromko a Matej Ščišľak v ZP Wiki prepojené cez kľúčové slovo FAISS? Uveď spoločné kľúčové slovo.,"[""Michal Stromko"", ""Matej Ščišľak"", ""FAISS""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]","[""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0028,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.029943,,Over prepojenie osôb Michal Stromko a Matej Ščišľak cez kľúčové slovo FAISS a pomenuj spoločné kľúčové slovo.,"[""Michal Stromko"", ""Matej Ščišľak"", ""FAISS""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]","[""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0031,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.031258,,Sú osoby Artem Yatsenko a Vladimír Ferko v ZP Wiki prepojené cez kľúčové slovo anotácia? Uveď spoločné kľúčové slovo.,"[""Artem Yatsenko"", ""Vladimír Ferko"", ""anotácia""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0032,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.034636,,Over prepojenie osôb Artem Yatsenko a Vladimír Ferko cez kľúčové slovo anotácia a pomenuj spoločné kľúčové slovo.,"[""Artem Yatsenko"", ""Vladimír Ferko"", ""anotácia""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0035,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.029476,,Sú osoby Matej Ščišľak a Valerii Kutsenko v ZP Wiki prepojené cez kľúčové slovo GraphRAG? Uveď spoločné kľúčové slovo.,"[""Matej Ščišľak"", ""Valerii Kutsenko"", ""GraphRAG""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0036,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.042411,,Over prepojenie osôb Matej Ščišľak a Valerii Kutsenko cez kľúčové slovo GraphRAG a pomenuj spoločné kľúčové slovo.,"[""Matej Ščišľak"", ""Valerii Kutsenko"", ""GraphRAG""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0037,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.036859,,Sú osoby Vladimír Ferko a Tetiana Mohorian v ZP Wiki prepojené cez kľúčové slovo hate speech? Uveď spoločné kľúčové slovo.,"[""Vladimír Ferko"", ""Tetiana Mohorian"", ""hate speech""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0038,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.029953,,Over prepojenie osôb Vladimír Ferko a Tetiana Mohorian cez kľúčové slovo hate speech a pomenuj spoločné kľúčové slovo.,"[""Vladimír Ferko"", ""Tetiana Mohorian"", ""hate speech""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0041,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033878,,Sú osoby Valerii Kutsenko a Ján Pták v ZP Wiki prepojené cez kľúčové slovo RAG? Uveď spoločné kľúčové slovo.,"[""Valerii Kutsenko"", ""Ján Pták"", ""RAG""]","[""Valerii Kutsenko"", ""Ján Pták"", ""RAG""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
True,True,,,g0042,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.034934,,Over prepojenie osôb Valerii Kutsenko a Ján Pták cez kľúčové slovo RAG a pomenuj spoločné kľúčové slovo.,"[""Valerii Kutsenko"", ""Ján Pták"", ""RAG""]","[""Valerii Kutsenko"", ""Ján Pták"", ""RAG""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
True,True,,,g0049,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.03198,,Sú osoby Tetiana Mohorian a Rostyslav Rodzhuk v ZP Wiki prepojené cez kľúčové slovo LLM? Uveď spoločné kľúčové slovo.,"[""Tetiana Mohorian"", ""Rostyslav Rodzhuk"", ""LLM""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2022/tetiana_mohorian/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""pages/students/2022/tetiana_mohorian/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]","[""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0050,dev,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.029189,,Over prepojenie osôb Tetiana Mohorian a Rostyslav Rodzhuk cez kľúčové slovo LLM a pomenuj spoločné kľúčové slovo.,"[""Tetiana Mohorian"", ""Rostyslav Rodzhuk"", ""LLM""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2022/tetiana_mohorian/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""pages/students/2022/tetiana_mohorian/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]","[""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0053,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03007,,Sú osoby Rostyslav Rodzhuk a Samuel Džurina v ZP Wiki prepojené cez kľúčové slovo agent? Uveď spoločné kľúčové slovo.,"[""Rostyslav Rodzhuk"", ""Samuel Džurina"", ""agent""]","[""Rostyslav Rodzhuk"", ""Samuel Džurina"", ""agent""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
True,True,,,g0054,dev,shared_keyword_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030627,,Over prepojenie osôb Rostyslav Rodzhuk a Samuel Džurina cez kľúčové slovo agent a pomenuj spoločné kľúčové slovo.,"[""Rostyslav Rodzhuk"", ""Samuel Džurina"", ""agent""]","[""Rostyslav Rodzhuk"", ""Samuel Džurina"", ""agent""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""shared_keyword""]","[""entity_resolution"", ""shared_keyword_constraints""]"
|
||||||
|
True,True,,,g0058,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.040538,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Pták a Samuel Džurina?,"[""Ján Pták"", ""Samuel Džurina"", ""2026""]","[""Ján Pták"", ""Samuel Džurina"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0060,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.035129,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Pták a Matej Novotný?,"[""Ján Pták"", ""Matej Novotný"", ""2026""]","[""Ján Pták"", ""Matej Novotný"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0063,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033403,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Rostyslav Rodzhuk a Samuel Džurina?,"[""Rostyslav Rodzhuk"", ""Samuel Džurina"", ""2026""]","[""Rostyslav Rodzhuk"", ""Samuel Džurina"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0064,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033754,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Novotný a Samuel Džurina?,"[""Matej Novotný"", ""Samuel Džurina"", ""2026""]","[""Matej Novotný"", ""Samuel Džurina"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0066,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03164,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Ščišľak a Samuel Džurina?,"[""Matej Ščišľak"", ""Samuel Džurina"", ""2026""]","[""Matej Ščišľak"", ""Samuel Džurina"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0068,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03323,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Artem Yatsenko a Kristián Sopkovič?,"[""Artem Yatsenko"", ""Kristián Sopkovič"", ""2022""]","[""Artem Yatsenko"", ""Kristián Sopkovič"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0071,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.034048,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Samuel Džurina a Simona Bobrovčanová?,"[""Samuel Džurina"", ""Simona Bobrovčanová"", ""2026""]","[""Samuel Džurina"", ""Simona Bobrovčanová"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0072,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.051306,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Pták a Rostyslav Rodzhuk?,"[""Ján Pták"", ""Rostyslav Rodzhuk"", ""2026""]","[""Ján Pták"", ""Rostyslav Rodzhuk"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0074,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.041968,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Holp a Maroš Harahus?,"[""Ján Holp"", ""Maroš Harahus"", ""2021""]","[""Ján Holp"", ""Maroš Harahus"", ""2021""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0075,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.039645,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Artem Yatsenko a Tomáš Kuchárik?,"[""Artem Yatsenko"", ""Tomáš Kuchárik"", ""2022""]","[""Artem Yatsenko"", ""Tomáš Kuchárik"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0076,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.037461,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Dávid Omasta a Vladimír Ferko?,"[""Dávid Omasta"", ""Vladimír Ferko"", ""2024""]","[""Dávid Omasta"", ""Vladimír Ferko"", ""2024""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2018/david_omasta/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""pages/students/2018/david_omasta/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]","[""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0078,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.040354,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Kristián Sopkovič a Michal Stromko?,"[""Kristián Sopkovič"", ""Michal Stromko"", ""2022""]","[""Kristián Sopkovič"", ""Michal Stromko"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0079,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.037006,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Artem Yatsenko a Michal Stromko?,"[""Artem Yatsenko"", ""Michal Stromko"", ""2022""]","[""Artem Yatsenko"", ""Michal Stromko"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0081,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.034235,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Pták a Yevhenii Medushivskyi?,"[""Ján Pták"", ""Yevhenii Medushivskyi"", ""2026""]","[""Ján Pták"", ""Yevhenii Medushivskyi"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0084,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03649,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Ščišľak a Yevhenii Medushivskyi?,"[""Matej Ščišľak"", ""Yevhenii Medushivskyi"", ""2026""]","[""Matej Ščišľak"", ""Yevhenii Medushivskyi"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0086,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.034878,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ondrej Megela a Patrik Pavlišin?,"[""Ondrej Megela"", ""Patrik Pavlišin"", ""2020""]","[""Ondrej Megela"", ""Patrik Pavlišin"", ""2020""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2018/ondrej_megela/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2018/ondrej_megela/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0087,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03767,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Jakub Maruniak a Maroš Harahus?,"[""Jakub Maruniak"", ""Maroš Harahus"", ""2021""]","[""Jakub Maruniak"", ""Maroš Harahus"", ""2021""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0088,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03211,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Novotný a Simona Bobrovčanová?,"[""Matej Novotný"", ""Simona Bobrovčanová"", ""2026""]","[""Matej Novotný"", ""Simona Bobrovčanová"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0089,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033544,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Dominik Nagy a Kristián Sopkovič?,"[""Dominik Nagy"", ""Kristián Sopkovič"", ""2022""]","[""Dominik Nagy"", ""Kristián Sopkovič"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0091,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033013,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Rostyslav Rodzhuk a Simona Bobrovčanová?,"[""Rostyslav Rodzhuk"", ""Simona Bobrovčanová"", ""2026""]","[""Rostyslav Rodzhuk"", ""Simona Bobrovčanová"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0092,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033095,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Simona Bobrovčanová a Yevhenii Medushivskyi?,"[""Simona Bobrovčanová"", ""Yevhenii Medushivskyi"", ""2026""]","[""Simona Bobrovčanová"", ""Yevhenii Medushivskyi"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0093,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.038339,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Kristián Sopkovič a Tomáš Kuchárik?,"[""Kristián Sopkovič"", ""Tomáš Kuchárik"", ""2022""]","[""Kristián Sopkovič"", ""Tomáš Kuchárik"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0095,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.036387,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Dominik Nagy a Michal Stromko?,"[""Dominik Nagy"", ""Michal Stromko"", ""2022""]","[""Dominik Nagy"", ""Michal Stromko"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0097,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033982,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Artem Yatsenko a Dominik Nagy?,"[""Artem Yatsenko"", ""Dominik Nagy"", ""2022""]","[""Artem Yatsenko"", ""Dominik Nagy"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0098,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.035164,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Michal Stromko a Tomáš Kuchárik?,"[""Michal Stromko"", ""Tomáš Kuchárik"", ""2022""]","[""Michal Stromko"", ""Tomáš Kuchárik"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0099,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033515,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Ščišľak a Rostyslav Rodzhuk?,"[""Matej Ščišľak"", ""Rostyslav Rodzhuk"", ""2026""]","[""Matej Ščišľak"", ""Rostyslav Rodzhuk"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0100,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031868,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Rostyslav Rodzhuk a Yevhenii Medushivskyi?,"[""Rostyslav Rodzhuk"", ""Yevhenii Medushivskyi"", ""2026""]","[""Rostyslav Rodzhuk"", ""Yevhenii Medushivskyi"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0104,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033453,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Pták a Matej Ščišľak?,"[""Ján Pták"", ""Matej Ščišľak"", ""2026""]","[""Ján Pták"", ""Matej Ščišľak"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0105,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033682,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Dominik Nagy a Tomáš Kuchárik?,"[""Dominik Nagy"", ""Tomáš Kuchárik"", ""2022""]","[""Dominik Nagy"", ""Tomáš Kuchárik"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0107,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03179,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Novotný a Yevhenii Medushivskyi?,"[""Matej Novotný"", ""Yevhenii Medushivskyi"", ""2026""]","[""Matej Novotný"", ""Yevhenii Medushivskyi"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0108,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031776,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Pták a Simona Bobrovčanová?,"[""Ján Pták"", ""Simona Bobrovčanová"", ""2026""]","[""Ján Pták"", ""Simona Bobrovčanová"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0110,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03159,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Novotný a Matej Ščišľak?,"[""Matej Novotný"", ""Matej Ščišľak"", ""2026""]","[""Matej Novotný"", ""Matej Ščišľak"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0111,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.034509,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Jakub Maruniak a Ján Holp?,"[""Jakub Maruniak"", ""Ján Holp"", ""2021""]","[""Jakub Maruniak"", ""Ján Holp"", ""2021""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0114,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033169,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Ščišľak a Simona Bobrovčanová?,"[""Matej Ščišľak"", ""Simona Bobrovčanová"", ""2026""]","[""Matej Ščišľak"", ""Simona Bobrovčanová"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0115,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.035052,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Matej Novotný a Rostyslav Rodzhuk?,"[""Matej Novotný"", ""Rostyslav Rodzhuk"", ""2026""]","[""Matej Novotný"", ""Rostyslav Rodzhuk"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0116,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032058,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Daniil Huzenko a Tetiana Mohorian?,"[""Daniil Huzenko"", ""Tetiana Mohorian"", ""2025""]","[""Daniil Huzenko"", ""Tetiana Mohorian"", ""2025""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0118,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.034542,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Samuel Džurina a Yevhenii Medushivskyi?,"[""Samuel Džurina"", ""Yevhenii Medushivskyi"", ""2026""]","[""Samuel Džurina"", ""Yevhenii Medushivskyi"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0122,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032246,,Aký rok práce spája osoby Ján Pták a Samuel Džurina?,"[""Ján Pták"", ""Samuel Džurina"", ""2026""]","[""Ján Pták"", ""Samuel Džurina"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0124,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.035132,,Aký rok práce spája osoby Ján Pták a Matej Novotný?,"[""Ján Pták"", ""Matej Novotný"", ""2026""]","[""Ján Pták"", ""Matej Novotný"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0127,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.040031,,Aký rok práce spája osoby Rostyslav Rodzhuk a Samuel Džurina?,"[""Rostyslav Rodzhuk"", ""Samuel Džurina"", ""2026""]","[""Rostyslav Rodzhuk"", ""Samuel Džurina"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0128,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.041605,,Aký rok práce spája osoby Matej Novotný a Samuel Džurina?,"[""Matej Novotný"", ""Samuel Džurina"", ""2026""]","[""Matej Novotný"", ""Samuel Džurina"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0130,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.039519,,Aký rok práce spája osoby Matej Ščišľak a Samuel Džurina?,"[""Matej Ščišľak"", ""Samuel Džurina"", ""2026""]","[""Matej Ščišľak"", ""Samuel Džurina"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0132,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.035394,,Aký rok práce spája osoby Artem Yatsenko a Kristián Sopkovič?,"[""Artem Yatsenko"", ""Kristián Sopkovič"", ""2022""]","[""Artem Yatsenko"", ""Kristián Sopkovič"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0135,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032907,,Aký rok práce spája osoby Samuel Džurina a Simona Bobrovčanová?,"[""Samuel Džurina"", ""Simona Bobrovčanová"", ""2026""]","[""Samuel Džurina"", ""Simona Bobrovčanová"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0136,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032575,,Aký rok práce spája osoby Ján Pták a Rostyslav Rodzhuk?,"[""Ján Pták"", ""Rostyslav Rodzhuk"", ""2026""]","[""Ján Pták"", ""Rostyslav Rodzhuk"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0138,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.035918,,Aký rok práce spája osoby Ján Holp a Maroš Harahus?,"[""Ján Holp"", ""Maroš Harahus"", ""2021""]","[""Ján Holp"", ""Maroš Harahus"", ""2021""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0139,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.035493,,Aký rok práce spája osoby Artem Yatsenko a Tomáš Kuchárik?,"[""Artem Yatsenko"", ""Tomáš Kuchárik"", ""2022""]","[""Artem Yatsenko"", ""Tomáš Kuchárik"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0140,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033322,,Aký rok práce spája osoby Dávid Omasta a Vladimír Ferko?,"[""Dávid Omasta"", ""Vladimír Ferko"", ""2024""]","[""Dávid Omasta"", ""Vladimír Ferko"", ""2024""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2018/david_omasta/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""pages/students/2018/david_omasta/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]","[""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0142,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.036853,,Aký rok práce spája osoby Kristián Sopkovič a Michal Stromko?,"[""Kristián Sopkovič"", ""Michal Stromko"", ""2022""]","[""Kristián Sopkovič"", ""Michal Stromko"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0143,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033705,,Aký rok práce spája osoby Artem Yatsenko a Michal Stromko?,"[""Artem Yatsenko"", ""Michal Stromko"", ""2022""]","[""Artem Yatsenko"", ""Michal Stromko"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0145,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033962,,Aký rok práce spája osoby Ján Pták a Yevhenii Medushivskyi?,"[""Ján Pták"", ""Yevhenii Medushivskyi"", ""2026""]","[""Ján Pták"", ""Yevhenii Medushivskyi"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0148,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.037038,,Aký rok práce spája osoby Matej Ščišľak a Yevhenii Medushivskyi?,"[""Matej Ščišľak"", ""Yevhenii Medushivskyi"", ""2026""]","[""Matej Ščišľak"", ""Yevhenii Medushivskyi"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0150,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.034444,,Aký rok práce spája osoby Ondrej Megela a Patrik Pavlišin?,"[""Ondrej Megela"", ""Patrik Pavlišin"", ""2020""]","[""Ondrej Megela"", ""Patrik Pavlišin"", ""2020""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2018/ondrej_megela/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2018/ondrej_megela/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0151,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03399,,Aký rok práce spája osoby Jakub Maruniak a Maroš Harahus?,"[""Jakub Maruniak"", ""Maroš Harahus"", ""2021""]","[""Jakub Maruniak"", ""Maroš Harahus"", ""2021""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0152,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032451,,Aký rok práce spája osoby Matej Novotný a Simona Bobrovčanová?,"[""Matej Novotný"", ""Simona Bobrovčanová"", ""2026""]","[""Matej Novotný"", ""Simona Bobrovčanová"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0153,dev,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.035207,,Aký rok práce spája osoby Dominik Nagy a Kristián Sopkovič?,"[""Dominik Nagy"", ""Kristián Sopkovič"", ""2022""]","[""Dominik Nagy"", ""Kristián Sopkovič"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0155,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.029885,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Tetiana Mohorian a Valerii Kutsenko?,"[""Tetiana Mohorian"", ""Valerii Kutsenko"", ""2022""]","[""Tetiana Mohorian"", ""Valerii Kutsenko"", ""2022""]",[],[],"[""pages/students/2022/tetiana_mohorian/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/tetiana_mohorian/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0156,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027903,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Ján Pták a Tetiana Mohorian?,"[""Ján Pták"", ""Tetiana Mohorian"", ""2022""]","[""Ján Pták"", ""Tetiana Mohorian"", ""2022""]",[],[],"[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0160,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027823,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Samuel Džurina a Yevhenii Medushivskyi?,"[""Samuel Džurina"", ""Yevhenii Medushivskyi"", ""2023""]","[""Samuel Džurina"", ""Yevhenii Medushivskyi"", ""2023""]",[],[],"[""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0162,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028935,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Ján Pták a Valerii Kutsenko?,"[""Ján Pták"", ""Valerii Kutsenko"", ""2022""]","[""Ján Pták"", ""Valerii Kutsenko"", ""2022""]",[],[],"[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0163,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.029787,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Rostyslav Rodzhuk a Simona Bobrovčanová?,"[""Rostyslav Rodzhuk"", ""Simona Bobrovčanová"", ""2023""]","[""Rostyslav Rodzhuk"", ""Simona Bobrovčanová"", ""2023""]",[],[],"[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0164,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.02925,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Simona Bobrovčanová a Yevhenii Medushivskyi?,"[""Simona Bobrovčanová"", ""Yevhenii Medushivskyi"", ""2023""]","[""Simona Bobrovčanová"", ""Yevhenii Medushivskyi"", ""2023""]",[],[],"[""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0165,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027829,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Matej Novotný a Matej Ščišľak?,"[""Matej Novotný"", ""Matej Ščišľak"", ""2021""]","[""Matej Novotný"", ""Matej Ščišľak"", ""2021""]",[],[],"[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0167,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028969,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Rostyslav Rodzhuk a Yevhenii Medushivskyi?,"[""Rostyslav Rodzhuk"", ""Yevhenii Medushivskyi"", ""2023""]","[""Rostyslav Rodzhuk"", ""Yevhenii Medushivskyi"", ""2023""]",[],[],"[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0168,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028057,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Jakub Maruniak a Ján Holp?,"[""Jakub Maruniak"", ""Ján Holp"", ""2016""]","[""Jakub Maruniak"", ""Ján Holp"", ""2016""]",[],[],"[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0172,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.036591,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Rostyslav Rodzhuk a Samuel Džurina?,"[""Rostyslav Rodzhuk"", ""Samuel Džurina"", ""2023""]","[""Rostyslav Rodzhuk"", ""Samuel Džurina"", ""2023""]",[],[],"[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0174,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027785,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Daniil Huzenko a Tetiana Mohorian?,"[""Daniil Huzenko"", ""Tetiana Mohorian"", ""2022""]","[""Daniil Huzenko"", ""Tetiana Mohorian"", ""2022""]",[],[],"[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0177,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030561,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Daniil Huzenko a Ján Pták?,"[""Daniil Huzenko"", ""Ján Pták"", ""2022""]","[""Daniil Huzenko"", ""Ján Pták"", ""2022""]",[],[],"[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0182,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031452,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Daniil Huzenko a Valerii Kutsenko?,"[""Daniil Huzenko"", ""Valerii Kutsenko"", ""2022""]","[""Daniil Huzenko"", ""Valerii Kutsenko"", ""2022""]",[],[],"[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0185,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028827,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Matej Novotný a Vladimír Ferko?,"[""Matej Novotný"", ""Vladimír Ferko"", ""2021""]","[""Matej Novotný"", ""Vladimír Ferko"", ""2021""]",[],[],"[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0186,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028735,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Samuel Džurina a Simona Bobrovčanová?,"[""Samuel Džurina"", ""Simona Bobrovčanová"", ""2023""]","[""Samuel Džurina"", ""Simona Bobrovčanová"", ""2023""]",[],[],"[""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0188,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028802,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Matej Ščišľak a Vladimír Ferko?,"[""Matej Ščišľak"", ""Vladimír Ferko"", ""2021""]","[""Matej Ščišľak"", ""Vladimír Ferko"", ""2021""]",[],[],"[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0189,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027861,,Cez ktorý rok začiatku štúdia sú prepojené osoby Tetiana Mohorian a Valerii Kutsenko?,"[""Tetiana Mohorian"", ""Valerii Kutsenko"", ""2022""]","[""Tetiana Mohorian"", ""Valerii Kutsenko"", ""2022""]",[],[],"[""pages/students/2022/tetiana_mohorian/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/tetiana_mohorian/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0190,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.02697,,Cez ktorý rok začiatku štúdia sú prepojené osoby Ján Pták a Tetiana Mohorian?,"[""Ján Pták"", ""Tetiana Mohorian"", ""2022""]","[""Ján Pták"", ""Tetiana Mohorian"", ""2022""]",[],[],"[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0194,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.026874,,Cez ktorý rok začiatku štúdia sú prepojené osoby Samuel Džurina a Yevhenii Medushivskyi?,"[""Samuel Džurina"", ""Yevhenii Medushivskyi"", ""2023""]","[""Samuel Džurina"", ""Yevhenii Medushivskyi"", ""2023""]",[],[],"[""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0196,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.026984,,Cez ktorý rok začiatku štúdia sú prepojené osoby Ján Pták a Valerii Kutsenko?,"[""Ján Pták"", ""Valerii Kutsenko"", ""2022""]","[""Ján Pták"", ""Valerii Kutsenko"", ""2022""]",[],[],"[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0197,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.026571,,Cez ktorý rok začiatku štúdia sú prepojené osoby Rostyslav Rodzhuk a Simona Bobrovčanová?,"[""Rostyslav Rodzhuk"", ""Simona Bobrovčanová"", ""2023""]","[""Rostyslav Rodzhuk"", ""Simona Bobrovčanová"", ""2023""]",[],[],"[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0198,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027659,,Cez ktorý rok začiatku štúdia sú prepojené osoby Simona Bobrovčanová a Yevhenii Medushivskyi?,"[""Simona Bobrovčanová"", ""Yevhenii Medushivskyi"", ""2023""]","[""Simona Bobrovčanová"", ""Yevhenii Medushivskyi"", ""2023""]",[],[],"[""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0199,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028289,,Cez ktorý rok začiatku štúdia sú prepojené osoby Matej Novotný a Matej Ščišľak?,"[""Matej Novotný"", ""Matej Ščišľak"", ""2021""]","[""Matej Novotný"", ""Matej Ščišľak"", ""2021""]",[],[],"[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0201,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027168,,Cez ktorý rok začiatku štúdia sú prepojené osoby Rostyslav Rodzhuk a Yevhenii Medushivskyi?,"[""Rostyslav Rodzhuk"", ""Yevhenii Medushivskyi"", ""2023""]","[""Rostyslav Rodzhuk"", ""Yevhenii Medushivskyi"", ""2023""]",[],[],"[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0202,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028239,,Cez ktorý rok začiatku štúdia sú prepojené osoby Jakub Maruniak a Ján Holp?,"[""Jakub Maruniak"", ""Ján Holp"", ""2016""]","[""Jakub Maruniak"", ""Ján Holp"", ""2016""]",[],[],"[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0206,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027256,,Cez ktorý rok začiatku štúdia sú prepojené osoby Rostyslav Rodzhuk a Samuel Džurina?,"[""Rostyslav Rodzhuk"", ""Samuel Džurina"", ""2023""]","[""Rostyslav Rodzhuk"", ""Samuel Džurina"", ""2023""]",[],[],"[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0208,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027307,,Cez ktorý rok začiatku štúdia sú prepojené osoby Daniil Huzenko a Tetiana Mohorian?,"[""Daniil Huzenko"", ""Tetiana Mohorian"", ""2022""]","[""Daniil Huzenko"", ""Tetiana Mohorian"", ""2022""]",[],[],"[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0211,dev,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027177,,Cez ktorý rok začiatku štúdia sú prepojené osoby Daniil Huzenko a Ján Pták?,"[""Daniil Huzenko"", ""Ján Pták"", ""2022""]","[""Daniil Huzenko"", ""Ján Pták"", ""2022""]",[],[],"[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0219,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031291,,Aký názov práce a aký rok práce sú uvedené pri osobe Artem Yatsenko?,"[""Artem Yatsenko"", ""Rozpoznávanie pomenovaných entít v slovenskom jazyku"", ""2022""]","[""Artem Yatsenko"", ""Rozpoznávanie pomenovaných entít v slovenskom jazyku"", ""2022""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0220,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032369,,"Prepoj osobu Artem Yatsenko s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Artem Yatsenko"", ""Rozpoznávanie pomenovaných entít v slovenskom jazyku"", ""2022""]","[""Artem Yatsenko"", ""Rozpoznávanie pomenovaných entít v slovenskom jazyku"", ""2022""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0221,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031417,,Aký názov práce a aký rok práce sú uvedené pri osobe Daniil Huzenko?,"[""Daniil Huzenko"", ""Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia"", ""2025""]","[""Daniil Huzenko"", ""Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia"", ""2025""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2022/daniil_huzenko/README.md""]","[""pages/students/2022/daniil_huzenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0222,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032088,,"Prepoj osobu Daniil Huzenko s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Daniil Huzenko"", ""Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia"", ""2025""]","[""Daniil Huzenko"", ""Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia"", ""2025""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2022/daniil_huzenko/README.md""]","[""pages/students/2022/daniil_huzenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0227,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.036523,,Aký názov práce a aký rok práce sú uvedené pri osobe Dominik Nagy?,"[""Dominik Nagy"", ""Neurónový strojový preklad pomocou knižnice Fairseq"", ""2022""]","[""Dominik Nagy"", ""Neurónový strojový preklad pomocou knižnice Fairseq"", ""2022""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/dominik_nagy/README.md""]","[""pages/students/2016/dominik_nagy/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0228,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.038864,,"Prepoj osobu Dominik Nagy s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Dominik Nagy"", ""Neurónový strojový preklad pomocou knižnice Fairseq"", ""2022""]","[""Dominik Nagy"", ""Neurónový strojový preklad pomocou knižnice Fairseq"", ""2022""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/dominik_nagy/README.md""]","[""pages/students/2016/dominik_nagy/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0231,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031716,,Aký názov práce a aký rok práce sú uvedené pri osobe Dávid Omasta?,"[""Dávid Omasta"", ""Generatívne modely pre automatické odpovede na otázky v slovenskom jazyku"", ""2024""]","[""Dávid Omasta"", ""Generatívne modely pre automatické odpovede na otázky v slovenskom jazyku"", ""2024""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2018/david_omasta/README.md""]","[""pages/students/2018/david_omasta/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]","[""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0232,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030937,,"Prepoj osobu Dávid Omasta s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Dávid Omasta"", ""Generatívne modely pre automatické odpovede na otázky v slovenskom jazyku"", ""2024""]","[""Dávid Omasta"", ""Generatívne modely pre automatické odpovede na otázky v slovenskom jazyku"", ""2024""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2018/david_omasta/README.md""]","[""pages/students/2018/david_omasta/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]","[""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0237,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031819,,Aký názov práce a aký rok práce sú uvedené pri osobe Jakub Maruniak?,"[""Jakub Maruniak"", ""Anotácia a rozpoznávanie pomenovaných entít v slovenskom jazyku"", ""2021""]","[""Jakub Maruniak"", ""Anotácia a rozpoznávanie pomenovaných entít v slovenskom jazyku"", ""2021""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/jakub_maruniak/README.md""]","[""pages/students/2016/jakub_maruniak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0238,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032217,,"Prepoj osobu Jakub Maruniak s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Jakub Maruniak"", ""Anotácia a rozpoznávanie pomenovaných entít v slovenskom jazyku"", ""2021""]","[""Jakub Maruniak"", ""Anotácia a rozpoznávanie pomenovaných entít v slovenskom jazyku"", ""2021""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/jakub_maruniak/README.md""]","[""pages/students/2016/jakub_maruniak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0239,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032698,,Aký názov práce a aký rok práce sú uvedené pri osobe Ján Holp?,"[""Ján Holp"", ""Systém získavania informácií v slovenskom jazyku"", ""2021""]","[""Ján Holp"", ""Systém získavania informácií v slovenskom jazyku"", ""2021""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0240,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.034307,,"Prepoj osobu Ján Holp s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Ján Holp"", ""Systém získavania informácií v slovenskom jazyku"", ""2021""]","[""Ján Holp"", ""Systém získavania informácií v slovenskom jazyku"", ""2021""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0243,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031937,,Aký názov práce a aký rok práce sú uvedené pri osobe Ján Pták?,"[""Ján Pták"", ""Agent pre manažment záverečných prác"", ""2026""]","[""Ján Pták"", ""Agent pre manažment záverečných prác"", ""2026""]","[""HAS_WORK""]","[""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","[""person_work""]","[""entity_resolution"", ""graph_traversal"", ""work_constraints""]"
|
||||||
|
True,True,,,g0244,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03133,,"Prepoj osobu Ján Pták s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Ján Pták"", ""Agent pre manažment záverečných prác"", ""2026""]","[""Ján Pták"", ""Agent pre manažment záverečných prác"", ""2026""]","[""HAS_WORK""]","[""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","[""person_work""]","[""entity_resolution"", ""graph_traversal"", ""work_constraints""]"
|
||||||
|
True,True,,,g0245,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.035096,,Aký názov práce a aký rok práce sú uvedené pri osobe Kristián Sopkovič?,"[""Kristián Sopkovič"", ""Model Spacy pre spracovanie prirodzeného jazyka v slovenčine"", ""2022""]","[""Kristián Sopkovič"", ""Model Spacy pre spracovanie prirodzeného jazyka v slovenčine"", ""2022""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0246,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.036623,,"Prepoj osobu Kristián Sopkovič s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Kristián Sopkovič"", ""Model Spacy pre spracovanie prirodzeného jazyka v slovenčine"", ""2022""]","[""Kristián Sopkovič"", ""Model Spacy pre spracovanie prirodzeného jazyka v slovenčine"", ""2022""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0251,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033342,,Aký názov práce a aký rok práce sú uvedené pri osobe Maroš Harahus?,"[""Maroš Harahus"", ""Neurónová morfologická anotácia slovenského jazyka"", ""2021""]","[""Maroš Harahus"", ""Neurónová morfologická anotácia slovenského jazyka"", ""2021""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0252,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032007,,"Prepoj osobu Maroš Harahus s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Maroš Harahus"", ""Neurónová morfologická anotácia slovenského jazyka"", ""2021""]","[""Maroš Harahus"", ""Neurónová morfologická anotácia slovenského jazyka"", ""2021""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0257,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031346,,Aký názov práce a aký rok práce sú uvedené pri osobe Matej Novotný?,"[""Matej Novotný"", ""Klasifikácia webových dát pre lepšie jazykové modelovanie"", ""2026""]","[""Matej Novotný"", ""Klasifikácia webových dát pre lepšie jazykové modelovanie"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/matej_novotny/README.md""]","[""pages/students/2021/matej_novotny/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0258,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030631,,"Prepoj osobu Matej Novotný s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Matej Novotný"", ""Klasifikácia webových dát pre lepšie jazykové modelovanie"", ""2026""]","[""Matej Novotný"", ""Klasifikácia webových dát pre lepšie jazykové modelovanie"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/matej_novotny/README.md""]","[""pages/students/2021/matej_novotny/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0259,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031052,,Aký názov práce a aký rok práce sú uvedené pri osobe Matej Ščišľak?,"[""Matej Ščišľak"", ""Znalostné grafy pre zlepšenie vyhľadávania právnych informácií"", ""2026""]","[""Matej Ščišľak"", ""Znalostné grafy pre zlepšenie vyhľadávania právnych informácií"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2021/matej_scislak/README.md""]","[""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0260,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031513,,"Prepoj osobu Matej Ščišľak s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Matej Ščišľak"", ""Znalostné grafy pre zlepšenie vyhľadávania právnych informácií"", ""2026""]","[""Matej Ščišľak"", ""Znalostné grafy pre zlepšenie vyhľadávania právnych informácií"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2021/matej_scislak/README.md""]","[""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0261,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.034855,,Aký názov práce a aký rok práce sú uvedené pri osobe Michal Stromko?,"[""Michal Stromko"", ""Indexovanie slovenského textu pomocou Elasticsearch"", ""2022""]","[""Michal Stromko"", ""Indexovanie slovenského textu pomocou Elasticsearch"", ""2022""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0262,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.054187,,"Prepoj osobu Michal Stromko s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Michal Stromko"", ""Indexovanie slovenského textu pomocou Elasticsearch"", ""2022""]","[""Michal Stromko"", ""Indexovanie slovenského textu pomocou Elasticsearch"", ""2022""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0269,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.035496,,Aký názov práce a aký rok práce sú uvedené pri osobe Ondrej Megela?,"[""Ondrej Megela"", ""Neurónové jazykové modelovanie typu BERT"", ""2020""]","[""Ondrej Megela"", ""Neurónové jazykové modelovanie typu BERT"", ""2020""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2018/ondrej_megela/README.md""]","[""pages/students/2018/ondrej_megela/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]","[""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0270,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032554,,"Prepoj osobu Ondrej Megela s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Ondrej Megela"", ""Neurónové jazykové modelovanie typu BERT"", ""2020""]","[""Ondrej Megela"", ""Neurónové jazykové modelovanie typu BERT"", ""2020""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2018/ondrej_megela/README.md""]","[""pages/students/2018/ondrej_megela/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]","[""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0271,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032514,,Aký názov práce a aký rok práce sú uvedené pri osobe Patrik Pavlišin?,"[""Patrik Pavlišin"", ""Metódy automatického prekladu"", ""2020""]","[""Patrik Pavlišin"", ""Metódy automatického prekladu"", ""2020""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0272,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03513,,"Prepoj osobu Patrik Pavlišin s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Patrik Pavlišin"", ""Metódy automatického prekladu"", ""2020""]","[""Patrik Pavlišin"", ""Metódy automatického prekladu"", ""2020""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0275,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033359,,Aký názov práce a aký rok práce sú uvedené pri osobe Rostyslav Rodzhuk?,"[""Rostyslav Rodzhuk"", ""Inteligentný agent pre podporu práce špeciálneho pedagóga"", ""2026""]","[""Rostyslav Rodzhuk"", ""Inteligentný agent pre podporu práce špeciálneho pedagóga"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0276,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.036935,,"Prepoj osobu Rostyslav Rodzhuk s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Rostyslav Rodzhuk"", ""Inteligentný agent pre podporu práce špeciálneho pedagóga"", ""2026""]","[""Rostyslav Rodzhuk"", ""Inteligentný agent pre podporu práce špeciálneho pedagóga"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0277,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031543,,Aký názov práce a aký rok práce sú uvedené pri osobe Samuel Džurina?,"[""Samuel Džurina"", ""Dialógový systém pre podporu firemných procesov"", ""2026""]","[""Samuel Džurina"", ""Dialógový systém pre podporu firemných procesov"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0278,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031702,,"Prepoj osobu Samuel Džurina s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Samuel Džurina"", ""Dialógový systém pre podporu firemných procesov"", ""2026""]","[""Samuel Džurina"", ""Dialógový systém pre podporu firemných procesov"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0281,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031534,,Aký názov práce a aký rok práce sú uvedené pri osobe Simona Bobrovčanová?,"[""Simona Bobrovčanová"", ""Automatická sumarizácia slovenského textu"", ""2026""]","[""Simona Bobrovčanová"", ""Automatická sumarizácia slovenského textu"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2023/simona_bobrovcanova/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0282,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030841,,"Prepoj osobu Simona Bobrovčanová s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Simona Bobrovčanová"", ""Automatická sumarizácia slovenského textu"", ""2026""]","[""Simona Bobrovčanová"", ""Automatická sumarizácia slovenského textu"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2023/simona_bobrovcanova/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0283,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031343,,Aký názov práce a aký rok práce sú uvedené pri osobe Tetiana Mohorian?,"[""Tetiana Mohorian"", ""Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov"", ""2025""]","[""Tetiana Mohorian"", ""Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov"", ""2025""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2022/tetiana_mohorian/README.md""]","[""pages/students/2022/tetiana_mohorian/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0284,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033305,,"Prepoj osobu Tetiana Mohorian s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Tetiana Mohorian"", ""Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov"", ""2025""]","[""Tetiana Mohorian"", ""Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov"", ""2025""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2022/tetiana_mohorian/README.md""]","[""pages/students/2022/tetiana_mohorian/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0285,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032355,,Aký názov práce a aký rok práce sú uvedené pri osobe Tomáš Kuchárik?,"[""Tomáš Kuchárik"", ""Tvorba korpusu otázok a odpovedí v slovenskom jazyku pomocou strojového prekladu"", ""2022""]","[""Tomáš Kuchárik"", ""Tvorba korpusu otázok a odpovedí v slovenskom jazyku pomocou strojového prekladu"", ""2022""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/tomas_kucharik/README.md""]","[""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0286,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.034518,,"Prepoj osobu Tomáš Kuchárik s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Tomáš Kuchárik"", ""Tvorba korpusu otázok a odpovedí v slovenskom jazyku pomocou strojového prekladu"", ""2022""]","[""Tomáš Kuchárik"", ""Tvorba korpusu otázok a odpovedí v slovenskom jazyku pomocou strojového prekladu"", ""2022""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/tomas_kucharik/README.md""]","[""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0287,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032253,,Aký názov práce a aký rok práce sú uvedené pri osobe Valerii Kutsenko?,"[""Valerii Kutsenko"", ""Zlepšenie vyhľadávania pomocou znalostných grafov"", ""2027""]","[""Valerii Kutsenko"", ""Zlepšenie vyhľadávania pomocou znalostných grafov"", ""2027""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0288,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032937,,"Prepoj osobu Valerii Kutsenko s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Valerii Kutsenko"", ""Zlepšenie vyhľadávania pomocou znalostných grafov"", ""2027""]","[""Valerii Kutsenko"", ""Zlepšenie vyhľadávania pomocou znalostných grafov"", ""2027""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0289,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030801,,Aký názov práce a aký rok práce sú uvedené pri osobe Vladimír Ferko?,"[""Vladimír Ferko"", ""Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči"", ""2024""]","[""Vladimír Ferko"", ""Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči"", ""2024""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/vladimir_ferko/README.md""]","[""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]","[""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0290,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032264,,"Prepoj osobu Vladimír Ferko s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Vladimír Ferko"", ""Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči"", ""2024""]","[""Vladimír Ferko"", ""Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči"", ""2024""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/vladimir_ferko/README.md""]","[""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]","[""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0293,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.039898,,Aký názov práce a aký rok práce sú uvedené pri osobe Yevhenii Medushivskyi?,"[""Yevhenii Medushivskyi"", ""Získavanie textu z webových stránok"", ""2026""]","[""Yevhenii Medushivskyi"", ""Získavanie textu z webových stránok"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0294,dev,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.046916,,"Prepoj osobu Yevhenii Medushivskyi s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Yevhenii Medushivskyi"", ""Získavanie textu z webových stránok"", ""2026""]","[""Yevhenii Medushivskyi"", ""Získavanie textu z webových stránok"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0296,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.028569,,"Aký je názov práce osoby Simona Bobrovčanová, ak jej dokument zároveň obsahuje kľúčové slovo slovenský text?","[""Simona Bobrovčanová"", ""slovenský text"", ""Automatická sumarizácia slovenského textu""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2023/simona_bobrovcanova/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0297,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.026116,,"Aký je názov práce osoby Kristián Sopkovič, ak jej dokument zároveň obsahuje kľúčové slovo transformery?","[""Kristián Sopkovič"", ""transformery"", ""Model Spacy pre spracovanie prirodzeného jazyka v slovenčine""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0298,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.032601,,"Aký je názov práce osoby Tetiana Mohorian, ak jej dokument zároveň obsahuje kľúčové slovo hate speech?","[""Tetiana Mohorian"", ""hate speech"", ""Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2022/tetiana_mohorian/README.md""]","[""pages/students/2022/tetiana_mohorian/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0299,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.025679,,"Aký je názov práce osoby Matej Ščišľak, ak jej dokument zároveň obsahuje kľúčové slovo FAISS?","[""Matej Ščišľak"", ""FAISS"", ""Znalostné grafy pre zlepšenie vyhľadávania právnych informácií""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2021/matej_scislak/README.md""]","[""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0300,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.025524,,"Aký je názov práce osoby Ján Pták, ak jej dokument zároveň obsahuje kľúčové slovo OpenWebUI?","[""Ján Pták"", ""OpenWebUI"", ""Agent pre manažment záverečných prác""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_WORK""]",[],"[""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0301,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.026537,,"Aký je názov práce osoby Matej Ščišľak, ak jej dokument zároveň obsahuje kľúčové slovo Neo4J?","[""Matej Ščišľak"", ""Neo4J"", ""Znalostné grafy pre zlepšenie vyhľadávania právnych informácií""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2021/matej_scislak/README.md""]","[""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0302,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.026121,,"Aký je názov práce osoby Tetiana Mohorian, ak jej dokument zároveň obsahuje kľúčové slovo prompting?","[""Tetiana Mohorian"", ""prompting"", ""Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2022/tetiana_mohorian/README.md""]","[""pages/students/2022/tetiana_mohorian/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0303,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.026,,"Aký je názov práce osoby Maroš Harahus, ak jej dokument zároveň obsahuje kľúčové slovo morfologická anotácia?","[""Maroš Harahus"", ""morfologická anotácia"", ""Neurónová morfologická anotácia slovenského jazyka""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0304,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.025574,,"Aký je názov práce osoby Tomáš Kuchárik, ak jej dokument zároveň obsahuje kľúčové slovo SQuAD?","[""Tomáš Kuchárik"", ""SQuAD"", ""Tvorba korpusu otázok a odpovedí v slovenskom jazyku pomocou strojového prekladu""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2016/tomas_kucharik/README.md""]","[""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0305,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.025864,,"Aký je názov práce osoby Ján Pták, ak jej dokument zároveň obsahuje kľúčové slovo Docker?","[""Ján Pták"", ""Docker"", ""Agent pre manažment záverečných prác""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_WORK""]",[],"[""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0309,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.026547,,"Aký je názov práce osoby Patrik Pavlišin, ak jej dokument zároveň obsahuje kľúčové slovo automatický preklad?","[""Patrik Pavlišin"", ""automatický preklad"", ""Metódy automatického prekladu""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2016/patrik_pavlisin/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0314,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.026596,,"Aký je názov práce osoby Samuel Džurina, ak jej dokument zároveň obsahuje kľúčové slovo zásielková spoločnosť?","[""Samuel Džurina"", ""zásielková spoločnosť"", ""Dialógový systém pre podporu firemných procesov""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0316,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.027153,,"Aký je názov práce osoby Valerii Kutsenko, ak jej dokument zároveň obsahuje kľúčové slovo znalostný graf?","[""Valerii Kutsenko"", ""znalostný graf"", ""Zlepšenie vyhľadávania pomocou znalostných grafov""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0319,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.030794,,"Aký je názov práce osoby Maroš Harahus, ak jej dokument zároveň obsahuje kľúčové slovo grafové neurónové siete?","[""Maroš Harahus"", ""grafové neurónové siete"", ""Neurónová morfologická anotácia slovenského jazyka""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0322,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.026689,,"Aký je názov práce osoby Artem Yatsenko, ak jej dokument zároveň obsahuje kľúčové slovo anotácia?","[""Artem Yatsenko"", ""anotácia"", ""Rozpoznávanie pomenovaných entít v slovenskom jazyku""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0323,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.028413,,"Aký je názov práce osoby Simona Bobrovčanová, ak jej dokument zároveň obsahuje kľúčové slovo sumarizácia?","[""Simona Bobrovčanová"", ""sumarizácia"", ""Automatická sumarizácia slovenského textu""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2023/simona_bobrovcanova/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0324,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.029888,,"Aký je názov práce osoby Patrik Pavlišin, ak jej dokument zároveň obsahuje kľúčové slovo strojový preklad?","[""Patrik Pavlišin"", ""strojový preklad"", ""Metódy automatického prekladu""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2016/patrik_pavlisin/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0327,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.03118,,"Aký je názov práce osoby Ján Holp, ak jej dokument zároveň obsahuje kľúčové slovo získavanie informácií?","[""Ján Holp"", ""získavanie informácií"", ""Systém získavania informácií v slovenskom jazyku""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0328,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.027693,,"Aký je názov práce osoby Rostyslav Rodzhuk, ak jej dokument zároveň obsahuje kľúčové slovo špeciálny pedagóg?","[""Rostyslav Rodzhuk"", ""špeciálny pedagóg"", ""Inteligentný agent pre podporu práce špeciálneho pedagóga""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0329,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.028028,,"Aký je názov práce osoby Valerii Kutsenko, ak jej dokument zároveň obsahuje kľúčové slovo GraphRAG?","[""Valerii Kutsenko"", ""GraphRAG"", ""Zlepšenie vyhľadávania pomocou znalostných grafov""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0330,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.036581,,"Aký je názov práce osoby Tetiana Mohorian, ak jej dokument zároveň obsahuje kľúčové slovo LLM?","[""Tetiana Mohorian"", ""LLM"", ""Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2022/tetiana_mohorian/README.md""]","[""pages/students/2022/tetiana_mohorian/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0331,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.032202,,"Aký je názov práce osoby Yevhenii Medushivskyi, ak jej dokument zároveň obsahuje kľúčové slovo deduplikácia?","[""Yevhenii Medushivskyi"", ""deduplikácia"", ""Získavanie textu z webových stránok""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0333,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.04347,,"Aký je názov práce osoby Rostyslav Rodzhuk, ak jej dokument zároveň obsahuje kľúčové slovo LLM?","[""Rostyslav Rodzhuk"", ""LLM"", ""Inteligentný agent pre podporu práce špeciálneho pedagóga""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0336,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.03309,,"Aký je názov práce osoby Artem Yatsenko, ak jej dokument zároveň obsahuje kľúčové slovo pomenované entity?","[""Artem Yatsenko"", ""pomenované entity"", ""Rozpoznávanie pomenovaných entít v slovenskom jazyku""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0337,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.043464,,"Aký je názov práce osoby Ján Holp, ak jej dokument zároveň obsahuje kľúčové slovo slovenský internet?","[""Ján Holp"", ""slovenský internet"", ""Systém získavania informácií v slovenskom jazyku""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0340,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.03595,,"Aký je názov práce osoby Matej Ščišľak, ak jej dokument zároveň obsahuje kľúčové slovo GraphRAG?","[""Matej Ščišľak"", ""GraphRAG"", ""Znalostné grafy pre zlepšenie vyhľadávania právnych informácií""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2021/matej_scislak/README.md""]","[""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0341,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.034697,,"Aký je názov práce osoby Michal Stromko, ak jej dokument zároveň obsahuje kľúčové slovo Elasticsearch?","[""Michal Stromko"", ""Elasticsearch"", ""Indexovanie slovenského textu pomocou Elasticsearch""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0343,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.040288,,"Aký je názov práce osoby Yevhenii Medushivskyi, ak jej dokument zároveň obsahuje kľúčové slovo crawler?","[""Yevhenii Medushivskyi"", ""crawler"", ""Získavanie textu z webových stránok""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0344,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.047147,,"Aký je názov práce osoby Vladimír Ferko, ak jej dokument zároveň obsahuje kľúčové slovo hate speech?","[""Vladimír Ferko"", ""hate speech"", ""Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2021/vladimir_ferko/README.md""]","[""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]","[""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0345,dev,person_keyword_title,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.046342,,"Aký je názov práce osoby Maroš Harahus, ak jej dokument zároveň obsahuje kľúčové slovo Spacy?","[""Maroš Harahus"", ""Spacy"", ""Neurónová morfologická anotácia slovenského jazyka""]","[""Maroš Harahus"", ""Spacy"", ""Neurónová morfologická anotácia slovenského jazyka""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_WORK""]","[""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""person_keyword"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints"", ""person_keyword_constraints""]"
|
||||||
|
True,True,,,g0346,dev,person_keyword_title,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.053478,,"Aký je názov práce osoby Valerii Kutsenko, ak jej dokument zároveň obsahuje kľúčové slovo RAG?","[""Valerii Kutsenko"", ""RAG"", ""Zlepšenie vyhľadávania pomocou znalostných grafov""]","[""Valerii Kutsenko"", ""RAG"", ""Zlepšenie vyhľadávania pomocou znalostných grafov""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_WORK""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""person_keyword"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints"", ""person_keyword_constraints""]"
|
||||||
|
True,True,,,g0347,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.030495,,"Aký je názov práce osoby Patrik Pavlišin, ak jej dokument zároveň obsahuje kľúčové slovo paralelný korpus?","[""Patrik Pavlišin"", ""paralelný korpus"", ""Metódy automatického prekladu""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2016/patrik_pavlisin/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0348,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.030233,,"Aký je názov práce osoby Vladimír Ferko, ak jej dokument zároveň obsahuje kľúčové slovo SlovakBERT?","[""Vladimír Ferko"", ""SlovakBERT"", ""Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2021/vladimir_ferko/README.md""]","[""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]","[""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0349,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.029778,,"Aký je názov práce osoby Vladimír Ferko, ak jej dokument zároveň obsahuje kľúčové slovo anotácia?","[""Vladimír Ferko"", ""anotácia"", ""Anotácia a vyhodnotenie slovenskej databázy nenávistnej reči""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2021/vladimir_ferko/README.md""]","[""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]","[""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0353,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.030976,,"Aký je názov práce osoby Dominik Nagy, ak jej dokument zároveň obsahuje kľúčové slovo strojový preklad?","[""Dominik Nagy"", ""strojový preklad"", ""Neurónový strojový preklad pomocou knižnice Fairseq""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2016/dominik_nagy/README.md""]","[""pages/students/2016/dominik_nagy/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0354,dev,person_keyword_title,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.042909,,"Aký je názov práce osoby Ondrej Megela, ak jej dokument zároveň obsahuje kľúčové slovo BERT?","[""Ondrej Megela"", ""BERT"", ""Neurónové jazykové modelovanie typu BERT""]","[""Ondrej Megela"", ""BERT"", ""Neurónové jazykové modelovanie typu BERT""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_WORK""]","[""pages/students/2018/ondrej_megela/README.md""]","[""pages/students/2018/ondrej_megela/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]","[""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]","[""person_keyword"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints"", ""person_keyword_constraints""]"
|
||||||
|
True,True,,,g0355,dev,person_keyword_title,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.043609,,"Aký je názov práce osoby Ján Holp, ak jej dokument zároveň obsahuje kľúčové slovo PageRank?","[""Ján Holp"", ""PageRank"", ""Systém získavania informácií v slovenskom jazyku""]","[""Ján Holp"", ""PageRank"", ""Systém získavania informácií v slovenskom jazyku""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_WORK""]","[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]","[""person_keyword"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints"", ""person_keyword_constraints""]"
|
||||||
|
True,True,,,g0359,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.032191,,"Aký je názov práce osoby Simona Bobrovčanová, ak jej dokument zároveň obsahuje kľúčové slovo právne dokumenty?","[""Simona Bobrovčanová"", ""právne dokumenty"", ""Automatická sumarizácia slovenského textu""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2023/simona_bobrovcanova/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0361,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.032137,,"Aký je názov práce osoby Michal Stromko, ak jej dokument zároveň obsahuje kľúčové slovo FAISS?","[""Michal Stromko"", ""FAISS"", ""Indexovanie slovenského textu pomocou Elasticsearch""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0364,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.032332,,"Aký je názov práce osoby Daniil Huzenko, ak jej dokument zároveň obsahuje kľúčové slovo Kubernetes?","[""Daniil Huzenko"", ""Kubernetes"", ""Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2022/daniil_huzenko/README.md""]","[""pages/students/2022/daniil_huzenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0366,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.033855,,"Aký je názov práce osoby Ondrej Megela, ak jej dokument zároveň obsahuje kľúčové slovo jazykové modelovanie?","[""Ondrej Megela"", ""jazykové modelovanie"", ""Neurónové jazykové modelovanie typu BERT""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2018/ondrej_megela/README.md""]","[""pages/students/2018/ondrej_megela/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]","[""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0368,dev,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.035037,,"Aký je názov práce osoby Daniil Huzenko, ak jej dokument zároveň obsahuje kľúčové slovo Raspberry Pi?","[""Daniil Huzenko"", ""Raspberry Pi"", ""Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2022/daniil_huzenko/README.md""]","[""pages/students/2022/daniil_huzenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0375,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.037333,,Ktorý autor dokumentu je pri osobe Michal Stromko spojený s kategóriou bp2022?,"[""Daniel Hladek"", ""bp2022"", ""Michal Stromko""]","[""Daniel Hladek"", ""bp2022"", ""Michal Stromko""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0376,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.038901,,Ktorý autor dokumentu je pri osobe Yevhenii Medushivskyi spojený s kategóriou bp2026?,"[""Daniel Hladek"", ""bp2026"", ""Yevhenii Medushivskyi""]","[""Daniel Hladek"", ""bp2026"", ""Yevhenii Medushivskyi""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0379,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.043376,,Ktorý autor dokumentu je pri osobe Kristián Sopkovič spojený s kategóriou bp2022?,"[""Daniel Hladek"", ""bp2022"", ""Kristián Sopkovič""]","[""Daniel Hladek"", ""bp2022"", ""Kristián Sopkovič""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0380,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.039161,,Ktorý autor dokumentu je pri osobe Michal Stromko spojený s kategóriou dp2024?,"[""Daniel Hladek"", ""dp2024"", ""Michal Stromko""]","[""Daniel Hladek"", ""dp2024"", ""Michal Stromko""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0381,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.038159,,Ktorý autor dokumentu je pri osobe Dominik Nagy spojený s kategóriou bp2019?,"[""Daniel Hladek"", ""bp2019"", ""Dominik Nagy""]","[""Daniel Hladek"", ""bp2019"", ""Dominik Nagy""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/dominik_nagy/README.md""]","[""pages/students/2016/dominik_nagy/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0382,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.036021,,Ktorý autor dokumentu je pri osobe Rostyslav Rodzhuk spojený s kategóriou vp2025?,"[""Daniel Hladek"", ""vp2025"", ""Rostyslav Rodzhuk""]","[""Daniel Hladek"", ""vp2025"", ""Rostyslav Rodzhuk""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0385,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.035788,,Ktorý autor dokumentu je pri osobe Oliver Pejic spojený s kategóriou iaeste?,"[""Daniel Hladek"", ""iaeste"", ""Oliver Pejic""]","[""Daniel Hladek"", ""iaeste"", ""Oliver Pejic""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/interns/oliver_pejic/README.md""]","[""pages/interns/oliver_pejic/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic""]","[""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0386,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.034071,,Ktorý autor dokumentu je pri osobe Vladimír Ferko spojený s kategóriou bp2024?,"[""Daniel Hladek"", ""bp2024"", ""Vladimír Ferko""]","[""Daniel Hladek"", ""bp2024"", ""Vladimír Ferko""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2021/vladimir_ferko/README.md""]","[""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]","[""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0387,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.034173,,Ktorý autor dokumentu je pri osobe Jakub Maruniak spojený s kategóriou bp2019?,"[""Daniel Hladek"", ""bp2019"", ""Jakub Maruniak""]","[""Daniel Hladek"", ""bp2019"", ""Jakub Maruniak""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/jakub_maruniak/README.md""]","[""pages/students/2016/jakub_maruniak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0388,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030977,,Ktorý autor dokumentu je pri osobe Ondrej Megela spojený s kategóriou dp2023?,"[""Daniel Hladek"", ""dp2023"", ""Ondrej Megela""]","[""Daniel Hladek"", ""dp2023"", ""Ondrej Megela""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2018/ondrej_megela/README.md""]","[""pages/students/2018/ondrej_megela/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]","[""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0389,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032516,,Ktorý autor dokumentu je pri osobe Dávid Omasta spojený s kategóriou dp2024?,"[""Daniel Hladek"", ""dp2024"", ""Dávid Omasta""]","[""Daniel Hladek"", ""dp2024"", ""Dávid Omasta""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2018/david_omasta/README.md""]","[""pages/students/2018/david_omasta/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]","[""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0390,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.038375,,Ktorý autor dokumentu je pri osobe Tomáš Kuchárik spojený s kategóriou dp2021?,"[""Daniel Hladek"", ""dp2021"", ""Tomáš Kuchárik""]","[""Daniel Hladek"", ""dp2021"", ""Tomáš Kuchárik""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/tomas_kucharik/README.md""]","[""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0392,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.037009,,Ktorý autor dokumentu je pri osobe Dominik Nagy spojený s kategóriou dp2022?,"[""Daniel Hladek"", ""dp2022"", ""Dominik Nagy""]","[""Daniel Hladek"", ""dp2022"", ""Dominik Nagy""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/dominik_nagy/README.md""]","[""pages/students/2016/dominik_nagy/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0393,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.035342,,Ktorý autor dokumentu je pri osobe Matej Novotný spojený s kategóriou dp2026?,"[""Daniel Hladek"", ""dp2026"", ""Matej Novotný""]","[""Daniel Hladek"", ""dp2026"", ""Matej Novotný""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2021/matej_novotny/README.md""]","[""pages/students/2021/matej_novotny/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0394,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.035975,,Ktorý autor dokumentu je pri osobe Simona Bobrovčanová spojený s kategóriou bp2026?,"[""Daniel Hladek"", ""bp2026"", ""Simona Bobrovčanová""]","[""Daniel Hladek"", ""bp2026"", ""Simona Bobrovčanová""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2023/simona_bobrovcanova/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0396,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.036146,,Ktorý autor dokumentu je pri osobe Maroš Harahus spojený s kategóriou bp2019?,"[""Daniel Hladek"", ""bp2019"", ""Maroš Harahus""]","[""Daniel Hladek"", ""bp2019"", ""Maroš Harahus""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0397,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.035641,,Ktorý autor dokumentu je pri osobe Valerii Kutsenko spojený s kategóriou bp2025?,"[""Daniel Hladek"", ""bp2025"", ""Valerii Kutsenko""]","[""Daniel Hladek"", ""bp2025"", ""Valerii Kutsenko""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0398,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.034506,,Ktorý autor dokumentu je pri osobe Patrik Pavlišin spojený s kategóriou bp2020?,"[""Daniel Hladek"", ""bp2020"", ""Patrik Pavlišin""]","[""Daniel Hladek"", ""bp2020"", ""Patrik Pavlišin""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0400,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.045822,,Ktorý autor dokumentu je pri osobe Ján Holp spojený s kategóriou bp2019?,"[""Daniel Hladek"", ""bp2019"", ""Ján Holp""]","[""Daniel Hladek"", ""bp2019"", ""Ján Holp""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0405,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03357,,Ktorý autor dokumentu je pri osobe Matej Ščišľak spojený s kategóriou bp2024?,"[""Daniel Hladek"", ""bp2024"", ""Matej Ščišľak""]","[""Daniel Hladek"", ""bp2024"", ""Matej Ščišľak""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2021/matej_scislak/README.md""]","[""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0407,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032658,,Ktorý autor dokumentu je pri osobe Samuel Džurina spojený s kategóriou bp2026?,"[""Daniel Hladek"", ""bp2026"", ""Samuel Džurina""]","[""Daniel Hladek"", ""bp2026"", ""Samuel Džurina""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2023/samuel_dzurina/README.md""]","[""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0408,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033924,,Ktorý autor dokumentu je pri osobe Patrik Pavlišin spojený s kategóriou dp2022?,"[""Daniel Hladek"", ""dp2022"", ""Patrik Pavlišin""]","[""Daniel Hladek"", ""dp2022"", ""Patrik Pavlišin""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0410,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03467,,Ktorý autor dokumentu je pri osobe Bogdan Paul Chiș spojený s kategóriou erasmus?,"[""Daniel Hladek"", ""erasmus"", ""Bogdan Paul Chiș""]","[""Daniel Hladek"", ""erasmus"", ""Bogdan Paul Chiș""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/interns/bogdan_paul_chis/README.md""]","[""pages/interns/bogdan_paul_chis/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis""]","[""https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0411,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033171,,Ktorý autor dokumentu je pri osobe Ján Holp spojený s kategóriou dp2021?,"[""Daniel Hladek"", ""dp2021"", ""Ján Holp""]","[""Daniel Hladek"", ""dp2021"", ""Ján Holp""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0412,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.039501,,Ktorý autor dokumentu je pri osobe Ján Pták spojený s kategóriou dp2027?,"[""Daniel Hladek"", ""dp2027"", ""Ján Pták""]","[""Daniel Hladek"", ""dp2027"", ""Ján Pták""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0415,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.040915,,Ktorý autor dokumentu je pri osobe Cesar Abascal Gutierrez spojený s kategóriou iaeste?,"[""Daniel Hladek"", ""iaeste"", ""Cesar Abascal Gutierrez""]","[""Daniel Hladek"", ""iaeste"", ""Cesar Abascal Gutierrez""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/interns/cesar_gutierrez/README.md""]","[""pages/interns/cesar_gutierrez/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/cesar_gutierrez""]","[""https://zp.kemt.fei.tuke.sk/interns/cesar_gutierrez""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0416,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.040674,,Ktorý autor dokumentu je pri osobe Ondrej Megela spojený s kategóriou bp2021?,"[""Daniel Hladek"", ""bp2021"", ""Ondrej Megela""]","[""Daniel Hladek"", ""bp2021"", ""Ondrej Megela""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2018/ondrej_megela/README.md""]","[""pages/students/2018/ondrej_megela/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]","[""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0417,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032794,,Ktorý autor dokumentu je pri osobe Tomáš Kuchárik spojený s kategóriou dp2022?,"[""Daniel Hladek"", ""dp2022"", ""Tomáš Kuchárik""]","[""Daniel Hladek"", ""dp2022"", ""Tomáš Kuchárik""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/tomas_kucharik/README.md""]","[""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0420,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.037246,,Ktorý autor dokumentu je pri osobe Michal Stromko spojený s kategóriou vp2021?,"[""Daniel Hladek"", ""vp2021"", ""Michal Stromko""]","[""Daniel Hladek"", ""vp2021"", ""Michal Stromko""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0422,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.040183,,Ktorý autor dokumentu je pri osobe Rostyslav Rodzhuk spojený s kategóriou bp2026?,"[""Daniel Hladek"", ""bp2026"", ""Rostyslav Rodzhuk""]","[""Daniel Hladek"", ""bp2026"", ""Rostyslav Rodzhuk""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0424,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.038684,,Ktorý autor dokumentu je pri osobe Valerii Kutsenko spojený s kategóriou vp2024?,"[""Daniel Hladek"", ""vp2024"", ""Valerii Kutsenko""]","[""Daniel Hladek"", ""vp2024"", ""Valerii Kutsenko""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0425,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.041273,,Ktorý autor dokumentu je pri osobe Kristián Sopkovič spojený s kategóriou dp2024?,"[""Daniel Hladek"", ""dp2024"", ""Kristián Sopkovič""]","[""Daniel Hladek"", ""dp2024"", ""Kristián Sopkovič""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0426,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03494,,Ktorý autor dokumentu je pri osobe Artem Yatsenko spojený s kategóriou bp2022?,"[""Daniel Hladek"", ""bp2022"", ""Artem Yatsenko""]","[""Daniel Hladek"", ""bp2022"", ""Artem Yatsenko""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0427,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033772,,Ktorý autor dokumentu je pri osobe Maroš Harahus spojený s kategóriou dp2021?,"[""Daniel Hladek"", ""dp2021"", ""Maroš Harahus""]","[""Daniel Hladek"", ""dp2021"", ""Maroš Harahus""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0433,dev,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033384,,Ktorý autor dokumentu je pri osobe Daniil Huzenko spojený s kategóriou bp2025?,"[""Daniel Hladek"", ""bp2025"", ""Daniil Huzenko""]","[""Daniel Hladek"", ""bp2025"", ""Daniil Huzenko""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2022/daniil_huzenko/README.md""]","[""pages/students/2022/daniil_huzenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0435,dev,person_multiple_categories,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030176,,V ktorých kategóriách sa nachádzajú dokumenty osoby Dávid Omasta?,"[""Dávid Omasta"", ""dp2023"", ""dp2024""]","[""Dávid Omasta"", ""dp2023"", ""dp2024""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2018/david_omasta/README.md""]","[""pages/students/2018/david_omasta/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]","[""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
True,True,,,g0436,dev,person_multiple_categories,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027677,,V ktorých kategóriách sa nachádzajú dokumenty osoby Ondrej Megela?,"[""Ondrej Megela"", ""bp2021"", ""dp2023""]","[""Ondrej Megela"", ""bp2021"", ""dp2023""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2018/ondrej_megela/README.md""]","[""pages/students/2018/ondrej_megela/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]","[""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
True,True,,,g0438,dev,person_multiple_categories,hard,False,1.0,1.0,1.0,1.0,1.0,1.0,1.0,False,0.027802,,V ktorých kategóriách sa nachádzajú dokumenty osoby Dominik Nagy?,"[""Dominik Nagy"", ""bp2019"", ""dp2022""]","[""Dominik Nagy"", ""bp2019"", ""dp2022""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/dominik_nagy/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/dominik_nagy/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy/timovy_projekt""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
True,True,,,g0439,dev,person_multiple_categories,hard,False,1.0,1.0,1.0,1.0,1.0,1.0,1.0,False,0.031714,,V ktorých kategóriách sa nachádzajú dokumenty osoby Maroš Harahus?,"[""Maroš Harahus"", ""bp2019"", ""dp2021""]","[""Maroš Harahus"", ""bp2019"", ""dp2021""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
True,True,,,g0440,dev,person_multiple_categories,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.0319,,V ktorých kategóriách sa nachádzajú dokumenty osoby Valerii Kutsenko?,"[""Valerii Kutsenko"", ""bp2025"", ""dp2027"", ""vp2024""]","[""Valerii Kutsenko"", ""bp2025"", ""dp2027"", ""vp2024""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
True,True,,,g0442,dev,person_multiple_categories,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.029485,,V ktorých kategóriách sa nachádzajú dokumenty osoby Patrik Pavlišin?,"[""Patrik Pavlišin"", ""bp2020"", ""dp2022"", ""tp2021""]","[""Patrik Pavlišin"", ""bp2020"", ""dp2022"", ""tp2021""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
True,True,,,g0443,dev,person_multiple_categories,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027084,,V ktorých kategóriách sa nachádzajú dokumenty osoby Kristián Sopkovič?,"[""Kristián Sopkovič"", ""bp2022"", ""dp2024""]","[""Kristián Sopkovič"", ""bp2022"", ""dp2024""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
True,True,,,g0445,dev,person_multiple_categories,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027547,,V ktorých kategóriách sa nachádzajú dokumenty osoby Tomáš Kuchárik?,"[""Tomáš Kuchárik"", ""dp2021"", ""dp2022""]","[""Tomáš Kuchárik"", ""dp2021"", ""dp2022""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/tomas_kucharik/README.md""]","[""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
True,True,,,g0447,dev,person_multiple_categories,hard,False,1.0,1.0,1.0,1.0,1.0,1.0,1.0,False,0.028774,,V ktorých kategóriách sa nachádzajú dokumenty osoby Ján Holp?,"[""Ján Holp"", ""bp2019"", ""dp2021""]","[""Ján Holp"", ""bp2019"", ""dp2021""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
True,True,,,g0449,dev,person_multiple_categories,hard,False,1.0,1.0,1.0,1.0,1.0,1.0,1.0,False,0.02964,,V ktorých kategóriách sa nachádzajú dokumenty osoby Jakub Maruniak?,"[""Jakub Maruniak"", ""bp2019"", ""dp2021""]","[""Jakub Maruniak"", ""bp2019"", ""dp2021""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/jakub_maruniak/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
True,True,,,g0450,dev,person_multiple_categories,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028497,,V ktorých kategóriách sa nachádzajú dokumenty osoby Michal Stromko?,"[""Michal Stromko"", ""bp2022"", ""dp2024"", ""vp2021""]","[""Michal Stromko"", ""bp2022"", ""dp2024"", ""vp2021""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
True,True,,,g0452,dev,person_multiple_categories,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027432,,V ktorých kategóriách sa nachádzajú dokumenty osoby Matej Ščišľak?,"[""Matej Ščišľak"", ""bp2024"", ""dp2026""]","[""Matej Ščišľak"", ""bp2024"", ""dp2026""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2021/matej_scislak/README.md""]","[""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
True,True,,,g0453,dev,person_multiple_categories,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027458,,V ktorých kategóriách sa nachádzajú dokumenty osoby Rostyslav Rodzhuk?,"[""Rostyslav Rodzhuk"", ""bp2026"", ""vp2025""]","[""Rostyslav Rodzhuk"", ""bp2026"", ""vp2025""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
True,True,,,g0454,dev,person_multiple_categories,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.026824,,V ktorých kategóriách sa nachádzajú dokumenty osoby Dávid Omasta?,"[""Dávid Omasta"", ""dp2023"", ""dp2024""]","[""Dávid Omasta"", ""dp2023"", ""dp2024""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2018/david_omasta/README.md""]","[""pages/students/2018/david_omasta/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]","[""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
True,True,,,g0455,dev,person_multiple_categories,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.026821,,V ktorých kategóriách sa nachádzajú dokumenty osoby Ondrej Megela?,"[""Ondrej Megela"", ""bp2021"", ""dp2023""]","[""Ondrej Megela"", ""bp2021"", ""dp2023""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2018/ondrej_megela/README.md""]","[""pages/students/2018/ondrej_megela/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]","[""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
True,True,,,g0457,dev,person_multiple_categories,hard,False,1.0,1.0,1.0,1.0,1.0,1.0,1.0,False,0.028557,,V ktorých kategóriách sa nachádzajú dokumenty osoby Dominik Nagy?,"[""Dominik Nagy"", ""bp2019"", ""dp2022""]","[""Dominik Nagy"", ""bp2019"", ""dp2022""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/dominik_nagy/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/dominik_nagy/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy/timovy_projekt""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
True,True,,,g0458,dev,person_multiple_categories,hard,False,1.0,1.0,1.0,1.0,1.0,1.0,1.0,False,0.027045,,V ktorých kategóriách sa nachádzajú dokumenty osoby Maroš Harahus?,"[""Maroš Harahus"", ""bp2019"", ""dp2021""]","[""Maroš Harahus"", ""bp2019"", ""dp2021""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
True,True,,,g0459,dev,person_multiple_categories,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.02714,,V ktorých kategóriách sa nachádzajú dokumenty osoby Valerii Kutsenko?,"[""Valerii Kutsenko"", ""bp2025"", ""dp2027"", ""vp2024""]","[""Valerii Kutsenko"", ""bp2025"", ""dp2027"", ""vp2024""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
True,True,,,g0461,dev,person_multiple_categories,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027403,,V ktorých kategóriách sa nachádzajú dokumenty osoby Patrik Pavlišin?,"[""Patrik Pavlišin"", ""bp2020"", ""dp2022"", ""tp2021""]","[""Patrik Pavlišin"", ""bp2020"", ""dp2022"", ""tp2021""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
True,True,,,g0462,dev,person_multiple_categories,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027458,,V ktorých kategóriách sa nachádzajú dokumenty osoby Kristián Sopkovič?,"[""Kristián Sopkovič"", ""bp2022"", ""dp2024""]","[""Kristián Sopkovič"", ""bp2022"", ""dp2024""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
True,True,,,g0464,dev,person_multiple_categories,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027554,,V ktorých kategóriách sa nachádzajú dokumenty osoby Tomáš Kuchárik?,"[""Tomáš Kuchárik"", ""dp2021"", ""dp2022""]","[""Tomáš Kuchárik"", ""dp2021"", ""dp2022""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/tomas_kucharik/README.md""]","[""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
True,True,3,3,g0465,dev,candidate_set_aggregation,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033718,,"Z kandidátov Jakub Maruniak, Ján Holp, Maroš Harahus, Artem Yatsenko vyber všetky osoby, pri ktorých je práca uvedená v roku 2021. Koľko ich je?","[""Jakub Maruniak"", ""Ján Holp"", ""Maroš Harahus"", ""3"", ""2021""]","[""Jakub Maruniak"", ""Ján Holp"", ""Maroš Harahus"", ""3"", ""2021""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,3,3,g0466,dev,candidate_set_aggregation,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.034614,,"Z kandidátov Artem Yatsenko, Dominik Nagy, Kristián Sopkovič, Daniil Huzenko vyber všetky osoby, pri ktorých je práca uvedená v roku 2022. Koľko ich je?","[""Artem Yatsenko"", ""Dominik Nagy"", ""Kristián Sopkovič"", ""3"", ""2022""]","[""Artem Yatsenko"", ""Dominik Nagy"", ""Kristián Sopkovič"", ""3"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2022/daniil_huzenko/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2022/daniil_huzenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,2,2,g0469,dev,candidate_set_aggregation,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03287,,"Z kandidátov Ondrej Megela, Patrik Pavlišin, Artem Yatsenko vyber všetky osoby, pri ktorých je práca uvedená v roku 2020. Koľko ich je?","[""Ondrej Megela"", ""Patrik Pavlišin"", ""2"", ""2020""]","[""Ondrej Megela"", ""Patrik Pavlišin"", ""2"", ""2020""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,2,2,g0471,dev,candidate_set_aggregation,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033216,,"Z kandidátov Dávid Omasta, Vladimír Ferko, Artem Yatsenko vyber všetky osoby, pri ktorých je práca uvedená v roku 2024. Koľko ich je?","[""Dávid Omasta"", ""Vladimír Ferko"", ""2"", ""2024""]","[""Dávid Omasta"", ""Vladimír Ferko"", ""2"", ""2024""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2018/david_omasta/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""pages/students/2018/david_omasta/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]","[""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,3,3,g0473,dev,candidate_set_aggregation,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.034866,,"Z kandidátov Ján Pták, Matej Novotný, Matej Ščišľak, Artem Yatsenko vyber všetky osoby, pri ktorých je práca uvedená v roku 2026. Koľko ich je?","[""Ján Pták"", ""Matej Novotný"", ""Matej Ščišľak"", ""3"", ""2026""]","[""Ján Pták"", ""Matej Novotný"", ""Matej Ščišľak"", ""3"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,2,2,g0475,dev,candidate_set_aggregation,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032192,,"Z kandidátov Daniil Huzenko, Tetiana Mohorian, Artem Yatsenko vyber všetky osoby, pri ktorých je práca uvedená v roku 2025. Koľko ich je?","[""Daniil Huzenko"", ""Tetiana Mohorian"", ""2"", ""2025""]","[""Daniil Huzenko"", ""Tetiana Mohorian"", ""2"", ""2025""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,3,3,g0476,dev,candidate_set_aggregation,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031572,,"Ktoré osoby zo zoznamu Jakub Maruniak, Ján Holp, Maroš Harahus, Artem Yatsenko zdieľajú rok práce 2021? Uveď aj ich počet.","[""Jakub Maruniak"", ""Ján Holp"", ""Maroš Harahus"", ""3"", ""2021""]","[""Jakub Maruniak"", ""Ján Holp"", ""Maroš Harahus"", ""3"", ""2021""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,3,3,g0477,dev,candidate_set_aggregation,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031041,,"Ktoré osoby zo zoznamu Artem Yatsenko, Dominik Nagy, Kristián Sopkovič, Daniil Huzenko zdieľajú rok práce 2022? Uveď aj ich počet.","[""Artem Yatsenko"", ""Dominik Nagy"", ""Kristián Sopkovič"", ""3"", ""2022""]","[""Artem Yatsenko"", ""Dominik Nagy"", ""Kristián Sopkovič"", ""3"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2022/daniil_huzenko/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2022/daniil_huzenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,2,2,g0480,dev,candidate_set_aggregation,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03146,,"Ktoré osoby zo zoznamu Ondrej Megela, Patrik Pavlišin, Artem Yatsenko zdieľajú rok práce 2020? Uveď aj ich počet.","[""Ondrej Megela"", ""Patrik Pavlišin"", ""2"", ""2020""]","[""Ondrej Megela"", ""Patrik Pavlišin"", ""2"", ""2020""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0484,dev,conjunctive_disambiguation,hard,False,0.0,0.0,0.0,0.0,0.0,1.0,1.0,True,0.027179,,Ktorá z osôb Ján Pták a Matej Novotný spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo OpenWebUI a jej práca je uvedená v roku 2026?,"[""Ján Pták"", ""OpenWebUI"", ""2026""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0485,dev,conjunctive_disambiguation,hard,False,0.0,0.0,0.0,0.0,0.0,1.0,1.0,True,0.02593,,Ktorá z osôb Michal Stromko a Artem Yatsenko spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo Elasticsearch a jej práca je uvedená v roku 2022?,"[""Michal Stromko"", ""Elasticsearch"", ""2022""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0486,dev,conjunctive_disambiguation,hard,False,0.0,0.0,0.0,0.0,0.0,1.0,1.0,True,0.033938,,Ktorá z osôb Tetiana Mohorian a Daniil Huzenko spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo LLM a jej práca je uvedená v roku 2025?,"[""Tetiana Mohorian"", ""LLM"", ""2025""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0488,dev,conjunctive_disambiguation,hard,False,0.0,0.0,0.0,0.0,0.0,1.0,1.0,True,0.02822,,Ktorá z osôb Michal Stromko a Artem Yatsenko spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo FAISS a jej práca je uvedená v roku 2022?,"[""Michal Stromko"", ""FAISS"", ""2022""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0490,dev,conjunctive_disambiguation,hard,False,0.0,0.0,0.0,0.0,0.0,1.0,1.0,True,0.027184,,Ktorá z osôb Tetiana Mohorian a Daniil Huzenko spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo prompting a jej práca je uvedená v roku 2025?,"[""Tetiana Mohorian"", ""prompting"", ""2025""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0492,dev,conjunctive_disambiguation,hard,False,0.0,0.0,0.0,0.0,0.0,1.0,1.0,True,0.026557,,Ktorá z osôb Yevhenii Medushivskyi a Ján Pták spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo webový korpus a jej práca je uvedená v roku 2026?,"[""Yevhenii Medushivskyi"", ""webový korpus"", ""2026""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0493,dev,conjunctive_disambiguation,hard,False,0.0,0.0,0.0,0.0,0.0,1.0,1.0,True,0.026611,,Ktorá z osôb Simona Bobrovčanová a Ján Pták spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo právne dokumenty a jej práca je uvedená v roku 2026?,"[""Simona Bobrovčanová"", ""právne dokumenty"", ""2026""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0495,dev,conjunctive_disambiguation,hard,False,0.0,0.0,0.0,0.0,0.0,1.0,1.0,True,0.025809,,Ktorá z osôb Kristián Sopkovič a Artem Yatsenko spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo slovenčina a jej práca je uvedená v roku 2022?,"[""Kristián Sopkovič"", ""slovenčina"", ""2022""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0498,dev,conjunctive_disambiguation,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03328,,Ktorá z osôb Maroš Harahus a Artem Yatsenko spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo Spacy a jej práca je uvedená v roku 2021?,"[""Maroš Harahus"", ""Spacy"", ""2021""]","[""Maroš Harahus"", ""Spacy"", ""2021""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]","[""person_keyword"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""person_keyword_constraints""]"
|
||||||
|
True,True,,,g0499,dev,conjunctive_disambiguation,hard,False,0.0,0.0,0.0,0.0,0.0,1.0,1.0,True,0.02629,,Ktorá z osôb Ján Holp a Jakub Maruniak spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo slovenský internet a jej práca je uvedená v roku 2021?,"[""Ján Holp"", ""slovenský internet"", ""2021""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0500,dev,conjunctive_disambiguation,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.034901,,Ktorá z osôb Kristián Sopkovič a Dominik Nagy spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo Spacy a jej práca je uvedená v roku 2022?,"[""Kristián Sopkovič"", ""Spacy"", ""2022""]","[""Kristián Sopkovič"", ""Spacy"", ""2022""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]","[""person_keyword"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""person_keyword_constraints""]"
|
||||||
|
28414
tools/graphrag/evaluation/results/final_2026-10-24/graphrag_dev.json
Normal file
28414
tools/graphrag/evaluation/results/final_2026-10-24/graphrag_dev.json
Normal file
File diff suppressed because it is too large
Load Diff
@ -0,0 +1,215 @@
|
|||||||
|
complete,count_ok,expected_count,actual_count,id,split,category,difficulty,strict,value_score,entity_score,relation_score,property_score,relation_choice_score,document_recall,source_recall,entity_set_ok,latency_seconds,error,question,expected_values,matched_values,expected_relations,actual_relations,expected_documents,actual_documents,expected_source_urls,actual_source_urls,fact_types,strategies
|
||||||
|
True,True,,,g0029,test,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.02863,,Sú osoby Alina Vitko a Ronald Zalacko v ZP Wiki prepojené cez kľúčové slovo Docker? Uveď spoločné kľúčové slovo.,"[""Alina Vitko"", ""Ronald Zalacko"", ""Docker""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0030,test,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.025681,,Over prepojenie osôb Alina Vitko a Ronald Zalacko cez kľúčové slovo Docker a pomenuj spoločné kľúčové slovo.,"[""Alina Vitko"", ""Ronald Zalacko"", ""Docker""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0033,test,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.028839,,Sú osoby Martin Šarišský a Oleksandr Dorybohov v ZP Wiki prepojené cez kľúčové slovo agent? Uveď spoločné kľúčové slovo.,"[""Martin Šarišský"", ""Oleksandr Dorybohov"", ""agent""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0034,test,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.027412,,Over prepojenie osôb Martin Šarišský a Oleksandr Dorybohov cez kľúčové slovo agent a pomenuj spoločné kľúčové slovo.,"[""Martin Šarišský"", ""Oleksandr Dorybohov"", ""agent""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0039,test,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.029397,,Sú osoby Andrii Pervashov a Samuel Vasiľ v ZP Wiki prepojené cez kľúčové slovo OpenWebUI? Uveď spoločné kľúčové slovo.,"[""Andrii Pervashov"", ""Samuel Vasiľ"", ""OpenWebUI""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0040,test,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.025237,,Over prepojenie osôb Andrii Pervashov a Samuel Vasiľ cez kľúčové slovo OpenWebUI a pomenuj spoločné kľúčové slovo.,"[""Andrii Pervashov"", ""Samuel Vasiľ"", ""OpenWebUI""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0043,test,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.025173,,Sú osoby Oleh Poiasnik a Ján Malinovský v ZP Wiki prepojené cez kľúčové slovo znalostný graf? Uveď spoločné kľúčové slovo.,"[""Oleh Poiasnik"", ""Ján Malinovský"", ""znalostný graf""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0044,test,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.026392,,Over prepojenie osôb Oleh Poiasnik a Ján Malinovský cez kľúčové slovo znalostný graf a pomenuj spoločné kľúčové slovo.,"[""Oleh Poiasnik"", ""Ján Malinovský"", ""znalostný graf""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0045,test,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.025938,,Sú osoby Oleh Poiasnik a Maksym Zatirka v ZP Wiki prepojené cez kľúčové slovo znalostný graf? Uveď spoločné kľúčové slovo.,"[""Oleh Poiasnik"", ""Maksym Zatirka"", ""znalostný graf""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0046,test,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.0252,,Over prepojenie osôb Oleh Poiasnik a Maksym Zatirka cez kľúčové slovo znalostný graf a pomenuj spoločné kľúčové slovo.,"[""Oleh Poiasnik"", ""Maksym Zatirka"", ""znalostný graf""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0047,test,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.026373,,Sú osoby Ján Malinovský a Maksym Zatirka v ZP Wiki prepojené cez kľúčové slovo znalostný graf? Uveď spoločné kľúčové slovo.,"[""Ján Malinovský"", ""Maksym Zatirka"", ""znalostný graf""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0048,test,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.025873,,Over prepojenie osôb Ján Malinovský a Maksym Zatirka cez kľúčové slovo znalostný graf a pomenuj spoločné kľúčové slovo.,"[""Ján Malinovský"", ""Maksym Zatirka"", ""znalostný graf""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0051,test,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.027964,,Sú osoby Ján Malinovský a Samuel Vasiľ v ZP Wiki prepojené cez kľúčové slovo RAG? Uveď spoločné kľúčové slovo.,"[""Ján Malinovský"", ""Samuel Vasiľ"", ""RAG""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0052,test,shared_keyword_pair,hard,False,0.0,0.0,0.0,1.0,1.0,1.0,1.0,True,0.028319,,Over prepojenie osôb Ján Malinovský a Samuel Vasiľ cez kľúčové slovo RAG a pomenuj spoločné kľúčové slovo.,"[""Ján Malinovský"", ""Samuel Vasiľ"", ""RAG""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0055,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033795,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Martin Šarišský a Ronald Zalacko?,"[""Martin Šarišský"", ""Ronald Zalacko"", ""2026""]","[""Martin Šarišský"", ""Ronald Zalacko"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0056,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032272,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Maksym Zatirka a Samuel Vasiľ?,"[""Maksym Zatirka"", ""Samuel Vasiľ"", ""2026""]","[""Maksym Zatirka"", ""Samuel Vasiľ"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0057,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032439,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Filip Tomáš a Márk Fehér?,"[""Filip Tomáš"", ""Márk Fehér"", ""2022""]","[""Filip Tomáš"", ""Márk Fehér"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0059,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031066,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Oleksandr Dorybohov a Ronald Zalacko?,"[""Oleksandr Dorybohov"", ""Ronald Zalacko"", ""2026""]","[""Oleksandr Dorybohov"", ""Ronald Zalacko"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0061,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033916,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Dárius Lindvai a Lukáš Pokrývka?,"[""Dárius Lindvai"", ""Lukáš Pokrývka"", ""2021""]","[""Dárius Lindvai"", ""Lukáš Pokrývka"", ""2021""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/lukas_pokryvka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0062,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.036186,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Malinovský a Samuel Vasiľ?,"[""Ján Malinovský"", ""Samuel Vasiľ"", ""2026""]","[""Ján Malinovský"", ""Samuel Vasiľ"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0065,test,same_academic_year_pair,hard,False,0.666667,0.0,1.0,0.0,0.0,1.0,1.0,True,0.034872,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Malinovský a Martin Šarišský?,"[""Ján Malinovský"", ""Martin Šarišský"", ""2026""]","[""Ján Malinovský"", ""Martin Šarišský""]",[],[],"[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2017/martin_jancura/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]","[""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]","[""academic_year_comparison""]","[""entity_resolution""]"
|
||||||
|
True,True,,,g0067,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032398,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ronald Zalacko a Samuel Vasiľ?,"[""Ronald Zalacko"", ""Samuel Vasiľ"", ""2026""]","[""Ronald Zalacko"", ""Samuel Vasiľ"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0069,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.0308,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Alina Vitko a Márk Fehér?,"[""Alina Vitko"", ""Márk Fehér"", ""2022""]","[""Alina Vitko"", ""Márk Fehér"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2019/alina_vitko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0070,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030749,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Martin Šarišský a Oleksandr Dorybohov?,"[""Martin Šarišský"", ""Oleksandr Dorybohov"", ""2026""]","[""Martin Šarišský"", ""Oleksandr Dorybohov"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0073,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033775,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Martin Šarišský a Samuel Vasiľ?,"[""Martin Šarišský"", ""Samuel Vasiľ"", ""2026""]","[""Martin Šarišský"", ""Samuel Vasiľ"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0077,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032121,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Malinovský a Oleksandr Dorybohov?,"[""Ján Malinovský"", ""Oleksandr Dorybohov"", ""2026""]","[""Ján Malinovský"", ""Oleksandr Dorybohov"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0080,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03028,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Denis Le Thanh a Maksym Zatirka?,"[""Denis Le Thanh"", ""Maksym Zatirka"", ""2026""]","[""Denis Le Thanh"", ""Maksym Zatirka"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0082,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.029731,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Oleksandr Dorybohov a Samuel Vasiľ?,"[""Oleksandr Dorybohov"", ""Samuel Vasiľ"", ""2026""]","[""Oleksandr Dorybohov"", ""Samuel Vasiľ"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0083,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031184,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Maksym Zatirka a Oleksandr Dorybohov?,"[""Maksym Zatirka"", ""Oleksandr Dorybohov"", ""2026""]","[""Maksym Zatirka"", ""Oleksandr Dorybohov"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0085,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030696,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Maksym Zatirka a Ronald Zalacko?,"[""Maksym Zatirka"", ""Ronald Zalacko"", ""2026""]","[""Maksym Zatirka"", ""Ronald Zalacko"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0090,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030473,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Malinovský a Maksym Zatirka?,"[""Ján Malinovský"", ""Maksym Zatirka"", ""2026""]","[""Ján Malinovský"", ""Maksym Zatirka"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0094,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030979,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Denis Le Thanh a Ronald Zalacko?,"[""Denis Le Thanh"", ""Ronald Zalacko"", ""2026""]","[""Denis Le Thanh"", ""Ronald Zalacko"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0096,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032781,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Alina Vitko a Filip Tomáš?,"[""Alina Vitko"", ""Filip Tomáš"", ""2022""]","[""Alina Vitko"", ""Filip Tomáš"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0101,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031393,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Denis Le Thanh a Ján Malinovský?,"[""Denis Le Thanh"", ""Ján Malinovský"", ""2026""]","[""Denis Le Thanh"", ""Ján Malinovský"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/denis_le_thanh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0102,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031656,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Maksym Zatirka a Martin Šarišský?,"[""Maksym Zatirka"", ""Martin Šarišský"", ""2026""]","[""Maksym Zatirka"", ""Martin Šarišský"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0103,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031534,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Andrii Pervashov a Oleh Poiasnik?,"[""Andrii Pervashov"", ""Oleh Poiasnik"", ""2027""]","[""Andrii Pervashov"", ""Oleh Poiasnik"", ""2027""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0106,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030663,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Denis Le Thanh a Samuel Vasiľ?,"[""Denis Le Thanh"", ""Samuel Vasiľ"", ""2026""]","[""Denis Le Thanh"", ""Samuel Vasiľ"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/denis_le_thanh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0109,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031207,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Denis Le Thanh a Oleksandr Dorybohov?,"[""Denis Le Thanh"", ""Oleksandr Dorybohov"", ""2026""]","[""Denis Le Thanh"", ""Oleksandr Dorybohov"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0112,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030988,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Dmytro Ushatenko a Martin Wencel?,"[""Dmytro Ushatenko"", ""Martin Wencel"", ""2020""]","[""Dmytro Ushatenko"", ""Martin Wencel"", ""2020""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2018/martin_wencel/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0113,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030088,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Malinovský a Ronald Zalacko?,"[""Ján Malinovský"", ""Ronald Zalacko"", ""2026""]","[""Ján Malinovský"", ""Ronald Zalacko"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0117,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03159,,V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Denis Le Thanh a Martin Šarišský?,"[""Denis Le Thanh"", ""Martin Šarišský"", ""2026""]","[""Denis Le Thanh"", ""Martin Šarišský"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/denis_le_thanh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0119,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03127,,Aký rok práce spája osoby Martin Šarišský a Ronald Zalacko?,"[""Martin Šarišský"", ""Ronald Zalacko"", ""2026""]","[""Martin Šarišský"", ""Ronald Zalacko"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0120,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030895,,Aký rok práce spája osoby Maksym Zatirka a Samuel Vasiľ?,"[""Maksym Zatirka"", ""Samuel Vasiľ"", ""2026""]","[""Maksym Zatirka"", ""Samuel Vasiľ"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0121,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032381,,Aký rok práce spája osoby Filip Tomáš a Márk Fehér?,"[""Filip Tomáš"", ""Márk Fehér"", ""2022""]","[""Filip Tomáš"", ""Márk Fehér"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0123,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030853,,Aký rok práce spája osoby Oleksandr Dorybohov a Ronald Zalacko?,"[""Oleksandr Dorybohov"", ""Ronald Zalacko"", ""2026""]","[""Oleksandr Dorybohov"", ""Ronald Zalacko"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0125,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032875,,Aký rok práce spája osoby Dárius Lindvai a Lukáš Pokrývka?,"[""Dárius Lindvai"", ""Lukáš Pokrývka"", ""2021""]","[""Dárius Lindvai"", ""Lukáš Pokrývka"", ""2021""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/lukas_pokryvka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0126,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03045,,Aký rok práce spája osoby Ján Malinovský a Samuel Vasiľ?,"[""Ján Malinovský"", ""Samuel Vasiľ"", ""2026""]","[""Ján Malinovský"", ""Samuel Vasiľ"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0129,test,same_academic_year_pair,hard,False,0.666667,0.0,1.0,0.0,0.0,1.0,1.0,True,0.032707,,Aký rok práce spája osoby Ján Malinovský a Martin Šarišský?,"[""Ján Malinovský"", ""Martin Šarišský"", ""2026""]","[""Ján Malinovský"", ""Martin Šarišský""]",[],[],"[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2017/martin_jancura/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]","[""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]","[""academic_year_comparison""]","[""entity_resolution""]"
|
||||||
|
True,True,,,g0131,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.0308,,Aký rok práce spája osoby Ronald Zalacko a Samuel Vasiľ?,"[""Ronald Zalacko"", ""Samuel Vasiľ"", ""2026""]","[""Ronald Zalacko"", ""Samuel Vasiľ"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0133,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.034011,,Aký rok práce spája osoby Alina Vitko a Márk Fehér?,"[""Alina Vitko"", ""Márk Fehér"", ""2022""]","[""Alina Vitko"", ""Márk Fehér"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2019/alina_vitko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0134,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030999,,Aký rok práce spája osoby Martin Šarišský a Oleksandr Dorybohov?,"[""Martin Šarišský"", ""Oleksandr Dorybohov"", ""2026""]","[""Martin Šarišský"", ""Oleksandr Dorybohov"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0137,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030742,,Aký rok práce spája osoby Martin Šarišský a Samuel Vasiľ?,"[""Martin Šarišský"", ""Samuel Vasiľ"", ""2026""]","[""Martin Šarišský"", ""Samuel Vasiľ"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0141,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030214,,Aký rok práce spája osoby Ján Malinovský a Oleksandr Dorybohov?,"[""Ján Malinovský"", ""Oleksandr Dorybohov"", ""2026""]","[""Ján Malinovský"", ""Oleksandr Dorybohov"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0144,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030026,,Aký rok práce spája osoby Denis Le Thanh a Maksym Zatirka?,"[""Denis Le Thanh"", ""Maksym Zatirka"", ""2026""]","[""Denis Le Thanh"", ""Maksym Zatirka"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0146,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030005,,Aký rok práce spája osoby Oleksandr Dorybohov a Samuel Vasiľ?,"[""Oleksandr Dorybohov"", ""Samuel Vasiľ"", ""2026""]","[""Oleksandr Dorybohov"", ""Samuel Vasiľ"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0147,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030108,,Aký rok práce spája osoby Maksym Zatirka a Oleksandr Dorybohov?,"[""Maksym Zatirka"", ""Oleksandr Dorybohov"", ""2026""]","[""Maksym Zatirka"", ""Oleksandr Dorybohov"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0149,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.029898,,Aký rok práce spája osoby Maksym Zatirka a Ronald Zalacko?,"[""Maksym Zatirka"", ""Ronald Zalacko"", ""2026""]","[""Maksym Zatirka"", ""Ronald Zalacko"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""academic_year_comparison"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0154,test,same_academic_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031309,,Aký rok práce spája osoby Ján Malinovský a Maksym Zatirka?,"[""Ján Malinovský"", ""Maksym Zatirka"", ""2026""]","[""Ján Malinovský"", ""Maksym Zatirka"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""academic_year_comparison"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0157,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028997,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Denis Le Thanh a Ronald Zalacko?,"[""Denis Le Thanh"", ""Ronald Zalacko"", ""2023""]","[""Denis Le Thanh"", ""Ronald Zalacko"", ""2023""]",[],[],"[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0158,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028138,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Ján Malinovský a Oleh Poiasnik?,"[""Ján Malinovský"", ""Oleh Poiasnik"", ""2022""]","[""Ján Malinovský"", ""Oleh Poiasnik"", ""2022""]",[],[],"[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0159,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.02848,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Oleh Poiasnik a Samuel Vasiľ?,"[""Oleh Poiasnik"", ""Samuel Vasiľ"", ""2022""]","[""Oleh Poiasnik"", ""Samuel Vasiľ"", ""2022""]",[],[],"[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0161,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027429,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Oleksandr Dorybohov a Ronald Zalacko?,"[""Oleksandr Dorybohov"", ""Ronald Zalacko"", ""2023""]","[""Oleksandr Dorybohov"", ""Ronald Zalacko"", ""2023""]",[],[],"[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0166,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032411,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Andrii Pervashov a Vladyslav Yanchenko?,"[""Andrii Pervashov"", ""Vladyslav Yanchenko"", ""2022""]","[""Andrii Pervashov"", ""Vladyslav Yanchenko"", ""2022""]",[],[],"[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0169,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.051023,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Oleh Poiasnik a Vladyslav Yanchenko?,"[""Oleh Poiasnik"", ""Vladyslav Yanchenko"", ""2022""]","[""Oleh Poiasnik"", ""Vladyslav Yanchenko"", ""2022""]",[],[],"[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0170,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.02952,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Maksym Zatirka a Oleksandr Dorybohov?,"[""Maksym Zatirka"", ""Oleksandr Dorybohov"", ""2023""]","[""Maksym Zatirka"", ""Oleksandr Dorybohov"", ""2023""]",[],[],"[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0171,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028049,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Ján Malinovský a Samuel Vasiľ?,"[""Ján Malinovský"", ""Samuel Vasiľ"", ""2022""]","[""Ján Malinovský"", ""Samuel Vasiľ"", ""2022""]",[],[],"[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0173,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028715,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Denis Le Thanh a Maksym Zatirka?,"[""Denis Le Thanh"", ""Maksym Zatirka"", ""2023""]","[""Denis Le Thanh"", ""Maksym Zatirka"", ""2023""]",[],[],"[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0175,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027294,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Maksym Zatirka a Ronald Zalacko?,"[""Maksym Zatirka"", ""Ronald Zalacko"", ""2023""]","[""Maksym Zatirka"", ""Ronald Zalacko"", ""2023""]",[],[],"[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0176,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027561,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Denis Le Thanh a Oleksandr Dorybohov?,"[""Denis Le Thanh"", ""Oleksandr Dorybohov"", ""2023""]","[""Denis Le Thanh"", ""Oleksandr Dorybohov"", ""2023""]",[],[],"[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0178,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027137,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Andrii Pervashov a Oleh Poiasnik?,"[""Andrii Pervashov"", ""Oleh Poiasnik"", ""2022""]","[""Andrii Pervashov"", ""Oleh Poiasnik"", ""2022""]",[],[],"[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0179,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027344,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Ján Malinovský a Vladyslav Yanchenko?,"[""Ján Malinovský"", ""Vladyslav Yanchenko"", ""2022""]","[""Ján Malinovský"", ""Vladyslav Yanchenko"", ""2022""]",[],[],"[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0180,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.02776,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Samuel Vasiľ a Vladyslav Yanchenko?,"[""Samuel Vasiľ"", ""Vladyslav Yanchenko"", ""2022""]","[""Samuel Vasiľ"", ""Vladyslav Yanchenko"", ""2022""]",[],[],"[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0181,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028278,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Andrii Pervashov a Ján Malinovský?,"[""Andrii Pervashov"", ""Ján Malinovský"", ""2022""]","[""Andrii Pervashov"", ""Ján Malinovský"", ""2022""]",[],[],"[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0183,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.029056,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Dárius Lindvai a Lukáš Pokrývka?,"[""Dárius Lindvai"", ""Lukáš Pokrývka"", ""2016""]","[""Dárius Lindvai"", ""Lukáš Pokrývka"", ""2016""]",[],[],"[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/lukas_pokryvka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0184,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027888,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Eduard Matovka a Martin Šarišský?,"[""Eduard Matovka"", ""Martin Šarišský"", ""2021""]","[""Eduard Matovka"", ""Martin Šarišský"", ""2021""]",[],[],"[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0187,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.02739,,Aký spoločný rok začiatku štúdia majú podľa ZP Wiki osoby Andrii Pervashov a Samuel Vasiľ?,"[""Andrii Pervashov"", ""Samuel Vasiľ"", ""2022""]","[""Andrii Pervashov"", ""Samuel Vasiľ"", ""2022""]",[],[],"[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""person_start_year"", ""start_year_comparison""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0191,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027939,,Cez ktorý rok začiatku štúdia sú prepojené osoby Denis Le Thanh a Ronald Zalacko?,"[""Denis Le Thanh"", ""Ronald Zalacko"", ""2023""]","[""Denis Le Thanh"", ""Ronald Zalacko"", ""2023""]",[],[],"[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0192,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027064,,Cez ktorý rok začiatku štúdia sú prepojené osoby Ján Malinovský a Oleh Poiasnik?,"[""Ján Malinovský"", ""Oleh Poiasnik"", ""2022""]","[""Ján Malinovský"", ""Oleh Poiasnik"", ""2022""]",[],[],"[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0193,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027957,,Cez ktorý rok začiatku štúdia sú prepojené osoby Oleh Poiasnik a Samuel Vasiľ?,"[""Oleh Poiasnik"", ""Samuel Vasiľ"", ""2022""]","[""Oleh Poiasnik"", ""Samuel Vasiľ"", ""2022""]",[],[],"[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0195,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027162,,Cez ktorý rok začiatku štúdia sú prepojené osoby Oleksandr Dorybohov a Ronald Zalacko?,"[""Oleksandr Dorybohov"", ""Ronald Zalacko"", ""2023""]","[""Oleksandr Dorybohov"", ""Ronald Zalacko"", ""2023""]",[],[],"[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0200,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.026257,,Cez ktorý rok začiatku štúdia sú prepojené osoby Andrii Pervashov a Vladyslav Yanchenko?,"[""Andrii Pervashov"", ""Vladyslav Yanchenko"", ""2022""]","[""Andrii Pervashov"", ""Vladyslav Yanchenko"", ""2022""]",[],[],"[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0203,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.026844,,Cez ktorý rok začiatku štúdia sú prepojené osoby Oleh Poiasnik a Vladyslav Yanchenko?,"[""Oleh Poiasnik"", ""Vladyslav Yanchenko"", ""2022""]","[""Oleh Poiasnik"", ""Vladyslav Yanchenko"", ""2022""]",[],[],"[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0204,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.02753,,Cez ktorý rok začiatku štúdia sú prepojené osoby Maksym Zatirka a Oleksandr Dorybohov?,"[""Maksym Zatirka"", ""Oleksandr Dorybohov"", ""2023""]","[""Maksym Zatirka"", ""Oleksandr Dorybohov"", ""2023""]",[],[],"[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0205,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028417,,Cez ktorý rok začiatku štúdia sú prepojené osoby Ján Malinovský a Samuel Vasiľ?,"[""Ján Malinovský"", ""Samuel Vasiľ"", ""2022""]","[""Ján Malinovský"", ""Samuel Vasiľ"", ""2022""]",[],[],"[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0207,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.026652,,Cez ktorý rok začiatku štúdia sú prepojené osoby Denis Le Thanh a Maksym Zatirka?,"[""Denis Le Thanh"", ""Maksym Zatirka"", ""2023""]","[""Denis Le Thanh"", ""Maksym Zatirka"", ""2023""]",[],[],"[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0209,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.026911,,Cez ktorý rok začiatku štúdia sú prepojené osoby Maksym Zatirka a Ronald Zalacko?,"[""Maksym Zatirka"", ""Ronald Zalacko"", ""2023""]","[""Maksym Zatirka"", ""Ronald Zalacko"", ""2023""]",[],[],"[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0210,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.026253,,Cez ktorý rok začiatku štúdia sú prepojené osoby Denis Le Thanh a Oleksandr Dorybohov?,"[""Denis Le Thanh"", ""Oleksandr Dorybohov"", ""2023""]","[""Denis Le Thanh"", ""Oleksandr Dorybohov"", ""2023""]",[],[],"[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0212,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.026634,,Cez ktorý rok začiatku štúdia sú prepojené osoby Andrii Pervashov a Oleh Poiasnik?,"[""Andrii Pervashov"", ""Oleh Poiasnik"", ""2022""]","[""Andrii Pervashov"", ""Oleh Poiasnik"", ""2022""]",[],[],"[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0213,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.026713,,Cez ktorý rok začiatku štúdia sú prepojené osoby Ján Malinovský a Vladyslav Yanchenko?,"[""Ján Malinovský"", ""Vladyslav Yanchenko"", ""2022""]","[""Ján Malinovský"", ""Vladyslav Yanchenko"", ""2022""]",[],[],"[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0214,test,same_start_year_pair,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.026558,,Cez ktorý rok začiatku štúdia sú prepojené osoby Samuel Vasiľ a Vladyslav Yanchenko?,"[""Samuel Vasiľ"", ""Vladyslav Yanchenko"", ""2022""]","[""Samuel Vasiľ"", ""Vladyslav Yanchenko"", ""2022""]",[],[],"[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""person_start_year""]","[""entity_resolution"", ""start_year_constraints""]"
|
||||||
|
True,True,,,g0215,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031693,,Aký názov práce a aký rok práce sú uvedené pri osobe Alina Vitko?,"[""Alina Vitko"", ""Systémy pre generovanie odpovede na otázku v prirodzenom jazyku"", ""2022""]","[""Alina Vitko"", ""Systémy pre generovanie odpovede na otázku v prirodzenom jazyku"", ""2022""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0216,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031474,,"Prepoj osobu Alina Vitko s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Alina Vitko"", ""Systémy pre generovanie odpovede na otázku v prirodzenom jazyku"", ""2022""]","[""Alina Vitko"", ""Systémy pre generovanie odpovede na otázku v prirodzenom jazyku"", ""2022""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0217,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033513,,Aký názov práce a aký rok práce sú uvedené pri osobe Andrii Pervashov?,"[""Andrii Pervashov"", ""Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu"", ""2027""]","[""Andrii Pervashov"", ""Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu"", ""2027""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0218,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032751,,"Prepoj osobu Andrii Pervashov s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Andrii Pervashov"", ""Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu"", ""2027""]","[""Andrii Pervashov"", ""Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu"", ""2027""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0223,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031669,,Aký názov práce a aký rok práce sú uvedené pri osobe Denis Le Thanh?,"[""Denis Le Thanh"", ""Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku"", ""2026""]","[""Denis Le Thanh"", ""Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0224,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031798,,"Prepoj osobu Denis Le Thanh s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Denis Le Thanh"", ""Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku"", ""2026""]","[""Denis Le Thanh"", ""Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0225,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030322,,Aký názov práce a aký rok práce sú uvedené pri osobe Dmytro Ushatenko?,"[""Dmytro Ushatenko"", ""Jednoduchý chatbot v jazyku Python"", ""2020""]","[""Dmytro Ushatenko"", ""Jednoduchý chatbot v jazyku Python"", ""2020""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0226,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030611,,"Prepoj osobu Dmytro Ushatenko s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Dmytro Ushatenko"", ""Jednoduchý chatbot v jazyku Python"", ""2020""]","[""Dmytro Ushatenko"", ""Jednoduchý chatbot v jazyku Python"", ""2020""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0229,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031376,,Aký názov práce a aký rok práce sú uvedené pri osobe Dárius Lindvai?,"[""Dárius Lindvai"", ""Obnovenie interpunkcie pomocou hlbokých neurónových sietí"", ""2021""]","[""Dárius Lindvai"", ""Obnovenie interpunkcie pomocou hlbokých neurónových sietí"", ""2021""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0230,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033436,,"Prepoj osobu Dárius Lindvai s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Dárius Lindvai"", ""Obnovenie interpunkcie pomocou hlbokých neurónových sietí"", ""2021""]","[""Dárius Lindvai"", ""Obnovenie interpunkcie pomocou hlbokých neurónových sietí"", ""2021""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0233,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031967,,Aký názov práce a aký rok práce sú uvedené pri osobe Eduard Matovka?,"[""Eduard Matovka"", ""Slovenská konverzačná umelá inteligencia"", ""2024""]","[""Eduard Matovka"", ""Slovenská konverzačná umelá inteligencia"", ""2024""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0234,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031886,,"Prepoj osobu Eduard Matovka s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Eduard Matovka"", ""Slovenská konverzačná umelá inteligencia"", ""2024""]","[""Eduard Matovka"", ""Slovenská konverzačná umelá inteligencia"", ""2024""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0235,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032539,,Aký názov práce a aký rok práce sú uvedené pri osobe Filip Tomáš?,"[""Filip Tomáš"", ""Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia"", ""2022""]","[""Filip Tomáš"", ""Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia"", ""2022""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0236,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03197,,"Prepoj osobu Filip Tomáš s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Filip Tomáš"", ""Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia"", ""2022""]","[""Filip Tomáš"", ""Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia"", ""2022""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0241,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030517,,Aký názov práce a aký rok práce sú uvedené pri osobe Ján Malinovský?,"[""Ján Malinovský"", ""Grafové vyhľadávanie pre podporu vzdelávania"", ""2026""]","[""Ján Malinovský"", ""Grafové vyhľadávanie pre podporu vzdelávania"", ""2026""]","[""HAS_WORK""]","[""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]","[""person_work""]","[""entity_resolution"", ""graph_traversal"", ""work_constraints""]"
|
||||||
|
True,True,,,g0242,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032665,,"Prepoj osobu Ján Malinovský s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Ján Malinovský"", ""Grafové vyhľadávanie pre podporu vzdelávania"", ""2026""]","[""Ján Malinovský"", ""Grafové vyhľadávanie pre podporu vzdelávania"", ""2026""]","[""HAS_WORK""]","[""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]","[""person_work""]","[""entity_resolution"", ""graph_traversal"", ""work_constraints""]"
|
||||||
|
True,True,,,g0247,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033034,,Aký názov práce a aký rok práce sú uvedené pri osobe Lukáš Pokrývka?,"[""Lukáš Pokrývka"", ""Paralelné trénovanie neurónových sietí"", ""2021""]","[""Lukáš Pokrývka"", ""Paralelné trénovanie neurónových sietí"", ""2021""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0248,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031437,,"Prepoj osobu Lukáš Pokrývka s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Lukáš Pokrývka"", ""Paralelné trénovanie neurónových sietí"", ""2021""]","[""Lukáš Pokrývka"", ""Paralelné trénovanie neurónových sietí"", ""2021""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0249,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031002,,Aký názov práce a aký rok práce sú uvedené pri osobe Maksym Zatirka?,"[""Maksym Zatirka"", ""Grafová databáza pre podporu generovania slovenského jazyka"", ""2026""]","[""Maksym Zatirka"", ""Grafová databáza pre podporu generovania slovenského jazyka"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0250,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03164,,"Prepoj osobu Maksym Zatirka s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Maksym Zatirka"", ""Grafová databáza pre podporu generovania slovenského jazyka"", ""2026""]","[""Maksym Zatirka"", ""Grafová databáza pre podporu generovania slovenského jazyka"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0253,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03014,,Aký názov práce a aký rok práce sú uvedené pri osobe Martin Wencel?,"[""Martin Wencel"", ""Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy"", ""2020""]","[""Martin Wencel"", ""Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy"", ""2020""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0254,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03106,,"Prepoj osobu Martin Wencel s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Martin Wencel"", ""Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy"", ""2020""]","[""Martin Wencel"", ""Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy"", ""2020""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0255,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031488,,Aký názov práce a aký rok práce sú uvedené pri osobe Martin Šarišský?,"[""Martin Šarišský"", ""Agentové systémy pomocou veľkého jazykového modelu"", ""2026""]","[""Martin Šarišský"", ""Agentové systémy pomocou veľkého jazykového modelu"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0256,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033026,,"Prepoj osobu Martin Šarišský s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Martin Šarišský"", ""Agentové systémy pomocou veľkého jazykového modelu"", ""2026""]","[""Martin Šarišský"", ""Agentové systémy pomocou veľkého jazykového modelu"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0263,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032823,,Aký názov práce a aký rok práce sú uvedené pri osobe Márk Fehér?,"[""Márk Fehér"", ""Klasifikácia textu metódami strojového učenia"", ""2022""]","[""Márk Fehér"", ""Klasifikácia textu metódami strojového učenia"", ""2022""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0264,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.036111,,"Prepoj osobu Márk Fehér s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Márk Fehér"", ""Klasifikácia textu metódami strojového učenia"", ""2022""]","[""Márk Fehér"", ""Klasifikácia textu metódami strojového učenia"", ""2022""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,,,g0265,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.041553,,Aký názov práce a aký rok práce sú uvedené pri osobe Oleh Poiasnik?,"[""Oleh Poiasnik"", ""Expertný agentový systém na podporu rozhodovania v lekárni"", ""2027""]","[""Oleh Poiasnik"", ""Expertný agentový systém na podporu rozhodovania v lekárni"", ""2027""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0266,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.035405,,"Prepoj osobu Oleh Poiasnik s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Oleh Poiasnik"", ""Expertný agentový systém na podporu rozhodovania v lekárni"", ""2027""]","[""Oleh Poiasnik"", ""Expertný agentový systém na podporu rozhodovania v lekárni"", ""2027""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0267,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032375,,Aký názov práce a aký rok práce sú uvedené pri osobe Oleksandr Dorybohov?,"[""Oleksandr Dorybohov"", ""Automatické odpovede na otázky v právnej oblasti"", ""2026""]","[""Oleksandr Dorybohov"", ""Automatické odpovede na otázky v právnej oblasti"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0268,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030871,,"Prepoj osobu Oleksandr Dorybohov s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Oleksandr Dorybohov"", ""Automatické odpovede na otázky v právnej oblasti"", ""2026""]","[""Oleksandr Dorybohov"", ""Automatické odpovede na otázky v právnej oblasti"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0273,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03133,,Aký názov práce a aký rok práce sú uvedené pri osobe Ronald Zalacko?,"[""Ronald Zalacko"", ""Skórovací online systém pre robotické súťaže"", ""2026""]","[""Ronald Zalacko"", ""Skórovací online systém pre robotické súťaže"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0274,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.029625,,"Prepoj osobu Ronald Zalacko s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Ronald Zalacko"", ""Skórovací online systém pre robotické súťaže"", ""2026""]","[""Ronald Zalacko"", ""Skórovací online systém pre robotické súťaže"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0279,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030054,,Aký názov práce a aký rok práce sú uvedené pri osobe Samuel Vasiľ?,"[""Samuel Vasiľ"", ""Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI"", ""2026""]","[""Samuel Vasiľ"", ""Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0280,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.033345,,"Prepoj osobu Samuel Vasiľ s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Samuel Vasiľ"", ""Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI"", ""2026""]","[""Samuel Vasiľ"", ""Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI"", ""2026""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0291,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.029265,,Aký názov práce a aký rok práce sú uvedené pri osobe Vladyslav Yanchenko?,"[""Vladyslav Yanchenko"", ""Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí"", ""2025""]","[""Vladyslav Yanchenko"", ""Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí"", ""2025""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0292,test,person_title_year,medium,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030024,,"Prepoj osobu Vladyslav Yanchenko s názvom jej práce a rokom, v ktorom je táto práca v ZP Wiki uvedená.","[""Vladyslav Yanchenko"", ""Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí"", ""2025""]","[""Vladyslav Yanchenko"", ""Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí"", ""2025""]","[""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0295,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.032062,,"Aký je názov práce osoby Vladyslav Yanchenko, ak jej dokument zároveň obsahuje kľúčové slovo cloud?","[""Vladyslav Yanchenko"", ""cloud"", ""Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0306,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.02586,,"Aký je názov práce osoby Denis Le Thanh, ak jej dokument zároveň obsahuje kľúčové slovo inštrukcie?","[""Denis Le Thanh"", ""inštrukcie"", ""Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0307,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.02625,,"Aký je názov práce osoby Martin Šarišský, ak jej dokument zároveň obsahuje kľúčové slovo právne informácie?","[""Martin Šarišský"", ""právne informácie"", ""Agentové systémy pomocou veľkého jazykového modelu""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0308,test,person_keyword_title,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031762,,"Aký je názov práce osoby Ján Malinovský, ak jej dokument zároveň obsahuje kľúčové slovo RAG?","[""Ján Malinovský"", ""RAG"", ""Grafové vyhľadávanie pre podporu vzdelávania""]","[""Ján Malinovský"", ""RAG"", ""Grafové vyhľadávanie pre podporu vzdelávania""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_WORK""]","[""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_WORK""]","[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]","[""person_keyword"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""work_constraints"", ""person_keyword_constraints""]"
|
||||||
|
True,True,,,g0310,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.02632,,"Aký je názov práce osoby Eduard Matovka, ak jej dokument zároveň obsahuje kľúčové slovo SlovakAlpaca?","[""Eduard Matovka"", ""SlovakAlpaca"", ""Slovenská konverzačná umelá inteligencia""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0311,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.025225,,"Aký je názov práce osoby Dárius Lindvai, ak jej dokument zároveň obsahuje kľúčové slovo BiLSTM?","[""Dárius Lindvai"", ""BiLSTM"", ""Obnovenie interpunkcie pomocou hlbokých neurónových sietí""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0312,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.025966,,"Aký je názov práce osoby Lukáš Pokrývka, ak jej dokument zároveň obsahuje kľúčové slovo NCCL?","[""Lukáš Pokrývka"", ""NCCL"", ""Paralelné trénovanie neurónových sietí""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0313,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.025838,,"Aký je názov práce osoby Ronald Zalacko, ak jej dokument zároveň obsahuje kľúčové slovo Docker?","[""Ronald Zalacko"", ""Docker"", ""Skórovací online systém pre robotické súťaže""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0315,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.033392,,"Aký je názov práce osoby Samuel Vasiľ, ak jej dokument zároveň obsahuje kľúčové slovo RAG?","[""Samuel Vasiľ"", ""RAG"", ""Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0317,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.025363,,"Aký je názov práce osoby Oleh Poiasnik, ak jej dokument zároveň obsahuje kľúčové slovo lekáreň?","[""Oleh Poiasnik"", ""lekáreň"", ""Expertný agentový systém na podporu rozhodovania v lekárni""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0318,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.03166,,"Aký je názov práce osoby Dmytro Ushatenko, ak jej dokument zároveň obsahuje kľúčové slovo chatbot?","[""Dmytro Ushatenko"", ""chatbot"", ""Jednoduchý chatbot v jazyku Python""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0320,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.030603,,"Aký je názov práce osoby Dmytro Ushatenko, ak jej dokument zároveň obsahuje kľúčové slovo Python?","[""Dmytro Ushatenko"", ""Python"", ""Jednoduchý chatbot v jazyku Python""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0321,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.024745,,"Aký je názov práce osoby Martin Wencel, ak jej dokument zároveň obsahuje kľúčové slovo morfologická analýza?","[""Martin Wencel"", ""morfologická analýza"", ""Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0325,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.025801,,"Aký je názov práce osoby Andrii Pervashov, ak jej dokument zároveň obsahuje kľúčové slovo speech-to-text?","[""Andrii Pervashov"", ""speech-to-text"", ""Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0326,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.026016,,"Aký je názov práce osoby Ronald Zalacko, ak jej dokument zároveň obsahuje kľúčové slovo robotické súťaže?","[""Ronald Zalacko"", ""robotické súťaže"", ""Skórovací online systém pre robotické súťaže""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0332,test,person_keyword_title,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.043224,,"Aký je názov práce osoby Martin Wencel, ak jej dokument zároveň obsahuje kľúčové slovo Spacy?","[""Martin Wencel"", ""Spacy"", ""Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy""]","[""Martin Wencel"", ""Spacy"", ""Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]","[""person_keyword"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""person_keyword_constraints""]"
|
||||||
|
True,True,,,g0334,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.025889,,"Aký je názov práce osoby Filip Tomáš, ak jej dokument zároveň obsahuje kľúčové slovo CI/CD?","[""Filip Tomáš"", ""CI/CD"", ""Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0335,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.026231,,"Aký je názov práce osoby Eduard Matovka, ak jej dokument zároveň obsahuje kľúčové slovo slovenský jazykový model?","[""Eduard Matovka"", ""slovenský jazykový model"", ""Slovenská konverzačná umelá inteligencia""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0338,test,person_keyword_title,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031166,,"Aký je názov práce osoby Oleksandr Dorybohov, ak jej dokument zároveň obsahuje kľúčové slovo agent?","[""Oleksandr Dorybohov"", ""agent"", ""Automatické odpovede na otázky v právnej oblasti""]","[""Oleksandr Dorybohov"", ""agent"", ""Automatické odpovede na otázky v právnej oblasti""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""person_keyword"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""person_keyword_constraints""]"
|
||||||
|
True,True,,,g0339,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.02561,,"Aký je názov práce osoby Samuel Vasiľ, ak jej dokument zároveň obsahuje kľúčové slovo MCP?","[""Samuel Vasiľ"", ""MCP"", ""Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0342,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.033742,,"Aký je názov práce osoby Martin Šarišský, ak jej dokument zároveň obsahuje kľúčové slovo agent?","[""Martin Šarišský"", ""agent"", ""Agentové systémy pomocou veľkého jazykového modelu""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0350,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.032128,,"Aký je názov práce osoby Lukáš Pokrývka, ak jej dokument zároveň obsahuje kľúčové slovo PyTorch?","[""Lukáš Pokrývka"", ""PyTorch"", ""Paralelné trénovanie neurónových sietí""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0351,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.025346,,"Aký je názov práce osoby Filip Tomáš, ak jej dokument zároveň obsahuje kľúčové slovo Docker Compose?","[""Filip Tomáš"", ""Docker Compose"", ""Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0352,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.025389,,"Aký je názov práce osoby Alina Vitko, ak jej dokument zároveň obsahuje kľúčové slovo Streamlit?","[""Alina Vitko"", ""Streamlit"", ""Systémy pre generovanie odpovede na otázku v prirodzenom jazyku""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0356,test,person_keyword_title,hard,False,1.0,0.5,1.0,1.0,1.0,1.0,1.0,True,0.033839,,"Aký je názov práce osoby Márk Fehér, ak jej dokument zároveň obsahuje kľúčové slovo klasifikácia textu?","[""Márk Fehér"", ""klasifikácia textu"", ""Klasifikácia textu metódami strojového učenia""]","[""Márk Fehér"", ""klasifikácia textu"", ""Klasifikácia textu metódami strojového učenia""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""HAS_WORK""]","[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher""]","[""person_keyword"", ""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints"", ""person_keyword_constraints""]"
|
||||||
|
True,True,,,g0357,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.025957,,"Aký je názov práce osoby Denis Le Thanh, ak jej dokument zároveň obsahuje kľúčové slovo Slovak Mistral?","[""Denis Le Thanh"", ""Slovak Mistral"", ""Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0358,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.025629,,"Aký je názov práce osoby Denis Le Thanh, ak jej dokument zároveň obsahuje kľúčové slovo kyberbezpečnosť?","[""Denis Le Thanh"", ""kyberbezpečnosť"", ""Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0360,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.025783,,"Aký je názov práce osoby Maksym Zatirka, ak jej dokument zároveň obsahuje kľúčové slovo slovenské právo?","[""Maksym Zatirka"", ""slovenské právo"", ""Grafová databáza pre podporu generovania slovenského jazyka""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0362,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.031582,,"Aký je názov práce osoby Alina Vitko, ak jej dokument zároveň obsahuje kľúčové slovo Question Answering?","[""Alina Vitko"", ""Question Answering"", ""Systémy pre generovanie odpovede na otázku v prirodzenom jazyku""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0363,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.025125,,"Aký je názov práce osoby Oleh Poiasnik, ak jej dokument zároveň obsahuje kľúčové slovo LightRAG?","[""Oleh Poiasnik"", ""LightRAG"", ""Expertný agentový systém na podporu rozhodovania v lekárni""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0365,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.025655,,"Aký je názov práce osoby Andrii Pervashov, ak jej dokument zároveň obsahuje kľúčové slovo OpenWebUI?","[""Andrii Pervashov"", ""OpenWebUI"", ""Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0367,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.026591,,"Aký je názov práce osoby Maksym Zatirka, ak jej dokument zároveň obsahuje kľúčové slovo grafová databáza?","[""Maksym Zatirka"", ""grafová databáza"", ""Grafová databáza pre podporu generovania slovenského jazyka""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0369,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.025261,,"Aký je názov práce osoby Oleksandr Dorybohov, ak jej dokument zároveň obsahuje kľúčové slovo API?","[""Oleksandr Dorybohov"", ""API"", ""Automatické odpovede na otázky v právnej oblasti""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0370,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.02565,,"Aký je názov práce osoby Samuel Vasiľ, ak jej dokument zároveň obsahuje kľúčové slovo OpenWebUI?","[""Samuel Vasiľ"", ""OpenWebUI"", ""Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0371,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.025979,,"Aký je názov práce osoby Vladyslav Yanchenko, ak jej dokument zároveň obsahuje kľúčové slovo Azure?","[""Vladyslav Yanchenko"", ""Azure"", ""Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0372,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.027264,,"Aký je názov práce osoby Dmytro Ushatenko, ak jej dokument zároveň obsahuje kľúčové slovo dialógový systém?","[""Dmytro Ushatenko"", ""dialógový systém"", ""Jednoduchý chatbot v jazyku Python""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0373,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.027055,,"Aký je názov práce osoby Dárius Lindvai, ak jej dokument zároveň obsahuje kľúčové slovo CRF?","[""Dárius Lindvai"", ""CRF"", ""Obnovenie interpunkcie pomocou hlbokých neurónových sietí""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0374,test,person_keyword_title,hard,False,0.0,0.0,0.0,0.0,1.0,1.0,1.0,True,0.025773,,"Aký je názov práce osoby Martin Šarišský, ak jej dokument zároveň obsahuje kľúčové slovo DeepEval?","[""Martin Šarišský"", ""DeepEval"", ""Agentové systémy pomocou veľkého jazykového modelu""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD"", ""AUTHORED""]",[],"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0377,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028582,,Ktorý autor dokumentu je pri osobe Oleh Poiasnik spojený s kategóriou dp2027?,"[""Daniel Hladek"", ""dp2027"", ""Oleh Poiasnik""]","[""Daniel Hladek"", ""dp2027"", ""Oleh Poiasnik""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0378,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027959,,Ktorý autor dokumentu je pri osobe Andrii Pervashov spojený s kategóriou bp2025?,"[""Daniel Hladek"", ""bp2025"", ""Andrii Pervashov""]","[""Daniel Hladek"", ""bp2025"", ""Andrii Pervashov""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0383,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028748,,Ktorý autor dokumentu je pri osobe Alina Vitko spojený s kategóriou bp2022?,"[""Daniel Hladek"", ""bp2022"", ""Alina Vitko""]","[""Daniel Hladek"", ""bp2022"", ""Alina Vitko""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0384,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.02859,,Ktorý autor dokumentu je pri osobe Ján Malinovský spojený s kategóriou dp2027?,"[""Daniel Hladek"", ""dp2027"", ""Ján Malinovský""]","[""Daniel Hladek"", ""dp2027"", ""Ján Malinovský""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0391,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027715,,Ktorý autor dokumentu je pri osobe Samuel Vasiľ spojený s kategóriou bp2026?,"[""Daniel Hladek"", ""bp2026"", ""Samuel Vasiľ""]","[""Daniel Hladek"", ""bp2026"", ""Samuel Vasiľ""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0395,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027904,,Ktorý autor dokumentu je pri osobe Lukáš Pokrývka spojený s kategóriou bp2019?,"[""Daniel Hladek"", ""bp2019"", ""Lukáš Pokrývka""]","[""Daniel Hladek"", ""bp2019"", ""Lukáš Pokrývka""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0399,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028353,,Ktorý autor dokumentu je pri osobe Filip Tomáš spojený s kategóriou dp2024?,"[""Daniel Hladek"", ""dp2024"", ""Filip Tomáš""]","[""Daniel Hladek"", ""dp2024"", ""Filip Tomáš""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0401,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028499,,Ktorý autor dokumentu je pri osobe Ronald Zalacko spojený s kategóriou bp2026?,"[""Daniel Hladek"", ""bp2026"", ""Ronald Zalacko""]","[""Daniel Hladek"", ""bp2026"", ""Ronald Zalacko""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0402,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028636,,Ktorý autor dokumentu je pri osobe Martin Wencel spojený s kategóriou bp2021?,"[""Daniel Hladek"", ""bp2021"", ""Martin Wencel""]","[""Daniel Hladek"", ""bp2021"", ""Martin Wencel""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0403,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027674,,Ktorý autor dokumentu je pri osobe Eduard Matovka spojený s kategóriou bp2024?,"[""Daniel Hladek"", ""bp2024"", ""Eduard Matovka""]","[""Daniel Hladek"", ""bp2024"", ""Eduard Matovka""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0404,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.029116,,Ktorý autor dokumentu je pri osobe Filip Tomáš spojený s kategóriou dp2025?,"[""Daniel Hladek"", ""dp2025"", ""Filip Tomáš""]","[""Daniel Hladek"", ""dp2025"", ""Filip Tomáš""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0406,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.02892,,Ktorý autor dokumentu je pri osobe Márk Fehér spojený s kategóriou dp2022?,"[""Daniel Hladek"", ""dp2022"", ""Márk Fehér""]","[""Daniel Hladek"", ""dp2022"", ""Márk Fehér""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0409,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.02801,,Ktorý autor dokumentu je pri osobe Oleksandr Dorybohov spojený s kategóriou bp2026?,"[""Daniel Hladek"", ""bp2026"", ""Oleksandr Dorybohov""]","[""Daniel Hladek"", ""bp2026"", ""Oleksandr Dorybohov""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0413,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027263,,Ktorý autor dokumentu je pri osobe Dmytro Ushatenko spojený s kategóriou bp2020?,"[""Daniel Hladek"", ""bp2020"", ""Dmytro Ushatenko""]","[""Daniel Hladek"", ""bp2020"", ""Dmytro Ushatenko""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0414,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028031,,Ktorý autor dokumentu je pri osobe Martin Šarišský spojený s kategóriou vp2023?,"[""Daniel Hladek"", ""vp2023"", ""Martin Šarišský""]","[""Daniel Hladek"", ""vp2023"", ""Martin Šarišský""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0418,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028608,,Ktorý autor dokumentu je pri osobe Filip Tomáš spojený s kategóriou bp2022?,"[""Daniel Hladek"", ""bp2022"", ""Filip Tomáš""]","[""Daniel Hladek"", ""bp2022"", ""Filip Tomáš""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0419,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028126,,Ktorý autor dokumentu je pri osobe Dárius Lindvai spojený s kategóriou bp2019?,"[""Daniel Hladek"", ""bp2019"", ""Dárius Lindvai""]","[""Daniel Hladek"", ""bp2019"", ""Dárius Lindvai""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0421,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.029637,,Ktorý autor dokumentu je pri osobe Youssef Ressaissi spojený s kategóriou iaeste?,"[""Daniel Hladek"", ""iaeste"", ""Youssef Ressaissi""]","[""Daniel Hladek"", ""iaeste"", ""Youssef Ressaissi""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/interns/yussef_ressaissi/README.md""]","[""pages/interns/yussef_ressaissi/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi""]","[""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0423,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.030141,,Ktorý autor dokumentu je pri osobe Lukáš Pokrývka spojený s kategóriou dp2021?,"[""Daniel Hladek"", ""dp2021"", ""Lukáš Pokrývka""]","[""Daniel Hladek"", ""dp2021"", ""Lukáš Pokrývka""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0428,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028402,,Ktorý autor dokumentu je pri osobe Vladyslav Yanchenko spojený s kategóriou bp2025?,"[""Daniel Hladek"", ""bp2025"", ""Vladyslav Yanchenko""]","[""Daniel Hladek"", ""bp2025"", ""Vladyslav Yanchenko""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0429,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028121,,Ktorý autor dokumentu je pri osobe Maksym Zatirka spojený s kategóriou bp2026?,"[""Daniel Hladek"", ""bp2026"", ""Maksym Zatirka""]","[""Daniel Hladek"", ""bp2026"", ""Maksym Zatirka""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0430,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027976,,Ktorý autor dokumentu je pri osobe Martin Šarišský spojený s kategóriou bp2024?,"[""Daniel Hladek"", ""bp2024"", ""Martin Šarišský""]","[""Daniel Hladek"", ""bp2024"", ""Martin Šarišský""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0431,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028124,,Ktorý autor dokumentu je pri osobe Sevval Bulburu spojený s kategóriou iaeste?,"[""Daniel Hladek"", ""iaeste"", ""Sevval Bulburu""]","[""Daniel Hladek"", ""iaeste"", ""Sevval Bulburu""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/interns/sevval_bulburu/README.md""]","[""pages/interns/sevval_bulburu/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0432,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028059,,Ktorý autor dokumentu je pri osobe Martin Šarišský spojený s kategóriou dp2026?,"[""Daniel Hladek"", ""dp2026"", ""Martin Šarišský""]","[""Daniel Hladek"", ""dp2026"", ""Martin Šarišský""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0434,test,document_author_category_multi_hop,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.028602,,Ktorý autor dokumentu je pri osobe Oleh Poiasnik spojený s kategóriou bp2025?,"[""Daniel Hladek"", ""bp2025"", ""Oleh Poiasnik""]","[""Daniel Hladek"", ""bp2025"", ""Oleh Poiasnik""]","[""HAS_DOCUMENT"", ""IN_CATEGORY"", ""AUTHORED_DOCUMENT""]","[""AUTHORED_DOCUMENT"", ""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""person_category"", ""person_document_author""]","[""entity_resolution"", ""person_category_constraints"", ""person_document_author_constraints""]"
|
||||||
|
True,True,,,g0437,test,person_multiple_categories,hard,False,1.0,1.0,1.0,1.0,1.0,1.0,1.0,False,0.031754,,V ktorých kategóriách sa nachádzajú dokumenty osoby Lukáš Pokrývka?,"[""Lukáš Pokrývka"", ""bp2019"", ""dp2021""]","[""Lukáš Pokrývka"", ""bp2019"", ""dp2021""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
True,True,,,g0441,test,person_multiple_categories,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.03159,,V ktorých kategóriách sa nachádzajú dokumenty osoby Filip Tomáš?,"[""Filip Tomáš"", ""bp2022"", ""dp2024"", ""dp2025""]","[""Filip Tomáš"", ""bp2022"", ""dp2024"", ""dp2025""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
True,True,,,g0444,test,person_multiple_categories,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.026818,,V ktorých kategóriách sa nachádzajú dokumenty osoby Oleh Poiasnik?,"[""Oleh Poiasnik"", ""bp2025"", ""dp2027""]","[""Oleh Poiasnik"", ""bp2025"", ""dp2027""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
True,True,,,g0446,test,person_multiple_categories,hard,False,1.0,1.0,1.0,1.0,1.0,1.0,1.0,False,0.026562,,V ktorých kategóriách sa nachádzajú dokumenty osoby Dárius Lindvai?,"[""Dárius Lindvai"", ""bp2019"", ""dp2021""]","[""Dárius Lindvai"", ""bp2019"", ""dp2021""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
True,True,,,g0448,test,person_multiple_categories,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.026852,,V ktorých kategóriách sa nachádzajú dokumenty osoby Andrii Pervashov?,"[""Andrii Pervashov"", ""bp2025"", ""dp2027""]","[""Andrii Pervashov"", ""bp2025"", ""dp2027""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
True,True,,,g0451,test,person_multiple_categories,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.02694,,V ktorých kategóriách sa nachádzajú dokumenty osoby Martin Šarišský?,"[""Martin Šarišský"", ""bp2024"", ""dp2026"", ""vp2023""]","[""Martin Šarišský"", ""bp2024"", ""dp2026"", ""vp2023""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
True,True,,,g0456,test,person_multiple_categories,hard,False,1.0,1.0,1.0,1.0,1.0,1.0,1.0,False,0.02701,,V ktorých kategóriách sa nachádzajú dokumenty osoby Lukáš Pokrývka?,"[""Lukáš Pokrývka"", ""bp2019"", ""dp2021""]","[""Lukáš Pokrývka"", ""bp2019"", ""dp2021""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
True,True,,,g0460,test,person_multiple_categories,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.027796,,V ktorých kategóriách sa nachádzajú dokumenty osoby Filip Tomáš?,"[""Filip Tomáš"", ""bp2022"", ""dp2024"", ""dp2025""]","[""Filip Tomáš"", ""bp2022"", ""dp2024"", ""dp2025""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
True,True,,,g0463,test,person_multiple_categories,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.026692,,V ktorých kategóriách sa nachádzajú dokumenty osoby Oleh Poiasnik?,"[""Oleh Poiasnik"", ""bp2025"", ""dp2027""]","[""Oleh Poiasnik"", ""bp2025"", ""dp2027""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""HAS_DOCUMENT"", ""IN_CATEGORY""]","[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""person_category""]","[""entity_resolution"", ""person_category_constraints""]"
|
||||||
|
True,True,2,2,g0467,test,candidate_set_aggregation,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031457,,"Z kandidátov Dárius Lindvai, Lukáš Pokrývka, Alina Vitko vyber všetky osoby, pri ktorých je práca uvedená v roku 2021. Koľko ich je?","[""Dárius Lindvai"", ""Lukáš Pokrývka"", ""2"", ""2021""]","[""Dárius Lindvai"", ""Lukáš Pokrývka"", ""2"", ""2021""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2019/alina_vitko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,3,3,g0468,test,candidate_set_aggregation,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031701,,"Z kandidátov Alina Vitko, Filip Tomáš, Márk Fehér, Andrii Pervashov vyber všetky osoby, pri ktorých je práca uvedená v roku 2022. Koľko ich je?","[""Alina Vitko"", ""Filip Tomáš"", ""Márk Fehér"", ""3"", ""2022""]","[""Alina Vitko"", ""Filip Tomáš"", ""Márk Fehér"", ""3"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2019/alina_vitko/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2019/alina_vitko/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/students/2022/andrii_pervashov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,2,2,g0470,test,candidate_set_aggregation,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031747,,"Z kandidátov Dmytro Ushatenko, Martin Wencel, Alina Vitko vyber všetky osoby, pri ktorých je práca uvedená v roku 2020. Koľko ich je?","[""Dmytro Ushatenko"", ""Martin Wencel"", ""2"", ""2020""]","[""Dmytro Ushatenko"", ""Martin Wencel"", ""2"", ""2020""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2019/alina_vitko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,3,3,g0472,test,candidate_set_aggregation,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031927,,"Z kandidátov Denis Le Thanh, Ján Malinovský, Maksym Zatirka, Alina Vitko vyber všetky osoby, pri ktorých je práca uvedená v roku 2026. Koľko ich je?","[""Denis Le Thanh"", ""Ján Malinovský"", ""Maksym Zatirka"", ""3"", ""2026""]","[""Denis Le Thanh"", ""Ján Malinovský"", ""Maksym Zatirka"", ""3"", ""2026""]",[],"[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_WORK""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]","[""person_thesis"", ""person_work""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""work_constraints""]"
|
||||||
|
True,True,2,2,g0474,test,candidate_set_aggregation,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031857,,"Z kandidátov Andrii Pervashov, Oleh Poiasnik, Alina Vitko vyber všetky osoby, pri ktorých je práca uvedená v roku 2027. Koľko ich je?","[""Andrii Pervashov"", ""Oleh Poiasnik"", ""2"", ""2027""]","[""Andrii Pervashov"", ""Oleh Poiasnik"", ""2"", ""2027""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,2,2,g0478,test,candidate_set_aggregation,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032573,,"Ktoré osoby zo zoznamu Dárius Lindvai, Lukáš Pokrývka, Alina Vitko zdieľajú rok práce 2021? Uveď aj ich počet.","[""Dárius Lindvai"", ""Lukáš Pokrývka"", ""2"", ""2021""]","[""Dárius Lindvai"", ""Lukáš Pokrývka"", ""2"", ""2021""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2019/alina_vitko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,3,3,g0479,test,candidate_set_aggregation,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.031797,,"Ktoré osoby zo zoznamu Alina Vitko, Filip Tomáš, Márk Fehér, Andrii Pervashov zdieľajú rok práce 2022? Uveď aj ich počet.","[""Alina Vitko"", ""Filip Tomáš"", ""Márk Fehér"", ""3"", ""2022""]","[""Alina Vitko"", ""Filip Tomáš"", ""Márk Fehér"", ""3"", ""2022""]",[],"[""AUTHORED"", ""EVIDENCED_BY""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2019/alina_vitko/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2019/alina_vitko/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/students/2022/andrii_pervashov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]","[""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints""]"
|
||||||
|
True,True,,,g0481,test,conjunctive_disambiguation,hard,False,0.0,0.0,0.0,0.0,0.0,1.0,1.0,True,0.026888,,Ktorá z osôb Denis Le Thanh a Ján Malinovský spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo inštrukcie a jej práca je uvedená v roku 2026?,"[""Denis Le Thanh"", ""inštrukcie"", ""2026""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/denis_le_thanh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0482,test,conjunctive_disambiguation,hard,False,0.0,0.0,0.0,0.0,0.0,1.0,1.0,True,0.026786,,Ktorá z osôb Denis Le Thanh a Ján Malinovský spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo Slovak Mistral a jej práca je uvedená v roku 2026?,"[""Denis Le Thanh"", ""Slovak Mistral"", ""2026""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/denis_le_thanh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0483,test,conjunctive_disambiguation,hard,False,0.0,0.0,0.0,0.0,0.0,1.0,1.0,True,0.026187,,Ktorá z osôb Oleh Poiasnik a Andrii Pervashov spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo znalostný graf a jej práca je uvedená v roku 2027?,"[""Oleh Poiasnik"", ""znalostný graf"", ""2027""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0487,test,conjunctive_disambiguation,hard,False,0.0,0.0,0.0,0.0,0.0,1.0,1.0,True,0.026325,,Ktorá z osôb Martin Wencel a Dmytro Ushatenko spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo pomenované entity a jej práca je uvedená v roku 2020?,"[""Martin Wencel"", ""pomenované entity"", ""2020""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2018/martin_wencel/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0489,test,conjunctive_disambiguation,hard,False,0.0,0.0,0.0,0.0,0.0,1.0,1.0,True,0.026418,,Ktorá z osôb Dárius Lindvai a Lukáš Pokrývka spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo CRF a jej práca je uvedená v roku 2021?,"[""Dárius Lindvai"", ""CRF"", ""2021""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/lukas_pokryvka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0491,test,conjunctive_disambiguation,hard,False,0.0,0.0,0.0,0.0,0.0,1.0,1.0,True,0.02581,,Ktorá z osôb Alina Vitko a Filip Tomáš spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo Streamlit a jej práca je uvedená v roku 2022?,"[""Alina Vitko"", ""Streamlit"", ""2022""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0494,test,conjunctive_disambiguation,hard,False,0.0,0.0,0.0,0.0,0.0,1.0,1.0,True,0.032847,,Ktorá z osôb Dmytro Ushatenko a Martin Wencel spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo chatbot a jej práca je uvedená v roku 2020?,"[""Dmytro Ushatenko"", ""chatbot"", ""2020""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2018/martin_wencel/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0496,test,conjunctive_disambiguation,hard,False,0.0,0.0,0.0,0.0,0.0,1.0,1.0,True,0.026247,,Ktorá z osôb Andrii Pervashov a Oleh Poiasnik spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo speech-to-text a jej práca je uvedená v roku 2027?,"[""Andrii Pervashov"", ""speech-to-text"", ""2027""]",[],"[""HAS_DOCUMENT"", ""HAS_KEYWORD""]",[],"[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]",[],"[""entity_resolution""]"
|
||||||
|
True,True,,,g0497,test,conjunctive_disambiguation,hard,True,1.0,1.0,1.0,1.0,1.0,1.0,1.0,True,0.032802,,Ktorá z osôb Lukáš Pokrývka a Dárius Lindvai spĺňa obe podmienky: jej dokument obsahuje kľúčové slovo GPU a jej práca je uvedená v roku 2021?,"[""Lukáš Pokrývka"", ""GPU"", ""2021""]","[""Lukáš Pokrývka"", ""GPU"", ""2021""]","[""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""AUTHORED"", ""EVIDENCED_BY"", ""HAS_DOCUMENT"", ""HAS_KEYWORD""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/lukas_pokryvka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]","[""person_keyword"", ""person_thesis""]","[""entity_resolution"", ""graph_traversal"", ""thesis_constraints"", ""person_keyword_constraints""]"
|
||||||
|
21155
tools/graphrag/evaluation/results/final_2026-10-24/graphrag_test.json
Normal file
21155
tools/graphrag/evaluation/results/final_2026-10-24/graphrag_test.json
Normal file
File diff suppressed because it is too large
Load Diff
@ -0,0 +1,200 @@
|
|||||||
|
{
|
||||||
|
"policy": "Recorded after the frozen TEST. No implementation or audit changes were made to improve these cases.",
|
||||||
|
"diagnosis": "Both questions concern the same pair. An additional Martin Jancura document appears in the evidence; likely overly broad fuzzy person matching. Investigate in a future version using separate development cases and a new holdout.",
|
||||||
|
"questions": [
|
||||||
|
{
|
||||||
|
"count_ok": true,
|
||||||
|
"expected_count": null,
|
||||||
|
"actual_count": null,
|
||||||
|
"complete": true,
|
||||||
|
"id": "g0065",
|
||||||
|
"split": "test",
|
||||||
|
"category": "same_academic_year_pair",
|
||||||
|
"difficulty": "hard",
|
||||||
|
"question": "V ktorom rovnakom roku je v ZP Wiki uvedená práca pri osobách Ján Malinovský a Martin Šarišský?",
|
||||||
|
"latency_seconds": 0.034872,
|
||||||
|
"error": null,
|
||||||
|
"strict": false,
|
||||||
|
"value_score": 0.666667,
|
||||||
|
"entity_score": 0.0,
|
||||||
|
"relation_score": 1.0,
|
||||||
|
"property_score": 0.0,
|
||||||
|
"relation_choice_score": 0.0,
|
||||||
|
"document_recall": 1.0,
|
||||||
|
"source_recall": 1.0,
|
||||||
|
"expected_values": [
|
||||||
|
"Ján Malinovský",
|
||||||
|
"Martin Šarišský",
|
||||||
|
"2026"
|
||||||
|
],
|
||||||
|
"matched_values": [
|
||||||
|
"Ján Malinovský",
|
||||||
|
"Martin Šarišský"
|
||||||
|
],
|
||||||
|
"expected_entities": [
|
||||||
|
{
|
||||||
|
"type": "year",
|
||||||
|
"value": "2026"
|
||||||
|
}
|
||||||
|
],
|
||||||
|
"matched_entities": [],
|
||||||
|
"expected_relations": [],
|
||||||
|
"actual_relations": [],
|
||||||
|
"matched_relations": [],
|
||||||
|
"expected_properties": [
|
||||||
|
"Thesis.year|Work.year",
|
||||||
|
"Thesis.year|Work.year"
|
||||||
|
],
|
||||||
|
"matched_properties": [],
|
||||||
|
"relation_choices": [
|
||||||
|
{
|
||||||
|
"choices": [
|
||||||
|
"AUTHORED",
|
||||||
|
"HAS_WORK"
|
||||||
|
],
|
||||||
|
"matched": false
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"choices": [
|
||||||
|
"AUTHORED",
|
||||||
|
"HAS_WORK"
|
||||||
|
],
|
||||||
|
"matched": false
|
||||||
|
}
|
||||||
|
],
|
||||||
|
"expected_documents": [
|
||||||
|
"pages/students/2021/martin_sarissky/README.md",
|
||||||
|
"pages/students/2022/jan_malinovsky/README.md"
|
||||||
|
],
|
||||||
|
"actual_documents": [
|
||||||
|
"pages/students/2017/martin_jancura/README.md",
|
||||||
|
"pages/students/2021/martin_sarissky/README.md",
|
||||||
|
"pages/students/2022/jan_malinovsky/README.md"
|
||||||
|
],
|
||||||
|
"matched_documents": [
|
||||||
|
"pages/students/2021/martin_sarissky/README.md",
|
||||||
|
"pages/students/2022/jan_malinovsky/README.md"
|
||||||
|
],
|
||||||
|
"expected_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"
|
||||||
|
],
|
||||||
|
"actual_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"
|
||||||
|
],
|
||||||
|
"matched_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"
|
||||||
|
],
|
||||||
|
"entity_set_expected": [],
|
||||||
|
"entity_set_actual": [],
|
||||||
|
"entity_set_mode": null,
|
||||||
|
"entity_set_ok": true,
|
||||||
|
"strategies": [
|
||||||
|
"entity_resolution"
|
||||||
|
],
|
||||||
|
"fact_types": [
|
||||||
|
"academic_year_comparison"
|
||||||
|
]
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"count_ok": true,
|
||||||
|
"expected_count": null,
|
||||||
|
"actual_count": null,
|
||||||
|
"complete": true,
|
||||||
|
"id": "g0129",
|
||||||
|
"split": "test",
|
||||||
|
"category": "same_academic_year_pair",
|
||||||
|
"difficulty": "hard",
|
||||||
|
"question": "Aký rok práce spája osoby Ján Malinovský a Martin Šarišský?",
|
||||||
|
"latency_seconds": 0.032707,
|
||||||
|
"error": null,
|
||||||
|
"strict": false,
|
||||||
|
"value_score": 0.666667,
|
||||||
|
"entity_score": 0.0,
|
||||||
|
"relation_score": 1.0,
|
||||||
|
"property_score": 0.0,
|
||||||
|
"relation_choice_score": 0.0,
|
||||||
|
"document_recall": 1.0,
|
||||||
|
"source_recall": 1.0,
|
||||||
|
"expected_values": [
|
||||||
|
"Ján Malinovský",
|
||||||
|
"Martin Šarišský",
|
||||||
|
"2026"
|
||||||
|
],
|
||||||
|
"matched_values": [
|
||||||
|
"Ján Malinovský",
|
||||||
|
"Martin Šarišský"
|
||||||
|
],
|
||||||
|
"expected_entities": [
|
||||||
|
{
|
||||||
|
"type": "year",
|
||||||
|
"value": "2026"
|
||||||
|
}
|
||||||
|
],
|
||||||
|
"matched_entities": [],
|
||||||
|
"expected_relations": [],
|
||||||
|
"actual_relations": [],
|
||||||
|
"matched_relations": [],
|
||||||
|
"expected_properties": [
|
||||||
|
"Thesis.year|Work.year",
|
||||||
|
"Thesis.year|Work.year"
|
||||||
|
],
|
||||||
|
"matched_properties": [],
|
||||||
|
"relation_choices": [
|
||||||
|
{
|
||||||
|
"choices": [
|
||||||
|
"AUTHORED",
|
||||||
|
"HAS_WORK"
|
||||||
|
],
|
||||||
|
"matched": false
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"choices": [
|
||||||
|
"AUTHORED",
|
||||||
|
"HAS_WORK"
|
||||||
|
],
|
||||||
|
"matched": false
|
||||||
|
}
|
||||||
|
],
|
||||||
|
"expected_documents": [
|
||||||
|
"pages/students/2021/martin_sarissky/README.md",
|
||||||
|
"pages/students/2022/jan_malinovsky/README.md"
|
||||||
|
],
|
||||||
|
"actual_documents": [
|
||||||
|
"pages/students/2017/martin_jancura/README.md",
|
||||||
|
"pages/students/2021/martin_sarissky/README.md",
|
||||||
|
"pages/students/2022/jan_malinovsky/README.md"
|
||||||
|
],
|
||||||
|
"matched_documents": [
|
||||||
|
"pages/students/2021/martin_sarissky/README.md",
|
||||||
|
"pages/students/2022/jan_malinovsky/README.md"
|
||||||
|
],
|
||||||
|
"expected_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"
|
||||||
|
],
|
||||||
|
"actual_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"
|
||||||
|
],
|
||||||
|
"matched_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"
|
||||||
|
],
|
||||||
|
"entity_set_expected": [],
|
||||||
|
"entity_set_actual": [],
|
||||||
|
"entity_set_mode": null,
|
||||||
|
"entity_set_ok": true,
|
||||||
|
"strategies": [
|
||||||
|
"entity_resolution"
|
||||||
|
],
|
||||||
|
"fact_types": [
|
||||||
|
"academic_year_comparison"
|
||||||
|
]
|
||||||
|
}
|
||||||
|
]
|
||||||
|
}
|
||||||
3804
tools/graphrag/evaluation/results/final_2026-10-24/source_audit.json
Normal file
3804
tools/graphrag/evaluation/results/final_2026-10-24/source_audit.json
Normal file
File diff suppressed because it is too large
Load Diff
117
tools/graphrag/evaluation/results/final_2026-10-24/summary.json
Normal file
117
tools/graphrag/evaluation/results/final_2026-10-24/summary.json
Normal file
@ -0,0 +1,117 @@
|
|||||||
|
{
|
||||||
|
"generated_at_utc": "2026-10-24T19:05:45.204482+00:00",
|
||||||
|
"freeze_sha256": "2277226cbefa6337e04b5642da1145e1a11c48bbb05cf90de7ee5a7dbc71d806",
|
||||||
|
"dataset_sha256": "b5c96e423fc9a5bcee0dcca38fdeac86b2f7cd1efebfcb0d7cd4cfb7fed0620e",
|
||||||
|
"primary_metric": "Strict accuracy over ALL questions; no exclusions.",
|
||||||
|
"supplementary_metric": "Strict accuracy on the source-consistent subset declared by static audit before TEST.",
|
||||||
|
"baseline_dev_same_evaluator": {
|
||||||
|
"questions": 286,
|
||||||
|
"strict_count": 106,
|
||||||
|
"strict_accuracy": 0.370629,
|
||||||
|
"error_count": 0,
|
||||||
|
"value_score": 0.772494,
|
||||||
|
"entity_score": 0.624126,
|
||||||
|
"relation_score": 0.853147,
|
||||||
|
"property_score": 0.793706,
|
||||||
|
"relation_choice_score": 0.870629,
|
||||||
|
"document_recall": 1.0,
|
||||||
|
"source_recall": 0.900058,
|
||||||
|
"latency_mean_seconds": 0.029989,
|
||||||
|
"latency_median_seconds": 0.028124,
|
||||||
|
"latency_p95_seconds": 0.041821
|
||||||
|
},
|
||||||
|
"dev": {
|
||||||
|
"questions": 286,
|
||||||
|
"strict_count": 209,
|
||||||
|
"strict_accuracy": 0.730769,
|
||||||
|
"error_count": 0,
|
||||||
|
"value_score": 0.751748,
|
||||||
|
"entity_score": 0.751748,
|
||||||
|
"relation_score": 0.751748,
|
||||||
|
"property_score": 0.835664,
|
||||||
|
"relation_choice_score": 0.968531,
|
||||||
|
"document_recall": 1.0,
|
||||||
|
"source_recall": 1.0,
|
||||||
|
"latency_mean_seconds": 0.032786,
|
||||||
|
"latency_median_seconds": 0.03221,
|
||||||
|
"latency_p95_seconds": 0.041831
|
||||||
|
},
|
||||||
|
"test": {
|
||||||
|
"questions": 214,
|
||||||
|
"strict_count": 152,
|
||||||
|
"strict_accuracy": 0.71028,
|
||||||
|
"error_count": 0,
|
||||||
|
"value_score": 0.735202,
|
||||||
|
"entity_score": 0.726636,
|
||||||
|
"relation_score": 0.738318,
|
||||||
|
"property_score": 0.794393,
|
||||||
|
"relation_choice_score": 0.953271,
|
||||||
|
"document_recall": 1.0,
|
||||||
|
"source_recall": 1.0,
|
||||||
|
"latency_mean_seconds": 0.029583,
|
||||||
|
"latency_median_seconds": 0.029331,
|
||||||
|
"latency_p95_seconds": 0.033782
|
||||||
|
},
|
||||||
|
"dev_source_consistent": {
|
||||||
|
"questions": 209,
|
||||||
|
"strict_count": 209,
|
||||||
|
"strict_accuracy": 1.0,
|
||||||
|
"error_count": 0,
|
||||||
|
"value_score": 1.0,
|
||||||
|
"entity_score": 1.0,
|
||||||
|
"relation_score": 1.0,
|
||||||
|
"property_score": 1.0,
|
||||||
|
"relation_choice_score": 1.0,
|
||||||
|
"document_recall": 1.0,
|
||||||
|
"source_recall": 1.0,
|
||||||
|
"latency_mean_seconds": 0.033557,
|
||||||
|
"latency_median_seconds": 0.033169,
|
||||||
|
"latency_p95_seconds": 0.041472
|
||||||
|
},
|
||||||
|
"test_source_consistent": {
|
||||||
|
"questions": 154,
|
||||||
|
"strict_count": 152,
|
||||||
|
"strict_accuracy": 0.987013,
|
||||||
|
"error_count": 0,
|
||||||
|
"value_score": 0.995671,
|
||||||
|
"entity_score": 0.987013,
|
||||||
|
"relation_score": 1.0,
|
||||||
|
"property_score": 0.987013,
|
||||||
|
"relation_choice_score": 0.987013,
|
||||||
|
"document_recall": 1.0,
|
||||||
|
"source_recall": 1.0,
|
||||||
|
"latency_mean_seconds": 0.030486,
|
||||||
|
"latency_median_seconds": 0.030564,
|
||||||
|
"latency_p95_seconds": 0.033949
|
||||||
|
},
|
||||||
|
"source_audit": {
|
||||||
|
"dev": {
|
||||||
|
"questions": 286,
|
||||||
|
"source_consistent": 209,
|
||||||
|
"issues": {
|
||||||
|
"keyword_not_in_frontmatter_catalog": 66,
|
||||||
|
"keyword_not_linked_to_expected_person": 5,
|
||||||
|
"exact_categories_omit_or_add_source_categories": 6
|
||||||
|
}
|
||||||
|
},
|
||||||
|
"test": {
|
||||||
|
"questions": 214,
|
||||||
|
"source_consistent": 154,
|
||||||
|
"issues": {
|
||||||
|
"keyword_not_in_frontmatter_catalog": 46,
|
||||||
|
"keyword_not_linked_to_expected_person": 11,
|
||||||
|
"exact_categories_omit_or_add_source_categories": 3
|
||||||
|
}
|
||||||
|
}
|
||||||
|
},
|
||||||
|
"unit_and_integration_tests": {
|
||||||
|
"passed": 359,
|
||||||
|
"skipped": 4,
|
||||||
|
"neo4j_integration_cases": 10
|
||||||
|
},
|
||||||
|
"holdout_failures_without_source_audit_issues": [
|
||||||
|
"g0065",
|
||||||
|
"g0129"
|
||||||
|
],
|
||||||
|
"post_test_code_changes": false
|
||||||
|
}
|
||||||
@ -0,0 +1,11 @@
|
|||||||
|
# GraphRAG v2 — zmrazené meranie 25. 10. 2026
|
||||||
|
|
||||||
|
- DEV: **509/509 (100 %)**, TEST: **67/80 (83,75 %)**, runtime chyby: 0.
|
||||||
|
- Celá testovacia sada: 426 passed, 4 skipped; vrátane 10 skutočných Neo4j rollback testov.
|
||||||
|
- Pôvodných 500 otázok je odteraz iba DEV/regresia. 128 chybných predpokladov o tagoch má overenú no-answer anotáciu a 9 otázok má opravené úplné kategórie.
|
||||||
|
- Nový TEST má 80 prípadov z 24 profilov bez prekryvu s DEV. Tagy, autori, korpus a rodiny šablón sú spoločné; nejde o dôkaz všeobecnej presnosti.
|
||||||
|
- Všetky zdroje boli anotované nezávislým parserom pôvodného Markdownu. Fakty sa hodnotia ako prepojené typované dôkazy vrátane správneho významu roku a platných alternatív zdrojov.
|
||||||
|
- 13 TEST zlyhaní je zachovaných v `holdout_failures.json`: formulácia tagu pred osobami a meno s číslicou. Verzia v2 sa po meraní neupravuje. Ak sa podľa zistení ďalej vyvíja, tieto otázky prechádzajú do DEV a nová verzia potrebuje nový holdout.
|
||||||
|
- Latencia je iba čas grafového vyhľadávania, bez LLM/OpenWebUI. Podrobné metriky a odtlačky obsahujú JSON/CSV a `../../frozen_v2.json`.
|
||||||
|
|
||||||
|
Historické v1 (152/214) a v2 (67/80) majú rozdielne datasety/evaluatory; samotný rozdiel percent nemožno vydávať za kontrolovaný experiment zlepšenia.
|
||||||
File diff suppressed because one or more lines are too long
88795
tools/graphrag/evaluation/results/final_v2_2026-10-25/graphrag_dev.json
Normal file
88795
tools/graphrag/evaluation/results/final_v2_2026-10-25/graphrag_dev.json
Normal file
File diff suppressed because it is too large
Load Diff
File diff suppressed because one or more lines are too long
15105
tools/graphrag/evaluation/results/final_v2_2026-10-25/graphrag_test.json
Normal file
15105
tools/graphrag/evaluation/results/final_v2_2026-10-25/graphrag_test.json
Normal file
File diff suppressed because it is too large
Load Diff
File diff suppressed because it is too large
Load Diff
@ -0,0 +1,46 @@
|
|||||||
|
{
|
||||||
|
"dev": {
|
||||||
|
"questions": 509,
|
||||||
|
"strict_count": 509,
|
||||||
|
"strict_accuracy": 1.0,
|
||||||
|
"error_count": 0,
|
||||||
|
"value_score": 1.0,
|
||||||
|
"entity_score": 1.0,
|
||||||
|
"relation_score": 1.0,
|
||||||
|
"property_score": 1.0,
|
||||||
|
"relation_choice_score": 1.0,
|
||||||
|
"document_recall": 1.0,
|
||||||
|
"source_recall": 1.0,
|
||||||
|
"binding_score": 1.0,
|
||||||
|
"path_score": 1.0,
|
||||||
|
"answerability_accuracy": 1.0,
|
||||||
|
"latency_mean_seconds": 0.042799,
|
||||||
|
"latency_median_seconds": 0.040359,
|
||||||
|
"latency_p95_seconds": 0.061584
|
||||||
|
},
|
||||||
|
"test": {
|
||||||
|
"questions": 80,
|
||||||
|
"strict_count": 67,
|
||||||
|
"strict_accuracy": 0.8375,
|
||||||
|
"error_count": 0,
|
||||||
|
"value_score": 0.845833,
|
||||||
|
"entity_score": 0.84375,
|
||||||
|
"relation_score": 1.0,
|
||||||
|
"property_score": 1.0,
|
||||||
|
"relation_choice_score": 1.0,
|
||||||
|
"document_recall": 1.0,
|
||||||
|
"source_recall": 1.0,
|
||||||
|
"binding_score": 0.8375,
|
||||||
|
"path_score": 0.8375,
|
||||||
|
"answerability_accuracy": 0.8375,
|
||||||
|
"latency_mean_seconds": 0.046289,
|
||||||
|
"latency_median_seconds": 0.037556,
|
||||||
|
"latency_p95_seconds": 0.054178
|
||||||
|
},
|
||||||
|
"unit_tests": {
|
||||||
|
"passed": 426,
|
||||||
|
"skipped": 4
|
||||||
|
},
|
||||||
|
"freeze_sha256": "233ce6fe63749b921d4c9947a55279ba5912fce0ff819153bfd6aaaf80910a46",
|
||||||
|
"limitations": "13 unseen-subject failures preserved; next version must use a new holdout."
|
||||||
|
}
|
||||||
24305
tools/graphrag/evaluation/results/v2_preparation/legacy_corrections.json
Normal file
24305
tools/graphrag/evaluation/results/v2_preparation/legacy_corrections.json
Normal file
File diff suppressed because it is too large
Load Diff
699
tools/graphrag/evaluation/results/v2_preparation/partition.json
Normal file
699
tools/graphrag/evaluation/results/v2_preparation/partition.json
Normal file
@ -0,0 +1,699 @@
|
|||||||
|
{
|
||||||
|
"seed": 20261024,
|
||||||
|
"strategy": "All previously seen 500 cases are DEV regression. TEST profiles never appeared in legacy start_entities; all real candidate profiles are disjoint.",
|
||||||
|
"dev_count": 509,
|
||||||
|
"test_count": 80,
|
||||||
|
"previously_exposed_profiles_excluded_from_test": [
|
||||||
|
"pages/students/2017/martin_jancura/README.md"
|
||||||
|
],
|
||||||
|
"dev_profiles": [
|
||||||
|
"pages/interns/bogdan_paul_chis/README.md",
|
||||||
|
"pages/interns/cesar_gutierrez/README.md",
|
||||||
|
"pages/interns/oliver_pejic/README.md",
|
||||||
|
"pages/interns/sevval_bulburu/README.md",
|
||||||
|
"pages/interns/yussef_ressaissi/README.md",
|
||||||
|
"pages/students/2016/darius_lindvai/README.md",
|
||||||
|
"pages/students/2016/dominik_nagy/README.md",
|
||||||
|
"pages/students/2016/jakub_maruniak/README.md",
|
||||||
|
"pages/students/2016/jan_holp/README.md",
|
||||||
|
"pages/students/2016/lukas_pokryvka/README.md",
|
||||||
|
"pages/students/2016/mark_feher/README.md",
|
||||||
|
"pages/students/2016/maros_harahus/README.md",
|
||||||
|
"pages/students/2016/patrik_pavlisin/README.md",
|
||||||
|
"pages/students/2016/tomas_kucharik/README.md",
|
||||||
|
"pages/students/2017/dmytro_ushatenko/README.md",
|
||||||
|
"pages/students/2018/david_omasta/README.md",
|
||||||
|
"pages/students/2018/martin_wencel/README.md",
|
||||||
|
"pages/students/2018/ondrej_megela/README.md",
|
||||||
|
"pages/students/2019/alina_vitko/README.md",
|
||||||
|
"pages/students/2019/artem_yatsenko/README.md",
|
||||||
|
"pages/students/2019/filip_tomas/README.md",
|
||||||
|
"pages/students/2019/kristian_sopkovic/README.md",
|
||||||
|
"pages/students/2019/michal_stromko/README.md",
|
||||||
|
"pages/students/2021/eduard_matovka/README.md",
|
||||||
|
"pages/students/2021/martin_sarissky/README.md",
|
||||||
|
"pages/students/2021/matej_novotny/README.md",
|
||||||
|
"pages/students/2021/matej_scislak/README.md",
|
||||||
|
"pages/students/2021/vladimir_ferko/README.md",
|
||||||
|
"pages/students/2022/andrii_pervashov/README.md",
|
||||||
|
"pages/students/2022/daniil_huzenko/README.md",
|
||||||
|
"pages/students/2022/jan_malinovsky/README.md",
|
||||||
|
"pages/students/2022/jan_ptak/README.md",
|
||||||
|
"pages/students/2022/oleh_poiasnik/README.md",
|
||||||
|
"pages/students/2022/samuel_vasil/README.md",
|
||||||
|
"pages/students/2022/tetiana_mohorian/README.md",
|
||||||
|
"pages/students/2022/valerii_kutsenko/README.md",
|
||||||
|
"pages/students/2022/vladyslav_yanchenko/README.md",
|
||||||
|
"pages/students/2023/denis_le_thanh/README.md",
|
||||||
|
"pages/students/2023/maksym_zatirka/README.md",
|
||||||
|
"pages/students/2023/oleksandr_dorybohov/README.md",
|
||||||
|
"pages/students/2023/ronald_zalacko/README.md",
|
||||||
|
"pages/students/2023/rostyslav_rodzhuk/README.md",
|
||||||
|
"pages/students/2023/samuel_dzurina/README.md",
|
||||||
|
"pages/students/2023/simona_bobrovcanova/README.md",
|
||||||
|
"pages/students/2023/yevhenii_medushivskyi/README.md"
|
||||||
|
],
|
||||||
|
"test_profiles": [
|
||||||
|
"pages/students/2016/ediz_morochovic/README.md",
|
||||||
|
"pages/students/2017/than_trung_thanh/README.md",
|
||||||
|
"pages/students/2018/NaN1name_buday/README.md",
|
||||||
|
"pages/students/2018/adrian_remias/README.md",
|
||||||
|
"pages/students/2018/david_ilas/README.md",
|
||||||
|
"pages/students/2018/oleh_bilykh/README.md",
|
||||||
|
"pages/students/2019/david_stromp/README.md",
|
||||||
|
"pages/students/2019/dmytro_mural/README.md",
|
||||||
|
"pages/students/2019/patrik_pokrivcak/README.md",
|
||||||
|
"pages/students/2019/samuel_horani/README.md",
|
||||||
|
"pages/students/2020/david_kostilnik/README.md",
|
||||||
|
"pages/students/2020/jakub_kristian_lukas/README.md",
|
||||||
|
"pages/students/2020/kamil_tomcufcik/README.md",
|
||||||
|
"pages/students/2020/matej_kobylan/README.md",
|
||||||
|
"pages/students/2020/matus_suchanic/README.md",
|
||||||
|
"pages/students/2020/pavol_hudak/README.md",
|
||||||
|
"pages/students/2020/vladyslav_krupko/README.md",
|
||||||
|
"pages/students/2021/artur_hyrenko/README.md",
|
||||||
|
"pages/students/2021/manohar_gowdru_shridharu/README.md",
|
||||||
|
"pages/students/2021/nikita_bodnar/README.md",
|
||||||
|
"pages/students/2021/oleksandr_hryshchenko/README.md",
|
||||||
|
"pages/students/2022/jakub_schwarc/README.md",
|
||||||
|
"pages/students/2022/serhii_yemets/README.md",
|
||||||
|
"pages/students/2022/yevhenii_leonov/README.md"
|
||||||
|
],
|
||||||
|
"dev_groups": [
|
||||||
|
"0050788a45bda43b1222",
|
||||||
|
"0103c15c3c9ba190aeb1",
|
||||||
|
"01fed40ab461e11ee093",
|
||||||
|
"041717b1d52a156b689d",
|
||||||
|
"042ad854987276b5fae7",
|
||||||
|
"051dd2b6d93c1ffd36dd",
|
||||||
|
"060ae15b2cc1ee67e042",
|
||||||
|
"06d333d39be40bfe3201",
|
||||||
|
"06d6e3cffb2176fd7f09",
|
||||||
|
"081950bac679dd5b8f2e",
|
||||||
|
"085915f393eb4a22f1b7",
|
||||||
|
"09abe45ab0019d2dc551",
|
||||||
|
"0a066435e6cc72efaece",
|
||||||
|
"0af90706211c204d9650",
|
||||||
|
"0b9404236ea0ff763cc7",
|
||||||
|
"0bb33c9fb545db6c7efd",
|
||||||
|
"0c018d0b1cbb0e237e9f",
|
||||||
|
"0c5aeb5d8296bc04d986",
|
||||||
|
"0ca664c5db081b2938ab",
|
||||||
|
"0ce6fb00116d00c3eb06",
|
||||||
|
"0d143d9ce8a23195a0c4",
|
||||||
|
"0d5c14ded54417c1bc5c",
|
||||||
|
"0e1cc7c92bda3356abcf",
|
||||||
|
"102c9752f792adabbe31",
|
||||||
|
"105adad4f3450df644b6",
|
||||||
|
"10c7c006019ae33b33f8",
|
||||||
|
"10fccdd7e670913abcf7",
|
||||||
|
"12189f45a9da9e287973",
|
||||||
|
"124dd5427db95b98b3dd",
|
||||||
|
"1332df3ed3789f7b036a",
|
||||||
|
"138ca699884b739f8e5c",
|
||||||
|
"13e4b7c269ad106ade3f",
|
||||||
|
"15aa69ef6dd8c01eea92",
|
||||||
|
"15e3f4152da21f13ba68",
|
||||||
|
"16c0e3be8ec9aff14109",
|
||||||
|
"178cfc213ab65750f963",
|
||||||
|
"17e04ec2656e870a65a6",
|
||||||
|
"18d5030f4fb216cf88bf",
|
||||||
|
"196584dd3a1c0be311c3",
|
||||||
|
"19975879efc9a3c0543e",
|
||||||
|
"19babc3459ab79ae9fbd",
|
||||||
|
"19fc794342b4529bdfb5",
|
||||||
|
"1c0829bc6ca8aec135ab",
|
||||||
|
"1c1ceae7ee00396bff0b",
|
||||||
|
"1d7a0440b3b7b23db8de",
|
||||||
|
"1f02638485671cd575af",
|
||||||
|
"1f1f3c76bf2356a03483",
|
||||||
|
"1f25d5fa12d8e0f927d0",
|
||||||
|
"1f5dc8574d879b802e9f",
|
||||||
|
"1fdb66ab8b7e50782215",
|
||||||
|
"201073002e2a3d9c114d",
|
||||||
|
"225ac2fab461d48837a1",
|
||||||
|
"238ce6b27deaa8850727",
|
||||||
|
"23accd0aac8edfa97641",
|
||||||
|
"276d583995a85ffc618f",
|
||||||
|
"27d4a0adbb9a1395d9e9",
|
||||||
|
"289b4d9aa835de0b5149",
|
||||||
|
"2992c61b66c504901bc2",
|
||||||
|
"2a392ebdea4f8995dbd8",
|
||||||
|
"2a39b124ed7c0db522e0",
|
||||||
|
"2a4658e0300657ac688d",
|
||||||
|
"2b16dd4e680a11ee7e32",
|
||||||
|
"2b54f27c9bb9e504078d",
|
||||||
|
"2c224d36ca4ae00f031e",
|
||||||
|
"2ca41afe293c025f7461",
|
||||||
|
"2cb7f465749b32572c55",
|
||||||
|
"2f81c228e7d4a7245950",
|
||||||
|
"2fb459ca2ecd45f9d636",
|
||||||
|
"2fc6aa95207f6095f9e7",
|
||||||
|
"32590bb3587e2545696f",
|
||||||
|
"32833974157304b75daa",
|
||||||
|
"336175547c48b728d871",
|
||||||
|
"3386127f93618557bb4c",
|
||||||
|
"33895a11fe99d4d8bfb9",
|
||||||
|
"35b103279cc7418ed880",
|
||||||
|
"3601e0886defba5b6e13",
|
||||||
|
"364c79ac377300bbeeb1",
|
||||||
|
"367607d5cead76acf875",
|
||||||
|
"36c17e69e16911c9e274",
|
||||||
|
"37472fdae47e5d35685a",
|
||||||
|
"374b61b37bb743011e59",
|
||||||
|
"380b64507274cec79e0d",
|
||||||
|
"38f40820889b9aeddbc1",
|
||||||
|
"396c842186fb13eda105",
|
||||||
|
"3ad244967ea15c0c83c5",
|
||||||
|
"3b3b6a2a8310ac233010",
|
||||||
|
"3b7e8c83e9cb48e2b3bf",
|
||||||
|
"3bb485022d56f4bb2515",
|
||||||
|
"3c13b559998508b83661",
|
||||||
|
"3c478754fd4ba3d25481",
|
||||||
|
"3c598b13d843def522fc",
|
||||||
|
"3c8224f893e71b535c4b",
|
||||||
|
"3d8163d06a1cbe755054",
|
||||||
|
"3e1010231db22ec0e1ee",
|
||||||
|
"3ea37b5f45f74ef5b575",
|
||||||
|
"3fac44cbc69c99bffe66",
|
||||||
|
"3ff85696eb212d231b57",
|
||||||
|
"4048165233ddb8c0a954",
|
||||||
|
"4051ce34a0447dccf398",
|
||||||
|
"408f182f5a81c0d0ebc3",
|
||||||
|
"409ac6e943a39dd2b7c4",
|
||||||
|
"41f700f58bbc8944ba56",
|
||||||
|
"423404addbc90daef335",
|
||||||
|
"423e26f480f005312e5c",
|
||||||
|
"431a00760487658f1033",
|
||||||
|
"43ac22f0906b7123b613",
|
||||||
|
"453a2b0bedf37bee63c1",
|
||||||
|
"45b9043079a704a753db",
|
||||||
|
"45fc60f4258c9809fad6",
|
||||||
|
"4614a9f8b635de0a8586",
|
||||||
|
"4616dbf3fbfe1b6340a4",
|
||||||
|
"46195c2692d2cb45d6a8",
|
||||||
|
"46c5299ff9202545c1db",
|
||||||
|
"477d6c4333dc132e401f",
|
||||||
|
"4843247cb2b934f0932a",
|
||||||
|
"4856784451591eda36b4",
|
||||||
|
"49c72dec79d95697dde8",
|
||||||
|
"4aa086b434f63f4e585a",
|
||||||
|
"4ba8f4d0878c22b27324",
|
||||||
|
"4c70ab578a254939f857",
|
||||||
|
"4e015f66967c98096fbc",
|
||||||
|
"4f5c657eb68f8a5d6043",
|
||||||
|
"4fa90c676836f148bc17",
|
||||||
|
"51977c3d8bd8617204d2",
|
||||||
|
"52e27e4f815aeb6b38ec",
|
||||||
|
"535e783ec079dea758ab",
|
||||||
|
"5370750473d7cd063755",
|
||||||
|
"542379845fa17d2ead90",
|
||||||
|
"54fceb5f1cd421f84829",
|
||||||
|
"556668355bc92d4e9433",
|
||||||
|
"57efdd43cc46f3761067",
|
||||||
|
"584e6360a5cbb1963fdd",
|
||||||
|
"58688526f38c1aec0947",
|
||||||
|
"5abc77af26e190437d1e",
|
||||||
|
"5ba577c5e9e18b4c7bac",
|
||||||
|
"5e56d28509eff32fd51c",
|
||||||
|
"5e6531d3875f47da5f89",
|
||||||
|
"5f44364d7cb1ce29f96b",
|
||||||
|
"5febb302d3bb1fbbb336",
|
||||||
|
"60137ba211d54af0b4f8",
|
||||||
|
"60eb85dae74e6a0d086b",
|
||||||
|
"623001edaea9bcc97d6f",
|
||||||
|
"62688a89431171a11a6e",
|
||||||
|
"62979bc36f4c969209eb",
|
||||||
|
"632cd49828d3710fe941",
|
||||||
|
"63687ef941e71d333267",
|
||||||
|
"63d5bf0c55b43eed6714",
|
||||||
|
"641a91ff5c4d8ed7f600",
|
||||||
|
"645ed6af8971e4717cc6",
|
||||||
|
"6490884e27bffcdf92ff",
|
||||||
|
"64959234464bb137392f",
|
||||||
|
"64ee1de58f1a508800a6",
|
||||||
|
"658bd279d4e0a439cc33",
|
||||||
|
"65b694ad9e7d1b5136c5",
|
||||||
|
"6740ef929d76f6dbeeee",
|
||||||
|
"67abf5daf51f59a6d650",
|
||||||
|
"687b177138f1f07a0c83",
|
||||||
|
"69ed7f36bae73f5f53cb",
|
||||||
|
"6b6ad897a76ae96eb97c",
|
||||||
|
"6bfdc1d535ca5943e177",
|
||||||
|
"6c51ba0a6448218c2b39",
|
||||||
|
"6cd7ba42a817705d5932",
|
||||||
|
"6d3b56a1c80d3295e291",
|
||||||
|
"6dc400b3dde53718bc7d",
|
||||||
|
"6dc6004e2db1d64175cf",
|
||||||
|
"6e82cbab59095f5c670d",
|
||||||
|
"6fd75ded68d480abbb3d",
|
||||||
|
"6fed450855b681b2c801",
|
||||||
|
"6feddf139106d31f6caa",
|
||||||
|
"709574d70ec4defbbcaf",
|
||||||
|
"719bd8001e924f64791f",
|
||||||
|
"7220fd134a2c4a9096ca",
|
||||||
|
"736f8ecc77f7a50a9d5a",
|
||||||
|
"737f28e7a259ee0429fa",
|
||||||
|
"74af0519e06229ff082e",
|
||||||
|
"74c35222dde8b0a2d835",
|
||||||
|
"751e1e06eb132442b38b",
|
||||||
|
"758aa49ff3e27cddbb86",
|
||||||
|
"75906931a0f9bd7220dc",
|
||||||
|
"75a6e93658bb32d4057e",
|
||||||
|
"75bce5742bdfb3969395",
|
||||||
|
"764715a32a1c5ba119c6",
|
||||||
|
"76ede2bc69434eed9593",
|
||||||
|
"7a39c6d9f1e5631fc2ce",
|
||||||
|
"7cb3572e158598dce28d",
|
||||||
|
"7d0f840d086c77a11be3",
|
||||||
|
"7d71e7dfb9c89e45d369",
|
||||||
|
"7da2820b2c042ed98403",
|
||||||
|
"7dd86ca1645c358c5473",
|
||||||
|
"7fefbde7eef0cb32860d",
|
||||||
|
"807411fec08f8d1bbb06",
|
||||||
|
"81127b0145e9373bc19b",
|
||||||
|
"8422a2b96fc68dc18bbd",
|
||||||
|
"84e4399e33d17437af05",
|
||||||
|
"852a84515cf2b87c7d8f",
|
||||||
|
"85c17f4431325a1eeb55",
|
||||||
|
"867856494bf46cb5731d",
|
||||||
|
"868c4f1149a07d14c29f",
|
||||||
|
"8787f884222e99c1117f",
|
||||||
|
"882db423c9009170c8ad",
|
||||||
|
"8941b66976efed07788f",
|
||||||
|
"895120c64299707314a3",
|
||||||
|
"8985ba93a5b0b2642e32",
|
||||||
|
"89b45ade5c76cddbe7ab",
|
||||||
|
"8afe1209d73bc7577baa",
|
||||||
|
"8c046b35358b44d32ed9",
|
||||||
|
"8c0675b66e058bba2ab2",
|
||||||
|
"8c334c4afb3afa6f08fa",
|
||||||
|
"8e295cd61eeeba98b60c",
|
||||||
|
"8e3dd865223c7aa5cf01",
|
||||||
|
"9195c18ad401ff5040f3",
|
||||||
|
"930dfac062948cafb8d4",
|
||||||
|
"9379a5cd15fc744b56b5",
|
||||||
|
"93dfe8f51b730118f8f3",
|
||||||
|
"93fbe31a61d591cca954",
|
||||||
|
"942cba00e39bc8c24b2a",
|
||||||
|
"953f09f9614cde47fc53",
|
||||||
|
"966eac1ed01626932631",
|
||||||
|
"96aadeb2f040c4da84a5",
|
||||||
|
"9833d7e826de1aee001e",
|
||||||
|
"990a98d22137308f662f",
|
||||||
|
"99c1119c6641b3cadb66",
|
||||||
|
"9a11978626ae77cf1e01",
|
||||||
|
"9b2f4a7313c52cf4b46a",
|
||||||
|
"9b9d4e8385b2177e050d",
|
||||||
|
"9bf50c84ab955b6faeb4",
|
||||||
|
"9c246763f9970db6c83d",
|
||||||
|
"9c8544050df636fda891",
|
||||||
|
"9c8afe03cc731ab22e52",
|
||||||
|
"9cbb7d33f915ddaa0cd4",
|
||||||
|
"9cbee8d3975d3f17bada",
|
||||||
|
"9e4ac177b0bce3e54dc3",
|
||||||
|
"9ea9662feacaf707e0d7",
|
||||||
|
"9eeba7ff8c656ccc5ff9",
|
||||||
|
"9f16b3457234f292e591",
|
||||||
|
"9f6855ff14faa668092b",
|
||||||
|
"9fff698f76ce390deee3",
|
||||||
|
"a09fbd795797d4780581",
|
||||||
|
"a0a93c51abe86c769b6c",
|
||||||
|
"a0dc9f574fefd6cfed34",
|
||||||
|
"a1bfe2bd52099e730fa4",
|
||||||
|
"a23357c241527dc9d73b",
|
||||||
|
"a3008a4c1ea8d5a7f471",
|
||||||
|
"a342fdb80e25ba33f41f",
|
||||||
|
"a370b3bb81c8fae07d78",
|
||||||
|
"a4441f4caf752a253853",
|
||||||
|
"a6734c40dc2e4f6f3abd",
|
||||||
|
"a71a559255d1a1cc1e0c",
|
||||||
|
"a7238df243a1e1d054ca",
|
||||||
|
"a82fcf639a7b5d9ccc80",
|
||||||
|
"a877b2b3782cbf03119c",
|
||||||
|
"a8a18d7b1f77a81cac4d",
|
||||||
|
"aab26c519689f94d8299",
|
||||||
|
"abd63ecc4c46d0c117f9",
|
||||||
|
"ac5669e28951bec3c836",
|
||||||
|
"ad8893021f6349eb0d0a",
|
||||||
|
"ae231bfdf6967d751421",
|
||||||
|
"ae3ee9f3e6c85a276f80",
|
||||||
|
"af46119c2615d493f7eb",
|
||||||
|
"af57c989b0371b75e631",
|
||||||
|
"b133d6391917293a077e",
|
||||||
|
"b1e89b1d28d31e5d3b5a",
|
||||||
|
"b20cee06c392baa507d5",
|
||||||
|
"b23b49af390e9c76e731",
|
||||||
|
"b242585085bd74d8dd6a",
|
||||||
|
"b39f89ce3757399e823b",
|
||||||
|
"b44a3b6ebc87e4420487",
|
||||||
|
"b44f2d90b67ab1dc6e8a",
|
||||||
|
"b4aa7863cbb63ce67cf0",
|
||||||
|
"b4d7638f023e3c2c516e",
|
||||||
|
"b59667f6f77f70ca1f12",
|
||||||
|
"b6a1f2c6292acaea994e",
|
||||||
|
"b77d91262bfebb8c0cdc",
|
||||||
|
"b98e551fdcf55e35b201",
|
||||||
|
"ba3e6cf1673462680a41",
|
||||||
|
"ba5bd4a7545d48476288",
|
||||||
|
"bb0345f6796e3502d174",
|
||||||
|
"bbeb9bc03c91bbc9b973",
|
||||||
|
"bc0c9e8530a9037af0a4",
|
||||||
|
"bd9e1a68ea30451c4236",
|
||||||
|
"bdffe2d073d6ebc98eeb",
|
||||||
|
"be75e5829e3577dcde6c",
|
||||||
|
"be77bdd82204294636ab",
|
||||||
|
"bea65225dda02b7e5ddd",
|
||||||
|
"beaedae396c5f2ec5422",
|
||||||
|
"befb0b1ab8abf6c8110b",
|
||||||
|
"c080889b7118496f130c",
|
||||||
|
"c0ea0b73203e76e55bd4",
|
||||||
|
"c120aac4897920301ed5",
|
||||||
|
"c313a88cc1c06aaa0fa3",
|
||||||
|
"c32ac0bd619204a09d9f",
|
||||||
|
"c3686003909f0401deee",
|
||||||
|
"c511c6bd4399cffe0a4e",
|
||||||
|
"c5230fe149db87e6413b",
|
||||||
|
"c5ba14ef7174efc532aa",
|
||||||
|
"c6284dee8d6bebef3e88",
|
||||||
|
"c6772224160aaa809213",
|
||||||
|
"c6e9971fb818cf66e0ca",
|
||||||
|
"c82a40dc7058bf4ff976",
|
||||||
|
"c835bb9e23d16b1672b6",
|
||||||
|
"c853a5ec612fa5f83baf",
|
||||||
|
"c860941bbc3ae42da1ec",
|
||||||
|
"c899f159f360c5a00aa5",
|
||||||
|
"c8cf8763ddf08da54a46",
|
||||||
|
"c91cc2251ebfc3fd42e6",
|
||||||
|
"c94abdaf37e7aa2a8259",
|
||||||
|
"ca5560087a7b6ec2338e",
|
||||||
|
"cb041b0d7cc0a5da97a6",
|
||||||
|
"cc91a3783e24ee935844",
|
||||||
|
"cd798efbb9849ed300ff",
|
||||||
|
"cdfd6e7d9f395f0a3cf4",
|
||||||
|
"d04138266fa695e9e3aa",
|
||||||
|
"d05e1263c6b63cadacdb",
|
||||||
|
"d2eb414d42d2b84679ad",
|
||||||
|
"d31690e85154dc9b3a32",
|
||||||
|
"d35ac8a452dc9f5c6c59",
|
||||||
|
"d4b4f8e418c0d285d183",
|
||||||
|
"d4bbdec8794ff9413cfb",
|
||||||
|
"d4c7e8e5244070cc85de",
|
||||||
|
"d5bb22435f95ee1c8144",
|
||||||
|
"d82e2b2c2968aed34dd4",
|
||||||
|
"d911a3843513c372c6bd",
|
||||||
|
"d99fa482032cbad9c8b2",
|
||||||
|
"d9ff12437fc4222b3c4e",
|
||||||
|
"da5bb8ee47f63796dc9d",
|
||||||
|
"da8e200bbb734c40c55c",
|
||||||
|
"dc5c897a86c84a75de30",
|
||||||
|
"dd6d9af68630cd49f592",
|
||||||
|
"dd910d1c5977fe92650d",
|
||||||
|
"de779be8cad2cb14d914",
|
||||||
|
"dea4a508f86cf619fe1b",
|
||||||
|
"e0845c6e01cb394a145e",
|
||||||
|
"e0c1e7df1d3452ac4b6d",
|
||||||
|
"e14273246247adacfbd9",
|
||||||
|
"e1c9b4bc0161cc93429d",
|
||||||
|
"e21e0258a09928903618",
|
||||||
|
"e235c90076eaebd255b3",
|
||||||
|
"e257afa56297a69f6599",
|
||||||
|
"e472fcba1eb459cc5351",
|
||||||
|
"e4c98931ba062d22c029",
|
||||||
|
"e5cf4190af5d183f674d",
|
||||||
|
"e6a2b801fc241b640bd9",
|
||||||
|
"e7679554205a27d14489",
|
||||||
|
"e79a9d05cd96563a6354",
|
||||||
|
"e79e64af963d3ca9ac57",
|
||||||
|
"e8e81129766bb46d639b",
|
||||||
|
"e9222cc7da300b3ce4a9",
|
||||||
|
"e98f74be79d2d9c85971",
|
||||||
|
"e9e9b6333c9c5586f71c",
|
||||||
|
"ea7138f5586005eb2e7b",
|
||||||
|
"eb50d59ca55b462b92b1",
|
||||||
|
"ec8bde81bb0646897006",
|
||||||
|
"ed3aee5ebbe3c07d7d8e",
|
||||||
|
"ededaf9e1df407272889",
|
||||||
|
"ee651b48b4637a398b26",
|
||||||
|
"ee84942b54d13d5f97dd",
|
||||||
|
"f055c459151e4eecc273",
|
||||||
|
"f1abac88648a8c306137",
|
||||||
|
"f25aef2d27019282846d",
|
||||||
|
"f2796295d90b79439260",
|
||||||
|
"f2b3737696d5e4254ec4",
|
||||||
|
"f3049037157bc616c2cb",
|
||||||
|
"f32ddefe51f6da76bb8d",
|
||||||
|
"f388d64b5afe17546204",
|
||||||
|
"f3909778ebc319ef0365",
|
||||||
|
"f3bb2f8fb5b4d7c37e1b",
|
||||||
|
"f3f457e60eef9dd0fbea",
|
||||||
|
"f415ae4fe5260c645b35",
|
||||||
|
"f5257bfb4aadb4833bd2",
|
||||||
|
"f66c09eac101ffde4a7f",
|
||||||
|
"f6bde12166ac4da9c73c",
|
||||||
|
"f6c38df87c100c00df2f",
|
||||||
|
"f6e126c1a7dc0257f6b9",
|
||||||
|
"f79f47ed01c427fe11ef",
|
||||||
|
"f84c3e859d0eb837cc1d",
|
||||||
|
"f85790e6f03955ae360e",
|
||||||
|
"f89b6f425bc8c8a23d83",
|
||||||
|
"f8facff9b4b09d7fae10",
|
||||||
|
"f979763651703649948a",
|
||||||
|
"fafb2c704342e41d5eda",
|
||||||
|
"fbc493629d5c604405d3",
|
||||||
|
"fc2a1d88a2a13bdf9d54",
|
||||||
|
"fde716a39603319e5e26"
|
||||||
|
],
|
||||||
|
"test_groups": [
|
||||||
|
"02000ebc391e13d1271b",
|
||||||
|
"03bed078c311eb856a1c",
|
||||||
|
"09ada7352b9dd8da8d42",
|
||||||
|
"09d50f740e87a02d6064",
|
||||||
|
"0bb712996aafa57f73c8",
|
||||||
|
"0ff833d8df034171bf46",
|
||||||
|
"10ac190aa42f43236baa",
|
||||||
|
"123aa244852830a141e7",
|
||||||
|
"1262098b15284562d361",
|
||||||
|
"14265c25d8e4404230da",
|
||||||
|
"16adda3d2b1ed0fd96a8",
|
||||||
|
"22314171964b13dbaf90",
|
||||||
|
"2405b208a39a2e87f92e",
|
||||||
|
"241b99b929249c77d920",
|
||||||
|
"260437dd491aa76c032a",
|
||||||
|
"26e43e80ffdb1c09a21a",
|
||||||
|
"28e4f0e13d2e0ff787be",
|
||||||
|
"2c75592e2250e088910b",
|
||||||
|
"2e8fb5205eaeb219e6ce",
|
||||||
|
"31d055e471ce655b24b1",
|
||||||
|
"34d5e08d5a667b637e35",
|
||||||
|
"39c80c93a9a02e632bc3",
|
||||||
|
"3be5310dddccc87e67cc",
|
||||||
|
"443d77a109bd929cb972",
|
||||||
|
"445f92f319941bc4b4b4",
|
||||||
|
"4674934e2a49c964df66",
|
||||||
|
"46cbc6f845226ac03420",
|
||||||
|
"470408a5fa9cabc43cb2",
|
||||||
|
"4aee26cad873f2ac3d7b",
|
||||||
|
"4fae42756d54cdf68230",
|
||||||
|
"510e31a611ebc1cdbc4f",
|
||||||
|
"588b7ee24a1ee3b3e93c",
|
||||||
|
"5bda104302dfc48459e0",
|
||||||
|
"66741543ff5e2bd233f7",
|
||||||
|
"6cc1c47acdf9f50ae7ea",
|
||||||
|
"6d8a4d5318e161cdffca",
|
||||||
|
"7ae9b481c8c70c9e0b4f",
|
||||||
|
"7d45acf96d837daf531d",
|
||||||
|
"801ee03a5d42e9430a67",
|
||||||
|
"81f1ccd804b817368af3",
|
||||||
|
"824378cc0619ae3ec6de",
|
||||||
|
"84920da57298060b8405",
|
||||||
|
"8569ad366a2034813ea6",
|
||||||
|
"88a6c1da308911c5b504",
|
||||||
|
"8a6285cb2fb15918b68e",
|
||||||
|
"8adeba074ad9666f61ab",
|
||||||
|
"8f46e5f47719e3eaca18",
|
||||||
|
"8ffbb1e251c2216ea87e",
|
||||||
|
"92676eb5a0be5c242eb8",
|
||||||
|
"93ea88c675008cd30187",
|
||||||
|
"9b84a2255330d4d8b229",
|
||||||
|
"9ee03df5bc8ce612b603",
|
||||||
|
"a3e2e1666a806e03456c",
|
||||||
|
"a73776fb55c3e03b6eed",
|
||||||
|
"a7bb4b2aa87eff88420c",
|
||||||
|
"ad225dd89d15c5cd1a67",
|
||||||
|
"add9ac9b0d9359f1fe79",
|
||||||
|
"b78c3a2827aff0d6b7aa",
|
||||||
|
"bd808fa49a2a441a8075",
|
||||||
|
"bf9f25c0d26f225506dc",
|
||||||
|
"c02e40993bcde239ae42",
|
||||||
|
"c231e43f1d4a8abc3f21",
|
||||||
|
"c2941ab6da65037eb5a2",
|
||||||
|
"c2e24af3eb4caae1ad96",
|
||||||
|
"cd018c970c3b9f11ce07",
|
||||||
|
"d7800334d22cb605cdb2",
|
||||||
|
"e19472c88f088e8fb85f",
|
||||||
|
"e491cd8b2ace998a455e",
|
||||||
|
"e752937f044f1e8a558a",
|
||||||
|
"e89bcf2966b89bfe1279",
|
||||||
|
"e9efbd24c8ca844688d5",
|
||||||
|
"ea8980864419ad5e24fb",
|
||||||
|
"edd78621b3a9fbd06687",
|
||||||
|
"efb4bfa512a47cfc9384",
|
||||||
|
"f07c1fddb4e712f86400",
|
||||||
|
"f1091f36d3f7c8eb10ec",
|
||||||
|
"f986770a1e1958595390",
|
||||||
|
"fc5129a02a76b4cf190d",
|
||||||
|
"ff1d0a969ad37a2e8d25",
|
||||||
|
"ff3f38f452813f3e0f5e"
|
||||||
|
],
|
||||||
|
"dev_categories": {
|
||||||
|
"shared_keyword_pair": 54,
|
||||||
|
"same_academic_year_pair": 100,
|
||||||
|
"same_start_year_pair": 60,
|
||||||
|
"person_title_year": 80,
|
||||||
|
"person_keyword_title": 80,
|
||||||
|
"document_author_category_multi_hop": 60,
|
||||||
|
"person_multiple_categories": 30,
|
||||||
|
"candidate_set_aggregation": 17,
|
||||||
|
"conjunctive_disambiguation": 20,
|
||||||
|
"negative_lookup": 8
|
||||||
|
},
|
||||||
|
"test_categories": {
|
||||||
|
"shared_keyword_pair": 8,
|
||||||
|
"same_academic_year_pair": 8,
|
||||||
|
"same_start_year_pair": 8,
|
||||||
|
"person_title_year": 8,
|
||||||
|
"person_keyword_title": 8,
|
||||||
|
"document_author_category_multi_hop": 8,
|
||||||
|
"person_multiple_categories": 8,
|
||||||
|
"candidate_set_aggregation": 8,
|
||||||
|
"conjunctive_disambiguation": 8,
|
||||||
|
"negative_lookup": 8
|
||||||
|
},
|
||||||
|
"source_corpus": {
|
||||||
|
"sha256": "440da12a7a991824e923f70cada7c616c3fb3b0f12767ec7d75039a6a3231b10",
|
||||||
|
"document_count": 114,
|
||||||
|
"documents": {
|
||||||
|
"pages/interns/bogdan_paul_chis/README.md": "3b4b946eb3c10e9f9a4092e6cffa01c5080e7579aded2f6ed3120c41ed62b647",
|
||||||
|
"pages/interns/cesar_gutierrez/README.md": "b0be60576eed28d4b1920e9acf198684519373dfc13171567247c853b3ed699e",
|
||||||
|
"pages/interns/oliver_pejic/README.md": "0470f3c8465be8f02204b08e4c75ef47f68c7e4ad1038faa5641cdf1811f33d5",
|
||||||
|
"pages/interns/sevval_bulburu/README.md": "ff2a9d66253802f1af0fdfd74832e40fae41b6df23c5e61dc266f6cd0cc16c4d",
|
||||||
|
"pages/interns/yussef_ressaissi/README.md": "f997a65699da0db3222ef7a3c37652d05dfc3419ad4ec74683bafc2c897bb987",
|
||||||
|
"pages/students/2016/darius_lindvai/README.md": "fcaa47bb9708a6439eec5c4b7f7b4ed6c7359e423e1d940e1aed9f44957e6d62",
|
||||||
|
"pages/students/2016/darius_lindvai/dp2021/README.md": "be3d0fea2a6d592b225eecabd9b19445c2fce62b8289c07ab6af93835db12970",
|
||||||
|
"pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md": "352162de1b1e192228fa5d26506c028ac47e567e90df53b1bbaa6ad736ec4766",
|
||||||
|
"pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md": "b4a81ff457624b089d618e4479afb1e3d748f6724f72104ef5518e535ae02fe5",
|
||||||
|
"pages/students/2016/dominik_nagy/README.md": "1c4037a158d84c45fa705a0c38e47142a9d46e226f0c138bc2d56d7c38f6d74d",
|
||||||
|
"pages/students/2016/dominik_nagy/timovy_projekt/README.md": "b81a4dab7316f7b846dcf36515f6aa9d44035c86f46f0e07b7a43308bcd31458",
|
||||||
|
"pages/students/2016/ediz_morochovic/README.md": "045e5eb9a3df2b84140808fbca0c3163266ad0efa144bc42d9d5c597881c6ac6",
|
||||||
|
"pages/students/2016/jakub_maruniak/README.md": "6734c41a95b9d0c1e3d226b393ad109ee4a7b82ebfffa73df2d7e0a743fefa14",
|
||||||
|
"pages/students/2016/jakub_maruniak/dp2021/README.md": "9cd884aec70705cdb2aaa0f514b513f16de263c37b749ced7f92916cd2f91c39",
|
||||||
|
"pages/students/2016/jakub_maruniak/dp2021/annotation/README.md": "debae0c50aea1accef0840912b9b1f37b2138f856002bb50e91d7ea2dbbe7963",
|
||||||
|
"pages/students/2016/jakub_maruniak/dp2021/train_experiments/README.md": "01dff38b37043414fa1db204394ddbe7aade00e14d02d495572b65c85d09b194",
|
||||||
|
"pages/students/2016/jakub_maruniak/timovy_projekt/README.md": "04114b1f3d84664aad5bdba5a0b614c5a6f23392be3c31fd9123d63db1be0a35",
|
||||||
|
"pages/students/2016/jan_holp/README.md": "80d6a8492766e5bfa61673a372e5f059d30c8e335de39842866c51485960e4d3",
|
||||||
|
"pages/students/2016/jan_holp/dp2021/README.md": "a62acb74009376766c7e2f9856ee01d21f84593eb9b3ce85cf2e6032aa412476",
|
||||||
|
"pages/students/2016/jan_holp/dp2021/zdrojove_subory/README.md": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||||
|
"pages/students/2016/jan_holp/timovy_projekt/README.md": "79eebdfd3af7e8d5c279077e285a580731b1cf8cc9b4454f6596796e9915f70c",
|
||||||
|
"pages/students/2016/lukas_pokryvka/README.md": "f279456c5c277ff1ee0dd89a3464ed9f9f67b44bc185a5da9811ef5cfb675002",
|
||||||
|
"pages/students/2016/lukas_pokryvka/dp2021/README.md": "39b61376ce108e4a930f926ab2d6a997207457121bccfcf617129a3b210a15cf",
|
||||||
|
"pages/students/2016/lukas_pokryvka/timovy_projekt/README.md": "4de4b6c8cfed17b6c60090f82df1d55a66be70a79d3013850689b2baebdd801b",
|
||||||
|
"pages/students/2016/mark_feher/README.md": "bec37c0319fe0869a0377d771db23d090dbda93c27328f5697cdaeb3bbccfe9b",
|
||||||
|
"pages/students/2016/maros_harahus/README.md": "0da150e91918632c9e8cd1443f04da403595a372517e254928ce9f76c9d5033d",
|
||||||
|
"pages/students/2016/maros_harahus/timovy_projekt/README.md": "75af19f7c68f4b646fa1dbae75f3f3dfc52633a9f9da1400d21808bb20be0d83",
|
||||||
|
"pages/students/2016/patrik_pavlisin/README.md": "dc1c648d7cd9b0f0e021c57f9b98189e37c100871439e7e304390715913f2763",
|
||||||
|
"pages/students/2016/patrik_pavlisin/dp21/README.md": "ac1eb0fd0360ad34aa21b7c8da5bb010a6edf10be5721f28dedc3986cd1d8c54",
|
||||||
|
"pages/students/2016/patrik_pavlisin/dp22/README.md": "f2a8c619a812b99abab618ae388eb672407950e1f33fb8d7da7a528c4de81d50",
|
||||||
|
"pages/students/2016/patrik_pavlisin/tp20/README.md": "ae9c771f27e7e093bc29c6888c8d0b27ed61fb41519fd0d7e7f4f6cbb4626edc",
|
||||||
|
"pages/students/2016/tomas_kucharik/README.md": "6a1a215433eb1857660177b4cb2ecec03c6a86743d3a04cd6d5c9d9682c9e63b",
|
||||||
|
"pages/students/2017/dmytro_ushatenko/README.md": "65f4ac177d492162b08ca5da3d9eb048bd088a3c117a28a662113b7e4bc3a4ec",
|
||||||
|
"pages/students/2017/martin_jancura/README.md": "6a0a18d5095dcfb12abfdd72c9cfd8025d714fb5e29a7858cd2b285e4cb986b9",
|
||||||
|
"pages/students/2017/stanislav_matsunych/README.md": "90ffa11eff4a4360b0252dbc53a116c3a5777b3d5dd86ce5c89c02bdd2051c73",
|
||||||
|
"pages/students/2017/than_trung_thanh/README.md": "2150519b8580e7337520db4de64d2d1c82d2634380537d019f41c506dbf2979d",
|
||||||
|
"pages/students/2018/NaN1name_buday/README.md": "23c8c58090bdc954347e36f141bea91f43c8d5b1d777e346864a2ebe84c0bcce",
|
||||||
|
"pages/students/2018/adrian_remias/README.md": "e5bfe1d5d4e626beaa636a02d34ec58cf2cff9b0e57833905af35b80bf1465a2",
|
||||||
|
"pages/students/2018/david_ilas/README.md": "96c45ff9c5a821ddcb1a2fc86d487bd8f4729d1b76887914b0f5fbf99af45af0",
|
||||||
|
"pages/students/2018/david_omasta/README.md": "4164051870e1e1cf8949ed18a74196e9ea789dfbe4fee24bdeb736ca42848327",
|
||||||
|
"pages/students/2018/martin_wencel/README.md": "0e6a7a981689f22304f8baa5de97d4315c0695c94c9277de7851943eb012253b",
|
||||||
|
"pages/students/2018/oleh_bilykh/README.md": "4072c62dd8ee753a0c8fa43fdfbbdf566e394c2df13e6a79d08a302e332710b1",
|
||||||
|
"pages/students/2018/ondrej_megela/README.md": "969ff2e1a436b8f957e7168cf5eb678196b99aeda17701c502b016441f644065",
|
||||||
|
"pages/students/2018/samuel_sirotnik/README.md": "cc230ede67b6e8632511c92a5ed6d1e9deb42e70819280222bdfd369ee77fc70",
|
||||||
|
"pages/students/2019/alina_vitko/README.md": "9b071fe2aff470c275ae027be236fe836f741f774cabb9cbbb55304a8d5102cd",
|
||||||
|
"pages/students/2019/artem_yatsenko/README.md": "328b101e46c51c959e792cf7ca226942f81d2ab8fe9648ad6d0ecd07016429e2",
|
||||||
|
"pages/students/2019/david_stromp/README.md": "e46ca8691d5ec894128f6f6f2ed33e2c7bd141f80719bb0449b20f10f30cca09",
|
||||||
|
"pages/students/2019/dmytro_mural/README.md": "e881a47d847c3ef8d680844113fdbfbb87553b28982bf9eef4936f6d30923e93",
|
||||||
|
"pages/students/2019/filip_tomas/README.md": "75a1fe7b921e4bff0fdf9e2a957b4adad4b4a57aa7ebdffbb73dd82c02123f94",
|
||||||
|
"pages/students/2019/kristian_sopkovic/README.md": "3286960fb30f584df35455f9b6dfae81ca4827a1d711d2bcd6e48c3f150c9279",
|
||||||
|
"pages/students/2019/michal_stromko/README.md": "3ae1dd9b6638a6a249a94be3f3846286555666aefa225bb3a2c7288b35900ce7",
|
||||||
|
"pages/students/2019/michal_stromko/vp2021/README.md": "feb2e093fdd6461239e79b1e1f96e65a1c8cd96e8a2b70535ae556a9c198046a",
|
||||||
|
"pages/students/2019/michal_stromko/vp2021/tutorials/README.md": "40e3fa448c7329ef863e705435e23fe6b4788de440710f066fe0eed92d132bad",
|
||||||
|
"pages/students/2019/michal_stromko/vp2021/tutorials/img/README.md": "e8d3ac160b17dfdee2c3e996bf6a03af7a6f16f9140bf5cf7ee343a82dd1865f",
|
||||||
|
"pages/students/2019/patrik_pokrivcak/README.md": "3e3957ad0f7aca59d6eb64c38a3f5e21d8fd953200825d0d0e5cacabfbc35a7d",
|
||||||
|
"pages/students/2019/samuel_horani/README.md": "86e6959ccc612b069687b57996fa3f61660075d6a0d65bfec64f423d39a0a999",
|
||||||
|
"pages/students/2020/david_kostilnik/README.md": "2927524b75da59a64120fc364a0fc374986fa4d364d54e52c36800762c203264",
|
||||||
|
"pages/students/2020/jakub_kristian_lukas/README.md": "f139d9b1ebf5a3f45612f3df5703ecdd935b90701763c27c7c529044c0b0455a",
|
||||||
|
"pages/students/2020/kamil_tomcufcik/README.md": "9d865adf538bc6d7992ee4f4882713447da5c936fca17c43ca0f576072537048",
|
||||||
|
"pages/students/2020/matej_kobylan/README.md": "3d7b289e17b8f25678a07e9ee0e6741688485a0ccb1e50940a6a6acc6312a547",
|
||||||
|
"pages/students/2020/matus_suchanic/README.md": "770ca49538cca22df35f8e7ba736ee97483e4fe5788c221496553592b4e78dc6",
|
||||||
|
"pages/students/2020/pavol_hudak/README.md": "33d06fccc6451e5f19b27b0cad001a34e81635b4ea294a01dec7771c823abc40",
|
||||||
|
"pages/students/2020/vladyslav_krupko/README.md": "4c28e6d38651bb2cafcbf4a18e35210cd369aef2caff6c5b0aa52fac38f0fe7d",
|
||||||
|
"pages/students/2021/artur_hyrenko/README.md": "0568261f4ade4de5472edcfeb1ffed9abae18dc67e4050f4ce2ad088839a2bb3",
|
||||||
|
"pages/students/2021/eduard_matovka/README.md": "de2a7ae38ec87110e347956b37d0605a298ed2847f972961cc9b977da8221d43",
|
||||||
|
"pages/students/2021/manohar_gowdru_shridharu/README.md": "c00ceb620ed7087ead5d9448d476bbb98d273d1d9e7bf1bc4355c367b26c7a6b",
|
||||||
|
"pages/students/2021/martin_sarissky/README.md": "8e97b45a253745faa55f63c844e0b5dfe680aeaf6eb01fb8f9d06ac6e8ee8bcf",
|
||||||
|
"pages/students/2021/matej_novotny/README.md": "b083a7cadde532e3428dc9a57bc61456fcc5905bda91e011b96033d42bf5d9cb",
|
||||||
|
"pages/students/2021/matej_scislak/README.md": "b9a32cce8605e044a4f2828ff2d91a2995a62ef3a841e62f0a225c97221f0cc8",
|
||||||
|
"pages/students/2021/nikita_bodnar/README.md": "2016c0dd923c0f8e561d5cea42ac81da3610fdcc54a4527f56d078e34e53ce90",
|
||||||
|
"pages/students/2021/oleksandr_hryshchenko/README.md": "4b073992b715b6c75b79fd2c8f850a69f940966e3a61a82c625c32c945a93036",
|
||||||
|
"pages/students/2021/vladimir_ferko/README.md": "68e7d311896eda2171e5eec1ec3a8da90d326ed91acaace8058f68664a50d271",
|
||||||
|
"pages/students/2022/andrii_pervashov/README.md": "319dcaa1cc2e29dd7e3a710bab26cb3ac6944ab71b0b97e1de076b1199122334",
|
||||||
|
"pages/students/2022/daniil_huzenko/README.md": "390782fbff6220a9462060ce1a62959f2a2b88f42d06e2c51d1f406b75d73f2c",
|
||||||
|
"pages/students/2022/jakub_schwarc/README.md": "f541a8852c2b0f6f9d7182e01a34c4e3beee9bfa55427a06b331638b11eb8be6",
|
||||||
|
"pages/students/2022/jan_malinovsky/README.md": "8af021bfb131fa005a7aec3e2f2f12fc17fa5dc14e2675311adbbfc445a4bcab",
|
||||||
|
"pages/students/2022/jan_ptak/README.md": "131cf053764fd5423541ebe672c3b4f5da875cfb8e4b821f1335ddb967282282",
|
||||||
|
"pages/students/2022/oleh_poiasnik/README.md": "c2f7dc3f61f8b4a5b43ded1e3ae4c7d3e7f874439ee6b17dd9c8d45dabc25bc8",
|
||||||
|
"pages/students/2022/samuel_vasil/README.md": "67c807049147aacd04f3050f4ff0233a8b3f0a239ab173b430e13dfe113ad0a5",
|
||||||
|
"pages/students/2022/serhii_yemets/README.md": "ffbeac893947acafe855d576322a8826f9d4f87ac344cb31f8ceeefa244b9133",
|
||||||
|
"pages/students/2022/tetiana_mohorian/README.md": "c9efdc632bf1ca89a0bfde0dc00be7aaac8a85da3d92e2ce8506236c73e93cfb",
|
||||||
|
"pages/students/2022/valerii_kutsenko/README.md": "dc764c609ad3c1df59cfea997d4db82a591b1b1e0764453e319d841115507e4f",
|
||||||
|
"pages/students/2022/vladyslav_yanchenko/README.md": "4d1ce216e3b526ee437ddbc658e51d7bb83530087e43628c096a569a3854a47f",
|
||||||
|
"pages/students/2022/yevhenii_leonov/README.md": "b90e41db0cec2451027020a9102d32a24d777e8a38b604ccca87b36cd6b3a292",
|
||||||
|
"pages/students/2023/denis_le_thanh/README.md": "2cb83f942d86a02712b0c58778e46dc2211346d1a6eba606471dfa832245db61",
|
||||||
|
"pages/students/2023/maksym_zatirka/README.md": "7a7d2cbe276c352dacfbc6ba6de5f15303d30ecf34845ff8da8d085f3d67c3dd",
|
||||||
|
"pages/students/2023/oleksandr_dorybohov/README.md": "c24d6f941de0dafb4459cea8259cf147821cafc86ba65be5b528f419f734bc18",
|
||||||
|
"pages/students/2023/ronald_zalacko/README.md": "724b0f8e6e641236dba9bddbd77f4546e09514076c7dfb151807aaf4b882c96f",
|
||||||
|
"pages/students/2023/rostyslav_rodzhuk/README.md": "de356dd7427c8a0716c165a0f88ae47b691a86ee7a388f60e2d2e9306298415c",
|
||||||
|
"pages/students/2023/samuel_dzurina/README.md": "4818191d044b91219c796a35010c95da5cf2093e050d494f30b219b91e13fa0e",
|
||||||
|
"pages/students/2023/simona_bobrovcanova/README.md": "e473a1911dae10ab40e2cf6696a8be616a58c22aaf09af5953fbac475791a35e",
|
||||||
|
"pages/students/2023/yevhenii_medushivskyi/README.md": "5710ebf91c893a12fe6d19f5372311938d1e7c7bbdf203f2dc8ed2fe7c4f5a24",
|
||||||
|
"pages/topics/akopisat/README.md": "c7245e1fbfa4160618502c0baf8cc6bc47cd9a82b8a85bc1c645314829a7b76a",
|
||||||
|
"pages/topics/bert/README.md": "35e507f7ec2ad1d3526e2a15f94ea085ee25f680a02daf6df62fd429bd9c25c9",
|
||||||
|
"pages/topics/chatbot/README.md": "6f2f83ffb80109be47f9750cca9d3036ec3645abef9f2b590bd6825780c7c48a",
|
||||||
|
"pages/topics/faq/README.md": "15cfbd9c2a1649c80a7a58922e2b66dadab5c86a5ef33ef16c82bebd4d2dbf06",
|
||||||
|
"pages/topics/hatespeech/README.md": "364df94e70dd740c63544e2586ba7b957780f714fc0c941d1b04b02233e6cbc5",
|
||||||
|
"pages/topics/legal/README.md": "003bb9bfe1e0ca21652091c2d11496312eb04e0689fe459e14c2d5a738e8eeea",
|
||||||
|
"pages/topics/morphology/README.md": "e242cc5ff1a4cc98e227566c0ead999bbc95937b7c20be62cb2afb773d0d35c0",
|
||||||
|
"pages/topics/named-entity/README.md": "66b2e25f70211d432d596e377d552b3b8f0c525b14c31e3bc9c956c3aeadca84",
|
||||||
|
"pages/topics/named-entity/navod/README.md": "1ff87079a98411de0414754c60241e08d2214ddcd63ddf974e4340cce2ce5b02",
|
||||||
|
"pages/topics/nlp/README.md": "6f90abf9dc3f0ff33475283c13b4a08561abf631425ec2daacb076155a9e02c2",
|
||||||
|
"pages/topics/otvorene/README.md": "cd5544925553fe3840c0ea6f8ef60ab756e26ab6757bf810025c948d8d4f98fc",
|
||||||
|
"pages/topics/prodigy/README.md": "5e4f691f2754c2ec4afbaab2f41e6db77feb5b322dd9344465eb40c35f116499",
|
||||||
|
"pages/topics/python/README.md": "2ef073adba672142c39e9a59fa2e00a98ab52bda54233d46fbe6940ee23f9fcc",
|
||||||
|
"pages/topics/question/README.md": "408078a2a67cea2699e12359e85ab641136231e6104c2afdf874a705879525df",
|
||||||
|
"pages/topics/question/navod/README.md": "061e737c69184b2bd244316ca7ba841f7186fe01ee80ee993742a733dcad3ecd",
|
||||||
|
"pages/topics/question/nezodpovedatelne/README.md": "b6703d9690f4599b973efb27595ce157773ae0fc0d55cf2c0a09d9f50e8e4c92",
|
||||||
|
"pages/topics/question/validacie/README.md": "3216a7127abdfc6da50ed116f44ff2d6785e7da4af70d23aceda774e745ad562",
|
||||||
|
"pages/topics/resources/README.md": "09405397387f00cbcc5680f7d655f2d861e4d92e5df792a62d9dfd04f3534f48",
|
||||||
|
"pages/topics/seq2seq/README.md": "969d15c03a63a3f8d5edc9017fe5a0fb7311fdf4de4a3473a08266241f92c1e2",
|
||||||
|
"pages/topics/spacy/README.md": "f504e5db77cb8694f08a57fb8636e522d59a0e669216f4bc8273bc3c5f375f87",
|
||||||
|
"pages/topics/steel/README.md": "b4068cef2ed197711467ac47630d5b2064fdc8828f898f7af99664e94d833330",
|
||||||
|
"pages/topics/translation/README.md": "a7d4289e72199b307dc5ad8fc69cda39c1a33c27a6c7447af70aa9c3cc6b8635"
|
||||||
|
}
|
||||||
|
},
|
||||||
|
"dataset_sha256": "fd9835adee93cacf2c45806dfe93463c2e9a58ccedb5f073876ad176039ad734",
|
||||||
|
"limitations": [
|
||||||
|
"Same source corpus and shared tag/category/author vocabulary.",
|
||||||
|
"Template families are known; TEST persons and their fact groups are withheld.",
|
||||||
|
"Oracle is independent of graph extraction but still rule-based; provenance permits human review."
|
||||||
|
]
|
||||||
|
}
|
||||||
4265
tools/graphrag/evaluation/results/v2_preparation/source_audit.json
Normal file
4265
tools/graphrag/evaluation/results/v2_preparation/source_audit.json
Normal file
File diff suppressed because it is too large
Load Diff
247
tools/graphrag/evaluation/source_oracle.py
Normal file
247
tools/graphrag/evaluation/source_oracle.py
Normal file
@ -0,0 +1,247 @@
|
|||||||
|
"""Independent benchmark oracle over original Markdown, not the GraphRAG parser.
|
||||||
|
|
||||||
|
Frontmatter defines tags/categories/document authors. Academic year comes from an
|
||||||
|
explicit academic heading, with a matching category used only as a fallback.
|
||||||
|
Every extracted value records the original file and source lines. No graph
|
||||||
|
payload, chunk JSON or retrieval result is used to construct this oracle.
|
||||||
|
"""
|
||||||
|
from __future__ import annotations
|
||||||
|
|
||||||
|
import hashlib
|
||||||
|
import json
|
||||||
|
import re
|
||||||
|
import unicodedata
|
||||||
|
from pathlib import Path
|
||||||
|
from typing import Any
|
||||||
|
|
||||||
|
import frontmatter
|
||||||
|
|
||||||
|
ROOT = Path(__file__).resolve().parents[3]
|
||||||
|
DEFAULT_WIKI = ROOT.parent / 'zpwiki'
|
||||||
|
|
||||||
|
|
||||||
|
def norm(value: Any) -> str:
|
||||||
|
value = unicodedata.normalize('NFKD', str(value or ''))
|
||||||
|
value = ''.join(c for c in value if not unicodedata.combining(c))
|
||||||
|
return ' '.join(re.findall(r'[a-z0-9]+', value.casefold()))
|
||||||
|
|
||||||
|
|
||||||
|
def clean(value: str) -> str:
|
||||||
|
value = re.sub(r'\[([^\]]+)\]\([^)]*\)', r'\1', value)
|
||||||
|
return re.sub(r'[*_`#]', '', value).strip()
|
||||||
|
|
||||||
|
|
||||||
|
def values(value: Any) -> list[str]:
|
||||||
|
if value is None:
|
||||||
|
return []
|
||||||
|
if isinstance(value, str):
|
||||||
|
return [value.strip()] if value.strip() else []
|
||||||
|
return [str(item).strip() for item in value if str(item).strip()]
|
||||||
|
|
||||||
|
|
||||||
|
def profile_path(path: str) -> str | None:
|
||||||
|
match = re.match(r'^(pages/students/\d{4}/[^/]+|pages/interns/[^/]+)/', path)
|
||||||
|
return match.group(1) + '/README.md' if match else None
|
||||||
|
|
||||||
|
|
||||||
|
def source_url(path: str) -> str:
|
||||||
|
return 'https://zp.kemt.fei.tuke.sk/' + path.removeprefix('pages/').removesuffix('/README.md')
|
||||||
|
|
||||||
|
|
||||||
|
def category_type(category: str) -> tuple[str | None, int | None]:
|
||||||
|
match = re.fullmatch(r'(bp|dp|phd|tp|vp)(20\d{2})', norm(category).replace(' ', ''))
|
||||||
|
if not match:
|
||||||
|
return None, None
|
||||||
|
return {'bp': 'bachelor_thesis', 'dp': 'diploma_thesis', 'phd': 'doctoral_thesis',
|
||||||
|
'tp': 'team_project', 'vp': 'research_project'}[match[1]], int(match[2])
|
||||||
|
|
||||||
|
|
||||||
|
def academic_type(heading: str) -> str | None:
|
||||||
|
text = norm(heading)
|
||||||
|
for prefix, kind in [('bakalarska praca', 'bachelor_thesis'),
|
||||||
|
('diplomova praca', 'diploma_thesis'),
|
||||||
|
('dizertacna praca', 'doctoral_thesis'),
|
||||||
|
('diplomovy projekt', 'diploma_project'),
|
||||||
|
('timovy projekt', 'team_project'),
|
||||||
|
('vyskumny projekt', 'research_project'),
|
||||||
|
('vedecky projekt', 'research_project')]:
|
||||||
|
if text.startswith(prefix):
|
||||||
|
return kind
|
||||||
|
return None
|
||||||
|
|
||||||
|
|
||||||
|
def acceptable_title(value: str) -> bool:
|
||||||
|
text = norm(value)
|
||||||
|
if not (len(value) >= 10 and len(value) <= 350 and len(text.split()) >= 2):
|
||||||
|
return False
|
||||||
|
if value.endswith(':') or re.match(r'^(?:https?://|[-*+] |\d+[.)] )', value):
|
||||||
|
return False
|
||||||
|
return not any(text.startswith(prefix) for prefix in [
|
||||||
|
'stretnutie', 'stav', 'ciel', 'ulohy', 'uloha', 'zadanie', 'navrh na zadanie',
|
||||||
|
'navrh na zadamie', 'poznamka', 'praca uspesne', 'projekt uspesne', 'projekt zakoncen',
|
||||||
|
'bakalarska praca na crzp', 'git repozitar', 'zdrojove texty', 'praca na crzp',
|
||||||
|
'rok zaciatku', 'zaciatok studia', 'meno veduceho', 'veduci', 'crzp',
|
||||||
|
])
|
||||||
|
|
||||||
|
|
||||||
|
def title_candidates(lines: list[str], offset: int = 0) -> list[dict]:
|
||||||
|
found = []
|
||||||
|
for index, raw in enumerate(lines):
|
||||||
|
line = clean(raw)
|
||||||
|
if ':' not in line:
|
||||||
|
continue
|
||||||
|
label, inline = line.split(':', 1)
|
||||||
|
key = norm(label)
|
||||||
|
if not (key in {'nazov', 'nazov prace', 'nazov bakalarskej prace', 'nazov diplomovej prace',
|
||||||
|
'predbezny nazov', 'tema', 'navrh na temu'} or key.startswith('navrh na nazov')):
|
||||||
|
continue
|
||||||
|
value = inline.strip()
|
||||||
|
value_index = index
|
||||||
|
if not value:
|
||||||
|
for next_index in range(index + 1, min(index + 7, len(lines))):
|
||||||
|
if lines[next_index].strip():
|
||||||
|
value = clean(lines[next_index]); value_index = next_index; break
|
||||||
|
if acceptable_title(value):
|
||||||
|
found.append({'title': value, 'line': offset + value_index + 1,
|
||||||
|
'label': key, 'label_line': offset + index + 1,
|
||||||
|
'priority': 0 if key.startswith('nazov') else 1 if key.startswith('navrh na nazov') else 2})
|
||||||
|
return sorted(found, key=lambda row: (row['priority'], row['line']))
|
||||||
|
|
||||||
|
|
||||||
|
def extract_academics(document: dict) -> list[dict]:
|
||||||
|
lines = document['body_lines']; offset = document['body_offset']
|
||||||
|
headings = []
|
||||||
|
for index, line in enumerate(lines):
|
||||||
|
if re.match(r'^\s*#{1,6}\s+', line):
|
||||||
|
kind = academic_type(clean(line))
|
||||||
|
if kind:
|
||||||
|
headings.append((index, kind, clean(line)))
|
||||||
|
records = []
|
||||||
|
root_end = headings[0][0] if headings else len(lines)
|
||||||
|
root_candidates = title_candidates(lines[:root_end], offset)
|
||||||
|
cat_years: dict[str, set[int]] = {}
|
||||||
|
for cat in document['categories']:
|
||||||
|
kind, year = category_type(cat)
|
||||||
|
if kind and year:
|
||||||
|
cat_years.setdefault(kind, set()).add(year)
|
||||||
|
for pos, (index, kind, heading) in enumerate(headings):
|
||||||
|
end = headings[pos + 1][0] if pos + 1 < len(headings) else len(lines)
|
||||||
|
section = lines[index + 1:end]
|
||||||
|
# Academic headings can contain a range, e.g. 2023/24. Prefer the
|
||||||
|
# matching category year within that range; otherwise use its end.
|
||||||
|
heading_years = [int(value) for value in re.findall(r'\b20\d{2}\b', heading)]
|
||||||
|
for match in re.finditer(r'\b(20\d{2})\s*[/–-]\s*(\d{2})(?!\d)', heading):
|
||||||
|
heading_years.append(int(match[1]) // 100 * 100 + int(match[2]))
|
||||||
|
matching_years = set(heading_years) & cat_years.get(kind, set())
|
||||||
|
year = (max(matching_years) if matching_years else max(heading_years)) if heading_years else (
|
||||||
|
next(iter(cat_years[kind])) if len(cat_years.get(kind, [])) == 1 else None)
|
||||||
|
candidates = title_candidates(section, offset + index + 1)
|
||||||
|
chosen = candidates[0] if candidates else None
|
||||||
|
# A root title explicitly marked BP/DP belongs to the matching thesis.
|
||||||
|
if not chosen:
|
||||||
|
matching_root = [row for row in root_candidates
|
||||||
|
if (' dp' in row['label'] or 'diplom' in row['label']) and kind == 'diploma_thesis'
|
||||||
|
or (' bp' in row['label'] or 'bakalar' in row['label']) and kind == 'bachelor_thesis']
|
||||||
|
if matching_root:
|
||||||
|
chosen = matching_root[0]
|
||||||
|
if not chosen:
|
||||||
|
# A short leading plain paragraph before assignment lists is a title;
|
||||||
|
# task/status labels, links and prose after a task boundary are not.
|
||||||
|
for n, raw in enumerate(section[:15]):
|
||||||
|
text = clean(raw)
|
||||||
|
if not text:
|
||||||
|
continue
|
||||||
|
if re.match(r'^\s*#{1,6}\s+', raw) or re.match(r'^\s*\d+[.)]\s+', raw):
|
||||||
|
break
|
||||||
|
if re.match(r'^\s*[-*+]\s+', raw):
|
||||||
|
if '](' in raw:
|
||||||
|
continue
|
||||||
|
break
|
||||||
|
if any(norm(text).startswith(word) for word in ['zadanie', 'ciel', 'ulohy', 'navrh na zadanie', 'navrh na zadamie', 'stretnutie']):
|
||||||
|
break
|
||||||
|
if raw.strip().startswith(('http', '[')) or not acceptable_title(text):
|
||||||
|
continue
|
||||||
|
chosen = {'title': text, 'line': offset + index + n + 2, 'label': 'leading_title'}
|
||||||
|
break
|
||||||
|
records.append({'academic_kind': 'Thesis' if kind.endswith('_thesis') else 'Work',
|
||||||
|
'academic_type': kind, 'year': year, 'title': chosen['title'] if chosen else None,
|
||||||
|
'document_path': document['path'], 'heading': heading,
|
||||||
|
'heading_line': offset + index + 1,
|
||||||
|
'title_line': chosen['line'] if chosen else None,
|
||||||
|
'year_basis': 'heading' if heading_years else 'frontmatter_category'})
|
||||||
|
# Standalone root titles occur in profiles without an academic heading.
|
||||||
|
# Use an explicit type label, or one unambiguous latest thesis category.
|
||||||
|
if root_candidates:
|
||||||
|
latest = sorted((year, kind) for kind, years in cat_years.items()
|
||||||
|
if kind.endswith('_thesis') for year in years)
|
||||||
|
if latest:
|
||||||
|
year, kind = latest[-1]
|
||||||
|
candidates = [row for row in root_candidates
|
||||||
|
if (' dp' not in row['label'] and 'diplom' not in row['label'] or kind == 'diploma_thesis')
|
||||||
|
and (' bp' not in row['label'] and 'bakalar' not in row['label'] or kind == 'bachelor_thesis')]
|
||||||
|
if candidates:
|
||||||
|
existing = next((r for r in records if r['academic_type'] == kind and r['year'] == year), None)
|
||||||
|
chosen = candidates[0]
|
||||||
|
if existing and not existing['title']:
|
||||||
|
existing.update(title=chosen['title'], title_line=chosen['line'])
|
||||||
|
elif existing is None:
|
||||||
|
records.append({'academic_kind': 'Thesis', 'academic_type': kind, 'year': year,
|
||||||
|
'title': chosen['title'], 'document_path': document['path'],
|
||||||
|
'heading': None, 'heading_line': None, 'title_line': chosen['line'],
|
||||||
|
'year_basis': 'frontmatter_category'})
|
||||||
|
return records
|
||||||
|
|
||||||
|
|
||||||
|
def load_source_oracle(wiki_root: Path = DEFAULT_WIKI) -> dict:
|
||||||
|
documents = {}
|
||||||
|
corpus_hashes = {}
|
||||||
|
for file in sorted((wiki_root / 'pages').rglob('README.md')):
|
||||||
|
raw = file.read_text(encoding='utf-8'); path = file.relative_to(wiki_root).as_posix()
|
||||||
|
corpus_hashes[path] = hashlib.sha256(file.read_bytes()).hexdigest()
|
||||||
|
page = frontmatter.loads(raw); taxonomy = page.get('taxonomy') or {}
|
||||||
|
raw_lines = raw.splitlines(); body_offset = 0
|
||||||
|
if raw_lines and raw_lines[0].strip() == '---':
|
||||||
|
body_offset = next((index + 1 for index in range(1, len(raw_lines)) if raw_lines[index].strip() == '---'), 0)
|
||||||
|
documents[path] = {'path': path, 'title': str(page.get('title') or '').strip(),
|
||||||
|
'tags': values(taxonomy.get('tag')), 'categories': values(taxonomy.get('category')),
|
||||||
|
'author': str(taxonomy.get('author') or page.get('author') or '').strip() or None,
|
||||||
|
'body_lines': raw_lines[body_offset:], 'body_offset': body_offset,
|
||||||
|
'sha256': corpus_hashes[path], 'source_url': source_url(path),
|
||||||
|
'raw_text': raw}
|
||||||
|
people = {}
|
||||||
|
for path, document in documents.items():
|
||||||
|
if profile_path(path) != path or not document['title']:
|
||||||
|
continue
|
||||||
|
family = [doc for child, doc in documents.items() if profile_path(child) == path]
|
||||||
|
start = re.search(r'(?:rok\s+)?zaciat\w*\s+studi\w*\s*:?\s*(20\d{2})', norm('\n'.join(document['body_lines'])))
|
||||||
|
if not start:
|
||||||
|
start = re.search(r'beginning of the study\s*(20\d{2})', norm('\n'.join(document['body_lines'])))
|
||||||
|
people[document['title']] = {'person': document['title'], 'profile': path, 'documents': [d['path'] for d in family],
|
||||||
|
'tags': sorted({tag for d in family for tag in d['tags']}, key=norm),
|
||||||
|
'categories': sorted({cat for d in family for cat in d['categories']}, key=norm),
|
||||||
|
'start_year': int(start[1]) if start else int(path.split('/')[2]) if path.startswith('pages/students/') else None,
|
||||||
|
'academics': extract_academics(document),
|
||||||
|
'year_conflicts': [r for r in extract_academics(document)
|
||||||
|
if r['year_basis'] == 'heading' and any(category_type(cat)[0] == r['academic_type']
|
||||||
|
and category_type(cat)[1] != r['year'] for cat in document['categories'])]}
|
||||||
|
canonical = json.dumps(corpus_hashes, sort_keys=True, separators=(',', ':'))
|
||||||
|
return {'wiki_root': str(wiki_root.resolve()), 'people': people, 'documents': documents,
|
||||||
|
'source_corpus': {'sha256': hashlib.sha256(canonical.encode()).hexdigest(),
|
||||||
|
'document_count': len(corpus_hashes), 'documents': corpus_hashes}}
|
||||||
|
|
||||||
|
|
||||||
|
def supporting_documents(oracle: dict, person: str, **constraints: Any) -> list[str]:
|
||||||
|
profile = oracle['people'].get(person)
|
||||||
|
if not profile:
|
||||||
|
return []
|
||||||
|
result = []
|
||||||
|
for path in profile['documents']:
|
||||||
|
doc = oracle['documents'][path]
|
||||||
|
if constraints.get('keyword') and norm(constraints['keyword']) not in {norm(tag) for tag in doc['tags']}:
|
||||||
|
continue
|
||||||
|
if constraints.get('category') and constraints['category'] not in doc['categories']:
|
||||||
|
continue
|
||||||
|
if constraints.get('document_author') and norm(doc['author']) != norm(constraints['document_author']):
|
||||||
|
continue
|
||||||
|
result.append(path)
|
||||||
|
return result
|
||||||
75
tools/graphrag/graph_db.py
Normal file
75
tools/graphrag/graph_db.py
Normal file
@ -0,0 +1,75 @@
|
|||||||
|
import os
|
||||||
|
from dataclasses import dataclass
|
||||||
|
|
||||||
|
from neo4j import GraphDatabase
|
||||||
|
|
||||||
|
|
||||||
|
@dataclass(frozen=True)
|
||||||
|
class Neo4jSettings:
|
||||||
|
uri: str
|
||||||
|
user: str
|
||||||
|
password: str
|
||||||
|
database: str
|
||||||
|
|
||||||
|
|
||||||
|
def get_neo4j_settings() -> Neo4jSettings:
|
||||||
|
password = os.getenv("NEO4J_PASSWORD")
|
||||||
|
|
||||||
|
if not password:
|
||||||
|
raise RuntimeError(
|
||||||
|
"NEO4J_PASSWORD is not configured."
|
||||||
|
)
|
||||||
|
|
||||||
|
return Neo4jSettings(
|
||||||
|
uri=os.getenv(
|
||||||
|
"NEO4J_URI",
|
||||||
|
"bolt://localhost:7687",
|
||||||
|
),
|
||||||
|
user=os.getenv(
|
||||||
|
"NEO4J_USER",
|
||||||
|
"neo4j",
|
||||||
|
),
|
||||||
|
password=password,
|
||||||
|
database=os.getenv(
|
||||||
|
"NEO4J_DATABASE",
|
||||||
|
"neo4j",
|
||||||
|
),
|
||||||
|
)
|
||||||
|
|
||||||
|
|
||||||
|
def create_neo4j_driver(
|
||||||
|
settings: Neo4jSettings | None = None,
|
||||||
|
):
|
||||||
|
resolved = settings or get_neo4j_settings()
|
||||||
|
|
||||||
|
return GraphDatabase.driver(
|
||||||
|
resolved.uri,
|
||||||
|
auth=(
|
||||||
|
resolved.user,
|
||||||
|
resolved.password,
|
||||||
|
),
|
||||||
|
)
|
||||||
|
|
||||||
|
|
||||||
|
def verify_neo4j_connection() -> Neo4jSettings:
|
||||||
|
settings = get_neo4j_settings()
|
||||||
|
|
||||||
|
with create_neo4j_driver(settings) as driver:
|
||||||
|
driver.verify_connectivity()
|
||||||
|
|
||||||
|
with driver.session(
|
||||||
|
database=settings.database
|
||||||
|
) as session:
|
||||||
|
record = session.run(
|
||||||
|
"RETURN 1 AS value"
|
||||||
|
).single()
|
||||||
|
|
||||||
|
if (
|
||||||
|
record is None
|
||||||
|
or record["value"] != 1
|
||||||
|
):
|
||||||
|
raise RuntimeError(
|
||||||
|
"Neo4j connectivity check failed."
|
||||||
|
)
|
||||||
|
|
||||||
|
return settings
|
||||||
2666
tools/graphrag/graph_search.py
Normal file
2666
tools/graphrag/graph_search.py
Normal file
File diff suppressed because it is too large
Load Diff
1904
tools/graphrag/graphrag.py
Normal file
1904
tools/graphrag/graphrag.py
Normal file
File diff suppressed because it is too large
Load Diff
14
tools/graphrag/neo4j_smoke.py
Normal file
14
tools/graphrag/neo4j_smoke.py
Normal file
@ -0,0 +1,14 @@
|
|||||||
|
from .graph_db import verify_neo4j_connection
|
||||||
|
|
||||||
|
|
||||||
|
def main() -> None:
|
||||||
|
settings = verify_neo4j_connection()
|
||||||
|
|
||||||
|
print("Neo4j connection: OK")
|
||||||
|
print(f"URI: {settings.uri}")
|
||||||
|
print(f"Database: {settings.database}")
|
||||||
|
print(f"User: {settings.user}")
|
||||||
|
|
||||||
|
|
||||||
|
if __name__ == "__main__":
|
||||||
|
main()
|
||||||
0
tools/graphrag/tests/__init__.py
Normal file
0
tools/graphrag/tests/__init__.py
Normal file
98
tools/graphrag/tests/test_evaluation_pipeline_v2.py
Normal file
98
tools/graphrag/tests/test_evaluation_pipeline_v2.py
Normal file
@ -0,0 +1,98 @@
|
|||||||
|
from __future__ import annotations
|
||||||
|
|
||||||
|
import copy
|
||||||
|
from pathlib import Path
|
||||||
|
|
||||||
|
import pytest
|
||||||
|
|
||||||
|
from tools.graphrag.evaluation.freeze_graphrag import make_freeze
|
||||||
|
from tools.graphrag.evaluation.reproducibility import source_corpus_fingerprint
|
||||||
|
|
||||||
|
|
||||||
|
def freeze_inputs():
|
||||||
|
questions = [
|
||||||
|
{'id': 'dev-a', 'split': 'dev', 'graph': {'schema_version': 3, 'source_profiles': ['pages/students/a/README.md']}},
|
||||||
|
{'id': 'test-b', 'split': 'test', 'graph': {'schema_version': 3, 'source_profiles': ['pages/students/b/README.md']}},
|
||||||
|
]
|
||||||
|
fingerprints = {'implementation': {}, 'dataset_sha256': 'dataset', 'inputs': {},
|
||||||
|
'source_corpus': {'sha256': 'raw-corpus'}}
|
||||||
|
audit = {'dataset_sha256': 'dataset', 'inputs': {}, 'source_corpus': {'sha256': 'raw-corpus'},
|
||||||
|
'questions': [{'id': q['id'], 'source_consistent': True} for q in questions], 'by_split': {}}
|
||||||
|
dev = {'configuration': {'split': 'dev', 'limit': 40, 'max_entities': 8},
|
||||||
|
'questions': [{'id': 'dev-a', 'error': None}], 'summary': {'error_count': 0},
|
||||||
|
'run_metadata': {'fingerprints': fingerprints, 'graph': {'sha256': 'graph'}}}
|
||||||
|
return dev, questions, fingerprints, audit
|
||||||
|
|
||||||
|
|
||||||
|
def test_primary_freeze_verifies_disjoint_profiles():
|
||||||
|
args = freeze_inputs()
|
||||||
|
manifest = make_freeze(*args)
|
||||||
|
assert manifest['partition']['overlap'] == 0
|
||||||
|
assert manifest['partition']['test_profile_count'] == 1
|
||||||
|
|
||||||
|
|
||||||
|
def test_primary_freeze_rejects_same_profile_across_splits():
|
||||||
|
dev, questions, fingerprints, audit = freeze_inputs()
|
||||||
|
questions[1]['graph']['source_profiles'] = questions[0]['graph']['source_profiles']
|
||||||
|
with pytest.raises(RuntimeError, match='profiles overlap'):
|
||||||
|
make_freeze(dev, questions, fingerprints, audit)
|
||||||
|
|
||||||
|
|
||||||
|
def test_primary_freeze_rejects_unvalidated_source_expectation():
|
||||||
|
dev, questions, fingerprints, audit = freeze_inputs()
|
||||||
|
audit['questions'][1]['source_consistent'] = False
|
||||||
|
with pytest.raises(RuntimeError, match='source-inconsistent'):
|
||||||
|
make_freeze(dev, questions, fingerprints, audit)
|
||||||
|
|
||||||
|
|
||||||
|
def test_primary_freeze_rejects_stale_raw_markdown_audit():
|
||||||
|
dev, questions, fingerprints, audit = freeze_inputs()
|
||||||
|
audit['source_corpus'] = {'sha256': 'stale'}
|
||||||
|
with pytest.raises(RuntimeError, match='original Markdown'):
|
||||||
|
make_freeze(dev, questions, fingerprints, audit)
|
||||||
|
|
||||||
|
|
||||||
|
def test_raw_source_fingerprint_detects_unindexed_change(tmp_path: Path, monkeypatch):
|
||||||
|
wiki = tmp_path / 'wiki'
|
||||||
|
doc = wiki / 'pages/students/example/README.md'
|
||||||
|
doc.parent.mkdir(parents=True)
|
||||||
|
doc.write_text('---\ntitle: Example\n---\nOriginal source\n')
|
||||||
|
monkeypatch.setenv('ZPWIKI_ROOT', str(wiki))
|
||||||
|
original = source_corpus_fingerprint()
|
||||||
|
doc.write_text('---\ntitle: Example\n---\nChanged source\n')
|
||||||
|
assert original['sha256'] != source_corpus_fingerprint()['sha256']
|
||||||
|
|
||||||
|
|
||||||
|
def test_freeze_cli_does_not_overwrite_previous_manifest(tmp_path, monkeypatch):
|
||||||
|
from tools.graphrag.evaluation.freeze_graphrag import main
|
||||||
|
previous = tmp_path / 'frozen_v1.json'
|
||||||
|
previous.write_text('historical manifest')
|
||||||
|
monkeypatch.setattr('sys.argv', ['freeze', '--dev-results', 'unused', '--audit', 'unused',
|
||||||
|
'--output', str(previous)])
|
||||||
|
with pytest.raises(SystemExit):
|
||||||
|
main()
|
||||||
|
assert previous.read_text() == 'historical manifest'
|
||||||
|
|
||||||
|
|
||||||
|
def test_dev_overwrite_cannot_replace_archived_results(tmp_path):
|
||||||
|
from argparse import Namespace
|
||||||
|
from tools.graphrag.evaluation.evaluate_graphrag import validate_output_destination
|
||||||
|
directory = tmp_path / 'final_v1'
|
||||||
|
directory.mkdir()
|
||||||
|
previous = directory / 'graphrag_dev.json'
|
||||||
|
previous.write_text('archived DEV')
|
||||||
|
args = Namespace(split='dev', ids='', max_questions=None, overwrite=True, output_dir=directory)
|
||||||
|
with pytest.raises(RuntimeError, match='immutable'):
|
||||||
|
validate_output_destination(args)
|
||||||
|
assert previous.read_text() == 'archived DEV'
|
||||||
|
|
||||||
|
|
||||||
|
def test_reproduction_requires_fresh_results_directory(tmp_path):
|
||||||
|
from argparse import Namespace
|
||||||
|
from tools.graphrag.evaluation.evaluate_graphrag import validate_output_destination
|
||||||
|
previous = tmp_path / 'graphrag_test.json'
|
||||||
|
previous.write_text('archived TEST')
|
||||||
|
args = Namespace(split='test', ids='', max_questions=None, overwrite=False, output_dir=tmp_path)
|
||||||
|
with pytest.raises(RuntimeError, match='already exist'):
|
||||||
|
validate_output_destination(args)
|
||||||
|
assert previous.read_text() == 'archived TEST'
|
||||||
226
tools/graphrag/tests/test_evaluator_connected_v2.py
Normal file
226
tools/graphrag/tests/test_evaluator_connected_v2.py
Normal file
@ -0,0 +1,226 @@
|
|||||||
|
from __future__ import annotations
|
||||||
|
|
||||||
|
import json
|
||||||
|
|
||||||
|
import pytest
|
||||||
|
|
||||||
|
from tools.graphrag.evaluation.graphrag_evaluator import evaluate_result, load_questions
|
||||||
|
|
||||||
|
|
||||||
|
def academic(person='Alena Nová', year=2024, title='Práca A', identifier='thesis-a', document='a.md', **extra):
|
||||||
|
return {'fact_type': 'person_thesis', 'person': person,
|
||||||
|
'thesis_id': identifier, 'thesis_type': 'bachelor_thesis',
|
||||||
|
'title': title, 'year': year, 'document_path': document,
|
||||||
|
'source_url': 'https://example.test/' + document, **extra}
|
||||||
|
|
||||||
|
|
||||||
|
def keyword(person='Alena Nová', value='RAG', document='a.md'):
|
||||||
|
return {'fact_type': 'person_keyword', 'person': person, 'keyword': value,
|
||||||
|
'document_path': document, 'source_url': 'https://example.test/' + document}
|
||||||
|
|
||||||
|
|
||||||
|
def question(bindings, **graph):
|
||||||
|
return {'id': 'synthetic-connected', 'split': 'dev', 'question': 'Overenie dôkazu.',
|
||||||
|
'graph': {'schema_version': 3, 'expected_bindings': bindings, **graph}}
|
||||||
|
|
||||||
|
|
||||||
|
def score(q, facts=(), **result):
|
||||||
|
result.setdefault('status', 'ok')
|
||||||
|
return evaluate_result(q, {'facts': list(facts), **result}, latency_seconds=0)
|
||||||
|
|
||||||
|
|
||||||
|
def test_same_person_keyword_and_academic_year_have_connected_proofs():
|
||||||
|
q = question([{'person': 'Alena Nová', 'academic_kind': 'Thesis', 'year': 2024, 'keyword': 'RAG'}])
|
||||||
|
row = score(q, [academic(), keyword()], status='ok')
|
||||||
|
assert row['strict'] and row['bindings_ok'] and row['paths_ok']
|
||||||
|
assert len(row['path_results']) == 2
|
||||||
|
assert all(path['witness'] for path in row['path_results'])
|
||||||
|
|
||||||
|
|
||||||
|
def test_disconnected_persons_cannot_satisfy_conjunction():
|
||||||
|
q = question([{'person': 'Alena Nová', 'year': 2024, 'keyword': 'RAG'}])
|
||||||
|
row = score(q, [academic(), keyword(person='Boris Iný')])
|
||||||
|
assert not row['strict'] and not row['bindings_ok']
|
||||||
|
|
||||||
|
|
||||||
|
def test_legacy_annotations_also_reject_disconnected_persons():
|
||||||
|
q = {'graph': {'schema_version': 2, 'expected_entities': [
|
||||||
|
{'type': 'person', 'value': 'Alena Nová'}, {'type': 'keyword', 'value': 'RAG'},
|
||||||
|
{'type': 'year', 'value': 2024}], 'expected_properties': ['Thesis.year'],
|
||||||
|
'expected_relations': ['AUTHORED', 'HAS_DOCUMENT', 'HAS_KEYWORD']}}
|
||||||
|
assert not score(q, [academic(), keyword(person='Boris Iný')])['strict']
|
||||||
|
|
||||||
|
|
||||||
|
def test_start_year_does_not_satisfy_academic_year():
|
||||||
|
q = question([{'person': 'Alena Nová', 'year': 2024}])
|
||||||
|
row = score(q, [academic(year=2025, start_year=2024)])
|
||||||
|
assert not row['strict']
|
||||||
|
|
||||||
|
|
||||||
|
def test_legacy_academic_year_entity_is_not_start_year():
|
||||||
|
q = {'expected_answer_contains': ['2024'], 'graph': {'expected_entities': [
|
||||||
|
{'type': 'year', 'value': '2024'}], 'expected_properties': ['Thesis.year']}}
|
||||||
|
row = score(q, [academic(year=2025, start_year=2024)])
|
||||||
|
assert not row['strict'] and row['entity_score'] == 0
|
||||||
|
|
||||||
|
|
||||||
|
def test_title_and_year_must_belong_to_the_same_work():
|
||||||
|
q = question([{'person': 'Alena Nová', 'title': 'Práca A', 'year': 2025}])
|
||||||
|
assert not score(q, [academic(), academic(year=2025, title='Práca B', identifier='thesis-b')])['strict']
|
||||||
|
|
||||||
|
|
||||||
|
def test_conflicting_same_node_properties_do_not_create_synthetic_work():
|
||||||
|
q = question([{'person': 'Alena Nová', 'title': 'Práca A', 'year': 2025}])
|
||||||
|
conflicting = academic(year=2025)
|
||||||
|
conflicting.pop('title')
|
||||||
|
assert not score(q, [academic(), conflicting])['strict']
|
||||||
|
|
||||||
|
|
||||||
|
def test_thesis_and_project_types_are_not_interchangeable():
|
||||||
|
q = question([{'person': 'Alena Nová', 'academic_kind': 'Work', 'year': 2024}])
|
||||||
|
assert not score(q, [academic()])['strict']
|
||||||
|
|
||||||
|
|
||||||
|
def test_project_proof_uses_has_work_not_authored():
|
||||||
|
q = question([{'person': 'Alena Nová', 'academic_kind': 'Work', 'academic_type': 'diploma_project', 'year': 2024}])
|
||||||
|
fact = academic()
|
||||||
|
fact.update(fact_type='person_work', work_id='project-a', work_type='diploma_project')
|
||||||
|
fact.pop('thesis_id'); fact.pop('thesis_type')
|
||||||
|
assert score(q, [fact])['strict']
|
||||||
|
|
||||||
|
|
||||||
|
def test_implicit_academic_proof_accepts_either_real_kind():
|
||||||
|
assert score(question([{'person': 'Alena Nová', 'year': 2024}]), [academic()])['strict']
|
||||||
|
|
||||||
|
|
||||||
|
def test_metadata_can_come_from_same_person_family_when_not_same_document_required():
|
||||||
|
q = question([{'person': 'Alena Nová', 'year': 2024, 'keyword': 'RAG'}])
|
||||||
|
assert score(q, [academic(), keyword(document='child.md')])['strict']
|
||||||
|
|
||||||
|
|
||||||
|
def test_same_document_constraint_rejects_family_only_join():
|
||||||
|
q = question([{'person': 'Alena Nová', 'year': 2024, 'keyword': 'RAG', 'same_document': True}])
|
||||||
|
assert not score(q, [academic(), keyword(document='child.md')])['strict']
|
||||||
|
|
||||||
|
|
||||||
|
def test_author_and_category_must_share_actual_document():
|
||||||
|
q = question([{'person': 'Alena Nová', 'category': 'bp2024', 'document_author': 'Autor Správny'}])
|
||||||
|
category = {'fact_type': 'person_category', 'person': 'Alena Nová', 'category': 'bp2024', 'document_path': 'a.md'}
|
||||||
|
author = {'fact_type': 'person_document_author', 'person': 'Alena Nová',
|
||||||
|
'document_author': 'Autor Správny', 'document_path': 'other.md'}
|
||||||
|
assert not score(q, [category, author])['strict']
|
||||||
|
author['document_path'] = 'a.md'
|
||||||
|
assert score(q, [category, author])['strict']
|
||||||
|
|
||||||
|
|
||||||
|
def test_author_category_query_fact_can_carry_same_document_category_proof():
|
||||||
|
q = question([{'person': 'Alena Nová', 'category': 'bp2024', 'document_author': 'Autor Správny'}])
|
||||||
|
author = {'fact_type': 'person_document_author', 'person': 'Alena Nová', 'category': 'bp2024',
|
||||||
|
'document_author': 'Autor Správny', 'document_path': 'a.md'}
|
||||||
|
assert score(q, [author])['strict']
|
||||||
|
|
||||||
|
|
||||||
|
def test_start_year_needs_direct_person_source_proof():
|
||||||
|
q = question([{'person': 'Alena Nová', 'start_year': 2020}])
|
||||||
|
assert not score(q, [academic(start_year=2020)])['strict']
|
||||||
|
direct = {'fact_type': 'person_start_year', 'person': 'Alena Nová', 'start_year': 2020, 'document_path': 'a.md'}
|
||||||
|
assert score(q, [direct])['strict']
|
||||||
|
direct.pop('document_path')
|
||||||
|
assert not score(q, [direct])['strict']
|
||||||
|
|
||||||
|
|
||||||
|
def test_conflicting_person_start_year_fails_closed():
|
||||||
|
q = question([{'person': 'Alena Nová', 'start_year': 2020}])
|
||||||
|
first = {'fact_type': 'person_start_year', 'person': 'Alena Nová', 'start_year': 2020, 'document_path': 'a.md'}
|
||||||
|
assert not score(q, [first, {**first, 'start_year': 2021}])['strict']
|
||||||
|
|
||||||
|
|
||||||
|
def test_explicit_path_pattern_is_bound_to_expected_subject():
|
||||||
|
q = question([{'person': 'Alena Nová', 'keyword': 'RAG'}], expected_path_patterns=[{
|
||||||
|
'binding_index': 0, 'node_kinds': ['Person', 'Document', 'Keyword'],
|
||||||
|
'relationships': ['HAS_DOCUMENT', 'HAS_KEYWORD']}])
|
||||||
|
assert not score(q, [keyword(person='Boris Iný')])['strict']
|
||||||
|
assert score(q, [keyword()])['strict']
|
||||||
|
|
||||||
|
|
||||||
|
def test_incompatible_ordered_path_does_not_forge_relationship():
|
||||||
|
q = question([{'person': 'Alena Nová', 'academic_kind': 'Work', 'year': 2024}])
|
||||||
|
path = {'nodes': [{'kind': 'Person', 'name': 'Alena Nová'},
|
||||||
|
{'kind': 'Work', 'id': 'work', 'year': 2024},
|
||||||
|
{'kind': 'Document', 'path': 'a.md'}],
|
||||||
|
'relationships': ['AUTHORED', 'EVIDENCED_BY']}
|
||||||
|
assert not score(q, paths=[path])['strict']
|
||||||
|
path['relationships'][0] = 'HAS_WORK'
|
||||||
|
assert score(q, paths=[path])['strict']
|
||||||
|
|
||||||
|
|
||||||
|
def test_unrecognized_query_entities_are_never_proof():
|
||||||
|
q = question([{'person': 'Alena Nová', 'year': 2024}])
|
||||||
|
assert not score(q, resolved_entities=[{'kind': 'Person', 'name': 'Alena Nová', 'year': 2024}])['strict']
|
||||||
|
|
||||||
|
|
||||||
|
def test_no_answer_is_a_success_only_when_no_positive_evidence_returned():
|
||||||
|
q = question([], expected_no_answer=True)
|
||||||
|
q['should_answer'] = False
|
||||||
|
assert score(q, status='no_answer', reason='unknown_person')['strict']
|
||||||
|
assert not score(q, [academic()], status='no_answer', reason='unknown_person')['strict']
|
||||||
|
assert not score(q, status='no_answer')['strict']
|
||||||
|
assert not score(q, status='ok', reason='unknown_person')['strict']
|
||||||
|
|
||||||
|
|
||||||
|
def test_no_answer_requires_expected_ambiguity_when_specified():
|
||||||
|
q = question([], expected_no_answer=True, expected_status='ambiguous')
|
||||||
|
assert score(q, status='ambiguous', reason='multiple_people')['strict']
|
||||||
|
assert not score(q, status='no_answer', reason='unknown_person')['strict']
|
||||||
|
|
||||||
|
|
||||||
|
def test_false_comparison_can_be_no_answer_evidence_without_positive_claim():
|
||||||
|
q = question([], expected_no_answer=True)
|
||||||
|
fact = {'fact_type': 'academic_year_comparison', 'shared_years': [], 'same_academic_year': False}
|
||||||
|
assert score(q, [fact], status='no_answer', reason='no_shared_year')['strict']
|
||||||
|
|
||||||
|
|
||||||
|
def test_empty_positive_contract_does_not_pass_vacuously():
|
||||||
|
assert not score(question([]), status='ok')['strict']
|
||||||
|
assert not score(question([{}]), status='ok')['strict']
|
||||||
|
|
||||||
|
|
||||||
|
def test_zero_count_is_a_grounded_answer_not_a_no_answer():
|
||||||
|
q = question([], expected_count=0, expected_entity_set=[], entity_set_mode='exact', entity_set_field='person')
|
||||||
|
result = {'aggregation': {'count': 0, 'people': [], 'complete': True}}
|
||||||
|
assert score(q, status='ok', **result)['strict']
|
||||||
|
assert not score(q, status='no_answer', reason='no_rows', **result)['strict']
|
||||||
|
|
||||||
|
|
||||||
|
def test_schema3_loader_rejects_unbound_path_pattern(tmp_path):
|
||||||
|
q = question([{'person': 'Alena Nová', 'keyword': 'RAG'}], expected_path_patterns=[{
|
||||||
|
'binding_index': 2, 'node_kinds': ['Person', 'Document'], 'relationships': ['HAS_DOCUMENT']}])
|
||||||
|
path = tmp_path / 'questions.json'; path.write_text(json.dumps([q]))
|
||||||
|
with pytest.raises(ValueError, match='invalid connected path pattern'):
|
||||||
|
load_questions(path)
|
||||||
|
|
||||||
|
|
||||||
|
def test_declared_count_and_people_must_match_actual_answer_evidence():
|
||||||
|
q = question([{'person': 'Alena Nová', 'year': 2024}], expected_count=1,
|
||||||
|
expected_entity_set=['Alena Nová'], entity_set_mode='exact', entity_set_field='person')
|
||||||
|
assert score(q, [academic()], aggregation={'count': 1, 'people': ['Alena Nová'], 'complete': True})['strict']
|
||||||
|
assert not score(q, [academic()], aggregation={'count': 1, 'people': ['Boris Iný'], 'complete': True})['strict']
|
||||||
|
assert not score(q, [academic()], aggregation={'count': True, 'people': ['Alena Nová'], 'complete': True})['strict']
|
||||||
|
|
||||||
|
|
||||||
|
def test_no_answer_cannot_hide_a_positive_comparison_claim():
|
||||||
|
q = question([], expected_no_answer=True)
|
||||||
|
fact = {'fact_type': 'academic_year_comparison', 'shared_years': [], 'same_academic_year': True}
|
||||||
|
assert not score(q, [fact], status='no_answer', reason='no_shared_year')['strict']
|
||||||
|
|
||||||
|
|
||||||
|
def test_evidence_accepts_one_of_valid_source_alternatives_not_every_duplicate():
|
||||||
|
q = question([{'person': 'Alena Nová', 'keyword': 'RAG'}], expected_evidence_documents=[{
|
||||||
|
'binding_index': 0, 'role': 'keyword_document', 'any_of': [
|
||||||
|
{'document_path': 'a.md', 'source_url': 'https://example.test/a.md'},
|
||||||
|
{'document_path': 'child.md', 'source_url': 'https://example.test/child.md'}]}])
|
||||||
|
assert score(q, [keyword(document='a.md')])['strict']
|
||||||
|
assert score(q, [keyword(document='child.md')])['strict']
|
||||||
|
assert not score(q, [keyword(document='unrelated.md')])['strict']
|
||||||
|
fact = keyword(document='a.md'); fact['source_url'] = 'https://wrong.test/'
|
||||||
|
assert not score(q, [fact])['strict']
|
||||||
1328
tools/graphrag/tests/test_graph_search.py
Normal file
1328
tools/graphrag/tests/test_graph_search.py
Normal file
File diff suppressed because it is too large
Load Diff
159
tools/graphrag/tests/test_graph_search_entity_v2.py
Normal file
159
tools/graphrag/tests/test_graph_search_entity_v2.py
Normal file
@ -0,0 +1,159 @@
|
|||||||
|
from __future__ import annotations
|
||||||
|
|
||||||
|
import pytest
|
||||||
|
|
||||||
|
from tools.graphrag import graph_search as gs
|
||||||
|
from .test_graph_search import FakeSession
|
||||||
|
|
||||||
|
|
||||||
|
def catalog():
|
||||||
|
return [
|
||||||
|
{'kind': 'Person', 'element_id': 'alice', 'id': 'person:alice', 'name': 'Alena Nová',
|
||||||
|
'source_document': 'alice.md'},
|
||||||
|
{'kind': 'Person', 'element_id': 'boris', 'id': 'person:boris', 'name': 'Boris Malý',
|
||||||
|
'source_document': 'boris.md'},
|
||||||
|
{'kind': 'Person', 'element_id': 'cross', 'id': 'person:cross', 'name': 'Boris Novák',
|
||||||
|
'source_document': 'cross.md'},
|
||||||
|
{'kind': 'Keyword', 'element_id': 'rag', 'id': 'rag', 'name': 'RAG'},
|
||||||
|
{'kind': 'Keyword', 'element_id': 'zp', 'id': 'zp', 'name': 'zp'},
|
||||||
|
]
|
||||||
|
|
||||||
|
|
||||||
|
def thesis():
|
||||||
|
return {'person_element_id': 'alice', 'person': 'Alena Nová', 'thesis_element_id': 'thesis-a',
|
||||||
|
'thesis_type': 'bachelor_thesis', 'year': 2024, 'title': 'Ukážkový výskum',
|
||||||
|
'document_path': 'alice.md', 'source_url': 'https://example.test/alice'}
|
||||||
|
|
||||||
|
|
||||||
|
def test_complete_names_cannot_be_assembled_from_different_people():
|
||||||
|
data = catalog() + [{'kind': 'Person', 'element_id': 'mixed', 'id': 'person:mixed', 'name': 'Boris Nová'}]
|
||||||
|
result = gs.resolve_entities('Porovnaj osoby Alena Nová a Boris Malý.', data)
|
||||||
|
assert {row['element_id'] for row in result if row['kind'] == 'Person'} == {'alice', 'boris'}
|
||||||
|
|
||||||
|
|
||||||
|
@pytest.mark.parametrize('query', [
|
||||||
|
'Akú prácu robila Alena Nová?',
|
||||||
|
'Aký je názov práce Aleny Novej?',
|
||||||
|
'Vyhľadaj prácu Borisa Malého.',
|
||||||
|
])
|
||||||
|
def test_controlled_name_inflections_still_resolve(query):
|
||||||
|
resolved = gs.resolve_entities(query, catalog())
|
||||||
|
assert any(row['kind'] == 'Person' for row in resolved)
|
||||||
|
|
||||||
|
|
||||||
|
def test_exact_full_name_wins_over_inflection_of_another_name():
|
||||||
|
data = [{'kind': 'Person', 'element_id': 'jan', 'id': 'jan', 'name': 'Ján Novák'},
|
||||||
|
{'kind': 'Person', 'element_id': 'jana', 'id': 'jana', 'name': 'Jana Novák'}]
|
||||||
|
assert [row['element_id'] for row in gs.resolve_entities('Čomu sa venuje Jana Novák?', data)] == ['jana']
|
||||||
|
|
||||||
|
|
||||||
|
@pytest.mark.parametrize('query', [
|
||||||
|
'Aký názov diplomovej práce má Zuzana Neexistujúca?',
|
||||||
|
'Aký názov diplomovej práce má zuzana neexistujuca?',
|
||||||
|
'Akú prácu robil Neznámy Študent?',
|
||||||
|
'Čomu sa venuje neznama osoba?',
|
||||||
|
'Aký je názov práce osoby neznama osoba?',
|
||||||
|
'Z kandidátov Alena Nová, neznama osoba, Boris Malý vyber osoby s prácou v roku 2024. Koľko ich je?',
|
||||||
|
])
|
||||||
|
def test_explicit_unknown_person_never_becomes_global_search(query):
|
||||||
|
session = FakeSession({gs.CATALOG_QUERY: catalog(), gs.THESIS_FACTS_QUERY: [thesis()]})
|
||||||
|
result = gs.search_graph_with_session(session, query)
|
||||||
|
assert result['status'] == 'no_answer'
|
||||||
|
assert result['reason'] == 'unknown_person'
|
||||||
|
assert result['facts'] == [] and result['paths'] == []
|
||||||
|
assert result['aggregation'] is None
|
||||||
|
assert gs.THESIS_FACTS_QUERY not in {statement for statement, _ in session.calls}
|
||||||
|
|
||||||
|
|
||||||
|
def test_legitimate_global_listing_keeps_unrestricted_query():
|
||||||
|
session = FakeSession({gs.CATALOG_QUERY: catalog(), gs.THESIS_FACTS_QUERY: [thesis()]})
|
||||||
|
result = gs.search_graph_with_session(session, 'Aké bakalárske práce sú uvedené v roku 2024?')
|
||||||
|
assert result['status'] == 'ok'
|
||||||
|
assert result['facts'][0]['title'] == 'Ukážkový výskum'
|
||||||
|
assert next(params for statement, params in session.calls if statement == gs.THESIS_FACTS_QUERY)['person_ids'] == []
|
||||||
|
|
||||||
|
|
||||||
|
def test_duplicate_full_name_is_explicitly_ambiguous():
|
||||||
|
data = catalog() + [{'kind': 'Person', 'element_id': 'duplicate', 'id': 'person:duplicate',
|
||||||
|
'name': 'Alena Nová', 'source_document': 'duplicate.md'}]
|
||||||
|
session = FakeSession({gs.CATALOG_QUERY: data, gs.THESIS_FACTS_QUERY: [thesis()]})
|
||||||
|
result = gs.search_graph_with_session(session, 'Aký názov práce má Alena Nová?')
|
||||||
|
assert result['status'] == 'ambiguous'
|
||||||
|
assert result['reason'] == 'ambiguous_person'
|
||||||
|
assert result['facts'] == []
|
||||||
|
|
||||||
|
|
||||||
|
def test_explicit_document_author_role_is_not_replaced_by_same_named_student():
|
||||||
|
data = catalog() + [{'kind': 'DocumentAuthor', 'element_id': 'author', 'id': 'author:alice', 'name': 'Alena Nová'}]
|
||||||
|
session = FakeSession({gs.CATALOG_QUERY: data})
|
||||||
|
result = gs.search_graph_with_session(session, 'Ktoré dokumenty napísal autor Alena Nová?')
|
||||||
|
params = next(params for statement, params in session.calls if statement == gs.PERSON_DOCUMENT_AUTHOR_FACTS_QUERY)
|
||||||
|
assert params['person_ids'] == []
|
||||||
|
assert params['author_ids'] == ['author']
|
||||||
|
assert not any(row['kind'] == 'Person' for row in result['resolved_entities'])
|
||||||
|
|
||||||
|
|
||||||
|
def test_unknown_document_author_does_not_list_every_document():
|
||||||
|
session = FakeSession({gs.CATALOG_QUERY: catalog()})
|
||||||
|
result = gs.search_graph_with_session(session, 'Ktoré dokumenty napísal autor Neznámy Autor?')
|
||||||
|
assert result['status'] == 'no_answer'
|
||||||
|
assert gs.PERSON_DOCUMENT_AUTHOR_FACTS_QUERY not in {statement for statement, _ in session.calls}
|
||||||
|
|
||||||
|
|
||||||
|
def test_unknown_multiword_tag_is_not_truncated_to_known_prefix():
|
||||||
|
session = FakeSession({gs.CATALOG_QUERY: catalog(), gs.THESIS_FACTS_QUERY: [thesis()]})
|
||||||
|
result = gs.search_graph_with_session(session,
|
||||||
|
'Aký názov práce má Alena Nová, ak má kľúčové slovo RAG neexistujuci?')
|
||||||
|
assert result['status'] == 'no_answer'
|
||||||
|
assert result['reason'] == 'unknown_keyword'
|
||||||
|
assert result['facts'] == []
|
||||||
|
|
||||||
|
|
||||||
|
def test_plural_tag_listing_does_not_filter_by_zp_from_zp_wiki():
|
||||||
|
session = FakeSession({gs.CATALOG_QUERY: catalog()})
|
||||||
|
gs.search_graph_with_session(session, 'Aké kľúčové slová má Alena Nová v ZP Wiki?')
|
||||||
|
params = next(params for statement, params in session.calls if statement == gs.PERSON_KEYWORD_FACTS_QUERY)
|
||||||
|
assert params['keyword_ids'] == []
|
||||||
|
|
||||||
|
|
||||||
|
def test_unsupported_count_domain_does_not_claim_zero():
|
||||||
|
session = FakeSession({gs.CATALOG_QUERY: catalog()})
|
||||||
|
result = gs.search_graph_with_session(session, 'Koľko kategórií má Alena Nová?')
|
||||||
|
assert result['status'] == 'no_answer'
|
||||||
|
assert result['reason'] == 'unsupported_count_domain'
|
||||||
|
assert result['aggregation'] is None
|
||||||
|
|
||||||
|
|
||||||
|
def test_zero_matching_candidates_is_answerable_count_zero():
|
||||||
|
session = FakeSession({gs.CATALOG_QUERY: catalog()})
|
||||||
|
result = gs.search_graph_with_session(session,
|
||||||
|
'Z kandidátov Alena Nová a Boris Malý vyber osoby s prácou v roku 2099. Koľko ich je?')
|
||||||
|
assert result['status'] == 'ok'
|
||||||
|
assert result['aggregation']['count'] == 0
|
||||||
|
assert result['aggregation']['complete']
|
||||||
|
|
||||||
|
|
||||||
|
@pytest.mark.parametrize('query', [
|
||||||
|
'Aký názov diplomovej práce má Zuzana?',
|
||||||
|
'Aký názov práce má osoba Zuzana?',
|
||||||
|
'Čomu sa venuje Zuzana?',
|
||||||
|
])
|
||||||
|
def test_single_token_unknown_subject_never_becomes_global_lookup(query):
|
||||||
|
session = FakeSession({gs.CATALOG_QUERY: catalog(), gs.THESIS_FACTS_QUERY: [thesis()]})
|
||||||
|
result = gs.search_graph_with_session(session, query)
|
||||||
|
assert result['status'] == 'no_answer'
|
||||||
|
assert 'unknown_person' in result['reason']
|
||||||
|
assert result['facts'] == []
|
||||||
|
assert all(cypher != gs.THESIS_FACTS_QUERY for cypher, _ in session.calls)
|
||||||
|
|
||||||
|
|
||||||
|
def test_trailing_instruction_is_not_an_unknown_candidate_name():
|
||||||
|
query = 'Over prepojenie osôb Alena Nová a Boris Malý cez kľúčové slovo RAG a pomenuj spoločné kľúčové slovo.'
|
||||||
|
assert gs.requested_name_phrases(query) == ['alena nova', 'boris maly']
|
||||||
|
|
||||||
|
|
||||||
|
def test_document_subject_is_not_misread_as_the_named_document_author():
|
||||||
|
query = 'Kto je autor dokumentu osoby Alena Nová, ktorý patrí do kategórie bp2024?'
|
||||||
|
assert gs.named_author_phrases(query) == []
|
||||||
|
result = gs.search_graph_with_session(FakeSession({gs.CATALOG_QUERY: catalog()}), query)
|
||||||
|
assert not result['constraints']['unresolved_document_author']
|
||||||
118
tools/graphrag/tests/test_graph_search_neo4j.py
Normal file
118
tools/graphrag/tests/test_graph_search_neo4j.py
Normal file
@ -0,0 +1,118 @@
|
|||||||
|
"""Optional real Cypher regressions; all fixtures are rolled back."""
|
||||||
|
from __future__ import annotations
|
||||||
|
|
||||||
|
import os
|
||||||
|
import uuid
|
||||||
|
|
||||||
|
import pytest
|
||||||
|
|
||||||
|
from tools.graphrag import graph_search as gs
|
||||||
|
from tools.graphrag.graph_db import create_neo4j_driver, get_neo4j_settings
|
||||||
|
|
||||||
|
pytestmark = pytest.mark.skipif(os.getenv('RUN_NEO4J_TESTS') != '1', reason='Set RUN_NEO4J_TESTS=1 for isolated Neo4j regressions.')
|
||||||
|
|
||||||
|
|
||||||
|
@pytest.fixture
|
||||||
|
def graph(monkeypatch):
|
||||||
|
scope = 'regression-' + uuid.uuid4().hex
|
||||||
|
monkeypatch.setattr(gs, 'GRAPH_SCOPE', scope)
|
||||||
|
category = 'regcat-' + uuid.uuid4().hex
|
||||||
|
settings = get_neo4j_settings()
|
||||||
|
with create_neo4j_driver(settings) as driver, driver.session(database=settings.database) as session:
|
||||||
|
tx = session.begin_transaction()
|
||||||
|
try:
|
||||||
|
for suffix, name, year, tag in [('a', 'Alena Nová', 2024, 'alpha'),
|
||||||
|
('b', 'Boris Iný', 2024, 'beta'),
|
||||||
|
('c', 'Cyril Malý', 2025, 'alpha')]:
|
||||||
|
tx.run('CREATE (p:Person {id:$id, name:$name, source_document:$path, graph_scope:$scope}) '
|
||||||
|
'CREATE (d:Document {path:$path, source_url:$url, graph_scope:$scope}) '
|
||||||
|
'CREATE (t:Thesis {id:$thesis, title:$title, year:$year, thesis_type:"bachelor_thesis", graph_scope:$scope}) '
|
||||||
|
'MERGE (k:Keyword {id:$keyword, name:$tag, graph_scope:$scope}) '
|
||||||
|
'CREATE (p)-[:HAS_DOCUMENT]->(d)-[:HAS_KEYWORD]->(k) '
|
||||||
|
'CREATE (p)-[:AUTHORED]->(t)-[:EVIDENCED_BY]->(d)',
|
||||||
|
id=scope+suffix, name=name, path=scope+'/'+suffix+'.md',
|
||||||
|
url='https://example.test/'+suffix, scope=scope, thesis=scope+'th'+suffix,
|
||||||
|
title='Výskum '+suffix, year=year, keyword=scope+tag, tag=tag).consume()
|
||||||
|
tx.run('MATCH (p:Person {id:$person})-[:HAS_DOCUMENT]->(d) '
|
||||||
|
'CREATE (c:Category {name:$category, graph_scope:$scope}) '
|
||||||
|
'CREATE (a:DocumentAuthor {id:$author, name:"Autor Správny", graph_scope:$scope}) '
|
||||||
|
'CREATE (d)-[:IN_CATEGORY]->(c) CREATE (a)-[:AUTHORED_DOCUMENT]->(d) '
|
||||||
|
'CREATE (child:Document {path:$child, graph_scope:$scope}) '
|
||||||
|
'CREATE (wrong:DocumentAuthor {id:$wrong, name:"Autor Iný", graph_scope:$scope}) '
|
||||||
|
'CREATE (p)-[:HAS_DOCUMENT]->(child)<-[:AUTHORED_DOCUMENT]-(wrong)',
|
||||||
|
person=scope+'a', category=category, scope=scope, author=scope+'author',
|
||||||
|
child=scope+'/child.md', wrong=scope+'wrong').consume()
|
||||||
|
yield tx, category
|
||||||
|
finally:
|
||||||
|
tx.rollback()
|
||||||
|
|
||||||
|
|
||||||
|
def test_real_keyword_year_conjunction(graph):
|
||||||
|
tx, _ = graph
|
||||||
|
result = gs.search_graph_with_session(tx,
|
||||||
|
'Ktorá z osôb Alena Nová a Boris Iný má kľúčové slovo alpha a jej práca je v roku 2024?')
|
||||||
|
assert {r['person'] for r in result['facts'] if r['fact_type'] == 'person_thesis'} == {'Alena Nová'}
|
||||||
|
assert {r['person'] for r in result['facts'] if r['fact_type'] == 'person_keyword'} == {'Alena Nová'}
|
||||||
|
|
||||||
|
|
||||||
|
def test_real_count_and_rejected_candidate_provenance(graph):
|
||||||
|
tx, _ = graph
|
||||||
|
result = gs.search_graph_with_session(tx,
|
||||||
|
'Z kandidátov Alena Nová, Boris Iný, Cyril Malý vyber osoby s prácou v roku 2024. Koľko ich je?')
|
||||||
|
assert result['aggregation'] == {'count': 2, 'people': ['Alena Nová', 'Boris Iný'], 'candidate_count': 3, 'complete': True}
|
||||||
|
assert 'https://example.test/c' in {r['source_url'] for r in result['documents']}
|
||||||
|
|
||||||
|
|
||||||
|
def test_real_author_and_category_must_share_document(graph):
|
||||||
|
tx, category = graph
|
||||||
|
result = gs.search_graph_with_session(tx, f'Ktorý autor dokumentu je pri osobe Alena Nová spojený s kategóriou {category}?')
|
||||||
|
authors = [r['document_author'] for r in result['facts'] if r['fact_type'] == 'person_document_author']
|
||||||
|
assert authors == ['Autor Správny']
|
||||||
|
|
||||||
|
|
||||||
|
def test_real_shared_year_does_not_invent_intersection(graph):
|
||||||
|
tx, _ = graph
|
||||||
|
result = gs.search_graph_with_session(tx, 'V ktorom rovnakom roku je práca pri osobách Alena Nová a Cyril Malý?')
|
||||||
|
assert not any(r['fact_type'] in {'person_thesis', 'person_work'} for r in result['facts'])
|
||||||
|
assert next(r for r in result['facts'] if r['fact_type'] == 'academic_year_comparison')['shared_years'] == []
|
||||||
|
|
||||||
|
|
||||||
|
def test_real_shared_keyword_uses_requested_keyword(graph):
|
||||||
|
tx, _ = graph
|
||||||
|
result = gs.search_graph_with_session(tx,
|
||||||
|
'Sú osoby Alena Nová a Cyril Malý prepojené cez kľúčové slovo alpha? Uveď spoločné kľúčové slovo.')
|
||||||
|
assert [r['keyword'] for r in result['facts'] if r['fact_type'] == 'shared_keyword'] == ['alpha']
|
||||||
|
|
||||||
|
|
||||||
|
def test_real_unknown_keyword_is_not_a_global_listing(graph):
|
||||||
|
tx, _ = graph
|
||||||
|
result = gs.search_graph_with_session(tx, 'Aký názov práce má Alena Nová, ak má kľúčové slovo missingtag?')
|
||||||
|
assert result['facts'] == []
|
||||||
|
|
||||||
|
|
||||||
|
@pytest.mark.parametrize('question', [
|
||||||
|
'V ktorom rovnakom roku je práca pri osobách Alena Nová a Boris Iný?',
|
||||||
|
'Aký rok práce spája osoby Alena Nová a Boris Iný?',
|
||||||
|
])
|
||||||
|
def test_real_shared_year_paraphrases_have_same_answer(graph, question):
|
||||||
|
tx, _ = graph
|
||||||
|
result = gs.search_graph_with_session(tx, question)
|
||||||
|
assert next(r for r in result['facts'] if r['fact_type'] == 'academic_year_comparison')['shared_years'] == [2024]
|
||||||
|
assert {r['year'] for r in result['facts'] if r['fact_type'] == 'person_thesis'} == {2024}
|
||||||
|
|
||||||
|
|
||||||
|
def test_real_title_and_keyword_are_both_returned(graph):
|
||||||
|
tx, _ = graph
|
||||||
|
result = gs.search_graph_with_session(tx,
|
||||||
|
'Aký je názov práce osoby Alena Nová, ak jej dokument obsahuje kľúčové slovo alpha?')
|
||||||
|
assert [(r['person'], r['title']) for r in result['facts'] if r['fact_type'] == 'person_thesis'] == [('Alena Nová', 'Výskum a')]
|
||||||
|
assert [r['keyword'] for r in result['facts'] if r['fact_type'] == 'person_keyword'] == ['alpha']
|
||||||
|
|
||||||
|
|
||||||
|
def test_real_count_is_not_cut_off_by_presentation_limit(graph):
|
||||||
|
tx, _ = graph
|
||||||
|
result = gs.search_graph_with_session(tx,
|
||||||
|
'Z kandidátov Alena Nová, Boris Iný, Cyril Malý vyber osoby s prácou v roku 2024. Koľko ich je?', limit=1)
|
||||||
|
assert result['aggregation']['count'] == 2
|
||||||
|
assert len(result['facts']) == 1
|
||||||
|
assert result['truncated']
|
||||||
111
tools/graphrag/tests/test_graph_search_regressions.py
Normal file
111
tools/graphrag/tests/test_graph_search_regressions.py
Normal file
@ -0,0 +1,111 @@
|
|||||||
|
from __future__ import annotations
|
||||||
|
|
||||||
|
import pytest
|
||||||
|
|
||||||
|
from tools.graphrag import graph_search as gs
|
||||||
|
from tools.graphrag.evaluation.audit_benchmark import audit_questions
|
||||||
|
from tools.graphrag.evaluation.graphrag_evaluator import evaluate_result, property_present, value_is_present
|
||||||
|
from .test_graph_search import FakeSession, sample_catalog
|
||||||
|
|
||||||
|
|
||||||
|
@pytest.mark.parametrize('word', ['názov', 'názvom', 'názvu'])
|
||||||
|
def test_title_inflections(word):
|
||||||
|
assert gs.extract_query_constraints(f'Prepoj osobu s {word} jej práce.')['mentions_title']
|
||||||
|
|
||||||
|
|
||||||
|
@pytest.mark.parametrize('question', [
|
||||||
|
'V ktorom rovnakom roku je uvedená práca pri osobách?',
|
||||||
|
'Aký rok práce spája tieto osoby?',
|
||||||
|
'Prepoj osobu s názvom jej práce a rokom.',
|
||||||
|
])
|
||||||
|
def test_academic_year_intent_does_not_require_a_numeric_year(question):
|
||||||
|
assert gs.extract_query_constraints(question)['mentions_academic_year']
|
||||||
|
|
||||||
|
|
||||||
|
def test_tag_is_extracted_without_following_clause():
|
||||||
|
assert gs.explicit_keyword_phrase('Kľúčové slovo RAG a jej práca v roku 2024?') == 'rag'
|
||||||
|
|
||||||
|
|
||||||
|
def test_incidental_zp_tag_does_not_filter_title_lookup():
|
||||||
|
catalog = sample_catalog() + [{'element_id': 'zp', 'kind': 'Keyword', 'id': 'zp', 'name': 'zp'}]
|
||||||
|
fact = {'person_element_id': 'p2', 'person': 'Jakub Maruniak', 'thesis_element_id': 'th1',
|
||||||
|
'title': 'Ukážková práca', 'year': 2021, 'thesis_type': 'diploma_thesis'}
|
||||||
|
session = FakeSession({gs.CATALOG_QUERY: catalog, gs.THESIS_FACTS_QUERY: [fact]})
|
||||||
|
result = gs.search_graph_with_session(session, 'Aký názov práce je v ZP Wiki pri osobe Jakub Maruniak?')
|
||||||
|
assert any(row['fact_type'] == 'person_thesis' for row in result['facts'])
|
||||||
|
assert gs.PERSON_KEYWORD_FACTS_QUERY not in {query for query, _ in session.calls}
|
||||||
|
|
||||||
|
|
||||||
|
def test_keyword_and_year_cannot_be_satisfied_by_different_people():
|
||||||
|
session = FakeSession({
|
||||||
|
gs.CATALOG_QUERY: sample_catalog(),
|
||||||
|
gs.THESIS_FACTS_QUERY: [{'person_element_id': 'p2', 'person': 'Jakub Maruniak',
|
||||||
|
'year': 2024, 'thesis_element_id': 'th1'}],
|
||||||
|
gs.PERSON_KEYWORD_FACTS_QUERY: [{'person_element_id': 'p1', 'person': 'Maroš Harahus',
|
||||||
|
'keyword_element_id': 'k2', 'keyword': 'RAG'}],
|
||||||
|
gs.THESIS_PATHS_QUERY: [{'nodes': [{'kind': 'Thesis', 'element_id': 'th1', 'year': 2024}],
|
||||||
|
'relationships': ['AUTHORED']}],
|
||||||
|
})
|
||||||
|
result = gs.search_graph_with_session(session,
|
||||||
|
'Ktorá z osôb Maroš Harahus a Jakub Maruniak má kľúčové slovo RAG a jej práca je z roku 2024?')
|
||||||
|
assert result['facts'] == []
|
||||||
|
assert result['paths'] == []
|
||||||
|
|
||||||
|
|
||||||
|
def test_unknown_explicit_tag_does_not_return_unfiltered_titles():
|
||||||
|
session = FakeSession({gs.CATALOG_QUERY: sample_catalog(), gs.THESIS_FACTS_QUERY: [{'title': 'Nepodložené'}]})
|
||||||
|
result = gs.search_graph_with_session(session,
|
||||||
|
'Aký názov práce má Jakub Maruniak, ak má kľúčové slovo neexistujucitag?')
|
||||||
|
assert result['facts'] == []
|
||||||
|
assert result['constraints']['unresolved_keyword']
|
||||||
|
|
||||||
|
|
||||||
|
def test_unknown_quoted_title_does_not_list_every_thesis():
|
||||||
|
session = FakeSession({gs.CATALOG_QUERY: sample_catalog(), gs.THESIS_FACTS_QUERY: [{'title': 'Iná práca'}]})
|
||||||
|
result = gs.search_graph_with_session(session, 'Kto riešil diplomovú prácu „Úplne vymyslený názov“?')
|
||||||
|
assert result['facts'] == []
|
||||||
|
|
||||||
|
|
||||||
|
def test_recognized_query_entities_are_not_answer_evidence():
|
||||||
|
result = {'resolved_entities': [{'kind': 'Thesis', 'title': 'Vymyslený názov', 'year': 2024}],
|
||||||
|
'facts': [], 'paths': [], 'documents': [{'document_path': 'Vymyslený názov'}]}
|
||||||
|
assert not value_is_present('Vymyslený názov', result)
|
||||||
|
assert not property_present('Thesis.title', result)
|
||||||
|
|
||||||
|
|
||||||
|
def test_value_matching_has_word_boundaries():
|
||||||
|
assert not value_is_present('202', {'facts': [{'year': 2024}]})
|
||||||
|
|
||||||
|
|
||||||
|
def test_wrong_entity_type_cannot_satisfy_expected_keyword():
|
||||||
|
question = {'graph': {'expected_entities': [{'type': 'keyword', 'value': 'RAG'}]}}
|
||||||
|
row = evaluate_result(question, {'facts': [{'title': 'RAG', 'thesis_type': 'diploma_thesis'}]}, latency_seconds=0)
|
||||||
|
assert row['entity_score'] == 0
|
||||||
|
|
||||||
|
|
||||||
|
def test_correct_set_with_wrong_count_fails_strict():
|
||||||
|
question = {'category': 'candidate_set_aggregation', 'graph': {
|
||||||
|
'expected_count': 1, 'expected_entity_set': ['Eva Nová'], 'entity_set_mode': 'exact'}}
|
||||||
|
result = {'facts': [{'fact_type': 'person_thesis', 'person': 'Eva Nová'}],
|
||||||
|
'aggregation': {'count': 2, 'complete': True}}
|
||||||
|
row = evaluate_result(question, result, latency_seconds=0)
|
||||||
|
assert not row['strict'] and not row['count_ok']
|
||||||
|
|
||||||
|
|
||||||
|
def test_truncated_result_cannot_pass_strict():
|
||||||
|
assert not evaluate_result({'graph': {}}, {'truncated': True}, latency_seconds=0)['strict']
|
||||||
|
|
||||||
|
|
||||||
|
def test_source_audit_detects_nonexistent_tag_and_omitted_child_category():
|
||||||
|
payload = {'people': [{'id': 'p', 'name': 'Eva Nová', 'source_document': 'p.md'}],
|
||||||
|
'documents': [{'path': 'p.md', 'categories': ['bp2024']},
|
||||||
|
{'path': 'child.md', 'categories': ['tp2023']}],
|
||||||
|
'person_documents': [{'person_id': 'p', 'document_path': path} for path in ['p.md', 'child.md']],
|
||||||
|
'keywords': [{'id': 'nlp', 'name': 'NLP'}], 'document_keywords': [], 'theses': [], 'works': []}
|
||||||
|
question = {'id': 'example', 'split': 'dev', 'category': 'person_multiple_categories', 'question': '',
|
||||||
|
'graph': {'start_entities': [{'type': 'person', 'value': 'Eva Nová'}],
|
||||||
|
'expected_entities': [{'type': 'keyword', 'value': 'Chýbajúci tag'}],
|
||||||
|
'expected_entity_set': ['bp2024'], 'entity_set_mode': 'exact'}}
|
||||||
|
issues = audit_questions([question], payload)['questions'][0]['issues']
|
||||||
|
assert 'keyword_not_in_frontmatter_catalog' in issues
|
||||||
|
assert 'exact_categories_omit_or_add_source_categories' in issues
|
||||||
1045
tools/graphrag/tests/test_graphrag.py
Normal file
1045
tools/graphrag/tests/test_graphrag.py
Normal file
File diff suppressed because it is too large
Load Diff
305
tools/graphrag/tests/test_graphrag_evaluator.py
Normal file
305
tools/graphrag/tests/test_graphrag_evaluator.py
Normal file
@ -0,0 +1,305 @@
|
|||||||
|
from __future__ import annotations
|
||||||
|
|
||||||
|
from tools.graphrag.evaluation.graphrag_evaluator import (
|
||||||
|
aggregate_rows,
|
||||||
|
collect_actual_relationships,
|
||||||
|
evaluate_result,
|
||||||
|
normalize_text,
|
||||||
|
property_present,
|
||||||
|
)
|
||||||
|
|
||||||
|
|
||||||
|
def test_normalize_text() -> None:
|
||||||
|
assert normalize_text(
|
||||||
|
"Dárius Lindvai"
|
||||||
|
) == "darius lindvai"
|
||||||
|
|
||||||
|
|
||||||
|
def test_relationships_can_be_derived_from_fact() -> None:
|
||||||
|
result = {
|
||||||
|
"paths": [],
|
||||||
|
"facts": [
|
||||||
|
{
|
||||||
|
"fact_type": (
|
||||||
|
"person_keyword"
|
||||||
|
),
|
||||||
|
"person": (
|
||||||
|
"Jakub Maruniak"
|
||||||
|
),
|
||||||
|
"keyword": "NLP",
|
||||||
|
}
|
||||||
|
],
|
||||||
|
}
|
||||||
|
|
||||||
|
relationships = (
|
||||||
|
collect_actual_relationships(
|
||||||
|
result
|
||||||
|
)
|
||||||
|
)
|
||||||
|
|
||||||
|
assert relationships == {
|
||||||
|
"HAS_DOCUMENT",
|
||||||
|
"HAS_KEYWORD",
|
||||||
|
}
|
||||||
|
|
||||||
|
|
||||||
|
def test_thesis_properties_from_fact() -> None:
|
||||||
|
result = {
|
||||||
|
"resolved_entities": [],
|
||||||
|
"paths": [],
|
||||||
|
"facts": [
|
||||||
|
{
|
||||||
|
"fact_type": (
|
||||||
|
"person_thesis"
|
||||||
|
),
|
||||||
|
"person": (
|
||||||
|
"Dárius Lindvai"
|
||||||
|
),
|
||||||
|
"title": (
|
||||||
|
"Obnovenie interpunkcie"
|
||||||
|
),
|
||||||
|
"year": 2021,
|
||||||
|
"thesis_type": (
|
||||||
|
"diploma_thesis"
|
||||||
|
),
|
||||||
|
}
|
||||||
|
],
|
||||||
|
}
|
||||||
|
|
||||||
|
assert property_present(
|
||||||
|
"Thesis.title",
|
||||||
|
result,
|
||||||
|
)
|
||||||
|
|
||||||
|
assert property_present(
|
||||||
|
"Thesis.year",
|
||||||
|
result,
|
||||||
|
)
|
||||||
|
|
||||||
|
assert property_present(
|
||||||
|
"Thesis.year|Work.year",
|
||||||
|
result,
|
||||||
|
)
|
||||||
|
|
||||||
|
|
||||||
|
def test_strict_thesis_result() -> None:
|
||||||
|
question = {
|
||||||
|
"id": "g-test",
|
||||||
|
"split": "dev",
|
||||||
|
"category": (
|
||||||
|
"person_title_year"
|
||||||
|
),
|
||||||
|
"difficulty": "medium",
|
||||||
|
"question": (
|
||||||
|
"Aký názov a rok práce?"
|
||||||
|
),
|
||||||
|
"expected_answer_contains": [
|
||||||
|
"Dárius Lindvai",
|
||||||
|
(
|
||||||
|
"Obnovenie interpunkcie "
|
||||||
|
"pomocou hlbokých neurónových sietí"
|
||||||
|
),
|
||||||
|
"2021",
|
||||||
|
],
|
||||||
|
"expected_documents": [
|
||||||
|
(
|
||||||
|
"pages/students/2016/"
|
||||||
|
"darius_lindvai/README.md"
|
||||||
|
)
|
||||||
|
],
|
||||||
|
"expected_source_urls": [
|
||||||
|
(
|
||||||
|
"https://zp.kemt.fei.tuke.sk/"
|
||||||
|
"students/2016/darius_lindvai"
|
||||||
|
)
|
||||||
|
],
|
||||||
|
"graph": {
|
||||||
|
"schema_version": 2,
|
||||||
|
"expected_entities": [
|
||||||
|
{
|
||||||
|
"type": (
|
||||||
|
"thesis_title"
|
||||||
|
),
|
||||||
|
"value": (
|
||||||
|
"Obnovenie interpunkcie "
|
||||||
|
"pomocou hlbokých neurónových sietí"
|
||||||
|
),
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"type": "year",
|
||||||
|
"value": "2021",
|
||||||
|
},
|
||||||
|
],
|
||||||
|
"expected_relations": [
|
||||||
|
"AUTHORED",
|
||||||
|
],
|
||||||
|
"expected_properties": [
|
||||||
|
"Thesis.title",
|
||||||
|
"Thesis.year",
|
||||||
|
],
|
||||||
|
},
|
||||||
|
}
|
||||||
|
|
||||||
|
result = {
|
||||||
|
"strategies": [
|
||||||
|
"entity_resolution",
|
||||||
|
"thesis_constraints",
|
||||||
|
],
|
||||||
|
"resolved_entities": [],
|
||||||
|
"paths": [],
|
||||||
|
"facts": [
|
||||||
|
{
|
||||||
|
"fact_type": (
|
||||||
|
"person_thesis"
|
||||||
|
),
|
||||||
|
"person": (
|
||||||
|
"Dárius Lindvai"
|
||||||
|
),
|
||||||
|
"title": (
|
||||||
|
"Obnovenie interpunkcie "
|
||||||
|
"pomocou hlbokých neurónových sietí"
|
||||||
|
),
|
||||||
|
"year": 2021,
|
||||||
|
"thesis_type": (
|
||||||
|
"diploma_thesis"
|
||||||
|
),
|
||||||
|
"document_path": (
|
||||||
|
"pages/students/2016/"
|
||||||
|
"darius_lindvai/README.md"
|
||||||
|
),
|
||||||
|
"source_url": (
|
||||||
|
"https://zp.kemt.fei.tuke.sk/"
|
||||||
|
"students/2016/darius_lindvai"
|
||||||
|
),
|
||||||
|
}
|
||||||
|
],
|
||||||
|
"documents": [
|
||||||
|
{
|
||||||
|
"document_path": (
|
||||||
|
"pages/students/2016/"
|
||||||
|
"darius_lindvai/README.md"
|
||||||
|
),
|
||||||
|
"source_url": (
|
||||||
|
"https://zp.kemt.fei.tuke.sk/"
|
||||||
|
"students/2016/darius_lindvai"
|
||||||
|
),
|
||||||
|
}
|
||||||
|
],
|
||||||
|
}
|
||||||
|
|
||||||
|
row = evaluate_result(
|
||||||
|
question,
|
||||||
|
result,
|
||||||
|
latency_seconds=0.01,
|
||||||
|
)
|
||||||
|
|
||||||
|
assert row[
|
||||||
|
"strict"
|
||||||
|
] is True
|
||||||
|
|
||||||
|
assert row[
|
||||||
|
"value_score"
|
||||||
|
] == 1.0
|
||||||
|
|
||||||
|
assert row[
|
||||||
|
"document_recall"
|
||||||
|
] == 1.0
|
||||||
|
|
||||||
|
|
||||||
|
def test_failed_result_is_not_strict() -> None:
|
||||||
|
question = {
|
||||||
|
"id": "g-test",
|
||||||
|
"split": "dev",
|
||||||
|
"category": (
|
||||||
|
"shared_keyword_pair"
|
||||||
|
),
|
||||||
|
"difficulty": "hard",
|
||||||
|
"question": "Otázka",
|
||||||
|
"expected_answer_contains": [
|
||||||
|
"NLP",
|
||||||
|
],
|
||||||
|
"expected_documents": [
|
||||||
|
"a.md",
|
||||||
|
],
|
||||||
|
"expected_source_urls": [],
|
||||||
|
"graph": {
|
||||||
|
"schema_version": 2,
|
||||||
|
"expected_entities": [
|
||||||
|
{
|
||||||
|
"type": "keyword",
|
||||||
|
"value": "NLP",
|
||||||
|
}
|
||||||
|
],
|
||||||
|
"expected_relations": [
|
||||||
|
"HAS_KEYWORD",
|
||||||
|
],
|
||||||
|
"expected_properties": [],
|
||||||
|
},
|
||||||
|
}
|
||||||
|
|
||||||
|
result = {
|
||||||
|
"strategies": [],
|
||||||
|
"resolved_entities": [],
|
||||||
|
"paths": [],
|
||||||
|
"facts": [],
|
||||||
|
"documents": [],
|
||||||
|
}
|
||||||
|
|
||||||
|
row = evaluate_result(
|
||||||
|
question,
|
||||||
|
result,
|
||||||
|
latency_seconds=0.01,
|
||||||
|
)
|
||||||
|
|
||||||
|
assert row[
|
||||||
|
"strict"
|
||||||
|
] is False
|
||||||
|
|
||||||
|
|
||||||
|
def test_aggregate_rows() -> None:
|
||||||
|
rows = [
|
||||||
|
{
|
||||||
|
"strict": True,
|
||||||
|
"error": None,
|
||||||
|
"value_score": 1.0,
|
||||||
|
"entity_score": 1.0,
|
||||||
|
"relation_score": 1.0,
|
||||||
|
"property_score": 1.0,
|
||||||
|
"relation_choice_score": 1.0,
|
||||||
|
"document_recall": 1.0,
|
||||||
|
"source_recall": 1.0,
|
||||||
|
"latency_seconds": 0.1,
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"strict": False,
|
||||||
|
"error": None,
|
||||||
|
"value_score": 0.5,
|
||||||
|
"entity_score": 0.5,
|
||||||
|
"relation_score": 0.5,
|
||||||
|
"property_score": 0.5,
|
||||||
|
"relation_choice_score": 0.5,
|
||||||
|
"document_recall": 0.5,
|
||||||
|
"source_recall": 0.5,
|
||||||
|
"latency_seconds": 0.2,
|
||||||
|
},
|
||||||
|
]
|
||||||
|
|
||||||
|
summary = aggregate_rows(
|
||||||
|
rows
|
||||||
|
)
|
||||||
|
|
||||||
|
assert summary[
|
||||||
|
"questions"
|
||||||
|
] == 2
|
||||||
|
|
||||||
|
assert summary[
|
||||||
|
"strict_count"
|
||||||
|
] == 1
|
||||||
|
|
||||||
|
assert summary[
|
||||||
|
"strict_accuracy"
|
||||||
|
] == 0.5
|
||||||
|
|
||||||
|
assert summary[
|
||||||
|
"latency_mean_seconds"
|
||||||
|
] == 0.15
|
||||||
72
tools/graphrag/tests/test_graphrag_freeze.py
Normal file
72
tools/graphrag/tests/test_graphrag_freeze.py
Normal file
@ -0,0 +1,72 @@
|
|||||||
|
from __future__ import annotations
|
||||||
|
|
||||||
|
import copy
|
||||||
|
|
||||||
|
import pytest
|
||||||
|
|
||||||
|
from tools.graphrag.evaluation.freeze_graphrag import make_freeze
|
||||||
|
from tools.graphrag.evaluation.reproducibility import sha256_file, verify_freeze
|
||||||
|
|
||||||
|
|
||||||
|
@pytest.fixture
|
||||||
|
def freeze_case():
|
||||||
|
questions = [{'id': 'development-a', 'split': 'dev'}, {'id': 'holdout-a', 'split': 'test'}]
|
||||||
|
fingerprints = {'implementation': {'search.py': 'version-one'}, 'dataset_sha256': 'dataset', 'inputs': {}}
|
||||||
|
graph = {'sha256': 'graph', 'nodes': 1, 'relationships': 0}
|
||||||
|
audit = {'questions': [{'id': q['id']} for q in questions], 'by_split': {},
|
||||||
|
'dataset_sha256': 'dataset', 'inputs': {}}
|
||||||
|
dev = {'configuration': {'split': 'dev', 'limit': 40, 'max_entities': 8},
|
||||||
|
'summary': {'error_count': 0}, 'questions': [{'id': 'development-a', 'error': None}],
|
||||||
|
'run_metadata': {'fingerprints': fingerprints, 'graph': graph}}
|
||||||
|
return questions, fingerprints, graph, audit, dev
|
||||||
|
|
||||||
|
|
||||||
|
def test_freeze_rejects_partial_dev(freeze_case):
|
||||||
|
questions, fingerprints, _, audit, dev = freeze_case
|
||||||
|
dev['questions'] = []
|
||||||
|
with pytest.raises(RuntimeError, match='complete DEV'):
|
||||||
|
make_freeze(dev, questions, fingerprints, audit)
|
||||||
|
|
||||||
|
|
||||||
|
def test_freeze_rejects_runtime_errors(freeze_case):
|
||||||
|
questions, fingerprints, _, audit, dev = freeze_case
|
||||||
|
dev['questions'][0]['error'] = 'database unavailable'
|
||||||
|
with pytest.raises(RuntimeError, match='runtime errors'):
|
||||||
|
make_freeze(dev, questions, fingerprints, audit)
|
||||||
|
|
||||||
|
|
||||||
|
def test_freeze_rejects_code_changed_after_dev(freeze_case):
|
||||||
|
questions, fingerprints, _, audit, dev = freeze_case
|
||||||
|
changed = copy.deepcopy(fingerprints)
|
||||||
|
changed['implementation']['search.py'] = 'version-two'
|
||||||
|
with pytest.raises(RuntimeError, match='changed after DEV'):
|
||||||
|
make_freeze(dev, questions, changed, audit)
|
||||||
|
|
||||||
|
|
||||||
|
def test_freeze_rejects_stale_source_audit(freeze_case):
|
||||||
|
questions, fingerprints, _, audit, dev = freeze_case
|
||||||
|
audit['inputs'] = {'documents': 'old-snapshot'}
|
||||||
|
with pytest.raises(RuntimeError, match='audit does not match'):
|
||||||
|
make_freeze(dev, questions, fingerprints, audit)
|
||||||
|
|
||||||
|
|
||||||
|
@pytest.mark.parametrize('mutation', ['code', 'graph', 'parameters', 'audit'])
|
||||||
|
def test_holdout_rejects_changes_after_freeze(freeze_case, tmp_path, mutation):
|
||||||
|
questions, fingerprints, graph, audit, dev = freeze_case
|
||||||
|
manifest = make_freeze(dev, questions, fingerprints, audit)
|
||||||
|
audit_path = tmp_path / 'audit.json'
|
||||||
|
audit_path.write_text('original-audit')
|
||||||
|
manifest['audit_sha256'] = sha256_file(audit_path)
|
||||||
|
metadata = {'fingerprints': copy.deepcopy(fingerprints)}
|
||||||
|
actual_graph = dict(graph)
|
||||||
|
limit = 40
|
||||||
|
if mutation == 'code':
|
||||||
|
metadata['fingerprints']['implementation']['search.py'] = 'changed'
|
||||||
|
elif mutation == 'graph':
|
||||||
|
actual_graph['sha256'] = 'changed'
|
||||||
|
elif mutation == 'parameters':
|
||||||
|
limit = 41
|
||||||
|
else:
|
||||||
|
audit_path.write_text('changed-audit')
|
||||||
|
with pytest.raises(RuntimeError, match='TEST refused'):
|
||||||
|
verify_freeze(manifest, metadata, actual_graph, limit=limit, max_entities=8, audit=audit_path)
|
||||||
11
tools/graphrag/tests/test_graphrag_research_v2.py
Normal file
11
tools/graphrag/tests/test_graphrag_research_v2.py
Normal file
@ -0,0 +1,11 @@
|
|||||||
|
from tools.graphrag.graphrag import extract_works
|
||||||
|
from .test_graphrag import make_document, make_chunk
|
||||||
|
|
||||||
|
|
||||||
|
def test_scientific_project_heading_has_research_project_semantics():
|
||||||
|
works = extract_works(make_document(categories=['vp2024']), [make_chunk(
|
||||||
|
0, ['Vedecký projekt 2024'],
|
||||||
|
'Sekcia: Vedecký projekt 2024\nNázov: Overovanie jazykových modelov\n')])
|
||||||
|
assert len(works) == 1
|
||||||
|
assert works[0]['work_type'] == 'research_project'
|
||||||
|
assert works[0]['year'] == 2024
|
||||||
171
tools/graphrag/tests/test_graphrag_root_title.py
Normal file
171
tools/graphrag/tests/test_graphrag_root_title.py
Normal file
@ -0,0 +1,171 @@
|
|||||||
|
from __future__ import annotations
|
||||||
|
|
||||||
|
from tools.graphrag.graphrag import (
|
||||||
|
build_graph_payload,
|
||||||
|
extract_works,
|
||||||
|
)
|
||||||
|
|
||||||
|
|
||||||
|
DARIUS_PATH = (
|
||||||
|
"pages/students/2016/"
|
||||||
|
"darius_lindvai/README.md"
|
||||||
|
)
|
||||||
|
|
||||||
|
|
||||||
|
def make_darius_document() -> dict:
|
||||||
|
return {
|
||||||
|
"path": DARIUS_PATH,
|
||||||
|
"title": "Dárius Lindvai",
|
||||||
|
"categories": [
|
||||||
|
"dp2021",
|
||||||
|
"bp2019",
|
||||||
|
],
|
||||||
|
"tags": [
|
||||||
|
"nn",
|
||||||
|
"interpunction",
|
||||||
|
"nlp",
|
||||||
|
],
|
||||||
|
"author": "Daniel Hladek",
|
||||||
|
"published": True,
|
||||||
|
}
|
||||||
|
|
||||||
|
|
||||||
|
def make_root_chunk() -> dict:
|
||||||
|
text = (
|
||||||
|
"Dokument: Dárius Lindvai\n\n"
|
||||||
|
"Rok začiatku štúdia: 2016\n\n"
|
||||||
|
"Repozitár so zdrojovými kódmi\n\n"
|
||||||
|
"Názov: Obnovenie interpunkcie pomocou "
|
||||||
|
"hlbokých neurónových sietí\n\n"
|
||||||
|
"1. Vypracujte prehľad metód.\n"
|
||||||
|
"2. Vyberte vhodnú metódu."
|
||||||
|
)
|
||||||
|
|
||||||
|
return {
|
||||||
|
"chunk_id": (
|
||||||
|
f"{DARIUS_PATH}::chunk-0"
|
||||||
|
),
|
||||||
|
"document_path": DARIUS_PATH,
|
||||||
|
"title": "Dárius Lindvai",
|
||||||
|
"categories": [
|
||||||
|
"dp2021",
|
||||||
|
"bp2019",
|
||||||
|
],
|
||||||
|
"tags": [
|
||||||
|
"nn",
|
||||||
|
"interpunction",
|
||||||
|
"nlp",
|
||||||
|
],
|
||||||
|
"author": "Daniel Hladek",
|
||||||
|
"published": True,
|
||||||
|
"chunk_index": 0,
|
||||||
|
"heading_paths": [
|
||||||
|
[
|
||||||
|
"Dárius Lindvai",
|
||||||
|
]
|
||||||
|
],
|
||||||
|
"text": text,
|
||||||
|
"text_length": len(text),
|
||||||
|
"token_count": 1,
|
||||||
|
"content_hash": "darius-root",
|
||||||
|
}
|
||||||
|
|
||||||
|
|
||||||
|
def test_root_title_creates_missing_latest_thesis() -> None:
|
||||||
|
works = extract_works(
|
||||||
|
make_darius_document(),
|
||||||
|
[
|
||||||
|
make_root_chunk(),
|
||||||
|
],
|
||||||
|
)
|
||||||
|
|
||||||
|
diploma = [
|
||||||
|
work
|
||||||
|
for work in works
|
||||||
|
if (
|
||||||
|
work["work_type"]
|
||||||
|
== "diploma_thesis"
|
||||||
|
)
|
||||||
|
]
|
||||||
|
|
||||||
|
bachelor = [
|
||||||
|
work
|
||||||
|
for work in works
|
||||||
|
if (
|
||||||
|
work["work_type"]
|
||||||
|
== "bachelor_thesis"
|
||||||
|
)
|
||||||
|
]
|
||||||
|
|
||||||
|
assert len(
|
||||||
|
diploma
|
||||||
|
) == 1
|
||||||
|
|
||||||
|
assert bachelor == []
|
||||||
|
|
||||||
|
thesis = diploma[0]
|
||||||
|
|
||||||
|
assert thesis[
|
||||||
|
"year"
|
||||||
|
] == 2021
|
||||||
|
|
||||||
|
assert thesis[
|
||||||
|
"heading"
|
||||||
|
] == "Diplomová práca 2021"
|
||||||
|
|
||||||
|
assert thesis[
|
||||||
|
"title"
|
||||||
|
] == (
|
||||||
|
"Obnovenie interpunkcie pomocou "
|
||||||
|
"hlbokých neurónových sietí"
|
||||||
|
)
|
||||||
|
|
||||||
|
assert thesis[
|
||||||
|
"source_chunk_ids"
|
||||||
|
] == [
|
||||||
|
f"{DARIUS_PATH}::chunk-0"
|
||||||
|
]
|
||||||
|
|
||||||
|
|
||||||
|
def test_graph_payload_contains_darius_thesis() -> None:
|
||||||
|
payload = build_graph_payload(
|
||||||
|
[
|
||||||
|
make_darius_document(),
|
||||||
|
],
|
||||||
|
[
|
||||||
|
make_root_chunk(),
|
||||||
|
],
|
||||||
|
)
|
||||||
|
|
||||||
|
assert len(
|
||||||
|
payload[
|
||||||
|
"theses"
|
||||||
|
]
|
||||||
|
) == 1
|
||||||
|
|
||||||
|
thesis = payload[
|
||||||
|
"theses"
|
||||||
|
][0]
|
||||||
|
|
||||||
|
assert thesis[
|
||||||
|
"thesis_type"
|
||||||
|
] == "diploma_thesis"
|
||||||
|
|
||||||
|
assert thesis[
|
||||||
|
"year"
|
||||||
|
] == 2021
|
||||||
|
|
||||||
|
assert thesis[
|
||||||
|
"title"
|
||||||
|
] == (
|
||||||
|
"Obnovenie interpunkcie pomocou "
|
||||||
|
"hlbokých neurónových sietí"
|
||||||
|
)
|
||||||
|
|
||||||
|
assert thesis[
|
||||||
|
"source_document"
|
||||||
|
] == DARIUS_PATH
|
||||||
|
|
||||||
|
assert payload[
|
||||||
|
"works"
|
||||||
|
] == []
|
||||||
95
tools/graphrag/tests/test_source_oracle_v2.py
Normal file
95
tools/graphrag/tests/test_source_oracle_v2.py
Normal file
@ -0,0 +1,95 @@
|
|||||||
|
from __future__ import annotations
|
||||||
|
|
||||||
|
from pathlib import Path
|
||||||
|
|
||||||
|
from tools.graphrag.evaluation.source_oracle import load_source_oracle, supporting_documents
|
||||||
|
from tools.graphrag.evaluation.benchmark_v2 import make_case, validate_case
|
||||||
|
|
||||||
|
|
||||||
|
def source_fixture(tmp_path: Path):
|
||||||
|
root = tmp_path / 'wiki'
|
||||||
|
profile = 'pages/students/2020/eva_nova/README.md'
|
||||||
|
path = root / profile
|
||||||
|
path.parent.mkdir(parents=True)
|
||||||
|
path.write_text('''---
|
||||||
|
title: Eva Nová
|
||||||
|
taxonomy:
|
||||||
|
category: [bp2025]
|
||||||
|
tag: [rag]
|
||||||
|
author: Autor Správny
|
||||||
|
---
|
||||||
|
Rok začiatku štúdia: 2020
|
||||||
|
# Diplomový projekt 2024
|
||||||
|
Téma: Výskum jazyka pomocou modelov
|
||||||
|
## Bakalárska práca 2025
|
||||||
|
Názov: Overovanie jazykových modelov
|
||||||
|
''')
|
||||||
|
child = root / 'pages/students/2020/eva_nova/projekt/README.md'
|
||||||
|
child.parent.mkdir(parents=True)
|
||||||
|
child.write_text('''---
|
||||||
|
title: Pomocný projekt
|
||||||
|
taxonomy:
|
||||||
|
category: [tp2023]
|
||||||
|
tag: [python]
|
||||||
|
author: Autor Iný
|
||||||
|
---
|
||||||
|
Pomocný dokument projektu.
|
||||||
|
''')
|
||||||
|
return load_source_oracle(root), profile
|
||||||
|
|
||||||
|
|
||||||
|
def test_raw_oracle_distinguishes_year_roles_and_academic_types(tmp_path):
|
||||||
|
oracle, _ = source_fixture(tmp_path)
|
||||||
|
person = oracle['people']['Eva Nová']
|
||||||
|
assert person['start_year'] == 2020
|
||||||
|
assert {(row['academic_kind'], row['academic_type'], row['year']) for row in person['academics']} == {
|
||||||
|
('Work', 'diploma_project', 2024), ('Thesis', 'bachelor_thesis', 2025)}
|
||||||
|
for row in person['academics']:
|
||||||
|
lines = oracle['documents'][row['document_path']]['raw_text'].splitlines()
|
||||||
|
assert row['title'] in lines[row['title_line'] - 1]
|
||||||
|
assert str(row['year']) in lines[row['heading_line'] - 1]
|
||||||
|
|
||||||
|
|
||||||
|
def test_categories_include_child_documents_without_becoming_work_keywords(tmp_path):
|
||||||
|
oracle, profile = source_fixture(tmp_path)
|
||||||
|
assert oracle['people']['Eva Nová']['categories'] == ['bp2025', 'tp2023']
|
||||||
|
assert set(oracle['people']['Eva Nová']['tags']) == {'rag', 'python'}
|
||||||
|
assert not supporting_documents(oracle, 'Eva Nová', keyword='jazykové modely')
|
||||||
|
assert supporting_documents(oracle, 'Eva Nová', category='bp2025', document_author='Autor Správny') == [profile]
|
||||||
|
assert not supporting_documents(oracle, 'Eva Nová', category='bp2025', document_author='Autor Iný')
|
||||||
|
|
||||||
|
|
||||||
|
def test_source_audit_rejects_falsely_negative_existing_tag(tmp_path):
|
||||||
|
oracle, _ = source_fixture(tmp_path)
|
||||||
|
case = make_case('example', 'dev', 'negative_lookup', 'Má Eva Nová kľúčové slovo rag?',
|
||||||
|
['Eva Nová'], oracle, [], no_answer=True,
|
||||||
|
negative_constraints={'keyword': 'rag'})
|
||||||
|
assert 'negative_conjunction_actually_satisfied' in validate_case(case, oracle)
|
||||||
|
case['graph']['negative_constraints']['keyword'] = 'neexistujucitag'
|
||||||
|
assert validate_case(case, oracle) == []
|
||||||
|
|
||||||
|
|
||||||
|
def test_source_audit_rejects_wrong_count(tmp_path):
|
||||||
|
oracle, _ = source_fixture(tmp_path)
|
||||||
|
case = make_case('count', 'dev', 'candidate_set_aggregation',
|
||||||
|
'Z kandidátov Eva Nová vyber osoby s prácou v roku 2025. Koľko ich je?',
|
||||||
|
['Eva Nová'], oracle, [], expected_set=[], set_field='person', count=0)
|
||||||
|
assert 'incorrect_candidate_set_or_count' in validate_case(case, oracle)
|
||||||
|
|
||||||
|
|
||||||
|
def test_source_audit_rejects_faked_partition_profiles(tmp_path):
|
||||||
|
oracle, _ = source_fixture(tmp_path)
|
||||||
|
case = make_case('example', 'dev', 'person_title_year', 'Aká práca?', ['Eva Nová'], oracle,
|
||||||
|
[{'person': 'Eva Nová', 'year': 2025}])
|
||||||
|
case['graph']['source_profiles'] = ['pages/students/fake/README.md']
|
||||||
|
assert 'incorrect_source_profile_partition' in validate_case(case, oracle)
|
||||||
|
|
||||||
|
|
||||||
|
def test_academic_range_uses_supported_category_end_year(tmp_path):
|
||||||
|
oracle, profile = source_fixture(tmp_path)
|
||||||
|
path = Path(oracle['wiki_root']) / profile
|
||||||
|
path.write_text(path.read_text().replace('bp2025', 'bp2026').replace(
|
||||||
|
'Bakalárska práca 2025', 'Bakalárska práca 2025/26'))
|
||||||
|
person = load_source_oracle(Path(oracle['wiki_root']))['people']['Eva Nová']
|
||||||
|
thesis = next(row for row in person['academics'] if row['academic_kind'] == 'Thesis')
|
||||||
|
assert thesis['year'] == 2026
|
||||||
0
tools/rag/__init__.py
Normal file
0
tools/rag/__init__.py
Normal file
@ -10,13 +10,13 @@ from pathlib import Path
|
|||||||
from rich import print
|
from rich import print
|
||||||
|
|
||||||
|
|
||||||
PROJECT_ROOT = Path(__file__).resolve().parents[1]
|
PROJECT_ROOT = Path(__file__).resolve().parents[2]
|
||||||
|
|
||||||
if str(PROJECT_ROOT) not in sys.path:
|
if str(PROJECT_ROOT) not in sys.path:
|
||||||
sys.path.insert(0, str(PROJECT_ROOT))
|
sys.path.insert(0, str(PROJECT_ROOT))
|
||||||
|
|
||||||
|
|
||||||
from scripts.common import (
|
from tools.rag.common import (
|
||||||
CHUNKS_FILE,
|
CHUNKS_FILE,
|
||||||
PAGES_ROOT,
|
PAGES_ROOT,
|
||||||
ZPWIKI_ROOT,
|
ZPWIKI_ROOT,
|
||||||
@ -10,19 +10,19 @@ from typing import Any
|
|||||||
from rich import print
|
from rich import print
|
||||||
|
|
||||||
|
|
||||||
PROJECT_ROOT = Path(__file__).resolve().parents[1]
|
PROJECT_ROOT = Path(__file__).resolve().parents[2]
|
||||||
|
|
||||||
if str(PROJECT_ROOT) not in sys.path:
|
if str(PROJECT_ROOT) not in sys.path:
|
||||||
sys.path.insert(0, str(PROJECT_ROOT))
|
sys.path.insert(0, str(PROJECT_ROOT))
|
||||||
|
|
||||||
|
|
||||||
from scripts.common import (
|
from tools.rag.common import (
|
||||||
CHUNKS_FILE,
|
CHUNKS_FILE,
|
||||||
DB_FILE,
|
DB_FILE,
|
||||||
DOCUMENTS_FILE,
|
DOCUMENTS_FILE,
|
||||||
read_json,
|
read_json,
|
||||||
)
|
)
|
||||||
from scripts.embedding_utils import (
|
from tools.rag.embedding_utils import (
|
||||||
build_embedding_text,
|
build_embedding_text,
|
||||||
embed_passages,
|
embed_passages,
|
||||||
embedding_model_name,
|
embedding_model_name,
|
||||||
@ -10,7 +10,7 @@ from typing import Any
|
|||||||
import frontmatter
|
import frontmatter
|
||||||
|
|
||||||
|
|
||||||
PROJECT_ROOT = Path(__file__).resolve().parents[1]
|
PROJECT_ROOT = Path(__file__).resolve().parents[2]
|
||||||
|
|
||||||
ZPWIKI_ROOT = Path(
|
ZPWIKI_ROOT = Path(
|
||||||
os.getenv(
|
os.getenv(
|
||||||
0
tools/rag/evaluation/__init__.py
Normal file
0
tools/rag/evaluation/__init__.py
Normal file
@ -9,7 +9,7 @@ from pathlib import Path
|
|||||||
from typing import Any
|
from typing import Any
|
||||||
|
|
||||||
|
|
||||||
PROJECT_ROOT = Path(__file__).resolve().parents[1]
|
PROJECT_ROOT = Path(__file__).resolve().parents[3]
|
||||||
|
|
||||||
if str(PROJECT_ROOT) not in sys.path:
|
if str(PROJECT_ROOT) not in sys.path:
|
||||||
sys.path.insert(
|
sys.path.insert(
|
||||||
@ -18,7 +18,7 @@ if str(PROJECT_ROOT) not in sys.path:
|
|||||||
)
|
)
|
||||||
|
|
||||||
|
|
||||||
from evaluation.rag_answer_data import (
|
from tools.rag.evaluation.rag_answer_data import (
|
||||||
DEFAULT_DELAY,
|
DEFAULT_DELAY,
|
||||||
apply_question_overrides,
|
apply_question_overrides,
|
||||||
questions_fingerprint,
|
questions_fingerprint,
|
||||||
@ -27,7 +27,7 @@ from evaluation.rag_answer_data import (
|
|||||||
validate_answer_questions,
|
validate_answer_questions,
|
||||||
validate_string_list,
|
validate_string_list,
|
||||||
)
|
)
|
||||||
from evaluation.rag_answer_state import (
|
from tools.rag.evaluation.rag_answer_state import (
|
||||||
PARTIAL_SCHEMA_VERSION,
|
PARTIAL_SCHEMA_VERSION,
|
||||||
build_base_result,
|
build_base_result,
|
||||||
build_error_result,
|
build_error_result,
|
||||||
@ -43,11 +43,11 @@ from evaluation.rag_answer_state import (
|
|||||||
save_json_results,
|
save_json_results,
|
||||||
validate_resume_compatibility,
|
validate_resume_compatibility,
|
||||||
)
|
)
|
||||||
from evaluation.rag_metrics import (
|
from tools.rag.evaluation.rag_metrics import (
|
||||||
evaluate_answer,
|
evaluate_answer,
|
||||||
summarize_results,
|
summarize_results,
|
||||||
)
|
)
|
||||||
from evaluation.rag_runner import (
|
from tools.rag.evaluation.rag_runner import (
|
||||||
DEFAULT_BACKOFF_BASE,
|
DEFAULT_BACKOFF_BASE,
|
||||||
DEFAULT_BACKOFF_MAX,
|
DEFAULT_BACKOFF_MAX,
|
||||||
DEFAULT_MAX_ATTEMPTS,
|
DEFAULT_MAX_ATTEMPTS,
|
||||||
@ -59,14 +59,13 @@ from evaluation.rag_runner import (
|
|||||||
request_json,
|
request_json,
|
||||||
run_question,
|
run_question,
|
||||||
)
|
)
|
||||||
from evaluation.retrieval_runner import (
|
from tools.rag.evaluation.retrieval_runner import (
|
||||||
load_questions,
|
load_questions,
|
||||||
)
|
)
|
||||||
|
|
||||||
|
|
||||||
EVALUATION_DIR = (
|
EVALUATION_DIR = (
|
||||||
PROJECT_ROOT
|
Path(__file__).resolve().parent
|
||||||
/ "evaluation"
|
|
||||||
)
|
)
|
||||||
|
|
||||||
JSON_FILES_DIR = (
|
JSON_FILES_DIR = (
|
||||||
@ -8,19 +8,19 @@ from pathlib import Path
|
|||||||
from typing import Any
|
from typing import Any
|
||||||
|
|
||||||
|
|
||||||
PROJECT_ROOT = Path(__file__).resolve().parents[1]
|
PROJECT_ROOT = Path(__file__).resolve().parents[3]
|
||||||
|
|
||||||
if str(PROJECT_ROOT) not in sys.path:
|
if str(PROJECT_ROOT) not in sys.path:
|
||||||
sys.path.insert(0, str(PROJECT_ROOT))
|
sys.path.insert(0, str(PROJECT_ROOT))
|
||||||
|
|
||||||
|
|
||||||
from evaluation.metrics import (
|
from tools.rag.evaluation.metrics import (
|
||||||
aggregate_by_category,
|
aggregate_by_category,
|
||||||
aggregate_by_difficulty,
|
aggregate_by_difficulty,
|
||||||
aggregate_metrics,
|
aggregate_metrics,
|
||||||
evaluate_question_mode,
|
evaluate_question_mode,
|
||||||
)
|
)
|
||||||
from evaluation.retrieval_runner import (
|
from tools.rag.evaluation.retrieval_runner import (
|
||||||
EVALUATION_MODES,
|
EVALUATION_MODES,
|
||||||
count_splits,
|
count_splits,
|
||||||
filter_questions_by_split,
|
filter_questions_by_split,
|
||||||
@ -29,10 +29,10 @@ from evaluation.retrieval_runner import (
|
|||||||
retrieve_all_modes,
|
retrieve_all_modes,
|
||||||
validate_dataset,
|
validate_dataset,
|
||||||
)
|
)
|
||||||
from scripts.common import DB_FILE
|
from tools.rag.common import DB_FILE
|
||||||
|
|
||||||
|
|
||||||
EVALUATION_DIR = PROJECT_ROOT / "evaluation"
|
EVALUATION_DIR = Path(__file__).resolve().parent
|
||||||
JSON_FILES_DIR = EVALUATION_DIR / "json_files"
|
JSON_FILES_DIR = EVALUATION_DIR / "json_files"
|
||||||
|
|
||||||
QUESTIONS_PATH = JSON_FILES_DIR / "questions.json"
|
QUESTIONS_PATH = JSON_FILES_DIR / "questions.json"
|
||||||
20833
tools/rag/evaluation/json_files/questions_before_override_merge.json
Normal file
20833
tools/rag/evaluation/json_files/questions_before_override_merge.json
Normal file
File diff suppressed because it is too large
Load Diff
@ -0,0 +1,138 @@
|
|||||||
|
{
|
||||||
|
"q0005": {
|
||||||
|
"question": "Aká téma diplomovej práce je uvedená pri osobe „Ján Holp“?"
|
||||||
|
},
|
||||||
|
"q0010": {
|
||||||
|
"question": "Je rok 2016 rokom diplomovej práce Jána Holpa? Ak nie, čo rok 2016 označuje a v ktorom roku je uvedená jeho diplomová práca?"
|
||||||
|
},
|
||||||
|
"q0020": {
|
||||||
|
"question": "Aká téma diplomovej práce je uvedená pri osobe „Maroš Harahus“?"
|
||||||
|
},
|
||||||
|
"q0031": {
|
||||||
|
"question": "Aká téma diplomovej práce je uvedená pri osobe „Tomáš Kuchárik“?"
|
||||||
|
},
|
||||||
|
"q0042": {
|
||||||
|
"question": "Aká téma diplomovej práce je uvedená pri osobe „Jakub Maruniak“?"
|
||||||
|
},
|
||||||
|
"q0056": {
|
||||||
|
"question": "Aká téma diplomovej práce je uvedená pri osobe „Lukáš Pokrývka“?"
|
||||||
|
},
|
||||||
|
"q0071": {
|
||||||
|
"question": "Aká téma diplomovej práce je uvedená pri osobe „Dárius Lindvai“?"
|
||||||
|
},
|
||||||
|
"q0086": {
|
||||||
|
"question": "Aká téma diplomovej práce je uvedená pri osobe „Dominik Nagy“?"
|
||||||
|
},
|
||||||
|
"q0097": {
|
||||||
|
"question": "Aká téma diplomovej práce je uvedená pri osobe „Márk Fehér“?"
|
||||||
|
},
|
||||||
|
"q0106": {
|
||||||
|
"question": "Aká téma bakalárskej práce je uvedená pri osobe „Patrik Pavlišin“?"
|
||||||
|
},
|
||||||
|
"q0116": {
|
||||||
|
"question": "Aká téma bakalárskej práce je uvedená pri osobe „Dmytro Ushatenko“?"
|
||||||
|
},
|
||||||
|
"q0126": {
|
||||||
|
"question": "Aká téma bakalárskej práce je uvedená pri osobe „Ondrej Megela“?"
|
||||||
|
},
|
||||||
|
"q0136": {
|
||||||
|
"question": "Aká téma bakalárskej práce je uvedená pri osobe „Martin Wencel“?"
|
||||||
|
},
|
||||||
|
"q0146": {
|
||||||
|
"question": "Aká téma diplomovej práce je uvedená pri osobe „Dávid Omasta“?"
|
||||||
|
},
|
||||||
|
"q0157": {
|
||||||
|
"question": "Aká téma bakalárskej práce je uvedená pri osobe „Filip Tomáš“?"
|
||||||
|
},
|
||||||
|
"q0168": {
|
||||||
|
"question": "Aká téma bakalárskej práce je uvedená pri osobe „Kristián Sopkovič“?"
|
||||||
|
},
|
||||||
|
"q0178": {
|
||||||
|
"question": "Aká téma bakalárskej práce je uvedená pri osobe „Michal Stromko“?"
|
||||||
|
},
|
||||||
|
"q0189": {
|
||||||
|
"question": "Aká téma bakalárskej práce je uvedená pri osobe „Alina Vitko“?"
|
||||||
|
},
|
||||||
|
"q0204": {
|
||||||
|
"question": "Aká téma bakalárskej práce je uvedená pri osobe „Artem Yatsenko“?"
|
||||||
|
},
|
||||||
|
"q0218": {
|
||||||
|
"question": "Aká téma diplomovej práce je uvedená pri osobe „Martin Šarišský“?"
|
||||||
|
},
|
||||||
|
"q0233": {
|
||||||
|
"question": "Aká téma diplomovej práce je uvedená pri osobe „Matej Ščišľak“?"
|
||||||
|
},
|
||||||
|
"q0249": {
|
||||||
|
"question": "Aká téma bakalárskej práce je uvedená pri osobe „Vladimír Ferko“?"
|
||||||
|
},
|
||||||
|
"q0264": {
|
||||||
|
"question": "Aká téma bakalárskej práce je uvedená pri osobe „Eduard Matovka“?"
|
||||||
|
},
|
||||||
|
"q0279": {
|
||||||
|
"question": "Aká téma diplomovej práce je uvedená pri osobe „Matej Novotný“?"
|
||||||
|
},
|
||||||
|
"q0292": {
|
||||||
|
"question": "Aká téma diplomovej práce je uvedená pri osobe „Andrii Pervashov“?"
|
||||||
|
},
|
||||||
|
"q0307": {
|
||||||
|
"question": "Aká téma diplomovej práce je uvedená pri osobe „Valerii Kutsenko“?"
|
||||||
|
},
|
||||||
|
"q0321": {
|
||||||
|
"question": "Aká téma diplomovej práce je uvedená pri osobe „Oleh Poiasnik“?"
|
||||||
|
},
|
||||||
|
"q0337": {
|
||||||
|
"question": "Aká téma bakalárskej práce je uvedená pri osobe „Tetiana Mohorian“?"
|
||||||
|
},
|
||||||
|
"q0352": {
|
||||||
|
"question": "Aká téma bakalárskej práce je uvedená pri osobe „Vladyslav Yanchenko“?"
|
||||||
|
},
|
||||||
|
"q0367": {
|
||||||
|
"question": "Aká téma bakalárskej práce je uvedená pri osobe „Daniil Huzenko“?"
|
||||||
|
},
|
||||||
|
"q0382": {
|
||||||
|
"question": "Aká téma diplomového projektu je uvedená pri osobe „Ján Pták“?"
|
||||||
|
},
|
||||||
|
"q0398": {
|
||||||
|
"question": "Aká téma diplomového projektu je uvedená pri osobe „Ján Malinovský“?"
|
||||||
|
},
|
||||||
|
"q0413": {
|
||||||
|
"question": "Aká téma bakalárskej práce je uvedená pri osobe „Maksym Zatirka“?"
|
||||||
|
},
|
||||||
|
"q0427": {
|
||||||
|
"question": "Aká téma bakalárskej práce je uvedená pri osobe „Rostyslav Rodzhuk“?"
|
||||||
|
},
|
||||||
|
"q0441": {
|
||||||
|
"question": "Aká téma bakalárskej práce je uvedená pri osobe „Yevhenii Medushivskyi“?"
|
||||||
|
},
|
||||||
|
"q0456": {
|
||||||
|
"question": "Aká téma bakalárskej práce je uvedená pri osobe „Ronald Zalacko“?"
|
||||||
|
},
|
||||||
|
"q0470": {
|
||||||
|
"question": "Aká téma bakalárskej práce je uvedená pri osobe „Oleksandr Dorybohov“?"
|
||||||
|
},
|
||||||
|
"q0484": {
|
||||||
|
"question": "Aká téma bakalárskej práce je uvedená pri osobe „Simona Bobrovčanová“?"
|
||||||
|
},
|
||||||
|
"q0499": {
|
||||||
|
"question": "Aká téma bakalárskej práce je uvedená pri osobe „Samuel Džurina“?"
|
||||||
|
},
|
||||||
|
"q0514": {
|
||||||
|
"question": "Aká téma bakalárskej práce je uvedená pri osobe „Samuel Vasiľ“?"
|
||||||
|
},
|
||||||
|
"q0529": {
|
||||||
|
"question": "Aká téma bakalárskej práce je uvedená pri osobe „Denis Le Thanh“?"
|
||||||
|
},
|
||||||
|
"q0024": {
|
||||||
|
"question": "Ktorý študentský dokument o grafových neurónových sieťach má v metadátach ako autora dokumentu uvedeného Maroša Harahusa?",
|
||||||
|
"expected_answer_contains": [
|
||||||
|
"Dmytro Mural",
|
||||||
|
"Maroš Harahus",
|
||||||
|
"grafové neurónové siete"
|
||||||
|
],
|
||||||
|
"expected_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"
|
||||||
|
],
|
||||||
|
"should_answer": true,
|
||||||
|
"note": "Answer-level disambiguation: študentský dokument patrí Dmytrovi Muralovi; Maroš Harahus je v jeho metadátach uvedený ako autor dokumentu. Nemá sa zamieňať autor dokumentu so študentom, ktorý prácu vypracoval."
|
||||||
|
}
|
||||||
|
}
|
||||||
@ -5,7 +5,7 @@ import json
|
|||||||
from pathlib import Path
|
from pathlib import Path
|
||||||
from typing import Any
|
from typing import Any
|
||||||
|
|
||||||
from evaluation.retrieval_runner import filter_questions_by_split
|
from tools.rag.evaluation.retrieval_runner import filter_questions_by_split
|
||||||
|
|
||||||
|
|
||||||
DEFAULT_DELAY = 0.5
|
DEFAULT_DELAY = 0.5
|
||||||
@ -8,13 +8,13 @@ from datetime import datetime, timezone
|
|||||||
from pathlib import Path
|
from pathlib import Path
|
||||||
from typing import Any
|
from typing import Any
|
||||||
|
|
||||||
from evaluation.rag_answer_data import (
|
from tools.rag.evaluation.rag_answer_data import (
|
||||||
questions_fingerprint,
|
questions_fingerprint,
|
||||||
)
|
)
|
||||||
from evaluation.rag_metrics import (
|
from tools.rag.evaluation.rag_metrics import (
|
||||||
summarize_results,
|
summarize_results,
|
||||||
)
|
)
|
||||||
from evaluation.rag_runner import (
|
from tools.rag.evaluation.rag_runner import (
|
||||||
LOCAL_RAG_URL,
|
LOCAL_RAG_URL,
|
||||||
OPENWEBUI_URL,
|
OPENWEBUI_URL,
|
||||||
)
|
)
|
||||||
@ -12,7 +12,7 @@ from pathlib import Path
|
|||||||
from typing import Any
|
from typing import Any
|
||||||
|
|
||||||
|
|
||||||
PROJECT_ROOT = Path(__file__).resolve().parents[1]
|
PROJECT_ROOT = Path(__file__).resolve().parents[3]
|
||||||
|
|
||||||
OPENWEBUI_URL = "https://ui.tukekemt.xyz/api/chat/completions"
|
OPENWEBUI_URL = "https://ui.tukekemt.xyz/api/chat/completions"
|
||||||
LOCAL_OPENAPI_URL = "http://localhost:8000/openapi.json"
|
LOCAL_OPENAPI_URL = "http://localhost:8000/openapi.json"
|
||||||
@ -0,0 +1,14 @@
|
|||||||
|
id,split,category,difficulty,question,requested_model,response_model,tool_called,tool_call_count,answer_contains_score,source_url_score,should_answer_score,overall_score,strict_pass,expected_answer_contains,expected_source_urls,rag_source_urls,answer,first_model_latency_seconds,tool_latency_seconds,final_model_latency_seconds,total_latency_seconds,prompt_tokens,completion_tokens,total_tokens,error
|
||||||
|
q0982,dev,single_document_synthesis,hard,Rozlíš pri osobe Dárius Lindvai rok začiatku štúdia a rok vyjadrený kategóriou jeho diplomovej práce. Nezamieňaj ho s rokom sekcie diplomového projektu.,model120-fast,Qwen3.5-122B-A10B-Q4_K_M,True,1,1.0,1.0,1.0,1.0,True,"[""2016"", ""2021""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","Rok začiatku štúdia Dáriusa Lindvaia je 2016, zatiaľ čo rok vyjadrený kategóriou jeho diplomovej práce (dp2021) je 2021.
|
||||||
|
|
||||||
|
Zdroj: https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai",2.042902,1.160638,21.304558,24.508885,26576,149,26725,
|
||||||
|
q1092,dev,multi_document,hard,"Porovnaj záznamy osôb Dárius Lindvai a Ján Pták. Pri Dáriusovi Lindvaiovi uveď názov diplomovej práce a rok vyjadrený kategóriou diplomovej práce, nie rok diplomového projektu. Pri Jánovi Ptákovi použi diplomový projekt a rok uvedený v názve jeho príslušnej sekcie. Uveď názov a rok pri oboch osobách.",model120-fast,Qwen3.5-122B-A10B-Q4_K_M,True,1,1.0,1.0,1.0,1.0,True,"[""Obnovenie interpunkcie pomocou hlbokých neurónových sietí"", ""2021"", ""Agent pre manažment záverečných prác"", ""2026""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","Dárius Lindvai vypracovával diplomovú prácu s názvom „Obnovenie interpunkcie pomocou hlbokých neurónových sietí"" v roku 2021, zatiaľ čo Ján Pták pracoval na diplomovom projekte s názvom „Agent pre manažment záverečných prác"" v roku 2026.
|
||||||
|
|
||||||
|
Zdroje:
|
||||||
|
https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai
|
||||||
|
https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak",1.904721,0.881586,9.992372,12.77906,10680,215,10895,
|
||||||
|
q1125,dev,multi_document,hard,"Porovnaj záznamy osôb Dárius Lindvai a Andrii Pervashov. Pri Dáriusovi Lindvaiovi uveď názov diplomovej práce a rok vyjadrený kategóriou diplomovej práce, nie rok diplomového projektu. Pri Andrii Pervashovovi použi diplomovú prácu a rok uvedený v názve príslušnej sekcie. Uveď názov a rok pri oboch osobách.",model120-fast,Qwen3.5-122B-A10B-Q4_K_M,True,1,1.0,1.0,1.0,1.0,True,"[""Obnovenie interpunkcie pomocou hlbokých neurónových sietí"", ""2021"", ""Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu"", ""2027""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/topics/question"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""]","Dárius Lindvai vypracovával diplomovú prácu s názvom „Obnovenie interpunkcie pomocou hlbokých neurónových sietí"" v roku 2021 a Andrii Pervashov má uvedenú diplomovú prácu s názvom „Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu"" v roku 2027.
|
||||||
|
|
||||||
|
Zdroje:
|
||||||
|
https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai
|
||||||
|
https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov",1.748535,1.355357,35.011748,38.116826,41730,220,41950,
|
||||||
|
@ -0,0 +1,348 @@
|
|||||||
|
{
|
||||||
|
"generated_at": "2026-09-28T09:14:38.732799+00:00",
|
||||||
|
"status": "complete",
|
||||||
|
"configuration": {
|
||||||
|
"schema_version": 2,
|
||||||
|
"questions_file": "/home/janko/DP/zp-agent/evaluation/json_files/questions.json",
|
||||||
|
"overrides_file": "/home/janko/DP/zp-agent/evaluation/json_files/rag_answer_overrides.json",
|
||||||
|
"questions_fingerprint": "c8869f550ad5048fd873d9fa125cb4dddef7f77c7637ab8906394944d9ece16e",
|
||||||
|
"selected_question_ids": [
|
||||||
|
"q0982",
|
||||||
|
"q1092",
|
||||||
|
"q1125"
|
||||||
|
],
|
||||||
|
"applied_override_ids": [],
|
||||||
|
"split": "dev",
|
||||||
|
"selected_question_count": 3,
|
||||||
|
"requested_model": "model120-fast",
|
||||||
|
"operation_id": "retrieve_zpwiki_context",
|
||||||
|
"openwebui_url": "https://ui.tukekemt.xyz/api/chat/completions",
|
||||||
|
"rag_url": "http://localhost:8000/rag",
|
||||||
|
"timeout": 180,
|
||||||
|
"max_attempts": 4,
|
||||||
|
"backoff_base": 1.0,
|
||||||
|
"backoff_max": 8.0,
|
||||||
|
"delay": 0.0
|
||||||
|
},
|
||||||
|
"summary": {
|
||||||
|
"total": 3,
|
||||||
|
"completed": 3,
|
||||||
|
"errors": 0,
|
||||||
|
"tool_call_rate": 1.0,
|
||||||
|
"answer_contains_score": 1.0,
|
||||||
|
"source_url_score": 1.0,
|
||||||
|
"should_answer_score": 1.0,
|
||||||
|
"overall_score": 1.0,
|
||||||
|
"strict_pass_count": 3,
|
||||||
|
"strict_pass_rate": 1.0,
|
||||||
|
"mean_latency_seconds": 25.134924,
|
||||||
|
"prompt_tokens": 78986,
|
||||||
|
"completion_tokens": 584,
|
||||||
|
"total_tokens": 79570,
|
||||||
|
"by_category": {
|
||||||
|
"multi_document": {
|
||||||
|
"total": 2,
|
||||||
|
"completed": 2,
|
||||||
|
"errors": 0,
|
||||||
|
"tool_call_rate": 1.0,
|
||||||
|
"answer_contains_score": 1.0,
|
||||||
|
"source_url_score": 1.0,
|
||||||
|
"should_answer_score": 1.0,
|
||||||
|
"overall_score": 1.0,
|
||||||
|
"strict_pass_count": 2,
|
||||||
|
"strict_pass_rate": 1.0,
|
||||||
|
"mean_latency_seconds": 25.447943,
|
||||||
|
"prompt_tokens": 52410,
|
||||||
|
"completion_tokens": 435,
|
||||||
|
"total_tokens": 52845
|
||||||
|
},
|
||||||
|
"single_document_synthesis": {
|
||||||
|
"total": 1,
|
||||||
|
"completed": 1,
|
||||||
|
"errors": 0,
|
||||||
|
"tool_call_rate": 1.0,
|
||||||
|
"answer_contains_score": 1.0,
|
||||||
|
"source_url_score": 1.0,
|
||||||
|
"should_answer_score": 1.0,
|
||||||
|
"overall_score": 1.0,
|
||||||
|
"strict_pass_count": 1,
|
||||||
|
"strict_pass_rate": 1.0,
|
||||||
|
"mean_latency_seconds": 24.508885,
|
||||||
|
"prompt_tokens": 26576,
|
||||||
|
"completion_tokens": 149,
|
||||||
|
"total_tokens": 26725
|
||||||
|
}
|
||||||
|
},
|
||||||
|
"by_difficulty": {
|
||||||
|
"hard": {
|
||||||
|
"total": 3,
|
||||||
|
"completed": 3,
|
||||||
|
"errors": 0,
|
||||||
|
"tool_call_rate": 1.0,
|
||||||
|
"answer_contains_score": 1.0,
|
||||||
|
"source_url_score": 1.0,
|
||||||
|
"should_answer_score": 1.0,
|
||||||
|
"overall_score": 1.0,
|
||||||
|
"strict_pass_count": 3,
|
||||||
|
"strict_pass_rate": 1.0,
|
||||||
|
"mean_latency_seconds": 25.134924,
|
||||||
|
"prompt_tokens": 78986,
|
||||||
|
"completion_tokens": 584,
|
||||||
|
"total_tokens": 79570
|
||||||
|
}
|
||||||
|
}
|
||||||
|
},
|
||||||
|
"results": [
|
||||||
|
{
|
||||||
|
"id": "q0982",
|
||||||
|
"split": "dev",
|
||||||
|
"category": "single_document_synthesis",
|
||||||
|
"difficulty": "hard",
|
||||||
|
"question": "Rozlíš pri osobe Dárius Lindvai rok začiatku štúdia a rok vyjadrený kategóriou jeho diplomovej práce. Nezamieňaj ho s rokom sekcie diplomového projektu.",
|
||||||
|
"override_applied": false,
|
||||||
|
"requested_model": "model120-fast",
|
||||||
|
"expected_documents": [
|
||||||
|
"pages/students/2016/darius_lindvai/README.md"
|
||||||
|
],
|
||||||
|
"expected_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"
|
||||||
|
],
|
||||||
|
"expected_answer_contains": [
|
||||||
|
"2016",
|
||||||
|
"2021"
|
||||||
|
],
|
||||||
|
"should_answer": true,
|
||||||
|
"note": "Nový hard test: odpoveď treba poskladať z viacerých faktov jedného dokumentu.",
|
||||||
|
"answer": "Rok začiatku štúdia Dáriusa Lindvaia je 2016, zatiaľ čo rok vyjadrený kategóriou jeho diplomovej práce (dp2021) je 2021.\n\nZdroj: https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai",
|
||||||
|
"tool_called": true,
|
||||||
|
"tool_call_count": 1,
|
||||||
|
"tool_calls": [
|
||||||
|
{
|
||||||
|
"name": "retrieve_zpwiki_context",
|
||||||
|
"arguments": {
|
||||||
|
"query": "Rozlíš pri osobe Dárius Lindvai rok začiatku štúdia a rok vyjadrený kategóriou jeho diplomovej práce. Nezamieňaj ho s rokom sekcie diplomového projektu.",
|
||||||
|
"limit": 10,
|
||||||
|
"max_per_document": 5
|
||||||
|
},
|
||||||
|
"latency_seconds": 1.160638,
|
||||||
|
"source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/topics/faq",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"
|
||||||
|
]
|
||||||
|
}
|
||||||
|
],
|
||||||
|
"rag_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/topics/faq",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"
|
||||||
|
],
|
||||||
|
"first_model_latency_seconds": 2.042902,
|
||||||
|
"tool_latency_seconds": 1.160638,
|
||||||
|
"final_model_latency_seconds": 21.304558,
|
||||||
|
"total_latency_seconds": 24.508885,
|
||||||
|
"usage": {
|
||||||
|
"prompt_tokens": 26576,
|
||||||
|
"completion_tokens": 149,
|
||||||
|
"total_tokens": 26725
|
||||||
|
},
|
||||||
|
"response_model": "Qwen3.5-122B-A10B-Q4_K_M",
|
||||||
|
"answer_matches": [
|
||||||
|
true,
|
||||||
|
true
|
||||||
|
],
|
||||||
|
"answer_contains_score": 1.0,
|
||||||
|
"source_matches": [
|
||||||
|
true
|
||||||
|
],
|
||||||
|
"source_match_count": 1,
|
||||||
|
"source_required_count": 1,
|
||||||
|
"source_url_score": 1.0,
|
||||||
|
"should_answer_ok": true,
|
||||||
|
"should_answer_score": 1.0,
|
||||||
|
"returned_no_answer": false,
|
||||||
|
"tool_score": 1.0,
|
||||||
|
"overall_score": 1.0,
|
||||||
|
"strict_pass": true,
|
||||||
|
"error": null
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"id": "q1092",
|
||||||
|
"split": "dev",
|
||||||
|
"category": "multi_document",
|
||||||
|
"difficulty": "hard",
|
||||||
|
"question": "Porovnaj záznamy osôb Dárius Lindvai a Ján Pták. Pri Dáriusovi Lindvaiovi uveď názov diplomovej práce a rok vyjadrený kategóriou diplomovej práce, nie rok diplomového projektu. Pri Jánovi Ptákovi použi diplomový projekt a rok uvedený v názve jeho príslušnej sekcie. Uveď názov a rok pri oboch osobách.",
|
||||||
|
"override_applied": false,
|
||||||
|
"requested_model": "model120-fast",
|
||||||
|
"expected_documents": [
|
||||||
|
"pages/students/2016/darius_lindvai/README.md",
|
||||||
|
"pages/students/2022/jan_ptak/README.md"
|
||||||
|
],
|
||||||
|
"expected_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"
|
||||||
|
],
|
||||||
|
"expected_answer_contains": [
|
||||||
|
"Obnovenie interpunkcie pomocou hlbokých neurónových sietí",
|
||||||
|
"2021",
|
||||||
|
"Agent pre manažment záverečných prác",
|
||||||
|
"2026"
|
||||||
|
],
|
||||||
|
"should_answer": true,
|
||||||
|
"note": "Nový hard multi-document test vyžadujúci fakty z dvoch samostatných dokumentov.",
|
||||||
|
"answer": "Dárius Lindvai vypracovával diplomovú prácu s názvom „Obnovenie interpunkcie pomocou hlbokých neurónových sietí\" v roku 2021, zatiaľ čo Ján Pták pracoval na diplomovom projekte s názvom „Agent pre manažment záverečných prác\" v roku 2026.\n\nZdroje:\nhttps://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai\nhttps://zp.kemt.fei.tuke.sk/students/2022/jan_ptak",
|
||||||
|
"tool_called": true,
|
||||||
|
"tool_call_count": 1,
|
||||||
|
"tool_calls": [
|
||||||
|
{
|
||||||
|
"name": "retrieve_zpwiki_context",
|
||||||
|
"arguments": {
|
||||||
|
"query": "Porovnaj záznamy osôb Dárius Lindvai a Ján Pták. Pri Dáriusovi Lindvaiovi uveď názov diplomovej práce a rok vyjadrený kategóriou diplomovej práce, nie rok diplomového projektu. Pri Jánovi Ptákovi použi diplomový projekt a rok uvedený v názve jeho príslušnej sekcie. Uveď názov a rok pri oboch osobách.",
|
||||||
|
"limit": 5,
|
||||||
|
"published_only": false,
|
||||||
|
"max_per_document": 10
|
||||||
|
},
|
||||||
|
"latency_seconds": 0.881586,
|
||||||
|
"source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"
|
||||||
|
]
|
||||||
|
}
|
||||||
|
],
|
||||||
|
"rag_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"
|
||||||
|
],
|
||||||
|
"first_model_latency_seconds": 1.904721,
|
||||||
|
"tool_latency_seconds": 0.881586,
|
||||||
|
"final_model_latency_seconds": 9.992372,
|
||||||
|
"total_latency_seconds": 12.77906,
|
||||||
|
"usage": {
|
||||||
|
"prompt_tokens": 10680,
|
||||||
|
"completion_tokens": 215,
|
||||||
|
"total_tokens": 10895
|
||||||
|
},
|
||||||
|
"response_model": "Qwen3.5-122B-A10B-Q4_K_M",
|
||||||
|
"answer_matches": [
|
||||||
|
true,
|
||||||
|
true,
|
||||||
|
true,
|
||||||
|
true
|
||||||
|
],
|
||||||
|
"answer_contains_score": 1.0,
|
||||||
|
"source_matches": [
|
||||||
|
true,
|
||||||
|
true
|
||||||
|
],
|
||||||
|
"source_match_count": 2,
|
||||||
|
"source_required_count": 2,
|
||||||
|
"source_url_score": 1.0,
|
||||||
|
"should_answer_ok": true,
|
||||||
|
"should_answer_score": 1.0,
|
||||||
|
"returned_no_answer": false,
|
||||||
|
"tool_score": 1.0,
|
||||||
|
"overall_score": 1.0,
|
||||||
|
"strict_pass": true,
|
||||||
|
"error": null
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"id": "q1125",
|
||||||
|
"split": "dev",
|
||||||
|
"category": "multi_document",
|
||||||
|
"difficulty": "hard",
|
||||||
|
"question": "Porovnaj záznamy osôb Dárius Lindvai a Andrii Pervashov. Pri Dáriusovi Lindvaiovi uveď názov diplomovej práce a rok vyjadrený kategóriou diplomovej práce, nie rok diplomového projektu. Pri Andrii Pervashovovi použi diplomovú prácu a rok uvedený v názve príslušnej sekcie. Uveď názov a rok pri oboch osobách.",
|
||||||
|
"override_applied": false,
|
||||||
|
"requested_model": "model120-fast",
|
||||||
|
"expected_documents": [
|
||||||
|
"pages/students/2016/darius_lindvai/README.md",
|
||||||
|
"pages/students/2022/andrii_pervashov/README.md"
|
||||||
|
],
|
||||||
|
"expected_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"
|
||||||
|
],
|
||||||
|
"expected_answer_contains": [
|
||||||
|
"Obnovenie interpunkcie pomocou hlbokých neurónových sietí",
|
||||||
|
"2021",
|
||||||
|
"Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu",
|
||||||
|
"2027"
|
||||||
|
],
|
||||||
|
"should_answer": true,
|
||||||
|
"note": "Nový hard multi-document test vyžadujúci fakty z dvoch samostatných dokumentov.",
|
||||||
|
"answer": "Dárius Lindvai vypracovával diplomovú prácu s názvom „Obnovenie interpunkcie pomocou hlbokých neurónových sietí\" v roku 2021 a Andrii Pervashov má uvedenú diplomovú prácu s názvom „Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu\" v roku 2027.\n\nZdroje:\nhttps://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai\nhttps://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov",
|
||||||
|
"tool_called": true,
|
||||||
|
"tool_call_count": 1,
|
||||||
|
"tool_calls": [
|
||||||
|
{
|
||||||
|
"name": "retrieve_zpwiki_context",
|
||||||
|
"arguments": {
|
||||||
|
"query": "Porovnaj záznamy osôb Dárius Lindvai a Andrii Pervashov. Pri Dáriusovi Lindvaiovi uveď názov diplomovej práce a rok vyjadrený kategóriou diplomovej práce, nie rok diplomového projektu. Pri Andrii Pervashovovi použi diplomovú prácu a rok uvedený v názve príslušnej sekcie. Uveď názov a rok pri oboch osobách.",
|
||||||
|
"limit": 10
|
||||||
|
},
|
||||||
|
"latency_seconds": 1.355357,
|
||||||
|
"source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/jan_holp",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/topics/akopisat",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/topics/faq",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/topics/question",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"
|
||||||
|
]
|
||||||
|
}
|
||||||
|
],
|
||||||
|
"rag_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/jan_holp",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/topics/akopisat",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/topics/faq",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/topics/question",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"
|
||||||
|
],
|
||||||
|
"first_model_latency_seconds": 1.748535,
|
||||||
|
"tool_latency_seconds": 1.355357,
|
||||||
|
"final_model_latency_seconds": 35.011748,
|
||||||
|
"total_latency_seconds": 38.116826,
|
||||||
|
"usage": {
|
||||||
|
"prompt_tokens": 41730,
|
||||||
|
"completion_tokens": 220,
|
||||||
|
"total_tokens": 41950
|
||||||
|
},
|
||||||
|
"response_model": "Qwen3.5-122B-A10B-Q4_K_M",
|
||||||
|
"answer_matches": [
|
||||||
|
true,
|
||||||
|
true,
|
||||||
|
true,
|
||||||
|
true
|
||||||
|
],
|
||||||
|
"answer_contains_score": 1.0,
|
||||||
|
"source_matches": [
|
||||||
|
true,
|
||||||
|
true
|
||||||
|
],
|
||||||
|
"source_match_count": 2,
|
||||||
|
"source_required_count": 2,
|
||||||
|
"source_url_score": 1.0,
|
||||||
|
"should_answer_ok": true,
|
||||||
|
"should_answer_score": 1.0,
|
||||||
|
"returned_no_answer": false,
|
||||||
|
"tool_score": 1.0,
|
||||||
|
"overall_score": 1.0,
|
||||||
|
"strict_pass": true,
|
||||||
|
"error": null
|
||||||
|
}
|
||||||
|
]
|
||||||
|
}
|
||||||
@ -0,0 +1,15 @@
|
|||||||
|
id,split,category,difficulty,question,requested_model,response_model,tool_called,tool_call_count,answer_contains_score,source_url_score,should_answer_score,overall_score,strict_pass,expected_answer_contains,expected_source_urls,rag_source_urls,answer,first_model_latency_seconds,tool_latency_seconds,final_model_latency_seconds,total_latency_seconds,prompt_tokens,completion_tokens,total_tokens,error
|
||||||
|
q0024,dev,keyword_grounding,medium,Ktorý študentský dokument o grafových neurónových sieťach má v metadátach ako autora dokumentu uvedeného Maroša Harahusa?,model120-fast,Qwen3.5-122B-A10B-Q4_K_M,True,1,0.6666666666666666,0.0,0.0,0.41666666666666663,False,"[""Dmytro Mural"", ""Maroš Harahus"", ""grafové neurónové siete""]","[""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","V dostupných dokumentoch ZP Wiki sa túto informáciu nepodarilo spoľahlivo nájsť. Hoci existuje dokument o grafových neurónových sieťach s autorom Marošom Harahusom, v metadátach je uvedený ako autor dokumentu Daniel Hladek, zatiaľ čo Maroš Harahuš je študentom, ktorý na tomto dokumente pracoval a má v úlohách vypracovať prehľad o grafových neurónových sieťach. Naopak, dokument o grafových neurónových sieťach, kde je Maroš Harahuš uvedený ako autor dokumentu v metadátach, nebol nájdený.
|
||||||
|
|
||||||
|
Zdroj: https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus",2.190052,0.482435,20.847032,23.520147,24189,260,24449,
|
||||||
|
q0311,dev,disambiguation_year,hard,Rozlíš rok začiatku štúdia a rok práce osoby Valerii Kutsenko.,model120-fast,Qwen3.5-122B-A10B-Q4_K_M,True,1,1.0,1.0,1.0,1.0,True,"[""2022"", ""2027""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","Valerii Kutsenko začal štúdium v roku 2022 a vypracováva diplomovú prácu v roku 2027.
|
||||||
|
|
||||||
|
Zdroj: https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko",1.407052,0.583248,18.338193,20.329448,23011,119,23130,
|
||||||
|
q0580,dev,reverse_lookup,medium,Kto pracoval na téme multilinguálna extrakcia trojíc z medicínskych dát?,model120-fast,Qwen3.5-122B-A10B-Q4_K_M,True,1,0.0,0.0,0.0,0.25,False,"[""Bogdan Paul Chiș""]","[""https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis""]","[""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","V dostupných dokumentoch ZP Wiki sa túto informáciu nepodarilo spoľahlivo nájsť.
|
||||||
|
|
||||||
|
Zdroje:
|
||||||
|
https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi
|
||||||
|
https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov
|
||||||
|
https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko
|
||||||
|
https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka
|
||||||
|
https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus",1.90643,0.532748,26.941411,29.381366,31564,237,31801,
|
||||||
|
@ -0,0 +1,371 @@
|
|||||||
|
{
|
||||||
|
"generated_at": "2026-09-28T13:54:30.413355+00:00",
|
||||||
|
"status": "complete",
|
||||||
|
"configuration": {
|
||||||
|
"schema_version": 2,
|
||||||
|
"questions_file": "/home/janko/DP/zp-agent/evaluation/json_files/questions.json",
|
||||||
|
"overrides_file": "/home/janko/DP/zp-agent/evaluation/json_files/rag_answer_overrides.json",
|
||||||
|
"questions_fingerprint": "98d0a80160067c196dd4d64ac213748519e34f9238df92e97c211f8731de8182",
|
||||||
|
"selected_question_ids": [
|
||||||
|
"q0024",
|
||||||
|
"q0311",
|
||||||
|
"q0580"
|
||||||
|
],
|
||||||
|
"applied_override_ids": [],
|
||||||
|
"split": "dev",
|
||||||
|
"selected_question_count": 3,
|
||||||
|
"requested_model": "model120-fast",
|
||||||
|
"operation_id": "retrieve_zpwiki_context",
|
||||||
|
"openwebui_url": "https://ui.tukekemt.xyz/api/chat/completions",
|
||||||
|
"rag_url": "http://localhost:8000/rag",
|
||||||
|
"timeout": 180,
|
||||||
|
"max_attempts": 4,
|
||||||
|
"backoff_base": 1.0,
|
||||||
|
"backoff_max": 8.0,
|
||||||
|
"delay": 0.0
|
||||||
|
},
|
||||||
|
"summary": {
|
||||||
|
"total": 3,
|
||||||
|
"completed": 3,
|
||||||
|
"errors": 0,
|
||||||
|
"tool_call_rate": 1.0,
|
||||||
|
"answer_contains_score": 0.555556,
|
||||||
|
"source_url_score": 0.333333,
|
||||||
|
"should_answer_score": 0.333333,
|
||||||
|
"overall_score": 0.555556,
|
||||||
|
"strict_pass_count": 1,
|
||||||
|
"strict_pass_rate": 0.333333,
|
||||||
|
"mean_latency_seconds": 24.41032,
|
||||||
|
"prompt_tokens": 78764,
|
||||||
|
"completion_tokens": 616,
|
||||||
|
"total_tokens": 79380,
|
||||||
|
"by_category": {
|
||||||
|
"disambiguation_year": {
|
||||||
|
"total": 1,
|
||||||
|
"completed": 1,
|
||||||
|
"errors": 0,
|
||||||
|
"tool_call_rate": 1.0,
|
||||||
|
"answer_contains_score": 1.0,
|
||||||
|
"source_url_score": 1.0,
|
||||||
|
"should_answer_score": 1.0,
|
||||||
|
"overall_score": 1.0,
|
||||||
|
"strict_pass_count": 1,
|
||||||
|
"strict_pass_rate": 1.0,
|
||||||
|
"mean_latency_seconds": 20.329448,
|
||||||
|
"prompt_tokens": 23011,
|
||||||
|
"completion_tokens": 119,
|
||||||
|
"total_tokens": 23130
|
||||||
|
},
|
||||||
|
"keyword_grounding": {
|
||||||
|
"total": 1,
|
||||||
|
"completed": 1,
|
||||||
|
"errors": 0,
|
||||||
|
"tool_call_rate": 1.0,
|
||||||
|
"answer_contains_score": 0.666667,
|
||||||
|
"source_url_score": 0.0,
|
||||||
|
"should_answer_score": 0.0,
|
||||||
|
"overall_score": 0.416667,
|
||||||
|
"strict_pass_count": 0,
|
||||||
|
"strict_pass_rate": 0.0,
|
||||||
|
"mean_latency_seconds": 23.520147,
|
||||||
|
"prompt_tokens": 24189,
|
||||||
|
"completion_tokens": 260,
|
||||||
|
"total_tokens": 24449
|
||||||
|
},
|
||||||
|
"reverse_lookup": {
|
||||||
|
"total": 1,
|
||||||
|
"completed": 1,
|
||||||
|
"errors": 0,
|
||||||
|
"tool_call_rate": 1.0,
|
||||||
|
"answer_contains_score": 0.0,
|
||||||
|
"source_url_score": 0.0,
|
||||||
|
"should_answer_score": 0.0,
|
||||||
|
"overall_score": 0.25,
|
||||||
|
"strict_pass_count": 0,
|
||||||
|
"strict_pass_rate": 0.0,
|
||||||
|
"mean_latency_seconds": 29.381366,
|
||||||
|
"prompt_tokens": 31564,
|
||||||
|
"completion_tokens": 237,
|
||||||
|
"total_tokens": 31801
|
||||||
|
}
|
||||||
|
},
|
||||||
|
"by_difficulty": {
|
||||||
|
"hard": {
|
||||||
|
"total": 1,
|
||||||
|
"completed": 1,
|
||||||
|
"errors": 0,
|
||||||
|
"tool_call_rate": 1.0,
|
||||||
|
"answer_contains_score": 1.0,
|
||||||
|
"source_url_score": 1.0,
|
||||||
|
"should_answer_score": 1.0,
|
||||||
|
"overall_score": 1.0,
|
||||||
|
"strict_pass_count": 1,
|
||||||
|
"strict_pass_rate": 1.0,
|
||||||
|
"mean_latency_seconds": 20.329448,
|
||||||
|
"prompt_tokens": 23011,
|
||||||
|
"completion_tokens": 119,
|
||||||
|
"total_tokens": 23130
|
||||||
|
},
|
||||||
|
"medium": {
|
||||||
|
"total": 2,
|
||||||
|
"completed": 2,
|
||||||
|
"errors": 0,
|
||||||
|
"tool_call_rate": 1.0,
|
||||||
|
"answer_contains_score": 0.333333,
|
||||||
|
"source_url_score": 0.0,
|
||||||
|
"should_answer_score": 0.0,
|
||||||
|
"overall_score": 0.333333,
|
||||||
|
"strict_pass_count": 0,
|
||||||
|
"strict_pass_rate": 0.0,
|
||||||
|
"mean_latency_seconds": 26.450757,
|
||||||
|
"prompt_tokens": 55753,
|
||||||
|
"completion_tokens": 497,
|
||||||
|
"total_tokens": 56250
|
||||||
|
}
|
||||||
|
}
|
||||||
|
},
|
||||||
|
"results": [
|
||||||
|
{
|
||||||
|
"id": "q0024",
|
||||||
|
"split": "dev",
|
||||||
|
"category": "keyword_grounding",
|
||||||
|
"difficulty": "medium",
|
||||||
|
"question": "Ktorý študentský dokument o grafových neurónových sieťach má v metadátach ako autora dokumentu uvedeného Maroša Harahusa?",
|
||||||
|
"override_applied": false,
|
||||||
|
"requested_model": "model120-fast",
|
||||||
|
"expected_documents": [
|
||||||
|
"pages/students/2016/maros_harahus/README.md"
|
||||||
|
],
|
||||||
|
"expected_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"
|
||||||
|
],
|
||||||
|
"expected_answer_contains": [
|
||||||
|
"Dmytro Mural",
|
||||||
|
"Maroš Harahus",
|
||||||
|
"grafové neurónové siete"
|
||||||
|
],
|
||||||
|
"should_answer": true,
|
||||||
|
"note": "Answer-level disambiguation: študentský dokument patrí Dmytrovi Muralovi; Maroš Harahus je v jeho metadátach uvedený ako autor dokumentu. Nemá sa zamieňať autor dokumentu so študentom, ktorý prácu vypracoval.",
|
||||||
|
"answer": "V dostupných dokumentoch ZP Wiki sa túto informáciu nepodarilo spoľahlivo nájsť. Hoci existuje dokument o grafových neurónových sieťach s autorom Marošom Harahusom, v metadátach je uvedený ako autor dokumentu Daniel Hladek, zatiaľ čo Maroš Harahuš je študentom, ktorý na tomto dokumente pracoval a má v úlohách vypracovať prehľad o grafových neurónových sieťach. Naopak, dokument o grafových neurónových sieťach, kde je Maroš Harahuš uvedený ako autor dokumentu v metadátach, nebol nájdený.\n\nZdroj: https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus",
|
||||||
|
"tool_called": true,
|
||||||
|
"tool_call_count": 1,
|
||||||
|
"tool_calls": [
|
||||||
|
{
|
||||||
|
"name": "retrieve_zpwiki_context",
|
||||||
|
"arguments": {
|
||||||
|
"query": "Ktorý študentský dokument o grafových neurónových sieťach má v metadátach ako autora dokumentu uvedeného Maroša Harahusa?",
|
||||||
|
"limit": 5,
|
||||||
|
"published_only": true,
|
||||||
|
"max_per_document": 1
|
||||||
|
},
|
||||||
|
"latency_seconds": 0.482435,
|
||||||
|
"source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"
|
||||||
|
]
|
||||||
|
}
|
||||||
|
],
|
||||||
|
"rag_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"
|
||||||
|
],
|
||||||
|
"first_model_latency_seconds": 2.190052,
|
||||||
|
"tool_latency_seconds": 0.482435,
|
||||||
|
"final_model_latency_seconds": 20.847032,
|
||||||
|
"total_latency_seconds": 23.520147,
|
||||||
|
"usage": {
|
||||||
|
"prompt_tokens": 24189,
|
||||||
|
"completion_tokens": 260,
|
||||||
|
"total_tokens": 24449
|
||||||
|
},
|
||||||
|
"response_model": "Qwen3.5-122B-A10B-Q4_K_M",
|
||||||
|
"answer_matches": [
|
||||||
|
false,
|
||||||
|
true,
|
||||||
|
true
|
||||||
|
],
|
||||||
|
"answer_contains_score": 0.6666666666666666,
|
||||||
|
"source_matches": [
|
||||||
|
false
|
||||||
|
],
|
||||||
|
"source_match_count": 0,
|
||||||
|
"source_required_count": 1,
|
||||||
|
"source_url_score": 0.0,
|
||||||
|
"should_answer_ok": false,
|
||||||
|
"should_answer_score": 0.0,
|
||||||
|
"returned_no_answer": true,
|
||||||
|
"tool_score": 1.0,
|
||||||
|
"overall_score": 0.41666666666666663,
|
||||||
|
"strict_pass": false,
|
||||||
|
"error": null
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"id": "q0311",
|
||||||
|
"split": "dev",
|
||||||
|
"category": "disambiguation_year",
|
||||||
|
"difficulty": "hard",
|
||||||
|
"question": "Rozlíš rok začiatku štúdia a rok práce osoby Valerii Kutsenko.",
|
||||||
|
"override_applied": false,
|
||||||
|
"requested_model": "model120-fast",
|
||||||
|
"expected_documents": [
|
||||||
|
"pages/students/2022/valerii_kutsenko/README.md"
|
||||||
|
],
|
||||||
|
"expected_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"
|
||||||
|
],
|
||||||
|
"expected_answer_contains": [
|
||||||
|
"2022",
|
||||||
|
"2027"
|
||||||
|
],
|
||||||
|
"should_answer": true,
|
||||||
|
"note": "Kontrola proti zámene roku začiatku štúdia s rokom záverečnej práce alebo projektu.",
|
||||||
|
"answer": "Valerii Kutsenko začal štúdium v roku 2022 a vypracováva diplomovú prácu v roku 2027.\n\nZdroj: https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko",
|
||||||
|
"tool_called": true,
|
||||||
|
"tool_call_count": 1,
|
||||||
|
"tool_calls": [
|
||||||
|
{
|
||||||
|
"name": "retrieve_zpwiki_context",
|
||||||
|
"arguments": {
|
||||||
|
"query": "Rozlíš rok začiatku štúdia a rok práce osoby Valerii Kutsenko.",
|
||||||
|
"limit": 10
|
||||||
|
},
|
||||||
|
"latency_seconds": 0.583248,
|
||||||
|
"source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/topics/faq",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/interns/oliver_pejic",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"
|
||||||
|
]
|
||||||
|
}
|
||||||
|
],
|
||||||
|
"rag_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/topics/faq",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/interns/oliver_pejic",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"
|
||||||
|
],
|
||||||
|
"first_model_latency_seconds": 1.407052,
|
||||||
|
"tool_latency_seconds": 0.583248,
|
||||||
|
"final_model_latency_seconds": 18.338193,
|
||||||
|
"total_latency_seconds": 20.329448,
|
||||||
|
"usage": {
|
||||||
|
"prompt_tokens": 23011,
|
||||||
|
"completion_tokens": 119,
|
||||||
|
"total_tokens": 23130
|
||||||
|
},
|
||||||
|
"response_model": "Qwen3.5-122B-A10B-Q4_K_M",
|
||||||
|
"answer_matches": [
|
||||||
|
true,
|
||||||
|
true
|
||||||
|
],
|
||||||
|
"answer_contains_score": 1.0,
|
||||||
|
"source_matches": [
|
||||||
|
true
|
||||||
|
],
|
||||||
|
"source_match_count": 1,
|
||||||
|
"source_required_count": 1,
|
||||||
|
"source_url_score": 1.0,
|
||||||
|
"should_answer_ok": true,
|
||||||
|
"should_answer_score": 1.0,
|
||||||
|
"returned_no_answer": false,
|
||||||
|
"tool_score": 1.0,
|
||||||
|
"overall_score": 1.0,
|
||||||
|
"strict_pass": true,
|
||||||
|
"error": null
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"id": "q0580",
|
||||||
|
"split": "dev",
|
||||||
|
"category": "reverse_lookup",
|
||||||
|
"difficulty": "medium",
|
||||||
|
"question": "Kto pracoval na téme multilinguálna extrakcia trojíc z medicínskych dát?",
|
||||||
|
"override_applied": false,
|
||||||
|
"requested_model": "model120-fast",
|
||||||
|
"expected_documents": [
|
||||||
|
"pages/interns/bogdan_paul_chis/README.md"
|
||||||
|
],
|
||||||
|
"expected_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis"
|
||||||
|
],
|
||||||
|
"expected_answer_contains": [
|
||||||
|
"Bogdan Paul Chiș"
|
||||||
|
],
|
||||||
|
"should_answer": true,
|
||||||
|
"note": null,
|
||||||
|
"answer": "V dostupných dokumentoch ZP Wiki sa túto informáciu nepodarilo spoľahlivo nájsť.\n\nZdroje:\nhttps://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi\nhttps://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov\nhttps://zp.kemt.fei.tuke.sk/students/2019/michal_stromko\nhttps://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka\nhttps://zp.kemt.fei.tuke.sk/students/2016/maros_harahus",
|
||||||
|
"tool_called": true,
|
||||||
|
"tool_call_count": 1,
|
||||||
|
"tool_calls": [
|
||||||
|
{
|
||||||
|
"name": "retrieve_zpwiki_context",
|
||||||
|
"arguments": {
|
||||||
|
"query": "Kto pracoval na téme multilinguálna extrakcia trojíc z medicínskych dát?",
|
||||||
|
"limit": 5,
|
||||||
|
"published_only": true,
|
||||||
|
"max_per_document": 1
|
||||||
|
},
|
||||||
|
"latency_seconds": 0.532748,
|
||||||
|
"source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"
|
||||||
|
]
|
||||||
|
}
|
||||||
|
],
|
||||||
|
"rag_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"
|
||||||
|
],
|
||||||
|
"first_model_latency_seconds": 1.90643,
|
||||||
|
"tool_latency_seconds": 0.532748,
|
||||||
|
"final_model_latency_seconds": 26.941411,
|
||||||
|
"total_latency_seconds": 29.381366,
|
||||||
|
"usage": {
|
||||||
|
"prompt_tokens": 31564,
|
||||||
|
"completion_tokens": 237,
|
||||||
|
"total_tokens": 31801
|
||||||
|
},
|
||||||
|
"response_model": "Qwen3.5-122B-A10B-Q4_K_M",
|
||||||
|
"answer_matches": [
|
||||||
|
false
|
||||||
|
],
|
||||||
|
"answer_contains_score": 0.0,
|
||||||
|
"source_matches": [
|
||||||
|
false
|
||||||
|
],
|
||||||
|
"source_match_count": 0,
|
||||||
|
"source_required_count": 1,
|
||||||
|
"source_url_score": 0.0,
|
||||||
|
"should_answer_ok": false,
|
||||||
|
"should_answer_score": 0.0,
|
||||||
|
"returned_no_answer": true,
|
||||||
|
"tool_score": 1.0,
|
||||||
|
"overall_score": 0.25,
|
||||||
|
"strict_pass": false,
|
||||||
|
"error": null
|
||||||
|
}
|
||||||
|
]
|
||||||
|
}
|
||||||
@ -0,0 +1,12 @@
|
|||||||
|
id,split,category,difficulty,question,requested_model,response_model,tool_called,tool_call_count,answer_contains_score,source_url_score,should_answer_score,overall_score,strict_pass,expected_answer_contains,expected_source_urls,rag_source_urls,answer,first_model_latency_seconds,tool_latency_seconds,final_model_latency_seconds,total_latency_seconds,prompt_tokens,completion_tokens,total_tokens,error
|
||||||
|
q0024,dev,keyword_grounding,medium,Ktorý študentský dokument o grafových neurónových sieťach má v metadátach ako autora dokumentu uvedeného Maroša Harahusa?,model120-fast,Qwen3.5-122B-A10B-Q4_K_M,True,1,1.0,1.0,1.0,1.0,True,"[""Dmytro Mural"", ""Maroš Harahus"", ""grafové neurónové siete""]","[""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural""]","V dostupných dokumentoch ZP Wiki sa túto informáciu nepodarilo spoľahlivo nájsť, keďže Maroš Harahus je v metadátach uvedený ako autor dokumentu pre študenta Dmytra Murala, ktorého téma je „Grafové neurónové siete pre vyhľadávanie na internete"", nie ako autor vlastnej študentskej práce o grafových neurónových sieťach.
|
||||||
|
|
||||||
|
Zdroj: https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural",1.931615,0.662689,11.145896,13.740618,11938,208,12146,
|
||||||
|
q0311,dev,disambiguation_year,hard,Rozlíš rok začiatku štúdia a rok práce osoby Valerii Kutsenko.,model120-fast,Qwen3.5-122B-A10B-Q4_K_M,True,1,1.0,1.0,1.0,1.0,True,"[""2022"", ""2027""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","Valerii Kutsenko začal štúdium v roku 2022 a vypracováva diplomovú prácu v roku 2027.
|
||||||
|
|
||||||
|
Zdroj: https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko",1.432716,0.583808,1.687614,3.705032,23011,119,23130,
|
||||||
|
q0580,dev,reverse_lookup,medium,Kto pracoval na téme multilinguálna extrakcia trojíc z medicínskych dát?,model120-fast,Qwen3.5-122B-A10B-Q4_K_M,True,1,0.0,0.0,0.0,0.25,False,"[""Bogdan Paul Chiș""]","[""https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis""]","[""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","V dostupných dokumentoch ZP Wiki sa túto informáciu nepodarilo spoľahlivo nájsť. Hoci Andrii Pervashov pracoval na téme extrakcie štruktúrovaných informácií z medicínskej domény a Yevhenii Medushivskyi vytváral korpus medicínskych dát, v žiadnom z nájdených záznamov sa neobjavuje konkrétna práca s názvom alebo témou „multilinguálna extrakcia trojíc z medicínskych dát"".
|
||||||
|
|
||||||
|
Zdroj:
|
||||||
|
https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov
|
||||||
|
https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi",1.715903,0.529436,27.760575,30.006754,31551,257,31808,
|
||||||
|
@ -0,0 +1,364 @@
|
|||||||
|
{
|
||||||
|
"generated_at": "2026-09-28T13:55:18.011092+00:00",
|
||||||
|
"status": "complete",
|
||||||
|
"configuration": {
|
||||||
|
"schema_version": 2,
|
||||||
|
"questions_file": "/home/janko/DP/zp-agent/evaluation/json_files/questions.json",
|
||||||
|
"overrides_file": "/home/janko/DP/zp-agent/evaluation/json_files/rag_answer_overrides.json",
|
||||||
|
"questions_fingerprint": "98d0a80160067c196dd4d64ac213748519e34f9238df92e97c211f8731de8182",
|
||||||
|
"selected_question_ids": [
|
||||||
|
"q0024",
|
||||||
|
"q0311",
|
||||||
|
"q0580"
|
||||||
|
],
|
||||||
|
"applied_override_ids": [],
|
||||||
|
"split": "dev",
|
||||||
|
"selected_question_count": 3,
|
||||||
|
"requested_model": "model120-fast",
|
||||||
|
"operation_id": "retrieve_zpwiki_context",
|
||||||
|
"openwebui_url": "https://ui.tukekemt.xyz/api/chat/completions",
|
||||||
|
"rag_url": "http://localhost:8000/rag",
|
||||||
|
"timeout": 180,
|
||||||
|
"max_attempts": 4,
|
||||||
|
"backoff_base": 1.0,
|
||||||
|
"backoff_max": 8.0,
|
||||||
|
"delay": 0.0
|
||||||
|
},
|
||||||
|
"summary": {
|
||||||
|
"total": 3,
|
||||||
|
"completed": 3,
|
||||||
|
"errors": 0,
|
||||||
|
"tool_call_rate": 1.0,
|
||||||
|
"answer_contains_score": 0.666667,
|
||||||
|
"source_url_score": 0.666667,
|
||||||
|
"should_answer_score": 0.666667,
|
||||||
|
"overall_score": 0.75,
|
||||||
|
"strict_pass_count": 2,
|
||||||
|
"strict_pass_rate": 0.666667,
|
||||||
|
"mean_latency_seconds": 15.817468,
|
||||||
|
"prompt_tokens": 66500,
|
||||||
|
"completion_tokens": 584,
|
||||||
|
"total_tokens": 67084,
|
||||||
|
"by_category": {
|
||||||
|
"disambiguation_year": {
|
||||||
|
"total": 1,
|
||||||
|
"completed": 1,
|
||||||
|
"errors": 0,
|
||||||
|
"tool_call_rate": 1.0,
|
||||||
|
"answer_contains_score": 1.0,
|
||||||
|
"source_url_score": 1.0,
|
||||||
|
"should_answer_score": 1.0,
|
||||||
|
"overall_score": 1.0,
|
||||||
|
"strict_pass_count": 1,
|
||||||
|
"strict_pass_rate": 1.0,
|
||||||
|
"mean_latency_seconds": 3.705032,
|
||||||
|
"prompt_tokens": 23011,
|
||||||
|
"completion_tokens": 119,
|
||||||
|
"total_tokens": 23130
|
||||||
|
},
|
||||||
|
"keyword_grounding": {
|
||||||
|
"total": 1,
|
||||||
|
"completed": 1,
|
||||||
|
"errors": 0,
|
||||||
|
"tool_call_rate": 1.0,
|
||||||
|
"answer_contains_score": 1.0,
|
||||||
|
"source_url_score": 1.0,
|
||||||
|
"should_answer_score": 1.0,
|
||||||
|
"overall_score": 1.0,
|
||||||
|
"strict_pass_count": 1,
|
||||||
|
"strict_pass_rate": 1.0,
|
||||||
|
"mean_latency_seconds": 13.740618,
|
||||||
|
"prompt_tokens": 11938,
|
||||||
|
"completion_tokens": 208,
|
||||||
|
"total_tokens": 12146
|
||||||
|
},
|
||||||
|
"reverse_lookup": {
|
||||||
|
"total": 1,
|
||||||
|
"completed": 1,
|
||||||
|
"errors": 0,
|
||||||
|
"tool_call_rate": 1.0,
|
||||||
|
"answer_contains_score": 0.0,
|
||||||
|
"source_url_score": 0.0,
|
||||||
|
"should_answer_score": 0.0,
|
||||||
|
"overall_score": 0.25,
|
||||||
|
"strict_pass_count": 0,
|
||||||
|
"strict_pass_rate": 0.0,
|
||||||
|
"mean_latency_seconds": 30.006754,
|
||||||
|
"prompt_tokens": 31551,
|
||||||
|
"completion_tokens": 257,
|
||||||
|
"total_tokens": 31808
|
||||||
|
}
|
||||||
|
},
|
||||||
|
"by_difficulty": {
|
||||||
|
"hard": {
|
||||||
|
"total": 1,
|
||||||
|
"completed": 1,
|
||||||
|
"errors": 0,
|
||||||
|
"tool_call_rate": 1.0,
|
||||||
|
"answer_contains_score": 1.0,
|
||||||
|
"source_url_score": 1.0,
|
||||||
|
"should_answer_score": 1.0,
|
||||||
|
"overall_score": 1.0,
|
||||||
|
"strict_pass_count": 1,
|
||||||
|
"strict_pass_rate": 1.0,
|
||||||
|
"mean_latency_seconds": 3.705032,
|
||||||
|
"prompt_tokens": 23011,
|
||||||
|
"completion_tokens": 119,
|
||||||
|
"total_tokens": 23130
|
||||||
|
},
|
||||||
|
"medium": {
|
||||||
|
"total": 2,
|
||||||
|
"completed": 2,
|
||||||
|
"errors": 0,
|
||||||
|
"tool_call_rate": 1.0,
|
||||||
|
"answer_contains_score": 0.5,
|
||||||
|
"source_url_score": 0.5,
|
||||||
|
"should_answer_score": 0.5,
|
||||||
|
"overall_score": 0.625,
|
||||||
|
"strict_pass_count": 1,
|
||||||
|
"strict_pass_rate": 0.5,
|
||||||
|
"mean_latency_seconds": 21.873686,
|
||||||
|
"prompt_tokens": 43489,
|
||||||
|
"completion_tokens": 465,
|
||||||
|
"total_tokens": 43954
|
||||||
|
}
|
||||||
|
}
|
||||||
|
},
|
||||||
|
"results": [
|
||||||
|
{
|
||||||
|
"id": "q0024",
|
||||||
|
"split": "dev",
|
||||||
|
"category": "keyword_grounding",
|
||||||
|
"difficulty": "medium",
|
||||||
|
"question": "Ktorý študentský dokument o grafových neurónových sieťach má v metadátach ako autora dokumentu uvedeného Maroša Harahusa?",
|
||||||
|
"override_applied": false,
|
||||||
|
"requested_model": "model120-fast",
|
||||||
|
"expected_documents": [
|
||||||
|
"pages/students/2016/maros_harahus/README.md"
|
||||||
|
],
|
||||||
|
"expected_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"
|
||||||
|
],
|
||||||
|
"expected_answer_contains": [
|
||||||
|
"Dmytro Mural",
|
||||||
|
"Maroš Harahus",
|
||||||
|
"grafové neurónové siete"
|
||||||
|
],
|
||||||
|
"should_answer": true,
|
||||||
|
"note": "Answer-level disambiguation: študentský dokument patrí Dmytrovi Muralovi; Maroš Harahus je v jeho metadátach uvedený ako autor dokumentu. Nemá sa zamieňať autor dokumentu so študentom, ktorý prácu vypracoval.",
|
||||||
|
"answer": "V dostupných dokumentoch ZP Wiki sa túto informáciu nepodarilo spoľahlivo nájsť, keďže Maroš Harahus je v metadátach uvedený ako autor dokumentu pre študenta Dmytra Murala, ktorého téma je „Grafové neurónové siete pre vyhľadávanie na internete\", nie ako autor vlastnej študentskej práce o grafových neurónových sieťach.\n\nZdroj: https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural",
|
||||||
|
"tool_called": true,
|
||||||
|
"tool_call_count": 1,
|
||||||
|
"tool_calls": [
|
||||||
|
{
|
||||||
|
"name": "retrieve_zpwiki_context",
|
||||||
|
"arguments": {
|
||||||
|
"query": "Ktorý študentský dokument o grafových neurónových sieťach má v metadátach ako autora dokumentu uvedeného Maroša Harahusa?",
|
||||||
|
"limit": 5,
|
||||||
|
"published_only": false,
|
||||||
|
"max_per_document": 10
|
||||||
|
},
|
||||||
|
"latency_seconds": 0.662689,
|
||||||
|
"source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"
|
||||||
|
]
|
||||||
|
}
|
||||||
|
],
|
||||||
|
"rag_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"
|
||||||
|
],
|
||||||
|
"first_model_latency_seconds": 1.931615,
|
||||||
|
"tool_latency_seconds": 0.662689,
|
||||||
|
"final_model_latency_seconds": 11.145896,
|
||||||
|
"total_latency_seconds": 13.740618,
|
||||||
|
"usage": {
|
||||||
|
"prompt_tokens": 11938,
|
||||||
|
"completion_tokens": 208,
|
||||||
|
"total_tokens": 12146
|
||||||
|
},
|
||||||
|
"response_model": "Qwen3.5-122B-A10B-Q4_K_M",
|
||||||
|
"answer_matches": [
|
||||||
|
true,
|
||||||
|
true,
|
||||||
|
true
|
||||||
|
],
|
||||||
|
"answer_contains_score": 1.0,
|
||||||
|
"source_matches": [
|
||||||
|
true
|
||||||
|
],
|
||||||
|
"source_match_count": 1,
|
||||||
|
"source_required_count": 1,
|
||||||
|
"source_url_score": 1.0,
|
||||||
|
"should_answer_ok": true,
|
||||||
|
"should_answer_score": 1.0,
|
||||||
|
"returned_no_answer": false,
|
||||||
|
"tool_score": 1.0,
|
||||||
|
"overall_score": 1.0,
|
||||||
|
"strict_pass": true,
|
||||||
|
"error": null
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"id": "q0311",
|
||||||
|
"split": "dev",
|
||||||
|
"category": "disambiguation_year",
|
||||||
|
"difficulty": "hard",
|
||||||
|
"question": "Rozlíš rok začiatku štúdia a rok práce osoby Valerii Kutsenko.",
|
||||||
|
"override_applied": false,
|
||||||
|
"requested_model": "model120-fast",
|
||||||
|
"expected_documents": [
|
||||||
|
"pages/students/2022/valerii_kutsenko/README.md"
|
||||||
|
],
|
||||||
|
"expected_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"
|
||||||
|
],
|
||||||
|
"expected_answer_contains": [
|
||||||
|
"2022",
|
||||||
|
"2027"
|
||||||
|
],
|
||||||
|
"should_answer": true,
|
||||||
|
"note": "Kontrola proti zámene roku začiatku štúdia s rokom záverečnej práce alebo projektu.",
|
||||||
|
"answer": "Valerii Kutsenko začal štúdium v roku 2022 a vypracováva diplomovú prácu v roku 2027.\n\nZdroj: https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko",
|
||||||
|
"tool_called": true,
|
||||||
|
"tool_call_count": 1,
|
||||||
|
"tool_calls": [
|
||||||
|
{
|
||||||
|
"name": "retrieve_zpwiki_context",
|
||||||
|
"arguments": {
|
||||||
|
"query": "Rozlíš rok začiatku štúdia a rok práce osoby Valerii Kutsenko.",
|
||||||
|
"limit": 10
|
||||||
|
},
|
||||||
|
"latency_seconds": 0.583808,
|
||||||
|
"source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/topics/faq",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/interns/oliver_pejic",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"
|
||||||
|
]
|
||||||
|
}
|
||||||
|
],
|
||||||
|
"rag_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/topics/faq",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/interns/oliver_pejic",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"
|
||||||
|
],
|
||||||
|
"first_model_latency_seconds": 1.432716,
|
||||||
|
"tool_latency_seconds": 0.583808,
|
||||||
|
"final_model_latency_seconds": 1.687614,
|
||||||
|
"total_latency_seconds": 3.705032,
|
||||||
|
"usage": {
|
||||||
|
"prompt_tokens": 23011,
|
||||||
|
"completion_tokens": 119,
|
||||||
|
"total_tokens": 23130
|
||||||
|
},
|
||||||
|
"response_model": "Qwen3.5-122B-A10B-Q4_K_M",
|
||||||
|
"answer_matches": [
|
||||||
|
true,
|
||||||
|
true
|
||||||
|
],
|
||||||
|
"answer_contains_score": 1.0,
|
||||||
|
"source_matches": [
|
||||||
|
true
|
||||||
|
],
|
||||||
|
"source_match_count": 1,
|
||||||
|
"source_required_count": 1,
|
||||||
|
"source_url_score": 1.0,
|
||||||
|
"should_answer_ok": true,
|
||||||
|
"should_answer_score": 1.0,
|
||||||
|
"returned_no_answer": false,
|
||||||
|
"tool_score": 1.0,
|
||||||
|
"overall_score": 1.0,
|
||||||
|
"strict_pass": true,
|
||||||
|
"error": null
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"id": "q0580",
|
||||||
|
"split": "dev",
|
||||||
|
"category": "reverse_lookup",
|
||||||
|
"difficulty": "medium",
|
||||||
|
"question": "Kto pracoval na téme multilinguálna extrakcia trojíc z medicínskych dát?",
|
||||||
|
"override_applied": false,
|
||||||
|
"requested_model": "model120-fast",
|
||||||
|
"expected_documents": [
|
||||||
|
"pages/interns/bogdan_paul_chis/README.md"
|
||||||
|
],
|
||||||
|
"expected_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis"
|
||||||
|
],
|
||||||
|
"expected_answer_contains": [
|
||||||
|
"Bogdan Paul Chiș"
|
||||||
|
],
|
||||||
|
"should_answer": true,
|
||||||
|
"note": null,
|
||||||
|
"answer": "V dostupných dokumentoch ZP Wiki sa túto informáciu nepodarilo spoľahlivo nájsť. Hoci Andrii Pervashov pracoval na téme extrakcie štruktúrovaných informácií z medicínskej domény a Yevhenii Medushivskyi vytváral korpus medicínskych dát, v žiadnom z nájdených záznamov sa neobjavuje konkrétna práca s názvom alebo témou „multilinguálna extrakcia trojíc z medicínskych dát\".\n\nZdroj:\nhttps://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov\nhttps://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi",
|
||||||
|
"tool_called": true,
|
||||||
|
"tool_call_count": 1,
|
||||||
|
"tool_calls": [
|
||||||
|
{
|
||||||
|
"name": "retrieve_zpwiki_context",
|
||||||
|
"arguments": {
|
||||||
|
"query": "Kto pracoval na téme multilinguálna extrakcia trojíc z medicínskych dát?",
|
||||||
|
"limit": 5,
|
||||||
|
"published_only": true
|
||||||
|
},
|
||||||
|
"latency_seconds": 0.529436,
|
||||||
|
"source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"
|
||||||
|
]
|
||||||
|
}
|
||||||
|
],
|
||||||
|
"rag_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"
|
||||||
|
],
|
||||||
|
"first_model_latency_seconds": 1.715903,
|
||||||
|
"tool_latency_seconds": 0.529436,
|
||||||
|
"final_model_latency_seconds": 27.760575,
|
||||||
|
"total_latency_seconds": 30.006754,
|
||||||
|
"usage": {
|
||||||
|
"prompt_tokens": 31551,
|
||||||
|
"completion_tokens": 257,
|
||||||
|
"total_tokens": 31808
|
||||||
|
},
|
||||||
|
"response_model": "Qwen3.5-122B-A10B-Q4_K_M",
|
||||||
|
"answer_matches": [
|
||||||
|
false
|
||||||
|
],
|
||||||
|
"answer_contains_score": 0.0,
|
||||||
|
"source_matches": [
|
||||||
|
false
|
||||||
|
],
|
||||||
|
"source_match_count": 0,
|
||||||
|
"source_required_count": 1,
|
||||||
|
"source_url_score": 0.0,
|
||||||
|
"should_answer_ok": false,
|
||||||
|
"should_answer_score": 0.0,
|
||||||
|
"returned_no_answer": true,
|
||||||
|
"tool_score": 1.0,
|
||||||
|
"overall_score": 0.25,
|
||||||
|
"strict_pass": false,
|
||||||
|
"error": null
|
||||||
|
}
|
||||||
|
]
|
||||||
|
}
|
||||||
@ -0,0 +1,15 @@
|
|||||||
|
id,split,category,difficulty,question,requested_model,response_model,tool_called,tool_call_count,answer_contains_score,source_url_score,should_answer_score,overall_score,strict_pass,expected_answer_contains,expected_source_urls,rag_source_urls,answer,first_model_latency_seconds,tool_latency_seconds,final_model_latency_seconds,total_latency_seconds,prompt_tokens,completion_tokens,total_tokens,error
|
||||||
|
q0024,dev,keyword_grounding,medium,Ktorý študentský dokument o grafových neurónových sieťach má v metadátach ako autora dokumentu uvedeného Maroša Harahusa?,model120-fast,Qwen3.5-122B-A10B-Q4_K_M,True,1,1.0,1.0,0.0,0.75,False,"[""Dmytro Mural"", ""Maroš Harahus"", ""grafové neurónové siete""]","[""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","V dostupných dokumentoch ZP Wiki sa túto informáciu nepodarilo spoľahlivo nájsť. Hoci v dokumente o študentovi Dmytrovi Muralovi je Maroš Harahus uvedený ako autor stránky a téma práce sa týka grafových neurónových sietí, v metadátach dokumentu je Maroš Harahus uvedený ako autor stránky, nie ako autor študentského dokumentu o grafových neurónových sieťach, a v dokumente o Marošovi Harahusovi sa grafové neurónové siete spomínajú len ako úloha na vypracovanie prehľadu, nie ako názov jeho vlastnej záverečnej práce.
|
||||||
|
|
||||||
|
Zdroje:
|
||||||
|
https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural
|
||||||
|
https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus",1.475591,0.479066,22.127946,24.083269,24163,264,24427,
|
||||||
|
q0311,dev,disambiguation_year,hard,Rozlíš rok začiatku štúdia a rok práce osoby Valerii Kutsenko.,model120-fast,Qwen3.5-122B-A10B-Q4_K_M,True,1,1.0,1.0,1.0,1.0,True,"[""2022"", ""2027""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","Valerii Kutsenko začal štúdium v roku 2022 a vypracováva diplomovú prácu v roku 2027.
|
||||||
|
|
||||||
|
Zdroj: https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko",1.846186,0.357021,4.919796,7.123257,4664,145,4809,
|
||||||
|
q0580,dev,reverse_lookup,medium,Kto pracoval na téme multilinguálna extrakcia trojíc z medicínskych dát?,model120-fast,Qwen3.5-122B-A10B-Q4_K_M,True,1,0.0,0.0,0.0,0.25,False,"[""Bogdan Paul Chiș""]","[""https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis""]","[""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","V dostupných dokumentoch ZP Wiki sa túto informáciu nepodarilo spoľahlivo nájsť. Zdroje obsahujú spomienky na „multilinguálnu extrakciu"" v súvislosti s inými študentmi (napr. Michal Stromko pri vyhľadávaní alebo Maroš Harahus pri generovaní otázok) a spracovanie medicínskych dát (napr. Yevhenii Medushivskyi pri tvorbe korpusov alebo Andrii Pervashov pri extrakcii štruktúrovaných informácií), ale žiadny z nich explicitne neuvádza prácu s presnou témou „multilinguálna extrakcia trojíc z medicínskych dát"".
|
||||||
|
|
||||||
|
Zdroj: https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi
|
||||||
|
Zdroj: https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov
|
||||||
|
Zdroj: https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko
|
||||||
|
Zdroj: https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus",1.884738,0.55145,5.140703,7.577916,31564,369,31933,
|
||||||
|
@ -0,0 +1,353 @@
|
|||||||
|
{
|
||||||
|
"generated_at": "2026-09-28T13:55:56.987787+00:00",
|
||||||
|
"status": "complete",
|
||||||
|
"configuration": {
|
||||||
|
"schema_version": 2,
|
||||||
|
"questions_file": "/home/janko/DP/zp-agent/evaluation/json_files/questions.json",
|
||||||
|
"overrides_file": "/home/janko/DP/zp-agent/evaluation/json_files/rag_answer_overrides.json",
|
||||||
|
"questions_fingerprint": "98d0a80160067c196dd4d64ac213748519e34f9238df92e97c211f8731de8182",
|
||||||
|
"selected_question_ids": [
|
||||||
|
"q0024",
|
||||||
|
"q0311",
|
||||||
|
"q0580"
|
||||||
|
],
|
||||||
|
"applied_override_ids": [],
|
||||||
|
"split": "dev",
|
||||||
|
"selected_question_count": 3,
|
||||||
|
"requested_model": "model120-fast",
|
||||||
|
"operation_id": "retrieve_zpwiki_context",
|
||||||
|
"openwebui_url": "https://ui.tukekemt.xyz/api/chat/completions",
|
||||||
|
"rag_url": "http://localhost:8000/rag",
|
||||||
|
"timeout": 180,
|
||||||
|
"max_attempts": 4,
|
||||||
|
"backoff_base": 1.0,
|
||||||
|
"backoff_max": 8.0,
|
||||||
|
"delay": 0.0
|
||||||
|
},
|
||||||
|
"summary": {
|
||||||
|
"total": 3,
|
||||||
|
"completed": 3,
|
||||||
|
"errors": 0,
|
||||||
|
"tool_call_rate": 1.0,
|
||||||
|
"answer_contains_score": 0.666667,
|
||||||
|
"source_url_score": 0.666667,
|
||||||
|
"should_answer_score": 0.333333,
|
||||||
|
"overall_score": 0.666667,
|
||||||
|
"strict_pass_count": 1,
|
||||||
|
"strict_pass_rate": 0.333333,
|
||||||
|
"mean_latency_seconds": 12.928147,
|
||||||
|
"prompt_tokens": 60391,
|
||||||
|
"completion_tokens": 778,
|
||||||
|
"total_tokens": 61169,
|
||||||
|
"by_category": {
|
||||||
|
"disambiguation_year": {
|
||||||
|
"total": 1,
|
||||||
|
"completed": 1,
|
||||||
|
"errors": 0,
|
||||||
|
"tool_call_rate": 1.0,
|
||||||
|
"answer_contains_score": 1.0,
|
||||||
|
"source_url_score": 1.0,
|
||||||
|
"should_answer_score": 1.0,
|
||||||
|
"overall_score": 1.0,
|
||||||
|
"strict_pass_count": 1,
|
||||||
|
"strict_pass_rate": 1.0,
|
||||||
|
"mean_latency_seconds": 7.123257,
|
||||||
|
"prompt_tokens": 4664,
|
||||||
|
"completion_tokens": 145,
|
||||||
|
"total_tokens": 4809
|
||||||
|
},
|
||||||
|
"keyword_grounding": {
|
||||||
|
"total": 1,
|
||||||
|
"completed": 1,
|
||||||
|
"errors": 0,
|
||||||
|
"tool_call_rate": 1.0,
|
||||||
|
"answer_contains_score": 1.0,
|
||||||
|
"source_url_score": 1.0,
|
||||||
|
"should_answer_score": 0.0,
|
||||||
|
"overall_score": 0.75,
|
||||||
|
"strict_pass_count": 0,
|
||||||
|
"strict_pass_rate": 0.0,
|
||||||
|
"mean_latency_seconds": 24.083269,
|
||||||
|
"prompt_tokens": 24163,
|
||||||
|
"completion_tokens": 264,
|
||||||
|
"total_tokens": 24427
|
||||||
|
},
|
||||||
|
"reverse_lookup": {
|
||||||
|
"total": 1,
|
||||||
|
"completed": 1,
|
||||||
|
"errors": 0,
|
||||||
|
"tool_call_rate": 1.0,
|
||||||
|
"answer_contains_score": 0.0,
|
||||||
|
"source_url_score": 0.0,
|
||||||
|
"should_answer_score": 0.0,
|
||||||
|
"overall_score": 0.25,
|
||||||
|
"strict_pass_count": 0,
|
||||||
|
"strict_pass_rate": 0.0,
|
||||||
|
"mean_latency_seconds": 7.577916,
|
||||||
|
"prompt_tokens": 31564,
|
||||||
|
"completion_tokens": 369,
|
||||||
|
"total_tokens": 31933
|
||||||
|
}
|
||||||
|
},
|
||||||
|
"by_difficulty": {
|
||||||
|
"hard": {
|
||||||
|
"total": 1,
|
||||||
|
"completed": 1,
|
||||||
|
"errors": 0,
|
||||||
|
"tool_call_rate": 1.0,
|
||||||
|
"answer_contains_score": 1.0,
|
||||||
|
"source_url_score": 1.0,
|
||||||
|
"should_answer_score": 1.0,
|
||||||
|
"overall_score": 1.0,
|
||||||
|
"strict_pass_count": 1,
|
||||||
|
"strict_pass_rate": 1.0,
|
||||||
|
"mean_latency_seconds": 7.123257,
|
||||||
|
"prompt_tokens": 4664,
|
||||||
|
"completion_tokens": 145,
|
||||||
|
"total_tokens": 4809
|
||||||
|
},
|
||||||
|
"medium": {
|
||||||
|
"total": 2,
|
||||||
|
"completed": 2,
|
||||||
|
"errors": 0,
|
||||||
|
"tool_call_rate": 1.0,
|
||||||
|
"answer_contains_score": 0.5,
|
||||||
|
"source_url_score": 0.5,
|
||||||
|
"should_answer_score": 0.0,
|
||||||
|
"overall_score": 0.5,
|
||||||
|
"strict_pass_count": 0,
|
||||||
|
"strict_pass_rate": 0.0,
|
||||||
|
"mean_latency_seconds": 15.830593,
|
||||||
|
"prompt_tokens": 55727,
|
||||||
|
"completion_tokens": 633,
|
||||||
|
"total_tokens": 56360
|
||||||
|
}
|
||||||
|
}
|
||||||
|
},
|
||||||
|
"results": [
|
||||||
|
{
|
||||||
|
"id": "q0024",
|
||||||
|
"split": "dev",
|
||||||
|
"category": "keyword_grounding",
|
||||||
|
"difficulty": "medium",
|
||||||
|
"question": "Ktorý študentský dokument o grafových neurónových sieťach má v metadátach ako autora dokumentu uvedeného Maroša Harahusa?",
|
||||||
|
"override_applied": false,
|
||||||
|
"requested_model": "model120-fast",
|
||||||
|
"expected_documents": [
|
||||||
|
"pages/students/2016/maros_harahus/README.md"
|
||||||
|
],
|
||||||
|
"expected_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"
|
||||||
|
],
|
||||||
|
"expected_answer_contains": [
|
||||||
|
"Dmytro Mural",
|
||||||
|
"Maroš Harahus",
|
||||||
|
"grafové neurónové siete"
|
||||||
|
],
|
||||||
|
"should_answer": true,
|
||||||
|
"note": "Answer-level disambiguation: študentský dokument patrí Dmytrovi Muralovi; Maroš Harahus je v jeho metadátach uvedený ako autor dokumentu. Nemá sa zamieňať autor dokumentu so študentom, ktorý prácu vypracoval.",
|
||||||
|
"answer": "V dostupných dokumentoch ZP Wiki sa túto informáciu nepodarilo spoľahlivo nájsť. Hoci v dokumente o študentovi Dmytrovi Muralovi je Maroš Harahus uvedený ako autor stránky a téma práce sa týka grafových neurónových sietí, v metadátach dokumentu je Maroš Harahus uvedený ako autor stránky, nie ako autor študentského dokumentu o grafových neurónových sieťach, a v dokumente o Marošovi Harahusovi sa grafové neurónové siete spomínajú len ako úloha na vypracovanie prehľadu, nie ako názov jeho vlastnej záverečnej práce.\n\nZdroje:\nhttps://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural\nhttps://zp.kemt.fei.tuke.sk/students/2016/maros_harahus",
|
||||||
|
"tool_called": true,
|
||||||
|
"tool_call_count": 1,
|
||||||
|
"tool_calls": [
|
||||||
|
{
|
||||||
|
"name": "retrieve_zpwiki_context",
|
||||||
|
"arguments": {
|
||||||
|
"query": "Ktorý študentský dokument o grafových neurónových sieťach má v metadátach ako autora dokumentu uvedeného Maroša Harahusa?",
|
||||||
|
"limit": 5
|
||||||
|
},
|
||||||
|
"latency_seconds": 0.479066,
|
||||||
|
"source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"
|
||||||
|
]
|
||||||
|
}
|
||||||
|
],
|
||||||
|
"rag_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"
|
||||||
|
],
|
||||||
|
"first_model_latency_seconds": 1.475591,
|
||||||
|
"tool_latency_seconds": 0.479066,
|
||||||
|
"final_model_latency_seconds": 22.127946,
|
||||||
|
"total_latency_seconds": 24.083269,
|
||||||
|
"usage": {
|
||||||
|
"prompt_tokens": 24163,
|
||||||
|
"completion_tokens": 264,
|
||||||
|
"total_tokens": 24427
|
||||||
|
},
|
||||||
|
"response_model": "Qwen3.5-122B-A10B-Q4_K_M",
|
||||||
|
"answer_matches": [
|
||||||
|
true,
|
||||||
|
true,
|
||||||
|
true
|
||||||
|
],
|
||||||
|
"answer_contains_score": 1.0,
|
||||||
|
"source_matches": [
|
||||||
|
true
|
||||||
|
],
|
||||||
|
"source_match_count": 1,
|
||||||
|
"source_required_count": 1,
|
||||||
|
"source_url_score": 1.0,
|
||||||
|
"should_answer_ok": false,
|
||||||
|
"should_answer_score": 0.0,
|
||||||
|
"returned_no_answer": true,
|
||||||
|
"tool_score": 1.0,
|
||||||
|
"overall_score": 0.75,
|
||||||
|
"strict_pass": false,
|
||||||
|
"error": null
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"id": "q0311",
|
||||||
|
"split": "dev",
|
||||||
|
"category": "disambiguation_year",
|
||||||
|
"difficulty": "hard",
|
||||||
|
"question": "Rozlíš rok začiatku štúdia a rok práce osoby Valerii Kutsenko.",
|
||||||
|
"override_applied": false,
|
||||||
|
"requested_model": "model120-fast",
|
||||||
|
"expected_documents": [
|
||||||
|
"pages/students/2022/valerii_kutsenko/README.md"
|
||||||
|
],
|
||||||
|
"expected_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"
|
||||||
|
],
|
||||||
|
"expected_answer_contains": [
|
||||||
|
"2022",
|
||||||
|
"2027"
|
||||||
|
],
|
||||||
|
"should_answer": true,
|
||||||
|
"note": "Kontrola proti zámene roku začiatku štúdia s rokom záverečnej práce alebo projektu.",
|
||||||
|
"answer": "Valerii Kutsenko začal štúdium v roku 2022 a vypracováva diplomovú prácu v roku 2027.\n\nZdroj: https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko",
|
||||||
|
"tool_called": true,
|
||||||
|
"tool_call_count": 1,
|
||||||
|
"tool_calls": [
|
||||||
|
{
|
||||||
|
"name": "retrieve_zpwiki_context",
|
||||||
|
"arguments": {
|
||||||
|
"query": "Rozlíš rok začiatku štúdia a rok práce osoby Valerii Kutsenko.",
|
||||||
|
"limit": 5,
|
||||||
|
"published_only": true,
|
||||||
|
"max_per_document": 10
|
||||||
|
},
|
||||||
|
"latency_seconds": 0.357021,
|
||||||
|
"source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"
|
||||||
|
]
|
||||||
|
}
|
||||||
|
],
|
||||||
|
"rag_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"
|
||||||
|
],
|
||||||
|
"first_model_latency_seconds": 1.846186,
|
||||||
|
"tool_latency_seconds": 0.357021,
|
||||||
|
"final_model_latency_seconds": 4.919796,
|
||||||
|
"total_latency_seconds": 7.123257,
|
||||||
|
"usage": {
|
||||||
|
"prompt_tokens": 4664,
|
||||||
|
"completion_tokens": 145,
|
||||||
|
"total_tokens": 4809
|
||||||
|
},
|
||||||
|
"response_model": "Qwen3.5-122B-A10B-Q4_K_M",
|
||||||
|
"answer_matches": [
|
||||||
|
true,
|
||||||
|
true
|
||||||
|
],
|
||||||
|
"answer_contains_score": 1.0,
|
||||||
|
"source_matches": [
|
||||||
|
true
|
||||||
|
],
|
||||||
|
"source_match_count": 1,
|
||||||
|
"source_required_count": 1,
|
||||||
|
"source_url_score": 1.0,
|
||||||
|
"should_answer_ok": true,
|
||||||
|
"should_answer_score": 1.0,
|
||||||
|
"returned_no_answer": false,
|
||||||
|
"tool_score": 1.0,
|
||||||
|
"overall_score": 1.0,
|
||||||
|
"strict_pass": true,
|
||||||
|
"error": null
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"id": "q0580",
|
||||||
|
"split": "dev",
|
||||||
|
"category": "reverse_lookup",
|
||||||
|
"difficulty": "medium",
|
||||||
|
"question": "Kto pracoval na téme multilinguálna extrakcia trojíc z medicínskych dát?",
|
||||||
|
"override_applied": false,
|
||||||
|
"requested_model": "model120-fast",
|
||||||
|
"expected_documents": [
|
||||||
|
"pages/interns/bogdan_paul_chis/README.md"
|
||||||
|
],
|
||||||
|
"expected_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis"
|
||||||
|
],
|
||||||
|
"expected_answer_contains": [
|
||||||
|
"Bogdan Paul Chiș"
|
||||||
|
],
|
||||||
|
"should_answer": true,
|
||||||
|
"note": null,
|
||||||
|
"answer": "V dostupných dokumentoch ZP Wiki sa túto informáciu nepodarilo spoľahlivo nájsť. Zdroje obsahujú spomienky na „multilinguálnu extrakciu\" v súvislosti s inými študentmi (napr. Michal Stromko pri vyhľadávaní alebo Maroš Harahus pri generovaní otázok) a spracovanie medicínskych dát (napr. Yevhenii Medushivskyi pri tvorbe korpusov alebo Andrii Pervashov pri extrakcii štruktúrovaných informácií), ale žiadny z nich explicitne neuvádza prácu s presnou témou „multilinguálna extrakcia trojíc z medicínskych dát\".\n\nZdroj: https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi\nZdroj: https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov\nZdroj: https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko\nZdroj: https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus",
|
||||||
|
"tool_called": true,
|
||||||
|
"tool_call_count": 1,
|
||||||
|
"tool_calls": [
|
||||||
|
{
|
||||||
|
"name": "retrieve_zpwiki_context",
|
||||||
|
"arguments": {
|
||||||
|
"query": "Kto pracoval na téme multilinguálna extrakcia trojíc z medicínskych dát?",
|
||||||
|
"limit": 5,
|
||||||
|
"published_only": true,
|
||||||
|
"max_per_document": 1
|
||||||
|
},
|
||||||
|
"latency_seconds": 0.55145,
|
||||||
|
"source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"
|
||||||
|
]
|
||||||
|
}
|
||||||
|
],
|
||||||
|
"rag_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"
|
||||||
|
],
|
||||||
|
"first_model_latency_seconds": 1.884738,
|
||||||
|
"tool_latency_seconds": 0.55145,
|
||||||
|
"final_model_latency_seconds": 5.140703,
|
||||||
|
"total_latency_seconds": 7.577916,
|
||||||
|
"usage": {
|
||||||
|
"prompt_tokens": 31564,
|
||||||
|
"completion_tokens": 369,
|
||||||
|
"total_tokens": 31933
|
||||||
|
},
|
||||||
|
"response_model": "Qwen3.5-122B-A10B-Q4_K_M",
|
||||||
|
"answer_matches": [
|
||||||
|
false
|
||||||
|
],
|
||||||
|
"answer_contains_score": 0.0,
|
||||||
|
"source_matches": [
|
||||||
|
false
|
||||||
|
],
|
||||||
|
"source_match_count": 0,
|
||||||
|
"source_required_count": 1,
|
||||||
|
"source_url_score": 0.0,
|
||||||
|
"should_answer_ok": false,
|
||||||
|
"should_answer_score": 0.0,
|
||||||
|
"returned_no_answer": true,
|
||||||
|
"tool_score": 1.0,
|
||||||
|
"overall_score": 0.25,
|
||||||
|
"strict_pass": false,
|
||||||
|
"error": null
|
||||||
|
}
|
||||||
|
]
|
||||||
|
}
|
||||||
@ -0,0 +1,66 @@
|
|||||||
|
id,split,category,difficulty,question,requested_model,response_model,tool_called,tool_call_count,answer_contains_score,source_url_score,should_answer_score,overall_score,strict_pass,expected_answer_contains,expected_source_urls,rag_source_urls,answer,first_model_latency_seconds,tool_latency_seconds,final_model_latency_seconds,total_latency_seconds,prompt_tokens,completion_tokens,total_tokens,error
|
||||||
|
q0004,dev,topic_lookup,medium,"Nájdi študenta alebo dokument, ktorý rieši tému „Systém získavania informácií v slovenskom jazyku“.",model120-fast,Qwen3.5-122B-A10B-Q4_K_M,True,1,0.0,0.0,1.0,0.5,False,"[""Ján Holp"", ""Systém získavania informácií v slovenskom jazyku""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]","[""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp""]","Študent Michal Stromko riešil v rámci svojho diplomového projektu 2 vytvorenie novej databázy pre vyhodnotenie získavania informácií v slovenskom jazyku a v bakalárskej práci 2022 sa venoval indexovaniu slovenského textu s cieľom vypracovať prehľad metód pre získavanie informácií.
|
||||||
|
|
||||||
|
Zdroje:
|
||||||
|
https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko",2.264907,0.939195,24.041229,27.246063,29443,203,29646,
|
||||||
|
q0026,dev,specific_fact,medium,Akú konkrétnu skupinu neurónových sietí mal Maroš Harahus naštudovať v rámci úloh po úvodnom stretnutí s US Steel?,model120-fast,Qwen3.5-122B-A10B-Q4_K_M,True,1,1.0,1.0,1.0,1.0,True,"[""grafové neurónové siete""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/topics/steel"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp21"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai""]","Maroš Harahus mal po úvodnom stretnutí s US Steel naštudovať a vypracovať prehľad aktuálnych metód grafových neurónových sietí (GNN).
|
||||||
|
|
||||||
|
Zdroj:
|
||||||
|
https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus",1.820668,1.166803,37.166568,40.155286,44981,150,45131,
|
||||||
|
q0040,dev,reverse_lookup,medium,Kto sa venuje práci s názvom „Anotácia a rozpoznávanie pomenovaných entít v slovenskom jazyku“?,model120-fast,Qwen3.5-122B-A10B-Q4_K_M,True,1,0.0,0.0,1.0,0.5,False,"[""Jakub Maruniak""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""]","[""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2022/serhii_yemets"", ""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/topics/named-entity/navod""]","V dostupných dokumentoch ZP Wiki sa nepodarilo nájsť konkrétnu študentskú prácu s presným názvom „Anotácia a rozpoznávanie pomenovaných entít v slovenskom jazyku"".
|
||||||
|
|
||||||
|
Zdroj: https://zp.kemt.fei.tuke.sk/topics/otvorene",1.536128,0.410449,21.557901,23.505169,26017,136,26153,
|
||||||
|
q0041,dev,topic_lookup,medium,"Nájdi študenta alebo dokument, ktorý rieši tému „Anotácia a rozpoznávanie pomenovaných entít v slovenskom jazyku“.",model120-fast,Qwen3.5-122B-A10B-Q4_K_M,True,1,0.5,0.0,1.0,0.625,False,"[""Jakub Maruniak"", ""Anotácia a rozpoznávanie pomenovaných entít v slovenskom jazyku""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""]","[""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2022/serhii_yemets"", ""https://zp.kemt.fei.tuke.sk/topics/named-entity/navod""]","Študent Than Trung Thanh vypracoval bakalársky projekt v roku 2020 s názvom „Rozpoznávanie pomenovaných entít v slovenskom jazyku pomocou nástrojov Spacy a Prodigy"", pri ktorom sa venoval tvorbe korpusu, anotáciám a vývoju modelu pre túto úlohu. Ďalším študentom, ktorý rieši tému rozpoznávania pomenovaných entít v slovenčine, je Serhii Yemets, ktorý v rámci bakalárskej práce v roku 2025 pracuje na zlepšení slovenského modelu pre túto úlohu s využitím modelov typu BERT.
|
||||||
|
|
||||||
|
Zdroje:
|
||||||
|
https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh
|
||||||
|
https://zp.kemt.fei.tuke.sk/students/2022/serhii_yemets",1.775508,0.357276,25.125982,27.259509,27920,286,28206,
|
||||||
|
q0253,dev,disambiguation_year,hard,Rozlíš pri osobe Vladimír Ferko rok začiatku štúdia a rok uvedený v názve sekcie jeho bakalárskej práce.,model120-fast,Qwen3.5-122B-A10B-Q4_K_M,True,1,1.0,1.0,1.0,1.0,True,"[""2021"", ""2024""]","[""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]","[""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/topics/akopisat""]","Vladimír Ferko začal štúdium v roku 2021, zatiaľ čo rok uvedený v názve sekcie jeho bakalárskej práce je 2024.
|
||||||
|
|
||||||
|
Zdroj: https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko",1.850572,0.503375,29.198301,31.553134,35152,149,35301,
|
||||||
|
q0336,dev,topic_lookup,medium,"Nájdi študenta alebo dokument, ktorý má bakalársku prácu s názvom „Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov“.",model120-fast,Qwen3.5-122B-A10B-Q4_K_M,True,1,0.0,0.0,0.0,0.25,False,"[""Tetiana Mohorian"", ""Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov""]","[""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]","V dostupných dokumentoch ZP Wiki sa túto informáciu nepodarilo spoľahlivo nájsť.
|
||||||
|
|
||||||
|
Zdroje:
|
||||||
|
https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil
|
||||||
|
https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov
|
||||||
|
https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina
|
||||||
|
https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova
|
||||||
|
https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov",1.919063,0.482241,24.748093,27.15017,27538,237,27775,
|
||||||
|
q0570,dev,internship_topic,medium,Akému problému alebo téme sa venovala stáž osoby Cesar Abascal Gutierrez?,model120-fast,Qwen3.5-122B-A10B-Q4_K_M,True,1,0.0,1.0,1.0,0.75,False,"[""anotácia pomenovaných entít""]","[""https://zp.kemt.fei.tuke.sk/interns/cesar_gutierrez""]","[""https://zp.kemt.fei.tuke.sk/interns/cesar_gutierrez"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","Cesar Abascal Gutierrez sa počas svojej stáže venoval téme automatickej annotácie entít v prekladoch reči (speech transcripts), kde jeho cieľom bolo vytvoriť manuálne annotovanú trénovaciu množinu dát a navrhnúť schému annotácie.
|
||||||
|
|
||||||
|
Zdroj: https://zp.kemt.fei.tuke.sk/interns/cesar_gutierrez",1.786802,0.267954,12.171385,14.226604,14010,166,14176,
|
||||||
|
q0633,dev,topic_page_lookup,medium,"Ktorá tematická stránka ZP Wiki, nie študentská práca, sa priamo venuje téme „Strojový preklad“?",model120-fast,Qwen3.5-122B-A10B-Q4_K_M,True,1,1.0,1.0,1.0,1.0,True,"[""Strojový preklad""]","[""https://zp.kemt.fei.tuke.sk/topics/translation""]","[""https://zp.kemt.fei.tuke.sk/topics/translation"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene""]","Tematícka stránka ZP Wiki, ktorá sa priamo venuje téme „Strojový preklad"" a nie je študentskou prácou, sa nazýva „Strojový preklad"" a nachádza sa pod URL adresou https://zp.kemt.fei.tuke.sk/topics/translation.
|
||||||
|
|
||||||
|
Zdroj: https://zp.kemt.fei.tuke.sk/topics/translation",1.859107,0.970622,32.057544,34.888168,38357,167,38524,
|
||||||
|
q0968,dev,single_document_synthesis,hard,Pri osobe Ján Pták uveď názov záznamu typu „diplomový projekt“ a rok uvedený v názve príslušnej sekcie. Neuvádzaj rok začiatku štúdia.,model120-fast,Qwen3.5-122B-A10B-Q4_K_M,True,1,0.5,1.0,1.0,0.875,False,"[""Agent pre manažment záverečných prác"", ""2026""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]","Pre Ján Pták je názvom záznamu typu „diplomový projekt“ sekcia „Diplomový projekt 2026“ a rok uvedený v názve príslušnej sekcie je 2026.
|
||||||
|
|
||||||
|
Zdroj: https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak",1.39529,0.456783,22.790452,24.643161,27026,129,27155,
|
||||||
|
q0982,dev,single_document_synthesis,hard,Rozlíš pri osobe Dárius Lindvai rok začiatku štúdia a rok vyjadrený kategóriou jeho diplomovej práce. Nezamieňaj ho s rokom sekcie diplomového projektu.,model120-fast,Qwen3.5-122B-A10B-Q4_K_M,True,1,0.5,1.0,1.0,0.875,False,"[""2016"", ""2021""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]","Dárius Lindvai začal štúdium v roku 2016 a jeho diplomová práca je vedená pod kategóriou roku 2020 (s názvom „Obnovenie interpunkcie pomocou hlbokých neurónových sietí""), pričom rok 2020 v sekcii „Diplomový projekt 2 2020"" označuje rok realizácie projektu a nie rok začiatku štúdia.
|
||||||
|
|
||||||
|
Zdroj: https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai",1.627795,1.417725,38.438714,41.485325,44152,197,44349,
|
||||||
|
q0990,dev,single_document_synthesis,hard,"V dokumente osoby Tomáš Kuchárik, ktorý súvisí s témou „strojový preklad“, uveď názov záznamu typu „diplomová práca“ a rok, pri ktorom je táto práca uvedená.",model120-fast,Qwen3.5-122B-A10B-Q4_K_M,True,1,1.0,1.0,1.0,1.0,True,"[""Tvorba korpusu otázok a odpovedí v slovenskom jazyku pomocou strojového prekladu"", ""2022""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/topics/translation"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]","Tomáš Kuchárik vypracovával diplomovú prácu s názvom „Tvorba korpusu otázok a odpovedí v slovenskom jazyku pomocou strojového prekladu"", ktorá je uvedená v roku 2022.
|
||||||
|
|
||||||
|
Zdroj: https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik",1.920394,0.796818,21.817399,24.535242,25948,170,26118,
|
||||||
|
q1022,dev,single_document_synthesis,hard,"V dokumente osoby Dárius Lindvai, ktorý súvisí s témou „interpunkcia“, uveď názov diplomovej práce a rok vyjadrený kategóriou tejto diplomovej práce. Nezamieňaj ho s rokom sekcie diplomového projektu.",model120-fast,Qwen3.5-122B-A10B-Q4_K_M,True,1,1.0,1.0,1.0,1.0,True,"[""Obnovenie interpunkcie pomocou hlbokých neurónových sietí"", ""2021""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai""]","Diplomová práca Dáriusa Lindvaiho s témou súvisiacou s interpunkciou sa volá „Obnovenie interpunkcie pomocou hlbokých neurónových sietí“ a jej kategóriou je rok 2021, ktorý je uvedený v názve repozitára a kontexte diplomového projektu (DP2021).
|
||||||
|
|
||||||
|
Zdroj: https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai",1.895492,0.694162,8.408121,10.998024,8309,195,8504,
|
||||||
|
q1092,dev,multi_document,hard,"Porovnaj záznamy osôb Dárius Lindvai a Ján Pták. Pri Dáriusovi Lindvaiovi uveď názov diplomovej práce a rok vyjadrený kategóriou diplomovej práce, nie rok diplomového projektu. Pri Jánovi Ptákovi použi diplomový projekt a rok uvedený v názve jeho príslušnej sekcie. Uveď názov a rok pri oboch osobách.",model120-fast,Qwen3.5-122B-A10B-Q4_K_M,True,1,0.75,1.0,1.0,0.9375,False,"[""Obnovenie interpunkcie pomocou hlbokých neurónových sietí"", ""2021"", ""Agent pre manažment záverečných prác"", ""2026""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]","Dárius Lindvai má v ZP Wiki evidovanú prácu s názvom „Obnovenie interpunkcie pomocou hlbokých neurónových sietí"" v rámci diplomového projektu pre rok 2020, pričom v dokumentoch nie je explicitne uvedená sekcia označená ako „diplomová práca"" s iným rokom. Ján Pták má v zázname uvedenú prácu s názvom „Agent pre manažment záverečných prác"" v rámci diplomového projektu pre rok 2026.
|
||||||
|
|
||||||
|
Zdroje:
|
||||||
|
https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai
|
||||||
|
https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak",1.963353,1.341374,14.677213,17.982364,16271,253,16524,
|
||||||
|
q1109,dev,multi_document,hard,"Porovnaj záznamy osôb Martin Šarišský a Andrii Pervashov. Pri osobe Martin Šarišský použi záznam typu „diplomová práca“ a pri osobe Andrii Pervashov záznam typu „diplomová práca“. Uveď názov každej práce a rok, pri ktorom je na ZP Wiki uvedená.",model120-fast,Qwen3.5-122B-A10B-Q4_K_M,True,1,1.0,1.0,1.0,1.0,True,"[""Agentové systémy pomocou veľkého jazykového modelu"", ""2026"", ""Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu"", ""2027""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]","V dostupných dokumentoch ZP Wiki sa pre Martina Šarišského v roku 2026 uvádza diplomová práca s názvom „Agentové systémy pomocou veľkého jazykového modelu“ a pre Andriiho Pervashova v roku 2027 je uvedená diplomová práca s návrhom názvu (témy) „Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu“.
|
||||||
|
|
||||||
|
Zdroje:
|
||||||
|
https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky
|
||||||
|
https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov",1.876024,0.881262,24.716133,27.47413,28433,235,28668,
|
||||||
|
q1125,dev,multi_document,hard,"Porovnaj záznamy osôb Dárius Lindvai a Andrii Pervashov. Pri Dáriusovi Lindvaiovi uveď názov diplomovej práce a rok vyjadrený kategóriou diplomovej práce, nie rok diplomového projektu. Pri Andrii Pervashovovi použi diplomovú prácu a rok uvedený v názve príslušnej sekcie. Uveď názov a rok pri oboch osobách.",model120-fast,Qwen3.5-122B-A10B-Q4_K_M,True,1,0.75,1.0,1.0,0.9375,False,"[""Obnovenie interpunkcie pomocou hlbokých neurónových sietí"", ""2021"", ""Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu"", ""2027""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","V dostupných dokumentoch ZP Wiki sa pre Dáriusa Lindvaia nenašla žiadna záverečná práca typu „diplomová práca"", nakoľko jeho záznam uvádza len „Diplomový projekt 2020"" s názvom „Obnovenie interpunkcie pomocou hlbokých neurónových sietí"", a pre Andriiho Pervashova sa nenašla explicitne uvedená „diplomová práca"" s rokom v názve sekcie, keďže sekcia „Diplomová práca 2027"" obsahuje iba návrh na tému „Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu"" bez potvrdeného roku ukončenia v názve práce.
|
||||||
|
|
||||||
|
Zdroje:
|
||||||
|
https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov
|
||||||
|
https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai",2.153057,0.951525,24.234206,27.339587,26186,325,26511,
|
||||||
|
q1136,dev,multi_document,hard,"Porovnaj záznamy osôb Ján Malinovský a Yevhenii Medushivskyi. Pri Jánovi Malinovskom použi diplomový projekt a pri Yevhenii Medushivskom bakalársku prácu. Pri oboch uveď názov práce a rok uvedený v názve príslušnej sekcie, nie rok začiatku štúdia.",model120-fast,Qwen3.5-122B-A10B-Q4_K_M,True,1,1.0,1.0,1.0,1.0,True,"[""Grafové vyhľadávanie pre podporu vzdelávania"", ""2026"", ""Získavanie textu z webových stránok"", ""2026""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]","[""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]","Ján Malinovský vypracováva diplomový projekt s názvom „Grafové vyhľadávanie pre podporu vzdelávania"" v roku 2026 a Yevhenii Medushivskyi vypracováva bakalársku prácu s názvom „Získavanie textu z webových stránok"" v roku 2026.
|
||||||
|
|
||||||
|
Zdroje:
|
||||||
|
https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky
|
||||||
|
https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi",1.888024,0.29403,13.043088,15.225568,14164,217,14381,
|
||||||
|
File diff suppressed because it is too large
Load Diff
@ -0,0 +1,24 @@
|
|||||||
|
id,split,category,difficulty,question,requested_model,response_model,tool_called,tool_call_count,answer_contains_score,source_url_score,should_answer_score,overall_score,strict_pass,expected_answer_contains,expected_source_urls,rag_source_urls,answer,first_model_latency_seconds,tool_latency_seconds,final_model_latency_seconds,total_latency_seconds,prompt_tokens,completion_tokens,total_tokens,error
|
||||||
|
q0024,dev,keyword_grounding,medium,Ktorý študentský dokument o grafových neurónových sieťach má v metadátach ako autora dokumentu uvedeného Maroša Harahusa?,model120-fast,Qwen3.5-122B-A10B-Q4_K_M,True,1,1.0,1.0,0.0,0.75,False,"[""Dmytro Mural"", ""Maroš Harahus"", ""grafové neurónové siete""]","[""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","V dostupných dokumentoch ZP Wiki sa túto informáciu nepodarilo spoľahlivo nájsť. Zdrojové dokumenty síce spomínajú Maroša Harahusa ako autora dokumentu pre študenta Dmytra Murala (tema: „Grafové neurónové siete pre vyhľadávanie na internete""), ale v metadátach dokumentu o Marošovi Harahusovi je uvedeným autorom Daniel Hladek a v texte jeho stránky sa o grafových neurónových sieťach hovorí len ako o úlohe na vypracovanie prehľadu, nie ako o názve jeho vlastnej záverečnej práce.
|
||||||
|
|
||||||
|
Zdroj: https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural",2.185565,0.535819,20.569647,23.291825,24257,264,24521,
|
||||||
|
q0311,dev,disambiguation_year,hard,Rozlíš rok začiatku štúdia a rok práce osoby Valerii Kutsenko.,model120-fast,Qwen3.5-122B-A10B-Q4_K_M,True,1,1.0,1.0,1.0,1.0,True,"[""2022"", ""2027""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","Valerii Kutsenko začala štúdium v roku 2022 a jej diplomová práca bola realizovaná v roku 2027.
|
||||||
|
|
||||||
|
Zdroj: https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko",1.832421,0.303168,4.572551,6.708397,4729,144,4873,
|
||||||
|
q0375,dev,keyword_grounding,medium,Ktorý dokument alebo študent súvisí s témou hybridný cloud a osobou Daniil Huzenko?,model120-fast,Qwen3.5-122B-A10B-Q4_K_M,True,1,1.0,1.0,1.0,1.0,True,"[""Daniil Huzenko"", ""hybridný cloud""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","Daniil Huzenko vypracováva bakalársku prácu s predbežným názvom „Testovanie hybridného klaudu s využitím kombinácie verejného a privátneho riešenia"", ktorej cieľom je vytvorenie vzdelávacích materiálov o Kubernetes a funkčného prototypu privátneho klastra v kombinácii s verejnými službami.
|
||||||
|
|
||||||
|
Zdroj: https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko",1.553068,0.340111,13.728013,15.62183,16356,178,16534,
|
||||||
|
q0579,dev,internship_topic,medium,Akému problému alebo téme sa venovala stáž osoby Bogdan Paul Chiș?,model120-fast,Qwen3.5-122B-A10B-Q4_K_M,True,1,1.0,1.0,1.0,1.0,True,"[""multilinguálna extrakcia trojíc z medicínskych dát""]","[""https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis""]","[""https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]","Stáž osoby Bogdan Paul Chiš sa venovala téme extrakcie trojíc z viacjazyčných lekárskych dát s cieľom zostrojiť znalostný graf z balíčkových letákov liekov a využiť ho v inteligentnom agentovi na odporúčanie liečiv.
|
||||||
|
|
||||||
|
Zdroj: https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis",1.773057,0.276874,10.683296,12.733637,12489,172,12661,
|
||||||
|
q0580,dev,reverse_lookup,medium,Kto pracoval na téme multilinguálna extrakcia trojíc z medicínskych dát?,model120-fast,Qwen3.5-122B-A10B-Q4_K_M,True,1,0.0,0.0,0.0,0.25,False,"[""Bogdan Paul Chiș""]","[""https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis""]","[""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]","V dostupných dokumentoch ZP Wiki sa túto informáciu nepodarilo spoľahlivo nájsť.
|
||||||
|
|
||||||
|
Zdroje:
|
||||||
|
https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi
|
||||||
|
https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov
|
||||||
|
https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko
|
||||||
|
https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka
|
||||||
|
https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela",1.869678,0.482586,27.027717,29.380772,31731,238,31969,
|
||||||
|
q0586,dev,specific_fact,medium,Z akého typu dokumentov mal Bogdan Paul Chiș zostaviť znalostný graf?,model120-fast,Qwen3.5-122B-A10B-Q4_K_M,True,1,1.0,1.0,1.0,1.0,True,"[""medical package inserts""]","[""https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis""]","[""https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","Bogdan Paul Chiș mal zostaviť znalostný graf z lekárskych príbalových letákov (medical package inserts) v viacerých jazykoch v rámci svojej stáže (ERASMUS Intern).
|
||||||
|
|
||||||
|
Zdroj: https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis",1.618991,0.285566,13.811282,15.71649,16511,141,16652,
|
||||||
|
@ -0,0 +1,614 @@
|
|||||||
|
{
|
||||||
|
"generated_at": "2026-09-28T14:56:07.499665+00:00",
|
||||||
|
"status": "complete",
|
||||||
|
"configuration": {
|
||||||
|
"schema_version": 2,
|
||||||
|
"questions_file": "/home/janko/DP/zp-agent/evaluation/json_files/questions.json",
|
||||||
|
"overrides_file": "/home/janko/DP/zp-agent/evaluation/json_files/rag_answer_overrides.json",
|
||||||
|
"questions_fingerprint": "b80c4d9cc4cb16d12a971cba13bde7de98de7aac4d1ad308a405fe0f1ae29905",
|
||||||
|
"selected_question_ids": [
|
||||||
|
"q0024",
|
||||||
|
"q0311",
|
||||||
|
"q0375",
|
||||||
|
"q0579",
|
||||||
|
"q0580",
|
||||||
|
"q0586"
|
||||||
|
],
|
||||||
|
"applied_override_ids": [],
|
||||||
|
"split": "dev",
|
||||||
|
"selected_question_count": 6,
|
||||||
|
"requested_model": "model120-fast",
|
||||||
|
"operation_id": "retrieve_zpwiki_context",
|
||||||
|
"openwebui_url": "https://ui.tukekemt.xyz/api/chat/completions",
|
||||||
|
"rag_url": "http://localhost:8000/rag",
|
||||||
|
"timeout": 180,
|
||||||
|
"max_attempts": 4,
|
||||||
|
"backoff_base": 1.0,
|
||||||
|
"backoff_max": 8.0,
|
||||||
|
"delay": 0.0
|
||||||
|
},
|
||||||
|
"summary": {
|
||||||
|
"total": 6,
|
||||||
|
"completed": 6,
|
||||||
|
"errors": 0,
|
||||||
|
"tool_call_rate": 1.0,
|
||||||
|
"answer_contains_score": 0.833333,
|
||||||
|
"source_url_score": 0.833333,
|
||||||
|
"should_answer_score": 0.666667,
|
||||||
|
"overall_score": 0.833333,
|
||||||
|
"strict_pass_count": 4,
|
||||||
|
"strict_pass_rate": 0.666667,
|
||||||
|
"mean_latency_seconds": 17.242158,
|
||||||
|
"prompt_tokens": 106073,
|
||||||
|
"completion_tokens": 1137,
|
||||||
|
"total_tokens": 107210,
|
||||||
|
"by_category": {
|
||||||
|
"disambiguation_year": {
|
||||||
|
"total": 1,
|
||||||
|
"completed": 1,
|
||||||
|
"errors": 0,
|
||||||
|
"tool_call_rate": 1.0,
|
||||||
|
"answer_contains_score": 1.0,
|
||||||
|
"source_url_score": 1.0,
|
||||||
|
"should_answer_score": 1.0,
|
||||||
|
"overall_score": 1.0,
|
||||||
|
"strict_pass_count": 1,
|
||||||
|
"strict_pass_rate": 1.0,
|
||||||
|
"mean_latency_seconds": 6.708397,
|
||||||
|
"prompt_tokens": 4729,
|
||||||
|
"completion_tokens": 144,
|
||||||
|
"total_tokens": 4873
|
||||||
|
},
|
||||||
|
"internship_topic": {
|
||||||
|
"total": 1,
|
||||||
|
"completed": 1,
|
||||||
|
"errors": 0,
|
||||||
|
"tool_call_rate": 1.0,
|
||||||
|
"answer_contains_score": 1.0,
|
||||||
|
"source_url_score": 1.0,
|
||||||
|
"should_answer_score": 1.0,
|
||||||
|
"overall_score": 1.0,
|
||||||
|
"strict_pass_count": 1,
|
||||||
|
"strict_pass_rate": 1.0,
|
||||||
|
"mean_latency_seconds": 12.733637,
|
||||||
|
"prompt_tokens": 12489,
|
||||||
|
"completion_tokens": 172,
|
||||||
|
"total_tokens": 12661
|
||||||
|
},
|
||||||
|
"keyword_grounding": {
|
||||||
|
"total": 2,
|
||||||
|
"completed": 2,
|
||||||
|
"errors": 0,
|
||||||
|
"tool_call_rate": 1.0,
|
||||||
|
"answer_contains_score": 1.0,
|
||||||
|
"source_url_score": 1.0,
|
||||||
|
"should_answer_score": 0.5,
|
||||||
|
"overall_score": 0.875,
|
||||||
|
"strict_pass_count": 1,
|
||||||
|
"strict_pass_rate": 0.5,
|
||||||
|
"mean_latency_seconds": 19.456827,
|
||||||
|
"prompt_tokens": 40613,
|
||||||
|
"completion_tokens": 442,
|
||||||
|
"total_tokens": 41055
|
||||||
|
},
|
||||||
|
"reverse_lookup": {
|
||||||
|
"total": 1,
|
||||||
|
"completed": 1,
|
||||||
|
"errors": 0,
|
||||||
|
"tool_call_rate": 1.0,
|
||||||
|
"answer_contains_score": 0.0,
|
||||||
|
"source_url_score": 0.0,
|
||||||
|
"should_answer_score": 0.0,
|
||||||
|
"overall_score": 0.25,
|
||||||
|
"strict_pass_count": 0,
|
||||||
|
"strict_pass_rate": 0.0,
|
||||||
|
"mean_latency_seconds": 29.380772,
|
||||||
|
"prompt_tokens": 31731,
|
||||||
|
"completion_tokens": 238,
|
||||||
|
"total_tokens": 31969
|
||||||
|
},
|
||||||
|
"specific_fact": {
|
||||||
|
"total": 1,
|
||||||
|
"completed": 1,
|
||||||
|
"errors": 0,
|
||||||
|
"tool_call_rate": 1.0,
|
||||||
|
"answer_contains_score": 1.0,
|
||||||
|
"source_url_score": 1.0,
|
||||||
|
"should_answer_score": 1.0,
|
||||||
|
"overall_score": 1.0,
|
||||||
|
"strict_pass_count": 1,
|
||||||
|
"strict_pass_rate": 1.0,
|
||||||
|
"mean_latency_seconds": 15.71649,
|
||||||
|
"prompt_tokens": 16511,
|
||||||
|
"completion_tokens": 141,
|
||||||
|
"total_tokens": 16652
|
||||||
|
}
|
||||||
|
},
|
||||||
|
"by_difficulty": {
|
||||||
|
"hard": {
|
||||||
|
"total": 1,
|
||||||
|
"completed": 1,
|
||||||
|
"errors": 0,
|
||||||
|
"tool_call_rate": 1.0,
|
||||||
|
"answer_contains_score": 1.0,
|
||||||
|
"source_url_score": 1.0,
|
||||||
|
"should_answer_score": 1.0,
|
||||||
|
"overall_score": 1.0,
|
||||||
|
"strict_pass_count": 1,
|
||||||
|
"strict_pass_rate": 1.0,
|
||||||
|
"mean_latency_seconds": 6.708397,
|
||||||
|
"prompt_tokens": 4729,
|
||||||
|
"completion_tokens": 144,
|
||||||
|
"total_tokens": 4873
|
||||||
|
},
|
||||||
|
"medium": {
|
||||||
|
"total": 5,
|
||||||
|
"completed": 5,
|
||||||
|
"errors": 0,
|
||||||
|
"tool_call_rate": 1.0,
|
||||||
|
"answer_contains_score": 0.8,
|
||||||
|
"source_url_score": 0.8,
|
||||||
|
"should_answer_score": 0.6,
|
||||||
|
"overall_score": 0.8,
|
||||||
|
"strict_pass_count": 3,
|
||||||
|
"strict_pass_rate": 0.6,
|
||||||
|
"mean_latency_seconds": 19.348911,
|
||||||
|
"prompt_tokens": 101344,
|
||||||
|
"completion_tokens": 993,
|
||||||
|
"total_tokens": 102337
|
||||||
|
}
|
||||||
|
}
|
||||||
|
},
|
||||||
|
"results": [
|
||||||
|
{
|
||||||
|
"id": "q0024",
|
||||||
|
"split": "dev",
|
||||||
|
"category": "keyword_grounding",
|
||||||
|
"difficulty": "medium",
|
||||||
|
"question": "Ktorý študentský dokument o grafových neurónových sieťach má v metadátach ako autora dokumentu uvedeného Maroša Harahusa?",
|
||||||
|
"override_applied": false,
|
||||||
|
"requested_model": "model120-fast",
|
||||||
|
"expected_documents": [
|
||||||
|
"pages/students/2016/maros_harahus/README.md"
|
||||||
|
],
|
||||||
|
"expected_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"
|
||||||
|
],
|
||||||
|
"expected_answer_contains": [
|
||||||
|
"Dmytro Mural",
|
||||||
|
"Maroš Harahus",
|
||||||
|
"grafové neurónové siete"
|
||||||
|
],
|
||||||
|
"should_answer": true,
|
||||||
|
"note": "Answer-level disambiguation: študentský dokument patrí Dmytrovi Muralovi; Maroš Harahus je v jeho metadátach uvedený ako autor dokumentu. Nemá sa zamieňať autor dokumentu so študentom, ktorý prácu vypracoval.",
|
||||||
|
"answer": "V dostupných dokumentoch ZP Wiki sa túto informáciu nepodarilo spoľahlivo nájsť. Zdrojové dokumenty síce spomínajú Maroša Harahusa ako autora dokumentu pre študenta Dmytra Murala (tema: „Grafové neurónové siete pre vyhľadávanie na internete\"), ale v metadátach dokumentu o Marošovi Harahusovi je uvedeným autorom Daniel Hladek a v texte jeho stránky sa o grafových neurónových sieťach hovorí len ako o úlohe na vypracovanie prehľadu, nie ako o názve jeho vlastnej záverečnej práce.\n\nZdroj: https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural",
|
||||||
|
"tool_called": true,
|
||||||
|
"tool_call_count": 1,
|
||||||
|
"tool_calls": [
|
||||||
|
{
|
||||||
|
"name": "retrieve_zpwiki_context",
|
||||||
|
"arguments": {
|
||||||
|
"query": "Ktorý študentský dokument o grafových neurónových sieťach má v metadátach ako autora dokumentu uvedeného Maroša Harahusa?",
|
||||||
|
"limit": 5,
|
||||||
|
"published_only": false,
|
||||||
|
"max_per_document": 1
|
||||||
|
},
|
||||||
|
"latency_seconds": 0.535819,
|
||||||
|
"source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"
|
||||||
|
]
|
||||||
|
}
|
||||||
|
],
|
||||||
|
"rag_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"
|
||||||
|
],
|
||||||
|
"first_model_latency_seconds": 2.185565,
|
||||||
|
"tool_latency_seconds": 0.535819,
|
||||||
|
"final_model_latency_seconds": 20.569647,
|
||||||
|
"total_latency_seconds": 23.291825,
|
||||||
|
"usage": {
|
||||||
|
"prompt_tokens": 24257,
|
||||||
|
"completion_tokens": 264,
|
||||||
|
"total_tokens": 24521
|
||||||
|
},
|
||||||
|
"response_model": "Qwen3.5-122B-A10B-Q4_K_M",
|
||||||
|
"answer_matches": [
|
||||||
|
true,
|
||||||
|
true,
|
||||||
|
true
|
||||||
|
],
|
||||||
|
"answer_contains_score": 1.0,
|
||||||
|
"source_matches": [
|
||||||
|
true
|
||||||
|
],
|
||||||
|
"source_match_count": 1,
|
||||||
|
"source_required_count": 1,
|
||||||
|
"source_url_score": 1.0,
|
||||||
|
"should_answer_ok": false,
|
||||||
|
"should_answer_score": 0.0,
|
||||||
|
"returned_no_answer": true,
|
||||||
|
"tool_score": 1.0,
|
||||||
|
"overall_score": 0.75,
|
||||||
|
"strict_pass": false,
|
||||||
|
"error": null
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"id": "q0311",
|
||||||
|
"split": "dev",
|
||||||
|
"category": "disambiguation_year",
|
||||||
|
"difficulty": "hard",
|
||||||
|
"question": "Rozlíš rok začiatku štúdia a rok práce osoby Valerii Kutsenko.",
|
||||||
|
"override_applied": false,
|
||||||
|
"requested_model": "model120-fast",
|
||||||
|
"expected_documents": [
|
||||||
|
"pages/students/2022/valerii_kutsenko/README.md"
|
||||||
|
],
|
||||||
|
"expected_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"
|
||||||
|
],
|
||||||
|
"expected_answer_contains": [
|
||||||
|
"2022",
|
||||||
|
"2027"
|
||||||
|
],
|
||||||
|
"should_answer": true,
|
||||||
|
"note": "Kontrola proti zámene roku začiatku štúdia s rokom záverečnej práce alebo projektu.",
|
||||||
|
"answer": "Valerii Kutsenko začala štúdium v roku 2022 a jej diplomová práca bola realizovaná v roku 2027.\n\nZdroj: https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko",
|
||||||
|
"tool_called": true,
|
||||||
|
"tool_call_count": 1,
|
||||||
|
"tool_calls": [
|
||||||
|
{
|
||||||
|
"name": "retrieve_zpwiki_context",
|
||||||
|
"arguments": {
|
||||||
|
"query": "Rozlíš rok začiatku štúdia a rok práce osoby Valerii Kutsenko.",
|
||||||
|
"limit": 5,
|
||||||
|
"published_only": true,
|
||||||
|
"max_per_document": 10
|
||||||
|
},
|
||||||
|
"latency_seconds": 0.303168,
|
||||||
|
"source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"
|
||||||
|
]
|
||||||
|
}
|
||||||
|
],
|
||||||
|
"rag_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"
|
||||||
|
],
|
||||||
|
"first_model_latency_seconds": 1.832421,
|
||||||
|
"tool_latency_seconds": 0.303168,
|
||||||
|
"final_model_latency_seconds": 4.572551,
|
||||||
|
"total_latency_seconds": 6.708397,
|
||||||
|
"usage": {
|
||||||
|
"prompt_tokens": 4729,
|
||||||
|
"completion_tokens": 144,
|
||||||
|
"total_tokens": 4873
|
||||||
|
},
|
||||||
|
"response_model": "Qwen3.5-122B-A10B-Q4_K_M",
|
||||||
|
"answer_matches": [
|
||||||
|
true,
|
||||||
|
true
|
||||||
|
],
|
||||||
|
"answer_contains_score": 1.0,
|
||||||
|
"source_matches": [
|
||||||
|
true
|
||||||
|
],
|
||||||
|
"source_match_count": 1,
|
||||||
|
"source_required_count": 1,
|
||||||
|
"source_url_score": 1.0,
|
||||||
|
"should_answer_ok": true,
|
||||||
|
"should_answer_score": 1.0,
|
||||||
|
"returned_no_answer": false,
|
||||||
|
"tool_score": 1.0,
|
||||||
|
"overall_score": 1.0,
|
||||||
|
"strict_pass": true,
|
||||||
|
"error": null
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"id": "q0375",
|
||||||
|
"split": "dev",
|
||||||
|
"category": "keyword_grounding",
|
||||||
|
"difficulty": "medium",
|
||||||
|
"question": "Ktorý dokument alebo študent súvisí s témou hybridný cloud a osobou Daniil Huzenko?",
|
||||||
|
"override_applied": false,
|
||||||
|
"requested_model": "model120-fast",
|
||||||
|
"expected_documents": [
|
||||||
|
"pages/students/2022/daniil_huzenko/README.md"
|
||||||
|
],
|
||||||
|
"expected_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"
|
||||||
|
],
|
||||||
|
"expected_answer_contains": [
|
||||||
|
"Daniil Huzenko",
|
||||||
|
"hybridný cloud"
|
||||||
|
],
|
||||||
|
"should_answer": true,
|
||||||
|
"note": null,
|
||||||
|
"answer": "Daniil Huzenko vypracováva bakalársku prácu s predbežným názvom „Testovanie hybridného klaudu s využitím kombinácie verejného a privátneho riešenia\", ktorej cieľom je vytvorenie vzdelávacích materiálov o Kubernetes a funkčného prototypu privátneho klastra v kombinácii s verejnými službami.\n\nZdroj: https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko",
|
||||||
|
"tool_called": true,
|
||||||
|
"tool_call_count": 1,
|
||||||
|
"tool_calls": [
|
||||||
|
{
|
||||||
|
"name": "retrieve_zpwiki_context",
|
||||||
|
"arguments": {
|
||||||
|
"query": "Ktorý dokument alebo študent súvisí s témou hybridný cloud a osobou Daniil Huzenko?",
|
||||||
|
"limit": 5,
|
||||||
|
"published_only": true
|
||||||
|
},
|
||||||
|
"latency_seconds": 0.340111,
|
||||||
|
"source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"
|
||||||
|
]
|
||||||
|
}
|
||||||
|
],
|
||||||
|
"rag_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"
|
||||||
|
],
|
||||||
|
"first_model_latency_seconds": 1.553068,
|
||||||
|
"tool_latency_seconds": 0.340111,
|
||||||
|
"final_model_latency_seconds": 13.728013,
|
||||||
|
"total_latency_seconds": 15.62183,
|
||||||
|
"usage": {
|
||||||
|
"prompt_tokens": 16356,
|
||||||
|
"completion_tokens": 178,
|
||||||
|
"total_tokens": 16534
|
||||||
|
},
|
||||||
|
"response_model": "Qwen3.5-122B-A10B-Q4_K_M",
|
||||||
|
"answer_matches": [
|
||||||
|
true,
|
||||||
|
true
|
||||||
|
],
|
||||||
|
"answer_contains_score": 1.0,
|
||||||
|
"source_matches": [
|
||||||
|
true
|
||||||
|
],
|
||||||
|
"source_match_count": 1,
|
||||||
|
"source_required_count": 1,
|
||||||
|
"source_url_score": 1.0,
|
||||||
|
"should_answer_ok": true,
|
||||||
|
"should_answer_score": 1.0,
|
||||||
|
"returned_no_answer": false,
|
||||||
|
"tool_score": 1.0,
|
||||||
|
"overall_score": 1.0,
|
||||||
|
"strict_pass": true,
|
||||||
|
"error": null
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"id": "q0579",
|
||||||
|
"split": "dev",
|
||||||
|
"category": "internship_topic",
|
||||||
|
"difficulty": "medium",
|
||||||
|
"question": "Akému problému alebo téme sa venovala stáž osoby Bogdan Paul Chiș?",
|
||||||
|
"override_applied": false,
|
||||||
|
"requested_model": "model120-fast",
|
||||||
|
"expected_documents": [
|
||||||
|
"pages/interns/bogdan_paul_chis/README.md"
|
||||||
|
],
|
||||||
|
"expected_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis"
|
||||||
|
],
|
||||||
|
"expected_answer_contains": [
|
||||||
|
"multilinguálna extrakcia trojíc z medicínskych dát"
|
||||||
|
],
|
||||||
|
"should_answer": true,
|
||||||
|
"note": null,
|
||||||
|
"answer": "Stáž osoby Bogdan Paul Chiš sa venovala téme extrakcie trojíc z viacjazyčných lekárskych dát s cieľom zostrojiť znalostný graf z balíčkových letákov liekov a využiť ho v inteligentnom agentovi na odporúčanie liečiv.\n\nZdroj: https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis",
|
||||||
|
"tool_called": true,
|
||||||
|
"tool_call_count": 1,
|
||||||
|
"tool_calls": [
|
||||||
|
{
|
||||||
|
"name": "retrieve_zpwiki_context",
|
||||||
|
"arguments": {
|
||||||
|
"query": "Akému problému alebo téme sa venovala stáž osoby Bogdan Paul Chiș?",
|
||||||
|
"published_only": true,
|
||||||
|
"limit": 5,
|
||||||
|
"max_per_document": 10
|
||||||
|
},
|
||||||
|
"latency_seconds": 0.276874,
|
||||||
|
"source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"
|
||||||
|
]
|
||||||
|
}
|
||||||
|
],
|
||||||
|
"rag_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"
|
||||||
|
],
|
||||||
|
"first_model_latency_seconds": 1.773057,
|
||||||
|
"tool_latency_seconds": 0.276874,
|
||||||
|
"final_model_latency_seconds": 10.683296,
|
||||||
|
"total_latency_seconds": 12.733637,
|
||||||
|
"usage": {
|
||||||
|
"prompt_tokens": 12489,
|
||||||
|
"completion_tokens": 172,
|
||||||
|
"total_tokens": 12661
|
||||||
|
},
|
||||||
|
"response_model": "Qwen3.5-122B-A10B-Q4_K_M",
|
||||||
|
"answer_matches": [
|
||||||
|
true
|
||||||
|
],
|
||||||
|
"answer_contains_score": 1.0,
|
||||||
|
"source_matches": [
|
||||||
|
true
|
||||||
|
],
|
||||||
|
"source_match_count": 1,
|
||||||
|
"source_required_count": 1,
|
||||||
|
"source_url_score": 1.0,
|
||||||
|
"should_answer_ok": true,
|
||||||
|
"should_answer_score": 1.0,
|
||||||
|
"returned_no_answer": false,
|
||||||
|
"tool_score": 1.0,
|
||||||
|
"overall_score": 1.0,
|
||||||
|
"strict_pass": true,
|
||||||
|
"error": null
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"id": "q0580",
|
||||||
|
"split": "dev",
|
||||||
|
"category": "reverse_lookup",
|
||||||
|
"difficulty": "medium",
|
||||||
|
"question": "Kto pracoval na téme multilinguálna extrakcia trojíc z medicínskych dát?",
|
||||||
|
"override_applied": false,
|
||||||
|
"requested_model": "model120-fast",
|
||||||
|
"expected_documents": [
|
||||||
|
"pages/interns/bogdan_paul_chis/README.md"
|
||||||
|
],
|
||||||
|
"expected_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis"
|
||||||
|
],
|
||||||
|
"expected_answer_contains": [
|
||||||
|
"Bogdan Paul Chiș"
|
||||||
|
],
|
||||||
|
"should_answer": true,
|
||||||
|
"note": null,
|
||||||
|
"answer": "V dostupných dokumentoch ZP Wiki sa túto informáciu nepodarilo spoľahlivo nájsť.\n\nZdroje:\nhttps://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi\nhttps://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov\nhttps://zp.kemt.fei.tuke.sk/students/2019/michal_stromko\nhttps://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka\nhttps://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela",
|
||||||
|
"tool_called": true,
|
||||||
|
"tool_call_count": 1,
|
||||||
|
"tool_calls": [
|
||||||
|
{
|
||||||
|
"name": "retrieve_zpwiki_context",
|
||||||
|
"arguments": {
|
||||||
|
"query": "Kto pracoval na téme multilinguálna extrakcia trojíc z medicínskych dát?",
|
||||||
|
"limit": 5,
|
||||||
|
"published_only": false,
|
||||||
|
"max_per_document": 1
|
||||||
|
},
|
||||||
|
"latency_seconds": 0.482586,
|
||||||
|
"source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"
|
||||||
|
]
|
||||||
|
}
|
||||||
|
],
|
||||||
|
"rag_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"
|
||||||
|
],
|
||||||
|
"first_model_latency_seconds": 1.869678,
|
||||||
|
"tool_latency_seconds": 0.482586,
|
||||||
|
"final_model_latency_seconds": 27.027717,
|
||||||
|
"total_latency_seconds": 29.380772,
|
||||||
|
"usage": {
|
||||||
|
"prompt_tokens": 31731,
|
||||||
|
"completion_tokens": 238,
|
||||||
|
"total_tokens": 31969
|
||||||
|
},
|
||||||
|
"response_model": "Qwen3.5-122B-A10B-Q4_K_M",
|
||||||
|
"answer_matches": [
|
||||||
|
false
|
||||||
|
],
|
||||||
|
"answer_contains_score": 0.0,
|
||||||
|
"source_matches": [
|
||||||
|
false
|
||||||
|
],
|
||||||
|
"source_match_count": 0,
|
||||||
|
"source_required_count": 1,
|
||||||
|
"source_url_score": 0.0,
|
||||||
|
"should_answer_ok": false,
|
||||||
|
"should_answer_score": 0.0,
|
||||||
|
"returned_no_answer": true,
|
||||||
|
"tool_score": 1.0,
|
||||||
|
"overall_score": 0.25,
|
||||||
|
"strict_pass": false,
|
||||||
|
"error": null
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"id": "q0586",
|
||||||
|
"split": "dev",
|
||||||
|
"category": "specific_fact",
|
||||||
|
"difficulty": "medium",
|
||||||
|
"question": "Z akého typu dokumentov mal Bogdan Paul Chiș zostaviť znalostný graf?",
|
||||||
|
"override_applied": false,
|
||||||
|
"requested_model": "model120-fast",
|
||||||
|
"expected_documents": [
|
||||||
|
"pages/interns/bogdan_paul_chis/README.md"
|
||||||
|
],
|
||||||
|
"expected_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis"
|
||||||
|
],
|
||||||
|
"expected_answer_contains": [
|
||||||
|
"medical package inserts"
|
||||||
|
],
|
||||||
|
"should_answer": true,
|
||||||
|
"note": null,
|
||||||
|
"answer": "Bogdan Paul Chiș mal zostaviť znalostný graf z lekárskych príbalových letákov (medical package inserts) v viacerých jazykoch v rámci svojej stáže (ERASMUS Intern).\n\nZdroj: https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis",
|
||||||
|
"tool_called": true,
|
||||||
|
"tool_call_count": 1,
|
||||||
|
"tool_calls": [
|
||||||
|
{
|
||||||
|
"name": "retrieve_zpwiki_context",
|
||||||
|
"arguments": {
|
||||||
|
"query": "Z akého typu dokumentov mal Bogdan Paul Chiș zostaviť znalostný graf?",
|
||||||
|
"limit": 5,
|
||||||
|
"published_only": true
|
||||||
|
},
|
||||||
|
"latency_seconds": 0.285566,
|
||||||
|
"source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"
|
||||||
|
]
|
||||||
|
}
|
||||||
|
],
|
||||||
|
"rag_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"
|
||||||
|
],
|
||||||
|
"first_model_latency_seconds": 1.618991,
|
||||||
|
"tool_latency_seconds": 0.285566,
|
||||||
|
"final_model_latency_seconds": 13.811282,
|
||||||
|
"total_latency_seconds": 15.71649,
|
||||||
|
"usage": {
|
||||||
|
"prompt_tokens": 16511,
|
||||||
|
"completion_tokens": 141,
|
||||||
|
"total_tokens": 16652
|
||||||
|
},
|
||||||
|
"response_model": "Qwen3.5-122B-A10B-Q4_K_M",
|
||||||
|
"answer_matches": [
|
||||||
|
true
|
||||||
|
],
|
||||||
|
"answer_contains_score": 1.0,
|
||||||
|
"source_matches": [
|
||||||
|
true
|
||||||
|
],
|
||||||
|
"source_match_count": 1,
|
||||||
|
"source_required_count": 1,
|
||||||
|
"source_url_score": 1.0,
|
||||||
|
"should_answer_ok": true,
|
||||||
|
"should_answer_score": 1.0,
|
||||||
|
"returned_no_answer": false,
|
||||||
|
"tool_score": 1.0,
|
||||||
|
"overall_score": 1.0,
|
||||||
|
"strict_pass": true,
|
||||||
|
"error": null
|
||||||
|
}
|
||||||
|
]
|
||||||
|
}
|
||||||
@ -0,0 +1,25 @@
|
|||||||
|
id,split,category,difficulty,question,requested_model,response_model,tool_called,tool_call_count,answer_contains_score,source_url_score,should_answer_score,overall_score,strict_pass,expected_answer_contains,expected_source_urls,rag_source_urls,answer,first_model_latency_seconds,tool_latency_seconds,final_model_latency_seconds,total_latency_seconds,prompt_tokens,completion_tokens,total_tokens,error
|
||||||
|
q0024,dev,keyword_grounding,medium,Ktorý študentský dokument o grafových neurónových sieťach má v metadátach ako autora dokumentu uvedeného Maroša Harahusa?,model120-fast,Qwen3.5-122B-A10B-Q4_K_M,True,1,1.0,1.0,1.0,1.0,True,"[""Dmytro Mural"", ""Maroš Harahus"", ""grafové neurónové siete""]","[""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]","V dostupných dokumentoch ZP Wiki sa túto informáciu nepodarilo spoľahlivo nájsť, keďže dokumenty o grafových neurónových sieťach majú v metadátach ako autora dokumentu Daniel Hladek (dokumenty študentov Dmytro Mural a Oleksandr Hryshchenko) alebo súvisia s Marošom Harahusom ako vedúcim, nie ako autorom dokumentu, ktorý by bol o grafových neurónových sieťach.
|
||||||
|
|
||||||
|
Zdroj: https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus
|
||||||
|
Zdroj: https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural
|
||||||
|
Zdroj: https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko",1.917333,0.435663,21.657875,24.011559,24252,279,24531,
|
||||||
|
q0311,dev,disambiguation_year,hard,Rozlíš rok začiatku štúdia a rok práce osoby Valerii Kutsenko.,model120-fast,Qwen3.5-122B-A10B-Q4_K_M,True,1,1.0,1.0,1.0,1.0,True,"[""2022"", ""2027""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu""]","Osoba Valerii Kutsenko začala štúdium v roku 2022 a vypracovávala diplomovú prácu v roku 2027.
|
||||||
|
|
||||||
|
Zdroj: https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko",1.659944,0.329471,11.619301,13.609409,13872,134,14006,
|
||||||
|
q0375,dev,keyword_grounding,medium,Ktorý dokument alebo študent súvisí s témou hybridný cloud a osobou Daniil Huzenko?,model120-fast,Qwen3.5-122B-A10B-Q4_K_M,True,1,1.0,1.0,1.0,1.0,True,"[""Daniil Huzenko"", ""hybridný cloud""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""]","[""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]","Študent Daniil Huzenko vypracováva bakalársku prácu s predbežným názvom „Testovanie hybridného klaudu s využitím kombinácie verejného a privátneho riešenia"", ktorá sa zaoberá hybridným cloudom.
|
||||||
|
|
||||||
|
Zdroj: https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko",1.817412,0.360819,13.656469,15.835248,16369,163,16532,
|
||||||
|
q0579,dev,internship_topic,medium,Akému problému alebo téme sa venovala stáž osoby Bogdan Paul Chiș?,model120-fast,Qwen3.5-122B-A10B-Q4_K_M,True,1,0.0,1.0,1.0,0.75,False,"[""multilinguálna extrakcia trojíc z medicínskych dát""]","[""https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis""]","[""https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]","Stáž osoby Bogdan Paul Chiš sa venovala téme viacerojazyčnej extrakcie trojíc z lekárskych údajov, s cieľom zostrojiť znalostný graf z lekárskych príbalových letákov v rôznych jazykoch a využiť ho v inteligentnom agentovi pre odporúčanie liekov.
|
||||||
|
|
||||||
|
Zdroj: https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis",1.823478,0.198371,10.966602,12.988833,12489,184,12673,
|
||||||
|
q0580,dev,reverse_lookup,medium,Kto pracoval na téme multilinguálna extrakcia trojíc z medicínskych dát?,model120-fast,Qwen3.5-122B-A10B-Q4_K_M,True,1,0.0,0.0,0.0,0.25,False,"[""Bogdan Paul Chiș""]","[""https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis""]","[""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]","V dostupných dokumentoch ZP Wiki sa túto informáciu nepodarilo spoľahlivo nájsť.
|
||||||
|
|
||||||
|
Hoci sa v zdrojoch nachádzajú študenti pracujúci na témach súvisiacich s extrakciou informácií z medicínskych dát (Andrii Pervashov s tématikou extrakcie štruktúrovaných informácií) alebo s multilinguálnym spracovaním (Michal Stromko s multilinguálnym vyhľadávaním, Yevhenii Medushivskyi s vytváraním korpusov vrátane medicínskych), žiadny z nájdených záznamov explicitne neuvádza tému „multilinguálna extrakcia trojíc z medicínskych dát"" ani meno študenta, ktorý by na nej pracoval.
|
||||||
|
|
||||||
|
Zdroj: https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov
|
||||||
|
Zdroj: https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko
|
||||||
|
Zdroj: https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi",1.894309,0.520932,29.369732,31.785818,31629,364,31993,
|
||||||
|
q0586,dev,specific_fact,medium,Z akého typu dokumentov mal Bogdan Paul Chiș zostaviť znalostný graf?,model120-fast,Qwen3.5-122B-A10B-Q4_K_M,True,1,0.0,1.0,1.0,0.75,False,"[""medical package inserts""]","[""https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis""]","[""https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]","Bogdan Paul Chiš mal zostaviť znalostný graf z viacjazyčných príbalových letákov na lieky v rámci svojej praxe Erasmus intern.
|
||||||
|
|
||||||
|
Zdroj: https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis",1.420306,0.293604,13.747362,15.461826,16498,116,16614,
|
||||||
|
@ -0,0 +1,621 @@
|
|||||||
|
{
|
||||||
|
"generated_at": "2026-09-28T14:58:01.449861+00:00",
|
||||||
|
"status": "complete",
|
||||||
|
"configuration": {
|
||||||
|
"schema_version": 2,
|
||||||
|
"questions_file": "/home/janko/DP/zp-agent/evaluation/json_files/questions.json",
|
||||||
|
"overrides_file": "/home/janko/DP/zp-agent/evaluation/json_files/rag_answer_overrides.json",
|
||||||
|
"questions_fingerprint": "b80c4d9cc4cb16d12a971cba13bde7de98de7aac4d1ad308a405fe0f1ae29905",
|
||||||
|
"selected_question_ids": [
|
||||||
|
"q0024",
|
||||||
|
"q0311",
|
||||||
|
"q0375",
|
||||||
|
"q0579",
|
||||||
|
"q0580",
|
||||||
|
"q0586"
|
||||||
|
],
|
||||||
|
"applied_override_ids": [],
|
||||||
|
"split": "dev",
|
||||||
|
"selected_question_count": 6,
|
||||||
|
"requested_model": "model120-fast",
|
||||||
|
"operation_id": "retrieve_zpwiki_context",
|
||||||
|
"openwebui_url": "https://ui.tukekemt.xyz/api/chat/completions",
|
||||||
|
"rag_url": "http://localhost:8000/rag",
|
||||||
|
"timeout": 180,
|
||||||
|
"max_attempts": 4,
|
||||||
|
"backoff_base": 1.0,
|
||||||
|
"backoff_max": 8.0,
|
||||||
|
"delay": 0.0
|
||||||
|
},
|
||||||
|
"summary": {
|
||||||
|
"total": 6,
|
||||||
|
"completed": 6,
|
||||||
|
"errors": 0,
|
||||||
|
"tool_call_rate": 1.0,
|
||||||
|
"answer_contains_score": 0.5,
|
||||||
|
"source_url_score": 0.833333,
|
||||||
|
"should_answer_score": 0.833333,
|
||||||
|
"overall_score": 0.791667,
|
||||||
|
"strict_pass_count": 3,
|
||||||
|
"strict_pass_rate": 0.5,
|
||||||
|
"mean_latency_seconds": 18.948782,
|
||||||
|
"prompt_tokens": 115109,
|
||||||
|
"completion_tokens": 1240,
|
||||||
|
"total_tokens": 116349,
|
||||||
|
"by_category": {
|
||||||
|
"disambiguation_year": {
|
||||||
|
"total": 1,
|
||||||
|
"completed": 1,
|
||||||
|
"errors": 0,
|
||||||
|
"tool_call_rate": 1.0,
|
||||||
|
"answer_contains_score": 1.0,
|
||||||
|
"source_url_score": 1.0,
|
||||||
|
"should_answer_score": 1.0,
|
||||||
|
"overall_score": 1.0,
|
||||||
|
"strict_pass_count": 1,
|
||||||
|
"strict_pass_rate": 1.0,
|
||||||
|
"mean_latency_seconds": 13.609409,
|
||||||
|
"prompt_tokens": 13872,
|
||||||
|
"completion_tokens": 134,
|
||||||
|
"total_tokens": 14006
|
||||||
|
},
|
||||||
|
"internship_topic": {
|
||||||
|
"total": 1,
|
||||||
|
"completed": 1,
|
||||||
|
"errors": 0,
|
||||||
|
"tool_call_rate": 1.0,
|
||||||
|
"answer_contains_score": 0.0,
|
||||||
|
"source_url_score": 1.0,
|
||||||
|
"should_answer_score": 1.0,
|
||||||
|
"overall_score": 0.75,
|
||||||
|
"strict_pass_count": 0,
|
||||||
|
"strict_pass_rate": 0.0,
|
||||||
|
"mean_latency_seconds": 12.988833,
|
||||||
|
"prompt_tokens": 12489,
|
||||||
|
"completion_tokens": 184,
|
||||||
|
"total_tokens": 12673
|
||||||
|
},
|
||||||
|
"keyword_grounding": {
|
||||||
|
"total": 2,
|
||||||
|
"completed": 2,
|
||||||
|
"errors": 0,
|
||||||
|
"tool_call_rate": 1.0,
|
||||||
|
"answer_contains_score": 1.0,
|
||||||
|
"source_url_score": 1.0,
|
||||||
|
"should_answer_score": 1.0,
|
||||||
|
"overall_score": 1.0,
|
||||||
|
"strict_pass_count": 2,
|
||||||
|
"strict_pass_rate": 1.0,
|
||||||
|
"mean_latency_seconds": 19.923403,
|
||||||
|
"prompt_tokens": 40621,
|
||||||
|
"completion_tokens": 442,
|
||||||
|
"total_tokens": 41063
|
||||||
|
},
|
||||||
|
"reverse_lookup": {
|
||||||
|
"total": 1,
|
||||||
|
"completed": 1,
|
||||||
|
"errors": 0,
|
||||||
|
"tool_call_rate": 1.0,
|
||||||
|
"answer_contains_score": 0.0,
|
||||||
|
"source_url_score": 0.0,
|
||||||
|
"should_answer_score": 0.0,
|
||||||
|
"overall_score": 0.25,
|
||||||
|
"strict_pass_count": 0,
|
||||||
|
"strict_pass_rate": 0.0,
|
||||||
|
"mean_latency_seconds": 31.785818,
|
||||||
|
"prompt_tokens": 31629,
|
||||||
|
"completion_tokens": 364,
|
||||||
|
"total_tokens": 31993
|
||||||
|
},
|
||||||
|
"specific_fact": {
|
||||||
|
"total": 1,
|
||||||
|
"completed": 1,
|
||||||
|
"errors": 0,
|
||||||
|
"tool_call_rate": 1.0,
|
||||||
|
"answer_contains_score": 0.0,
|
||||||
|
"source_url_score": 1.0,
|
||||||
|
"should_answer_score": 1.0,
|
||||||
|
"overall_score": 0.75,
|
||||||
|
"strict_pass_count": 0,
|
||||||
|
"strict_pass_rate": 0.0,
|
||||||
|
"mean_latency_seconds": 15.461826,
|
||||||
|
"prompt_tokens": 16498,
|
||||||
|
"completion_tokens": 116,
|
||||||
|
"total_tokens": 16614
|
||||||
|
}
|
||||||
|
},
|
||||||
|
"by_difficulty": {
|
||||||
|
"hard": {
|
||||||
|
"total": 1,
|
||||||
|
"completed": 1,
|
||||||
|
"errors": 0,
|
||||||
|
"tool_call_rate": 1.0,
|
||||||
|
"answer_contains_score": 1.0,
|
||||||
|
"source_url_score": 1.0,
|
||||||
|
"should_answer_score": 1.0,
|
||||||
|
"overall_score": 1.0,
|
||||||
|
"strict_pass_count": 1,
|
||||||
|
"strict_pass_rate": 1.0,
|
||||||
|
"mean_latency_seconds": 13.609409,
|
||||||
|
"prompt_tokens": 13872,
|
||||||
|
"completion_tokens": 134,
|
||||||
|
"total_tokens": 14006
|
||||||
|
},
|
||||||
|
"medium": {
|
||||||
|
"total": 5,
|
||||||
|
"completed": 5,
|
||||||
|
"errors": 0,
|
||||||
|
"tool_call_rate": 1.0,
|
||||||
|
"answer_contains_score": 0.4,
|
||||||
|
"source_url_score": 0.8,
|
||||||
|
"should_answer_score": 0.8,
|
||||||
|
"overall_score": 0.75,
|
||||||
|
"strict_pass_count": 2,
|
||||||
|
"strict_pass_rate": 0.4,
|
||||||
|
"mean_latency_seconds": 20.016657,
|
||||||
|
"prompt_tokens": 101237,
|
||||||
|
"completion_tokens": 1106,
|
||||||
|
"total_tokens": 102343
|
||||||
|
}
|
||||||
|
}
|
||||||
|
},
|
||||||
|
"results": [
|
||||||
|
{
|
||||||
|
"id": "q0024",
|
||||||
|
"split": "dev",
|
||||||
|
"category": "keyword_grounding",
|
||||||
|
"difficulty": "medium",
|
||||||
|
"question": "Ktorý študentský dokument o grafových neurónových sieťach má v metadátach ako autora dokumentu uvedeného Maroša Harahusa?",
|
||||||
|
"override_applied": false,
|
||||||
|
"requested_model": "model120-fast",
|
||||||
|
"expected_documents": [
|
||||||
|
"pages/students/2016/maros_harahus/README.md"
|
||||||
|
],
|
||||||
|
"expected_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"
|
||||||
|
],
|
||||||
|
"expected_answer_contains": [
|
||||||
|
"Dmytro Mural",
|
||||||
|
"Maroš Harahus",
|
||||||
|
"grafové neurónové siete"
|
||||||
|
],
|
||||||
|
"should_answer": true,
|
||||||
|
"note": "Answer-level disambiguation: študentský dokument patrí Dmytrovi Muralovi; Maroš Harahus je v jeho metadátach uvedený ako autor dokumentu. Nemá sa zamieňať autor dokumentu so študentom, ktorý prácu vypracoval.",
|
||||||
|
"answer": "V dostupných dokumentoch ZP Wiki sa túto informáciu nepodarilo spoľahlivo nájsť, keďže dokumenty o grafových neurónových sieťach majú v metadátach ako autora dokumentu Daniel Hladek (dokumenty študentov Dmytro Mural a Oleksandr Hryshchenko) alebo súvisia s Marošom Harahusom ako vedúcim, nie ako autorom dokumentu, ktorý by bol o grafových neurónových sieťach.\n\nZdroj: https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus\nZdroj: https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural\nZdroj: https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko",
|
||||||
|
"tool_called": true,
|
||||||
|
"tool_call_count": 1,
|
||||||
|
"tool_calls": [
|
||||||
|
{
|
||||||
|
"name": "retrieve_zpwiki_context",
|
||||||
|
"arguments": {
|
||||||
|
"query": "Ktorý študentský dokument o grafových neurónových sieťach má v metadátach ako autora dokumentu uvedeného Maroša Harahusa?",
|
||||||
|
"limit": 5,
|
||||||
|
"published_only": true,
|
||||||
|
"max_per_document": 1
|
||||||
|
},
|
||||||
|
"latency_seconds": 0.435663,
|
||||||
|
"source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"
|
||||||
|
]
|
||||||
|
}
|
||||||
|
],
|
||||||
|
"rag_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"
|
||||||
|
],
|
||||||
|
"first_model_latency_seconds": 1.917333,
|
||||||
|
"tool_latency_seconds": 0.435663,
|
||||||
|
"final_model_latency_seconds": 21.657875,
|
||||||
|
"total_latency_seconds": 24.011559,
|
||||||
|
"usage": {
|
||||||
|
"prompt_tokens": 24252,
|
||||||
|
"completion_tokens": 279,
|
||||||
|
"total_tokens": 24531
|
||||||
|
},
|
||||||
|
"response_model": "Qwen3.5-122B-A10B-Q4_K_M",
|
||||||
|
"answer_matches": [
|
||||||
|
true,
|
||||||
|
true,
|
||||||
|
true
|
||||||
|
],
|
||||||
|
"answer_contains_score": 1.0,
|
||||||
|
"source_matches": [
|
||||||
|
true
|
||||||
|
],
|
||||||
|
"source_match_count": 1,
|
||||||
|
"source_required_count": 1,
|
||||||
|
"source_url_score": 1.0,
|
||||||
|
"should_answer_ok": true,
|
||||||
|
"should_answer_score": 1.0,
|
||||||
|
"returned_no_answer": false,
|
||||||
|
"tool_score": 1.0,
|
||||||
|
"overall_score": 1.0,
|
||||||
|
"strict_pass": true,
|
||||||
|
"error": null
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"id": "q0311",
|
||||||
|
"split": "dev",
|
||||||
|
"category": "disambiguation_year",
|
||||||
|
"difficulty": "hard",
|
||||||
|
"question": "Rozlíš rok začiatku štúdia a rok práce osoby Valerii Kutsenko.",
|
||||||
|
"override_applied": false,
|
||||||
|
"requested_model": "model120-fast",
|
||||||
|
"expected_documents": [
|
||||||
|
"pages/students/2022/valerii_kutsenko/README.md"
|
||||||
|
],
|
||||||
|
"expected_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"
|
||||||
|
],
|
||||||
|
"expected_answer_contains": [
|
||||||
|
"2022",
|
||||||
|
"2027"
|
||||||
|
],
|
||||||
|
"should_answer": true,
|
||||||
|
"note": "Kontrola proti zámene roku začiatku štúdia s rokom záverečnej práce alebo projektu.",
|
||||||
|
"answer": "Osoba Valerii Kutsenko začala štúdium v roku 2022 a vypracovávala diplomovú prácu v roku 2027.\n\nZdroj: https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko",
|
||||||
|
"tool_called": true,
|
||||||
|
"tool_call_count": 1,
|
||||||
|
"tool_calls": [
|
||||||
|
{
|
||||||
|
"name": "retrieve_zpwiki_context",
|
||||||
|
"arguments": {
|
||||||
|
"query": "Rozlíš rok začiatku štúdia a rok práce osoby Valerii Kutsenko.",
|
||||||
|
"limit": 5,
|
||||||
|
"published_only": true
|
||||||
|
},
|
||||||
|
"latency_seconds": 0.329471,
|
||||||
|
"source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"
|
||||||
|
]
|
||||||
|
}
|
||||||
|
],
|
||||||
|
"rag_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"
|
||||||
|
],
|
||||||
|
"first_model_latency_seconds": 1.659944,
|
||||||
|
"tool_latency_seconds": 0.329471,
|
||||||
|
"final_model_latency_seconds": 11.619301,
|
||||||
|
"total_latency_seconds": 13.609409,
|
||||||
|
"usage": {
|
||||||
|
"prompt_tokens": 13872,
|
||||||
|
"completion_tokens": 134,
|
||||||
|
"total_tokens": 14006
|
||||||
|
},
|
||||||
|
"response_model": "Qwen3.5-122B-A10B-Q4_K_M",
|
||||||
|
"answer_matches": [
|
||||||
|
true,
|
||||||
|
true
|
||||||
|
],
|
||||||
|
"answer_contains_score": 1.0,
|
||||||
|
"source_matches": [
|
||||||
|
true
|
||||||
|
],
|
||||||
|
"source_match_count": 1,
|
||||||
|
"source_required_count": 1,
|
||||||
|
"source_url_score": 1.0,
|
||||||
|
"should_answer_ok": true,
|
||||||
|
"should_answer_score": 1.0,
|
||||||
|
"returned_no_answer": false,
|
||||||
|
"tool_score": 1.0,
|
||||||
|
"overall_score": 1.0,
|
||||||
|
"strict_pass": true,
|
||||||
|
"error": null
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"id": "q0375",
|
||||||
|
"split": "dev",
|
||||||
|
"category": "keyword_grounding",
|
||||||
|
"difficulty": "medium",
|
||||||
|
"question": "Ktorý dokument alebo študent súvisí s témou hybridný cloud a osobou Daniil Huzenko?",
|
||||||
|
"override_applied": false,
|
||||||
|
"requested_model": "model120-fast",
|
||||||
|
"expected_documents": [
|
||||||
|
"pages/students/2022/daniil_huzenko/README.md"
|
||||||
|
],
|
||||||
|
"expected_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"
|
||||||
|
],
|
||||||
|
"expected_answer_contains": [
|
||||||
|
"Daniil Huzenko",
|
||||||
|
"hybridný cloud"
|
||||||
|
],
|
||||||
|
"should_answer": true,
|
||||||
|
"note": null,
|
||||||
|
"answer": "Študent Daniil Huzenko vypracováva bakalársku prácu s predbežným názvom „Testovanie hybridného klaudu s využitím kombinácie verejného a privátneho riešenia\", ktorá sa zaoberá hybridným cloudom.\n\nZdroj: https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko",
|
||||||
|
"tool_called": true,
|
||||||
|
"tool_call_count": 1,
|
||||||
|
"tool_calls": [
|
||||||
|
{
|
||||||
|
"name": "retrieve_zpwiki_context",
|
||||||
|
"arguments": {
|
||||||
|
"query": "Ktorý dokument alebo študent súvisí s témou hybridný cloud a osobou Daniil Huzenko?",
|
||||||
|
"limit": 5,
|
||||||
|
"published_only": true,
|
||||||
|
"max_per_document": 1
|
||||||
|
},
|
||||||
|
"latency_seconds": 0.360819,
|
||||||
|
"source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"
|
||||||
|
]
|
||||||
|
}
|
||||||
|
],
|
||||||
|
"rag_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"
|
||||||
|
],
|
||||||
|
"first_model_latency_seconds": 1.817412,
|
||||||
|
"tool_latency_seconds": 0.360819,
|
||||||
|
"final_model_latency_seconds": 13.656469,
|
||||||
|
"total_latency_seconds": 15.835248,
|
||||||
|
"usage": {
|
||||||
|
"prompt_tokens": 16369,
|
||||||
|
"completion_tokens": 163,
|
||||||
|
"total_tokens": 16532
|
||||||
|
},
|
||||||
|
"response_model": "Qwen3.5-122B-A10B-Q4_K_M",
|
||||||
|
"answer_matches": [
|
||||||
|
true,
|
||||||
|
true
|
||||||
|
],
|
||||||
|
"answer_contains_score": 1.0,
|
||||||
|
"source_matches": [
|
||||||
|
true
|
||||||
|
],
|
||||||
|
"source_match_count": 1,
|
||||||
|
"source_required_count": 1,
|
||||||
|
"source_url_score": 1.0,
|
||||||
|
"should_answer_ok": true,
|
||||||
|
"should_answer_score": 1.0,
|
||||||
|
"returned_no_answer": false,
|
||||||
|
"tool_score": 1.0,
|
||||||
|
"overall_score": 1.0,
|
||||||
|
"strict_pass": true,
|
||||||
|
"error": null
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"id": "q0579",
|
||||||
|
"split": "dev",
|
||||||
|
"category": "internship_topic",
|
||||||
|
"difficulty": "medium",
|
||||||
|
"question": "Akému problému alebo téme sa venovala stáž osoby Bogdan Paul Chiș?",
|
||||||
|
"override_applied": false,
|
||||||
|
"requested_model": "model120-fast",
|
||||||
|
"expected_documents": [
|
||||||
|
"pages/interns/bogdan_paul_chis/README.md"
|
||||||
|
],
|
||||||
|
"expected_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis"
|
||||||
|
],
|
||||||
|
"expected_answer_contains": [
|
||||||
|
"multilinguálna extrakcia trojíc z medicínskych dát"
|
||||||
|
],
|
||||||
|
"should_answer": true,
|
||||||
|
"note": null,
|
||||||
|
"answer": "Stáž osoby Bogdan Paul Chiš sa venovala téme viacerojazyčnej extrakcie trojíc z lekárskych údajov, s cieľom zostrojiť znalostný graf z lekárskych príbalových letákov v rôznych jazykoch a využiť ho v inteligentnom agentovi pre odporúčanie liekov.\n\nZdroj: https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis",
|
||||||
|
"tool_called": true,
|
||||||
|
"tool_call_count": 1,
|
||||||
|
"tool_calls": [
|
||||||
|
{
|
||||||
|
"name": "retrieve_zpwiki_context",
|
||||||
|
"arguments": {
|
||||||
|
"query": "Akému problému alebo téme sa venovala stáž osoby Bogdan Paul Chiș?",
|
||||||
|
"limit": 5,
|
||||||
|
"published_only": true,
|
||||||
|
"max_per_document": 10
|
||||||
|
},
|
||||||
|
"latency_seconds": 0.198371,
|
||||||
|
"source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"
|
||||||
|
]
|
||||||
|
}
|
||||||
|
],
|
||||||
|
"rag_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"
|
||||||
|
],
|
||||||
|
"first_model_latency_seconds": 1.823478,
|
||||||
|
"tool_latency_seconds": 0.198371,
|
||||||
|
"final_model_latency_seconds": 10.966602,
|
||||||
|
"total_latency_seconds": 12.988833,
|
||||||
|
"usage": {
|
||||||
|
"prompt_tokens": 12489,
|
||||||
|
"completion_tokens": 184,
|
||||||
|
"total_tokens": 12673
|
||||||
|
},
|
||||||
|
"response_model": "Qwen3.5-122B-A10B-Q4_K_M",
|
||||||
|
"answer_matches": [
|
||||||
|
false
|
||||||
|
],
|
||||||
|
"answer_contains_score": 0.0,
|
||||||
|
"source_matches": [
|
||||||
|
true
|
||||||
|
],
|
||||||
|
"source_match_count": 1,
|
||||||
|
"source_required_count": 1,
|
||||||
|
"source_url_score": 1.0,
|
||||||
|
"should_answer_ok": true,
|
||||||
|
"should_answer_score": 1.0,
|
||||||
|
"returned_no_answer": false,
|
||||||
|
"tool_score": 1.0,
|
||||||
|
"overall_score": 0.75,
|
||||||
|
"strict_pass": false,
|
||||||
|
"error": null
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"id": "q0580",
|
||||||
|
"split": "dev",
|
||||||
|
"category": "reverse_lookup",
|
||||||
|
"difficulty": "medium",
|
||||||
|
"question": "Kto pracoval na téme multilinguálna extrakcia trojíc z medicínskych dát?",
|
||||||
|
"override_applied": false,
|
||||||
|
"requested_model": "model120-fast",
|
||||||
|
"expected_documents": [
|
||||||
|
"pages/interns/bogdan_paul_chis/README.md"
|
||||||
|
],
|
||||||
|
"expected_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis"
|
||||||
|
],
|
||||||
|
"expected_answer_contains": [
|
||||||
|
"Bogdan Paul Chiș"
|
||||||
|
],
|
||||||
|
"should_answer": true,
|
||||||
|
"note": null,
|
||||||
|
"answer": "V dostupných dokumentoch ZP Wiki sa túto informáciu nepodarilo spoľahlivo nájsť.\n\nHoci sa v zdrojoch nachádzajú študenti pracujúci na témach súvisiacich s extrakciou informácií z medicínskych dát (Andrii Pervashov s tématikou extrakcie štruktúrovaných informácií) alebo s multilinguálnym spracovaním (Michal Stromko s multilinguálnym vyhľadávaním, Yevhenii Medushivskyi s vytváraním korpusov vrátane medicínskych), žiadny z nájdených záznamov explicitne neuvádza tému „multilinguálna extrakcia trojíc z medicínskych dát\" ani meno študenta, ktorý by na nej pracoval.\n\nZdroj: https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov\nZdroj: https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko\nZdroj: https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi",
|
||||||
|
"tool_called": true,
|
||||||
|
"tool_call_count": 1,
|
||||||
|
"tool_calls": [
|
||||||
|
{
|
||||||
|
"name": "retrieve_zpwiki_context",
|
||||||
|
"arguments": {
|
||||||
|
"query": "Kto pracoval na téme multilinguálna extrakcia trojíc z medicínskych dát?",
|
||||||
|
"limit": 5,
|
||||||
|
"published_only": true,
|
||||||
|
"max_per_document": 1
|
||||||
|
},
|
||||||
|
"latency_seconds": 0.520932,
|
||||||
|
"source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"
|
||||||
|
]
|
||||||
|
}
|
||||||
|
],
|
||||||
|
"rag_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"
|
||||||
|
],
|
||||||
|
"first_model_latency_seconds": 1.894309,
|
||||||
|
"tool_latency_seconds": 0.520932,
|
||||||
|
"final_model_latency_seconds": 29.369732,
|
||||||
|
"total_latency_seconds": 31.785818,
|
||||||
|
"usage": {
|
||||||
|
"prompt_tokens": 31629,
|
||||||
|
"completion_tokens": 364,
|
||||||
|
"total_tokens": 31993
|
||||||
|
},
|
||||||
|
"response_model": "Qwen3.5-122B-A10B-Q4_K_M",
|
||||||
|
"answer_matches": [
|
||||||
|
false
|
||||||
|
],
|
||||||
|
"answer_contains_score": 0.0,
|
||||||
|
"source_matches": [
|
||||||
|
false
|
||||||
|
],
|
||||||
|
"source_match_count": 0,
|
||||||
|
"source_required_count": 1,
|
||||||
|
"source_url_score": 0.0,
|
||||||
|
"should_answer_ok": false,
|
||||||
|
"should_answer_score": 0.0,
|
||||||
|
"returned_no_answer": true,
|
||||||
|
"tool_score": 1.0,
|
||||||
|
"overall_score": 0.25,
|
||||||
|
"strict_pass": false,
|
||||||
|
"error": null
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"id": "q0586",
|
||||||
|
"split": "dev",
|
||||||
|
"category": "specific_fact",
|
||||||
|
"difficulty": "medium",
|
||||||
|
"question": "Z akého typu dokumentov mal Bogdan Paul Chiș zostaviť znalostný graf?",
|
||||||
|
"override_applied": false,
|
||||||
|
"requested_model": "model120-fast",
|
||||||
|
"expected_documents": [
|
||||||
|
"pages/interns/bogdan_paul_chis/README.md"
|
||||||
|
],
|
||||||
|
"expected_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis"
|
||||||
|
],
|
||||||
|
"expected_answer_contains": [
|
||||||
|
"medical package inserts"
|
||||||
|
],
|
||||||
|
"should_answer": true,
|
||||||
|
"note": null,
|
||||||
|
"answer": "Bogdan Paul Chiš mal zostaviť znalostný graf z viacjazyčných príbalových letákov na lieky v rámci svojej praxe Erasmus intern.\n\nZdroj: https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis",
|
||||||
|
"tool_called": true,
|
||||||
|
"tool_call_count": 1,
|
||||||
|
"tool_calls": [
|
||||||
|
{
|
||||||
|
"name": "retrieve_zpwiki_context",
|
||||||
|
"arguments": {
|
||||||
|
"query": "Z akého typu dokumentov mal Bogdan Paul Chiș zostaviť znalostný graf?",
|
||||||
|
"limit": 5
|
||||||
|
},
|
||||||
|
"latency_seconds": 0.293604,
|
||||||
|
"source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"
|
||||||
|
]
|
||||||
|
}
|
||||||
|
],
|
||||||
|
"rag_source_urls": [
|
||||||
|
"https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko",
|
||||||
|
"https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"
|
||||||
|
],
|
||||||
|
"first_model_latency_seconds": 1.420306,
|
||||||
|
"tool_latency_seconds": 0.293604,
|
||||||
|
"final_model_latency_seconds": 13.747362,
|
||||||
|
"total_latency_seconds": 15.461826,
|
||||||
|
"usage": {
|
||||||
|
"prompt_tokens": 16498,
|
||||||
|
"completion_tokens": 116,
|
||||||
|
"total_tokens": 16614
|
||||||
|
},
|
||||||
|
"response_model": "Qwen3.5-122B-A10B-Q4_K_M",
|
||||||
|
"answer_matches": [
|
||||||
|
false
|
||||||
|
],
|
||||||
|
"answer_contains_score": 0.0,
|
||||||
|
"source_matches": [
|
||||||
|
true
|
||||||
|
],
|
||||||
|
"source_match_count": 1,
|
||||||
|
"source_required_count": 1,
|
||||||
|
"source_url_score": 1.0,
|
||||||
|
"should_answer_ok": true,
|
||||||
|
"should_answer_score": 1.0,
|
||||||
|
"returned_no_answer": false,
|
||||||
|
"tool_score": 1.0,
|
||||||
|
"overall_score": 0.75,
|
||||||
|
"strict_pass": false,
|
||||||
|
"error": null
|
||||||
|
}
|
||||||
|
]
|
||||||
|
}
|
||||||
Some files were not shown because too many files have changed in this diff Show More
Loading…
Reference in New Issue
Block a user