Compare commits
23 Commits
master
...
graphrag-v
| Author | SHA1 | Date | |
|---|---|---|---|
| b943632fd1 | |||
| d8961f9db6 | |||
| bfe8cbba1b | |||
| 3fe25382e6 | |||
| 427bbc3222 | |||
| 9389a54dcd | |||
| d0ab5fdddf | |||
| 90fc7f2df0 | |||
| fee6ffc70f | |||
| 86a155691d | |||
| 90abe1558b | |||
| 348be522bd | |||
| b5153fd79b | |||
| a3e43eac9c | |||
| 4ff72bb74b | |||
| 9f3483d290 | |||
| 921642a16a | |||
| 043db73ee6 | |||
| f38ebf65f7 | |||
| 9b59994d2c | |||
| 40dc2ba38e | |||
| 4d64ad2b83 | |||
| 78e952dcfb |
3
.gitignore
vendored
3
.gitignore
vendored
@ -1,5 +1,8 @@
|
||||
.env
|
||||
data/
|
||||
docs/
|
||||
runtime_assets/*
|
||||
!runtime_assets/.gitkeep
|
||||
.venv/
|
||||
__pycache__/
|
||||
*.py[cod]
|
||||
|
||||
18
Dockerfile
18
Dockerfile
@ -25,7 +25,23 @@ RUN python -m pip install --no-cache-dir \
|
||||
-r requirements.txt
|
||||
|
||||
COPY app ./app
|
||||
COPY scripts ./scripts
|
||||
COPY tools ./tools
|
||||
COPY runtime_assets/ /opt/zp-assets/
|
||||
|
||||
ARG EMBEDDING_MODEL=intfloat/multilingual-e5-small
|
||||
ARG EMBEDDING_REVISION=""
|
||||
ARG CHUNK_TOKEN_ENCODING=cl100k_base
|
||||
ARG RAG_LLM_TOKEN_ENCODING=cl100k_base
|
||||
|
||||
RUN python -m tools.runtime_assets prepare --output /opt/zp-assets \
|
||||
--model "$EMBEDDING_MODEL" --revision "$EMBEDDING_REVISION" \
|
||||
--encoding "$CHUNK_TOKEN_ENCODING" --encoding "$RAG_LLM_TOKEN_ENCODING"
|
||||
|
||||
ENV ZP_RUNTIME_ASSETS=/opt/zp-assets
|
||||
ENV ZP_ASSETS_REQUIRED=1
|
||||
ENV HF_HUB_OFFLINE=1
|
||||
ENV TRANSFORMERS_OFFLINE=1
|
||||
ENV TIKTOKEN_CACHE_DIR=/opt/zp-assets/tiktoken
|
||||
|
||||
RUN mkdir -p data
|
||||
|
||||
|
||||
638
README.md
638
README.md
@ -10,10 +10,14 @@ vytvorená RAG vrstva, ktorá pripravuje kontext, zdroje a pravidlá pre
|
||||
odpoveď jazykového modelu. API je integrované so školským OpenWebUI ako
|
||||
OpenAPI Tool Server.
|
||||
|
||||
Súčasná hlavná retrieval vetva používa klasický hybridný RAG:
|
||||
FTS5/BM25 + embeddingy + RRF. GraphRAG zatiaľ nie je implementovaný;
|
||||
je preň pripravený samostatný evaluačný dataset a bude sa dopĺňať ako
|
||||
ďalšia experimentálna vetva.
|
||||
Stabilná baseline retrieval vetva používa klasický hybridný RAG:
|
||||
FTS5/BM25 + embeddingy + RRF. Nad týmto baseline sa vo vetve GraphRAG
|
||||
dopĺňa knowledge graph uložený v Neo4j. Aktuálne je implementovaná
|
||||
grafová infraštruktúra, deterministický builder, vizualizácia grafu a
|
||||
samostatné grafové vyhľadávanie. Grafová vrstva má zdrojovo overený benchmark a zmrazenú opravenú
|
||||
verziu v7 s novým TESTom 80 kombinácií a regresiou 320 historických otázok, kontrolou všetkých vrátených
|
||||
typovaných faktov a samostatným overením generovania odpovedí cez OpenWebUI API. Ďalším krokom je natívne zapojenie grafového
|
||||
nástroja a hlavného agenta do OpenWebUI.
|
||||
|
||||
## Implementované
|
||||
|
||||
@ -60,6 +64,15 @@ je preň pripravený samostatný evaluačný dataset a bude sa dopĺňať ako
|
||||
- atomická výmena databázy po úspešnom reindexovaní,
|
||||
- persistentná Hugging Face cache v Docker volume,
|
||||
- warm-up embeddingového modelu,
|
||||
- Neo4j databáza spúšťaná ako samostatná Docker služba,
|
||||
- deterministická tvorba knowledge graphu z `documents.json` a
|
||||
`chunks.json`,
|
||||
- grafové entity `Person`, `Document`, `DocumentAuthor`, `Thesis`,
|
||||
`Work`, `Keyword`, `Topic` a `Category`,
|
||||
- grafové vzťahy pre dokumenty, práce, témy, kategórie a autorstvo,
|
||||
- uniqueness constraints a opakovateľný rebuild GraphRAG grafu,
|
||||
- Neo4j Browser na vizualizáciu a kontrolu vytvoreného grafu,
|
||||
- samostatné grafové vyhľadávanie nad Neo4j s rozpoznaním entít, vzťahov, prác, tém a rokov,
|
||||
- retrieval evaluácia pre FTS, embeddings a hybridný retrieval,
|
||||
- answer-level RAG evaluácia cez OpenWebUI model a RAG tool,
|
||||
- oddelené answer-level overrides bez úpravy frozen retrieval
|
||||
@ -113,6 +126,38 @@ jazykový model
|
||||
odpoveď + source_url
|
||||
```
|
||||
|
||||
GraphRAG vývojová vetva:
|
||||
|
||||
```text
|
||||
documents.json + chunks.json
|
||||
↓
|
||||
graphrag.py
|
||||
↓
|
||||
build_graphrag.py
|
||||
↓
|
||||
Neo4j
|
||||
├── Person
|
||||
├── Document
|
||||
├── Thesis
|
||||
├── Work
|
||||
├── Keyword
|
||||
├── Topic
|
||||
├── Category
|
||||
└── DocumentAuthor
|
||||
↓
|
||||
grafové vzťahy + vizualizácia
|
||||
↓
|
||||
graph_search.py
|
||||
↓
|
||||
grafové entity + cesty + zdrojové dokumenty
|
||||
↓
|
||||
spojenie s klasickým RAG
|
||||
```
|
||||
|
||||
V aktuálnom stave je implementované vytvorenie a uloženie knowledge
|
||||
graphu aj samostatné grafové vyhľadávanie. Jeho zapojenie do `/rag` a
|
||||
OpenWebUI sa ešte dopĺňa.
|
||||
|
||||
Synchronizačná vetva:
|
||||
|
||||
```text
|
||||
@ -134,7 +179,7 @@ atomická výmena databázy
|
||||
Evaluačná vetva:
|
||||
|
||||
```text
|
||||
evaluation/json_files/*.json
|
||||
tools/rag/evaluation/json_files/*.json
|
||||
↓
|
||||
retrieval evaluator / RAG answer evaluator
|
||||
↓
|
||||
@ -142,11 +187,11 @@ runner
|
||||
↓
|
||||
metriky
|
||||
↓
|
||||
evaluation/results/
|
||||
tools/rag/evaluation/results/
|
||||
```
|
||||
|
||||
`evaluation/results/` nie je v nižšie uvedenom stromčeku, pretože
|
||||
obsahuje generované výstupy experimentov.
|
||||
`tools/rag/evaluation/results/` nie je v nižšie uvedenom stromčeku,
|
||||
pretože obsahuje generované výstupy experimentov.
|
||||
|
||||
## Štruktúra projektu
|
||||
|
||||
@ -161,34 +206,47 @@ zp-agent/
|
||||
│ ├── routes.py
|
||||
│ └── security.py
|
||||
│
|
||||
├── scripts/
|
||||
│ ├── common.py
|
||||
│ ├── scan_zpwiki.py
|
||||
│ ├── build_chunks.py
|
||||
│ ├── build_sqlite_index.py
|
||||
│ ├── embedding_utils.py
|
||||
│ ├── rag_utils.py
|
||||
│ ├── rebuild_index.py
|
||||
│ ├── search_db.py
|
||||
│ ├── search_core.py
|
||||
│ └── search_utils.py
|
||||
├── tools/
|
||||
│ ├── rag/
|
||||
│ │ ├── common.py
|
||||
│ │ ├── scan_zpwiki.py
|
||||
│ │ ├── build_chunks.py
|
||||
│ │ ├── build_sqlite_index.py
|
||||
│ │ ├── embedding_utils.py
|
||||
│ │ ├── rebuild_index.py
|
||||
│ │ ├── search_core.py
|
||||
│ │ ├── search_utils.py
|
||||
│ │ ├── search_db.py
|
||||
│ │ ├── rag_utils.py
|
||||
│ │ ├── rag_document_expansion.py
|
||||
│ │ ├── rag_query_evidence.py
|
||||
│ │ ├── rag_supplemental_expansion.py
|
||||
│ │ ├── run_e5_regression.sh
|
||||
│ │ ├── run_e5_1_regression.sh
|
||||
│ │ ├── evaluation/
|
||||
│ │ │ ├── evaluate_retrieval.py
|
||||
│ │ │ ├── evaluate_rag_answers.py
|
||||
│ │ │ ├── retrieval_runner.py
|
||||
│ │ │ ├── rag_runner.py
|
||||
│ │ │ ├── metrics.py
|
||||
│ │ │ ├── rag_metrics.py
|
||||
│ │ │ └── json_files/
|
||||
│ │ └── tests/
|
||||
│ │
|
||||
│ └── graphrag/
|
||||
│ ├── graph_db.py
|
||||
│ ├── graphrag.py
|
||||
│ ├── build_graphrag.py
|
||||
│ ├── graph_search.py
|
||||
│ ├── neo4j_smoke.py
|
||||
│ ├── evaluation/
|
||||
│ │ └── graphrag_questions.json
|
||||
│ └── tests/
|
||||
│
|
||||
├── evaluation/
|
||||
│ ├── evaluate_retrieval.py
|
||||
│ ├── retrieval_runner.py
|
||||
│ ├── metrics.py
|
||||
│ ├── evaluate_rag_answers.py
|
||||
│ ├── rag_runner.py
|
||||
│ ├── rag_metrics.py
|
||||
│ └── json_files/
|
||||
│ ├── questions.json
|
||||
│ ├── questions_before_ambiguity_cleanup.json
|
||||
│ ├── questions_before_validation.json
|
||||
│ ├── rag_answer_overrides.json
|
||||
│ ├── questions_extended_2000.json
|
||||
│ ├── graphrag_questions.json
|
||||
│ ├── robustness_questions.json
|
||||
│ └── performance_queries.json
|
||||
├── test/
|
||||
│ ├── test_api.py
|
||||
│ ├── test_configuration.py
|
||||
│ └── test_security.py
|
||||
│
|
||||
├── data/
|
||||
│ ├── documents.json
|
||||
@ -240,7 +298,7 @@ vypnuté. Pre integráciu OpenWebUI je dôležitý endpoint:
|
||||
- používa bezpečné porovnávanie autentifikačných hodnôt,
|
||||
- validuje očakávaný Gitea repozitár a súvisiacu konfiguráciu.
|
||||
|
||||
### `scripts/`
|
||||
### `tools/rag/`
|
||||
|
||||
`common.py`
|
||||
|
||||
@ -277,6 +335,42 @@ vyhľadávacou vrstvou.
|
||||
- normalizuje vektory,
|
||||
- poskytuje utility pre vektorové vyhľadávanie.
|
||||
|
||||
### `tools/graphrag/`
|
||||
|
||||
`graph_db.py`
|
||||
|
||||
- načítava konfiguráciu Neo4j,
|
||||
- vytvára Neo4j driver,
|
||||
- poskytuje kontrolu spojenia s grafovou databázou.
|
||||
|
||||
`graphrag.py`
|
||||
|
||||
- pripravuje dátový model knowledge graphu,
|
||||
- normalizuje grafové identifikátory,
|
||||
- extrahuje osoby, práce, roky, témy, kategórie a súvisiace metadata,
|
||||
- pripravuje uzly a vzťahy pre zápis do Neo4j.
|
||||
|
||||
`build_graphrag.py`
|
||||
|
||||
- načíta `documents.json` a `chunks.json`,
|
||||
- vytvorí GraphRAG payload,
|
||||
- vytvorí Neo4j uniqueness constraints,
|
||||
- zapíše uzly a vzťahy,
|
||||
- podporuje opakovateľný rebuild spravovanej časti grafu,
|
||||
- vypíše základné počty uzlov, vzťahov a kvalitu extrakcie názvov prác.
|
||||
|
||||
`graph_search.py`
|
||||
|
||||
- rozpoznáva relevantné osoby a obmedzenia v otázke,
|
||||
- vyhľadáva práce, témy, roky a spoločné vzťahy v Neo4j,
|
||||
- vracia grafové cesty, fakty a zdrojové dokumenty,
|
||||
- slúži ako základ budúceho GraphRAG nástroja pre OpenWebUI.
|
||||
|
||||
`neo4j_smoke.py`
|
||||
|
||||
Jednoduchý smoke test pripojenia k Neo4j používaný pri kontrole Docker
|
||||
prostredia.
|
||||
|
||||
`search_core.py`
|
||||
|
||||
Nízkoúrovňové jadro vyhľadávania:
|
||||
@ -322,7 +416,7 @@ scan
|
||||
→ atomická výmena DB
|
||||
```
|
||||
|
||||
### `evaluation/`
|
||||
### `tools/rag/evaluation/`
|
||||
|
||||
`evaluate_retrieval.py`
|
||||
|
||||
@ -376,7 +470,7 @@ Počíta answer-level metriky, napríklad:
|
||||
- strict pass,
|
||||
- latency a tokenové údaje.
|
||||
|
||||
### `evaluation/json_files/`
|
||||
### `tools/rag/evaluation/json_files/`
|
||||
|
||||
`questions.json`
|
||||
|
||||
@ -397,7 +491,7 @@ Historická záloha datasetu pred úpravami nejednoznačností.
|
||||
|
||||
Historická záloha datasetu pred validačnými úpravami.
|
||||
|
||||
`questions_extended_2000.json`
|
||||
`questions_extended.json`
|
||||
|
||||
Rozšírený benchmark s presne 2000 otázkami. Je pripravený pre neskoršie
|
||||
rozsiahlejšie experimenty nad klasickým retrievalom a RAG.
|
||||
@ -418,35 +512,13 @@ Obsahuje kombináciu:
|
||||
Tento dataset je zatiaľ pripravený, ale nemá sa používať na priebežné
|
||||
ladenie frozen benchmarku.
|
||||
|
||||
`graphrag_questions.json`
|
||||
|
||||
Samostatný benchmark pripravený pre budúcu GraphRAG vetvu.
|
||||
|
||||
Obsahuje 500 otázok zameraných na:
|
||||
|
||||
- multi-hop vzťahy,
|
||||
- spoločné témy,
|
||||
- spoločné roky,
|
||||
- person → title → year,
|
||||
- person → topic → title,
|
||||
- person → category → author,
|
||||
- agregácie,
|
||||
- konjunktívnu disambiguáciu,
|
||||
- multi-document reasoning.
|
||||
|
||||
Dataset obsahuje aj GraphRAG metadata ako:
|
||||
GraphRAG benchmark je po oddelení nástrojov uložený samostatne v:
|
||||
|
||||
```text
|
||||
graph.task
|
||||
graph.hop_count
|
||||
graph.start_entities
|
||||
graph.expected_entities
|
||||
graph.expected_relations
|
||||
graph.expected_paths
|
||||
tools/graphrag/evaluation/graphrag_questions.json
|
||||
```
|
||||
|
||||
Dôležité: existencia tohto datasetu neznamená, že je GraphRAG už
|
||||
implementovaný. Dataset je pripravený na neskorší vývoj a porovnanie.
|
||||
Obsahuje 500 otázok zameraných na grafové a viacvzťahové dopyty.
|
||||
|
||||
`robustness_questions.json`
|
||||
|
||||
@ -511,12 +583,21 @@ V koreňovom priečinku vytvor `.env`:
|
||||
WEBHOOK_SECRET=<náhodná hodnota s minimálne 32 znakmi>
|
||||
SYNC_API_KEY=<iná náhodná hodnota s minimálne 32 znakmi>
|
||||
SEARCH_API_KEY=<ďalšia náhodná hodnota s minimálne 32 znakmi>
|
||||
EXPECTED_GITEA_REPOSITORY=KEMT/zpwiki
|
||||
WEBHOOK_PULL_GIT=false
|
||||
EXPECTED_GITEA_REPOSITORY=jp170na/zpwiki
|
||||
EXPECTED_GITEA_BRANCH=master
|
||||
WEBHOOK_PULL_GIT=true
|
||||
ZPWIKI_SSH_KEY=/absolutna/cesta/k/ssh_klucu
|
||||
ZPWIKI_KNOWN_HOSTS=/absolutna/cesta/k/known_hosts
|
||||
|
||||
# Voliteľné
|
||||
EMBEDDING_MODEL=intfloat/multilingual-e5-small
|
||||
EMBEDDING_BATCH_SIZE=32
|
||||
|
||||
# GraphRAG / Neo4j
|
||||
NEO4J_URI=bolt://localhost:7687
|
||||
NEO4J_USER=neo4j
|
||||
NEO4J_PASSWORD=<silné lokálne heslo>
|
||||
NEO4J_DATABASE=neo4j
|
||||
```
|
||||
|
||||
Tajomstvá je možné vygenerovať príkazom:
|
||||
@ -538,10 +619,49 @@ CHUNK_TOKEN_ENCODING=cl100k_base
|
||||
|
||||
## Spustenie cez Docker
|
||||
|
||||
Potrebný je dostupný Docker Engine, natívny Linux Compose v2 a Buildx.
|
||||
Vo WSL používaj kontext, ku ktorému sa Linux klient vie pripojiť; Windows
|
||||
kontext s `npipe` tu nie je náhradou Linux socketu. Overenie:
|
||||
|
||||
```bash
|
||||
docker compose up -d --build
|
||||
docker --context default info
|
||||
docker compose version
|
||||
docker buildx version
|
||||
```
|
||||
|
||||
Po vytvorení `.env`, klonu `../zpwiki` a SSH konfigurácie spusti:
|
||||
|
||||
```bash
|
||||
./scripts/start_project.sh
|
||||
```
|
||||
|
||||
Skript štandardne používa kontext `default`, nemení globálny Docker kontext
|
||||
a spravuje iba projekt `zp-agent`. Iný cieľ nastav cez `ZP_DOCKER_CONTEXT`.
|
||||
Zostaví image, počká na zdravý Neo4j, overí existujúce indexy a podľa
|
||||
potreby ich koordinovane vytvorí. Až potom spustí API a počká na readiness.
|
||||
Pri opakovanom spustení ponechá konzistentné a aktuálne indexy.
|
||||
|
||||
Model aj tokenizér sú súčasťou image v `/opt/zp-assets`. Bežný štart
|
||||
nevyžaduje internet ani existujúcu používateľskú Hugging Face/tiktoken cache.
|
||||
Prvý build potrebuje balíky a modelové súbory; build overuje aj načítanie
|
||||
pripravených assets so zakázanou sieťou. Prázdny HF cache volume neskrýva
|
||||
model pribalený v image. Git pripojenie je samostatná sieťová operácia;
|
||||
príznaky offline zakazujú sťahovanie modelu, nie synchronizáciu wiki.
|
||||
|
||||
Voliteľne môžeš pred buildom pripraviť ignorované lokálne podklady a využiť
|
||||
už stiahnutý model z hostiteľa:
|
||||
|
||||
```bash
|
||||
.venv/bin/python -m tools.runtime_assets prepare
|
||||
```
|
||||
|
||||
`runtime_assets/` obsahuje veľké modelové súbory a do Gitu nepatrí; verzovaný
|
||||
je iba prázdny adresár pre čistý build. Bez pripravených lokálnych podkladov
|
||||
si ich Docker build vytvorí sám. Súbory majú manifest so SHA-256 a model je
|
||||
pripnutý na konkrétny commit. Iný model/revízia vyžaduje nový build s
|
||||
`EMBEDDING_MODEL`/`EMBEDDING_REVISION` a zodpovedajúce pripravené assets.
|
||||
API pri nesúlade neprejde potichu na sťahovanie iného modelu.
|
||||
|
||||
Kontrola služby:
|
||||
|
||||
```bash
|
||||
@ -566,16 +686,37 @@ Zastavenie:
|
||||
docker compose down
|
||||
```
|
||||
|
||||
Hugging Face cache je uložená v persistentnom Docker volume, takže sa
|
||||
embeddingový model pri bežnom reštarte kontajnera nemusí znova sťahovať.
|
||||
Hugging Face cache volume zostáva persistentné; predvolený embeddingový
|
||||
model a tokenizér však štartujú priamo z overených súborov v image.
|
||||
|
||||
Neo4j je spustené ako samostatná služba v rovnakom Docker Compose
|
||||
prostredí. Stav služieb je možné skontrolovať:
|
||||
|
||||
```bash
|
||||
docker compose ps
|
||||
```
|
||||
|
||||
Neo4j Browser je lokálne dostupný na:
|
||||
|
||||
```text
|
||||
http://127.0.0.1:7474/browser/
|
||||
```
|
||||
|
||||
Kontrola spojenia z API kontajnera:
|
||||
|
||||
```bash
|
||||
docker compose exec zp-agent-api \
|
||||
python -m tools.graphrag.neo4j_smoke
|
||||
```
|
||||
|
||||
## Reindexovanie
|
||||
|
||||
Celý proces načíta dokumenty, vytvorí chunky, obnoví FTS5 index a
|
||||
vytvorí embedding pre každý chunk:
|
||||
Spoločná synchronizácia pripraví dokumenty, chunky, SQLite/FTS5, embeddingy
|
||||
a Neo4j graf z jedného snapshotu wiki. Nová generácia sa aktivuje až po
|
||||
úspešnej príprave oboch indexov:
|
||||
|
||||
```bash
|
||||
docker compose run --rm zp-agent-api python scripts/rebuild_index.py
|
||||
docker compose run --rm zp-agent-api python -m tools.rag.rebuild_index
|
||||
```
|
||||
|
||||
Vzniknú súbory:
|
||||
@ -584,15 +725,38 @@ Vzniknú súbory:
|
||||
data/documents.json
|
||||
data/chunks.json
|
||||
data/zp_index.sqlite
|
||||
data/index_version.json
|
||||
```
|
||||
|
||||
Databáza obsahuje dokumenty, chunky, FTS5 index, metadata a embeddingy.
|
||||
|
||||
Pri automatickom reindexovaní sa používa zámok proti súbežnému spusteniu
|
||||
a atomická výmena databázy po úspešnom vytvorení nového indexu.
|
||||
Manuálny `/sync`, push webhook a uvedený CLI príkaz používajú rovnakú pipeline.
|
||||
SQLite, Neo4j a odpovede nástrojov evidujú spoločnú verziu dát a Git revíziu.
|
||||
Pri krátkom prepnutí sa nové vyhľadávanie dočasne odmietne; chyba grafu
|
||||
vyvolá rollback. Pri nedokončenom prepnutí po páde zostane vyhľadávanie
|
||||
nedostupné do úspešného opakovania synchronizácie. Podrobnosti a zotavenie:
|
||||
[Spoločná synchronizácia indexov](docs/synchronizacia_indexov.md).
|
||||
|
||||
## Publikovanie a dostupnosť nástrojov
|
||||
|
||||
Oba nástroje predvolene vylučujú iba explicitné `published=false`.
|
||||
Chýbajúca hodnota sa považuje za publikovanú. Parameter
|
||||
`published_only=false` výslovne zahrnie aj nepublikované dokumenty pri
|
||||
autorizovanom volaní; CLI používa `--include-unpublished`.
|
||||
|
||||
`/health` uvádza samostatne `tools.rag`, `tools.neo4j` a `tools.graphrag`.
|
||||
Globálne `ready` vyžaduje oba vyhľadávacie nástroje; pri výpadku Neo4j
|
||||
môže klient ďalej používať RAG podľa `tools.rag.ready`.
|
||||
[Politika, migrácia a príklady](docs/publikovanie_a_dostupnost.md).
|
||||
|
||||
## Hybridné vyhľadávanie
|
||||
|
||||
RAG aj GraphRAG používajú spoločné polia `status`, `reason`, `sources`,
|
||||
`index_version`, `complete`, `truncated` a `truncation_reasons`. Pôvodný
|
||||
RAG kontext aj grafové fakty a cesty zostávajú dostupné. Úplnosť vyhľadania
|
||||
sa odlišuje od pravdivosti odpovede; pri RAG môže byť nezaručená (`null`).
|
||||
[Výstupný kontrakt a spracovanie chýb](docs/vystupny_kontrakt.md).
|
||||
|
||||
Vyhľadávanie kombinuje:
|
||||
|
||||
```text
|
||||
@ -623,7 +787,7 @@ Test z terminálu:
|
||||
|
||||
```bash
|
||||
docker compose run --rm zp-agent-api \
|
||||
python scripts/search_db.py "rag agent" --limit 5
|
||||
python -m tools.rag.search_db "rag agent" --limit 5
|
||||
```
|
||||
|
||||
Pred volaním API načítaj premenné z `.env`:
|
||||
@ -643,7 +807,7 @@ curl -X POST http://127.0.0.1:8000/search \
|
||||
-d '{
|
||||
"query": "strojový preklad",
|
||||
"limit": 3,
|
||||
"published_only": false,
|
||||
"published_only": true,
|
||||
"max_per_document": 1
|
||||
}'
|
||||
```
|
||||
@ -661,7 +825,7 @@ dokumentu.
|
||||
## RAG
|
||||
|
||||
Nad hybridným retrievalom je implementovaná RAG vrstva v
|
||||
`scripts/rag_utils.py`.
|
||||
`tools/rag/rag_utils.py`.
|
||||
|
||||
Endpoint `/rag` vyhľadá relevantné dokumenty a pripraví:
|
||||
|
||||
@ -694,11 +858,82 @@ curl -X POST http://127.0.0.1:8000/rag \
|
||||
-d '{
|
||||
"query": "V akom roku robil Ján Holp diplomovú prácu?",
|
||||
"limit": 5,
|
||||
"published_only": false,
|
||||
"published_only": true,
|
||||
"max_per_document": 1
|
||||
}'
|
||||
```
|
||||
|
||||
## GraphRAG
|
||||
|
||||
GraphRAG vetva rozširuje existujúci klasický RAG o knowledge graph.
|
||||
Graf sa vytvára deterministicky z už pripravených dokumentov a chunkov
|
||||
a ukladá sa do Neo4j.
|
||||
|
||||
Aktuálne používané hlavné typy uzlov:
|
||||
|
||||
```text
|
||||
Person
|
||||
Document
|
||||
DocumentAuthor
|
||||
Thesis
|
||||
Work
|
||||
Keyword
|
||||
Topic
|
||||
Category
|
||||
```
|
||||
|
||||
Hlavné vzťahy zahŕňajú napríklad:
|
||||
|
||||
```text
|
||||
Person -[:HAS_DOCUMENT]-> Document
|
||||
Person -[:AUTHORED]-> Thesis
|
||||
Person -[:HAS_WORK]-> Work
|
||||
Thesis/Work -[:EVIDENCED_BY]-> Document
|
||||
Document -[:HAS_KEYWORD]-> Keyword
|
||||
Document -[:IN_CATEGORY]-> Category
|
||||
DocumentAuthor -[:AUTHORED_DOCUMENT]-> Document
|
||||
Document -[:DESCRIBES]-> Topic
|
||||
```
|
||||
|
||||
Knowledge graph sa vytvorí príkazom:
|
||||
|
||||
```bash
|
||||
docker compose exec zp-agent-api \
|
||||
python -m tools.graphrag.build_graphrag
|
||||
```
|
||||
|
||||
Builder vytvára constraints, zapisuje uzly a vzťahy a pri štandardnom
|
||||
spustení obnoví iba časť grafu spravovanú ZP Agentom. Zmazanie aj zápis
|
||||
prebiehajú v jednej transakcii s kontrolou počtov, takže chyba zachová
|
||||
pôvodný graf. Opakované spustenie nevytvára duplicitné uzly.
|
||||
|
||||
Graf je možné vizuálne kontrolovať v Neo4j Browseri. Samostatné
|
||||
grafové vyhľadávanie je implementované v `tools/graphrag/graph_search.py`.
|
||||
GraphRAG zatiaľ nezasahuje do stabilného klasického `/rag` toku; ďalšia
|
||||
etapa spojí grafové výsledky s klasickým RAG a OpenWebUI nástrojom.
|
||||
|
||||
Aktuálna evaluácia GraphRAG **v7** má DEV **1 046/1 046** a nový TEST
|
||||
**80/80** pre grafové vyhľadávanie aj finálne odpovede. Modelový DEV má
|
||||
**46/46**; pri novom TESTe prešlo na prvý pokus **77/80 (96,25 %)**,
|
||||
po jednej povolenej oprave **80/80 (100 %)**. Prirodzený text sa skladá
|
||||
z overených štruktúrovaných tvrdení. Sú to nové kombinácie nad známym
|
||||
korpusom a šablónami, nie neznáme osoby ani ľudsky anotovaný benchmark.
|
||||
Samostatná historická regresia má **319/320 (99,69 %)**; nepodložená
|
||||
odpoveď v zostávajúcom prípade bola odmietnutá pred doručením.
|
||||
|
||||
Všetkých **591 testov** vrátane živých prešlo. V7 opravuje ignorovanie rokov
|
||||
mimo 20xx, kontrolu rozporných tvrdení o úplnosti, počtov, povinných tvrdení
|
||||
a citácií vrátane referenčného Markdownu a HTML. Začiatok štúdia vyžaduje
|
||||
explicitný zdroj, neodvodzuje sa z adresára; opravilo sa 10 očakávaní.
|
||||
Všetky v1–v6 merania ostávajú zachované.
|
||||
[Finálna správa v7](tools/graphrag/evaluation/results/final_v7_2026-10-26/REPORT.md)
|
||||
uvádza presný protokol, opravy, regresiu aj obmedzenia.
|
||||
|
||||
Historická v4 mala grafový strict TEST 320/320, doplnkovú kontrolu kontextových
|
||||
faktov 319/320 a LLM TEST 281/300 (93,67 %). Pôvodné otázky aj výsledky
|
||||
v1–v4 zostávajú zachované. Aktuálne skóre nie je zárukou všeobecnej pravdivosti.
|
||||
[Protokol a reprodukcia](tools/graphrag/evaluation/README.md).
|
||||
|
||||
## OpenWebUI
|
||||
|
||||
ZP Agent je pripojený do OpenWebUI ako OpenAPI Tool Server.
|
||||
@ -734,7 +969,7 @@ Výsledná odpoveď má byť grounded v ZP Wiki a má používať relevantný
|
||||
Frozen retrieval benchmark sa spúšťa napríklad:
|
||||
|
||||
```bash
|
||||
python evaluation/evaluate_retrieval.py \
|
||||
python -m tools.rag.evaluation.evaluate_retrieval \
|
||||
--split dev \
|
||||
--strict-dataset
|
||||
```
|
||||
@ -772,7 +1007,7 @@ TEST split sa nemá používať na priebežné ladenie retrieval konfigurácie.
|
||||
Answer-level evaluácia používa:
|
||||
|
||||
```bash
|
||||
python evaluation/evaluate_rag_answers.py --split dev
|
||||
python -m tools.rag.evaluation.evaluate_rag_answers --split dev
|
||||
```
|
||||
|
||||
Evaluuje kompletný model/tool/RAG tok a od retrieval benchmarku je
|
||||
@ -782,56 +1017,118 @@ Ak je pôvodná otázka vhodná pre retrieval, ale nejednoznačná pre
|
||||
generatívnu odpoveď, jej answer-level formulácia sa upraví iba cez:
|
||||
|
||||
```text
|
||||
evaluation/json_files/rag_answer_overrides.json
|
||||
tools/rag/evaluation/json_files/rag_answer_overrides.json
|
||||
```
|
||||
|
||||
Pôvodný frozen `questions.json` tým ostáva nezmenený.
|
||||
|
||||
## Manuálna synchronizácia
|
||||
## Tokenové limity, segmenty a embeddingová cache
|
||||
|
||||
Manuálne reindexovanie cez zabezpečený endpoint:
|
||||
Chunkovanie dodrží `CHUNK_MAX_TOKENS` aj pri dlhom slove, riadku kódu,
|
||||
tabuľke alebo nadpise. Posledné delenie zachová Unicode znaky a obsah;
|
||||
celá cesta nadpisov zostáva v metadátach.
|
||||
|
||||
Finálny embeddingový vstup obsahuje názov, autora, tagy, kategórie, obsah
|
||||
aj prefix `passage: `. Jeho veľkosť sa meria skutočným tokenizérom modelu
|
||||
vrátane špeciálnych tokenov. Nadlimitný vstup sa bez straty obsahu rozdelí
|
||||
na segmenty. Pôvodný chunk, FTS a graf ostávajú zachované. Vektorové
|
||||
vyhľadávanie vyberá najlepšiu zhodu segmentu a každý chunk vráti iba raz.
|
||||
Encoder nadlimitný nesegmentovaný vstup odmietne namiesto tichého orezania.
|
||||
|
||||
`data/embedding_cache.sqlite` uchováva vektory podľa presného vstupu a
|
||||
odtlačku váh, tokenizéra a konfigurácie modelu. Pri zmene relevantných
|
||||
metadát alebo modelu sa vektor prepočíta. Kontrolný súčet zachytí poškodený
|
||||
záznam cache. Prvé vytvorenie novej cache prepočíta všetko; ďalšia obnova
|
||||
nezmenených vstupov použije cache. Výsledok synchronizácie obsahuje
|
||||
`embedding_segments`, `embedding_computed` a `embedding_reused`; počet
|
||||
`embedding_chunks` stále označuje počet pokrytých pôvodných chunkov.
|
||||
Cache je obnoviteľná optimalizácia; jej odstránenie pri zastavenej
|
||||
synchronizácii vyvolá nový výpočet, nezmení aktívne indexy.
|
||||
|
||||
`POST /rag` predvolene vracia dôkazy iba raz v `context` a stručné citačné
|
||||
metadáta v `sources`. Diagnostické expanzie a ich texty sa vrátia len pri
|
||||
explicitnom `include_diagnostics: true`, oddelene v `diagnostics`.
|
||||
RAG evaluačný klient diagnostiku pred odoslaním modelu vždy odstráni.
|
||||
|
||||
`RAG_LLM_MAX_TOKENS` (predvolene 12000) obmedzuje celý JSON podkladu
|
||||
vrátane kontextu, pokynov, zdrojov a verzie dát. Nie je to rozpočet celej
|
||||
konverzácie ani výstupu modelu. `RAG_LLM_TOKEN_ENCODING` má predvolene
|
||||
`cl100k_base`; ide o explicitný odhad, nie presný tokenizér všetkých
|
||||
vzdialených modelov. Výstup `context_budget` uvádza použitý tokenizér,
|
||||
limit a skutočný počet podľa tohto odhadu. Pri orezaní nástroj nastaví
|
||||
`complete=false`, `truncated=true` a dôvod `llm_context_budget`.
|
||||
|
||||
## Manuálna synchronizácia a stav úloh
|
||||
|
||||
`POST /sync` uloží požiadavku do persistentnej fronty a ihneď vráti HTTP 202.
|
||||
Indexovanie prebieha na pozadí; prijatie požiadavky ešte neznamená dokončenie.
|
||||
|
||||
```bash
|
||||
curl -X POST http://127.0.0.1:8000/sync \
|
||||
-H "Content-Type: application/json" \
|
||||
-H "X-API-Key: $SYNC_API_KEY" \
|
||||
-d '{"pull_git": false}'
|
||||
-d '{"pull_git": true}'
|
||||
```
|
||||
|
||||
## Gitea webhook
|
||||
Odpoveď obsahuje `job_id` a `status_url`, napríklad `/sync/jobs/<job_id>`.
|
||||
Stav načítaj rovnakým `SYNC_API_KEY`:
|
||||
|
||||
Endpoint:
|
||||
|
||||
```text
|
||||
POST /webhook/gitea
|
||||
```bash
|
||||
curl http://127.0.0.1:8000/sync/jobs/<job_id> -H "X-API-Key: $SYNC_API_KEY"
|
||||
curl http://127.0.0.1:8000/sync/status -H "X-API-Key: $SYNC_API_KEY"
|
||||
```
|
||||
|
||||
Webhook overuje:
|
||||
Úloha má stav `queued`, `running`, `succeeded` alebo `failed`. Pole `phase`
|
||||
rozlišuje čakanie na zámok, Git, budovanie a publikovanie indexov. Úspešná
|
||||
úloha obsahuje v `result` počty, trvanie a spoločnú verziu SQLite a Neo4j.
|
||||
Prehľad obsahuje aktívne úlohy, posledný úspech a posledné zlyhanie.
|
||||
|
||||
- HMAC-SHA256 podpis,
|
||||
- typ Gitea udalosti,
|
||||
- očakávaný repozitár,
|
||||
- maximálnu veľkosť payloadu,
|
||||
- stav reindexovacieho zámku.
|
||||
Fronta `data/sync_jobs.sqlite` prežije reštart. Procesový zámok povoľuje
|
||||
iba jedného pracovníka; rozpracovaná úloha sa po páde zopakuje. Push prijatý
|
||||
po začiatku obnovy vytvorí následnú úlohu. Ďalšie čakajúce požiadavky sa
|
||||
zlúčia, pričom požiadavka na stiahnutie z Gitu sa zachová. Konflikt s CLI
|
||||
obnovou spôsobí čakanie, nie stratu požiadavky. Bežná chyba sa skúsi najviac
|
||||
trikrát; následne zostane viditeľný stav `failed` a možno poslať nový `/sync`.
|
||||
CLI `python -m tools.rag.rebuild_index --pull` zostáva synchronný.
|
||||
|
||||
Očakávaný repozitár:
|
||||
|
||||
```dotenv
|
||||
EXPECTED_GITEA_REPOSITORY=KEMT/zpwiki
|
||||
```
|
||||
|
||||
Ak je povolené:
|
||||
## Gitea webhook a prístup ku Gitu
|
||||
|
||||
Endpoint `POST /webhook/gitea` overuje HMAC-SHA256 nad pôvodným telom,
|
||||
veľkosť payloadu, udalosť `push`, repozitár a konkrétnu vetvu z `ref`:
|
||||
|
||||
```dotenv
|
||||
EXPECTED_GITEA_REPOSITORY=jp170na/zpwiki
|
||||
EXPECTED_GITEA_BRANCH=master
|
||||
WEBHOOK_PULL_GIT=true
|
||||
```
|
||||
|
||||
pred reindexovaním sa vykoná:
|
||||
Push inej vetvy a zmazanie vetvy sa ignorujú bez obnovy. `X-Gitea-Delivery`
|
||||
zabraňuje opakovanému zaradeniu rovnakého doručenia. Platný push vráti HTTP
|
||||
202 s odkazom na stav úlohy; nečaká na dokončenie indexovania.
|
||||
|
||||
Git aktualizácia overí zhodu `origin` s očakávaným repozitárom, aktívnu
|
||||
vetvu a neprítomnosť lokálnych zmien vrátane nesledovaných súborov. Potom vykoná:
|
||||
|
||||
```bash
|
||||
git pull --ff-only
|
||||
git fetch --no-tags --no-recurse-submodules origin refs/heads/master:refs/remotes/origin/master
|
||||
git merge --ff-only refs/remotes/origin/master
|
||||
```
|
||||
|
||||
Cieľom je aktuálna verzia nakonfigurovanej vetvy; oneskorený webhook
|
||||
neprepína wiki naspäť na starší commit. Odlišná história sa automaticky
|
||||
neprepisuje. Pri chybe Gitu zostávajú predchádzajúce indexy zachované.
|
||||
|
||||
Pre tento wiki server treba SSH. V `.env` nastav absolútne hostiteľské cesty
|
||||
`ZPWIKI_SSH_KEY` a `ZPWIKI_KNOWN_HOSTS`. Compose pripája iba tieto dva súbory
|
||||
na čítanie do `/run/secrets/`; kľúč sa nekopíruje do image ani repozitára.
|
||||
Použi kľúč s prístupom k wiki, ideálne deploy kľúč iba na čítanie, a vopred
|
||||
over záznam servera v `known_hosts`. SSH používa `BatchMode` a povinné
|
||||
striktné overenie servera; pri chybe si interaktívne nepýta heslo.
|
||||
|
||||
Na Gitea nastav push webhook na verejne dosiahnuteľnú adresu
|
||||
`https://<adresa-api>/webhook/gitea` s rovnakým `WEBHOOK_SECRET`. Lokálna
|
||||
adresa `127.0.0.1` nie je zo vzdialeného Gitea servera dosiahnuteľná.
|
||||
|
||||
## Bezpečnosť
|
||||
|
||||
Vyhľadávanie podporuje API key:
|
||||
@ -874,10 +1171,10 @@ Kontrola syntaxe najdôležitejších upravovaných modulov:
|
||||
|
||||
```bash
|
||||
python -m py_compile \
|
||||
scripts/rag_utils.py \
|
||||
evaluation/evaluate_rag_answers.py \
|
||||
evaluation/rag_runner.py \
|
||||
evaluation/rag_metrics.py
|
||||
tools/rag/rag_utils.py \
|
||||
tools/rag/evaluation/evaluate_rag_answers.py \
|
||||
tools/rag/evaluation/rag_runner.py \
|
||||
tools/rag/evaluation/rag_metrics.py
|
||||
```
|
||||
|
||||
Pred checkpointom je vhodné použiť aj:
|
||||
@ -891,116 +1188,65 @@ Pevný počet `pytest` výsledkov nie je v README uvádzaný, pretože sa
|
||||
s vývojom mení. Aktuálny stav sa má vždy potvrdiť novým spustením testov
|
||||
na konkrétnom commite.
|
||||
|
||||
## Pripravené, ale zatiaľ neaktívne experimenty
|
||||
## Experimentálne datasety
|
||||
|
||||
Nasledujúce datasety sú pripravené, ale nemajú sa teraz používať na
|
||||
priebežné ladenie aktuálneho frozen benchmarku:
|
||||
Pre ďalšie experimenty sú pripravené:
|
||||
|
||||
```text
|
||||
questions_extended_2000.json
|
||||
questions_extended.json
|
||||
graphrag_questions.json
|
||||
robustness_questions.json
|
||||
performance_queries.json
|
||||
```
|
||||
|
||||
Odporúčané poradie ich neskoršieho použitia:
|
||||
|
||||
```text
|
||||
stabilný klasický RAG
|
||||
↓
|
||||
extended benchmark
|
||||
↓
|
||||
robustness benchmark
|
||||
↓
|
||||
GraphRAG implementácia
|
||||
↓
|
||||
GraphRAG benchmark
|
||||
↓
|
||||
performance benchmark
|
||||
↓
|
||||
stress test
|
||||
↓
|
||||
finálne experimenty
|
||||
```
|
||||
`graphrag_questions.json` je aktuálne určený pre vývoj GraphRAG vetvy.
|
||||
Ostatné datasety zostávajú oddelené od priebežného ladenia frozen
|
||||
klasického baseline.
|
||||
|
||||
## Najbližší postup
|
||||
|
||||
Najbližšia vývojová etapa je zámerne menšia a má uzavrieť existujúci
|
||||
klasický RAG pred otvorením ďalších experimentov.
|
||||
Klasický RAG a GraphRAG sú oddelené do samostatných komponentov v
|
||||
`tools/rag/` a `tools/graphrag/`. Stabilný klasický RAG zostáva
|
||||
referenčným bodom.
|
||||
|
||||
### 1. Uzavretie retrieval/regresie
|
||||
### 1. GraphRAG dátový model
|
||||
|
||||
Najprv sa má potvrdiť, že aktuálne zmeny neovplyvnili frozen retrieval
|
||||
baseline.
|
||||
Model je implementovaný. Rozlišuje autora dokumentu, študenta, záverečnú
|
||||
prácu, projekt, tému a kľúčové slovo. Študijný program sa nedopĺňa bez
|
||||
spoľahlivého zdroja.
|
||||
|
||||
Postup:
|
||||
### 2. GraphRAG evaluácia
|
||||
|
||||
```text
|
||||
py_compile
|
||||
↓
|
||||
pytest
|
||||
↓
|
||||
frozen retrieval DEV strict
|
||||
↓
|
||||
porovnanie s uloženým baseline
|
||||
↓
|
||||
git diff --check
|
||||
↓
|
||||
retrieval lock
|
||||
```
|
||||
V7 má zmrazený graf, DEV **1 046/1 046** a nový TEST **80/80**.
|
||||
[Finálna správa](tools/graphrag/evaluation/results/final_v7_2026-10-26/REPORT.md)
|
||||
oddeľuje nový TEST od historickej regresie a vyhľadávanie od modelu
|
||||
s kontrolami a rendererom; pôvodné v1–v6 sa nemenia.
|
||||
Pred formálnym porovnaním s klasickým RAG potrebujeme spoločnú metodiku
|
||||
a ideálne otázky anotované nezávislým človekom. Nový nezávislý TEST vyžaduje
|
||||
nové otázky; opakované meranie odhalených otázok je regresia.
|
||||
|
||||
Do retrieval scoringu sa potom nemá zasahovať bez nového
|
||||
experimentálneho dôvodu.
|
||||
### 3. OpenWebUI nástroje
|
||||
|
||||
### 2. Regresia section-lead RAG kontextu
|
||||
Pripraviť samostatne inštalovateľný RAG nástroj a GraphRAG nástroj.
|
||||
Každý komponent bude mať vlastný adresár, rozhranie a testy.
|
||||
|
||||
Treba potvrdiť, že section-lead expanzia:
|
||||
### 4. Hlavný agent
|
||||
|
||||
- opravuje prípady, kde primárny chunk chýba o názov/tému/rok,
|
||||
- nepridáva duplicitný chunk,
|
||||
- zostáva v rovnakom dokumente a sekcii,
|
||||
- nemení retrieval `max_per_document=1`,
|
||||
- nevytvára zbytočne veľký kontext.
|
||||
Pridať hlavný prompt/agenta, ktorý podľa otázky vyberie vhodný nástroj a
|
||||
bude vedieť kombinovať ich výsledky.
|
||||
|
||||
### 3. `retry + backoff + resume` pre answer evaluator
|
||||
### 5. Git MCP server
|
||||
|
||||
Pred spustením veľkého DEV answer benchmarku sa má evaluator doplniť
|
||||
tak, aby dlhý beh nebol znehodnotený jedným timeoutom alebo dočasnou
|
||||
chybou API.
|
||||
Pridať samostatný MCP server pre prácu s Git repozitárom a spúšťať ho v
|
||||
Dockeri. Následne ho sprístupniť hlavnému agentovi ako ďalší nástroj.
|
||||
|
||||
Plánované správanie:
|
||||
### 6. Spojenie GraphRAG s klasickým RAG
|
||||
|
||||
```text
|
||||
request
|
||||
↓
|
||||
úspech ───────────────→ uložiť výsledok
|
||||
│
|
||||
└─ timeout / 429 / 5xx
|
||||
↓
|
||||
retry
|
||||
↓
|
||||
exponential backoff
|
||||
↓
|
||||
retry limit
|
||||
```
|
||||
Po stabilizovaní grafového vyhľadávania spojiť výsledky grafu s
|
||||
existujúcim FTS5 + embedding vyhľadávaním a porovnať klasický RAG s
|
||||
GraphRAG variantom.
|
||||
|
||||
Resume mechanizmus má:
|
||||
### 7. Finálne experimenty
|
||||
|
||||
- priebežne ukladať `.partial.json`,
|
||||
- pri novom spustení načítať existujúci partial výsledok,
|
||||
- overiť kompatibilitu modelu/datasetu/splitu,
|
||||
- preskočiť už úspešne dokončené otázky,
|
||||
- pokračovať od ďalšej otázky,
|
||||
- neprepisovať hotové výsledky bez explicitnej voľby,
|
||||
- po úspešnom dokončení vytvoriť finálny JSON/CSV výstup.
|
||||
|
||||
Zároveň je vhodné:
|
||||
|
||||
- rozlišovať retryable a permanentné chyby,
|
||||
- logovať číslo pokusu a dôvod retry,
|
||||
- mať konfigurovateľný maximálny počet pokusov,
|
||||
- mať konfigurovateľný počiatočný backoff,
|
||||
- používať mierny delay medzi otázkami,
|
||||
- validovať typy answer-level datasetových polí,
|
||||
- nenačítavať osobný OpenWebUI API kľúč z fallback súboru, ak má byť
|
||||
podľa bezpečnostnej politiky dostupný iba cez environment.
|
||||
Až po stabilizovaní celého systému vykonať širšie porovnanie embedding
|
||||
modelov, robustnosti, výkonu a ostatných finálnych experimentov.
|
||||
|
||||
61
app/main.py
61
app/main.py
@ -13,6 +13,11 @@ from fastapi import (
|
||||
from fastapi.middleware.cors import (
|
||||
CORSMiddleware,
|
||||
)
|
||||
from fastapi.exceptions import RequestValidationError
|
||||
from fastapi.encoders import jsonable_encoder
|
||||
from fastapi.exception_handlers import http_exception_handler, request_validation_exception_handler
|
||||
from starlette.exceptions import HTTPException as StarletteHTTPException
|
||||
from starlette.responses import JSONResponse
|
||||
|
||||
|
||||
PROJECT_ROOT = Path(__file__).resolve().parents[1]
|
||||
@ -28,7 +33,11 @@ from app.routes import router
|
||||
from app.security import (
|
||||
validate_security_configuration,
|
||||
)
|
||||
from scripts.embedding_utils import embed_query
|
||||
from tools.rag.embedding_utils import embed_query
|
||||
from tools.retrieval_contract import error_result
|
||||
from tools.rag.common import DATA_DIR
|
||||
from tools.sync_jobs import SyncJobs
|
||||
from tools.rag.rebuild_index import rebuild_index
|
||||
|
||||
|
||||
logger = logging.getLogger(__name__)
|
||||
@ -41,15 +50,17 @@ OPENWEBUI_ORIGIN = (
|
||||
|
||||
@asynccontextmanager
|
||||
async def lifespan(
|
||||
_: FastAPI,
|
||||
application: FastAPI,
|
||||
):
|
||||
validate_security_configuration()
|
||||
application.state.embedding_ready = False
|
||||
|
||||
try:
|
||||
await asyncio.to_thread(
|
||||
embed_query,
|
||||
"warmup",
|
||||
)
|
||||
application.state.embedding_ready = True
|
||||
|
||||
except Exception:
|
||||
logger.exception(
|
||||
@ -58,7 +69,17 @@ async def lifespan(
|
||||
"úspešného warm-upu."
|
||||
)
|
||||
|
||||
yield
|
||||
def run_sync(**kwargs):
|
||||
result = rebuild_index(**kwargs)
|
||||
application.state.embedding_ready = True
|
||||
return result
|
||||
|
||||
application.state.sync_jobs = SyncJobs(DATA_DIR, runner=run_sync)
|
||||
application.state.sync_jobs.start()
|
||||
try:
|
||||
yield
|
||||
finally:
|
||||
await asyncio.to_thread(application.state.sync_jobs.stop)
|
||||
|
||||
|
||||
app = FastAPI(
|
||||
@ -76,6 +97,27 @@ app = FastAPI(
|
||||
)
|
||||
|
||||
|
||||
@app.exception_handler(StarletteHTTPException)
|
||||
async def retrieval_http_error(request: Request, error: StarletteHTTPException):
|
||||
if request.url.path not in {'/rag', '/search'}:
|
||||
return await http_exception_handler(request, error)
|
||||
reason = {400: 'invalid_query', 401: 'unauthorized', 403: 'forbidden',
|
||||
404: 'not_found', 405: 'method_not_allowed', 422: 'invalid_request',
|
||||
503: 'retrieval_unavailable'}.get(error.status_code, 'internal_error')
|
||||
return JSONResponse(status_code=error.status_code, headers=error.headers,
|
||||
content={**error_result(reason=reason), 'detail': error.detail})
|
||||
|
||||
|
||||
@app.exception_handler(RequestValidationError)
|
||||
async def retrieval_validation_error(request: Request, error: RequestValidationError):
|
||||
if request.url.path not in {'/rag', '/search'}:
|
||||
return await request_validation_exception_handler(request, error)
|
||||
# Retain useful validation locations/types without echoing submitted secrets.
|
||||
details = [{'loc': row['loc'], 'type': row['type'], 'msg': row['msg']} for row in error.errors()]
|
||||
return JSONResponse(status_code=422, content=jsonable_encoder({
|
||||
**error_result(reason='invalid_request'), 'detail': details}))
|
||||
|
||||
|
||||
app.add_middleware(
|
||||
CORSMiddleware,
|
||||
allow_origins=[
|
||||
@ -114,9 +156,16 @@ async def add_security_headers(
|
||||
request: Request,
|
||||
call_next,
|
||||
):
|
||||
response = await call_next(
|
||||
request
|
||||
)
|
||||
try:
|
||||
response = await call_next(request)
|
||||
except Exception:
|
||||
if request.url.path not in {'/rag', '/search'}:
|
||||
raise
|
||||
# Serialization failures must obey the same contract as backend errors.
|
||||
logger.exception('Neočakávaná chyba výstupu retrieval API.')
|
||||
response = JSONResponse(status_code=500, content={
|
||||
**error_result(reason='internal_error'),
|
||||
'detail': 'Nastala interná chyba servera.'})
|
||||
|
||||
response.headers[
|
||||
"Cache-Control"
|
||||
|
||||
255
app/routes.py
255
app/routes.py
@ -1,8 +1,8 @@
|
||||
from __future__ import annotations
|
||||
|
||||
import asyncio
|
||||
import json
|
||||
import logging
|
||||
import re
|
||||
import sqlite3
|
||||
from typing import (
|
||||
Any,
|
||||
@ -36,16 +36,17 @@ from app.security import (
|
||||
verify_gitea_signature,
|
||||
webhook_should_pull_git,
|
||||
)
|
||||
from scripts.common import (
|
||||
from tools.rag.common import (
|
||||
DB_FILE,
|
||||
ZPWIKI_ROOT,
|
||||
)
|
||||
from scripts.rag_utils import build_rag_context
|
||||
from scripts.rebuild_index import (
|
||||
ReindexInProgressError,
|
||||
rebuild_index,
|
||||
)
|
||||
from scripts.search_utils import search_database
|
||||
from tools.rag.rag_utils import build_rag_context
|
||||
from tools.rag.llm_context import compact_rag_payload
|
||||
from tools.rag.search_utils import search_database
|
||||
from tools.wiki_git import expected_branch
|
||||
from tools.publication import DEFAULT_PUBLISHED_ONLY
|
||||
from tools.tool_health import tools_readiness
|
||||
from tools.retrieval_contract import RetrievalResponse, RetrievalSource, RetrievalErrorResponse
|
||||
|
||||
|
||||
logger = logging.getLogger(__name__)
|
||||
@ -72,10 +73,6 @@ INTERNAL_ERROR_DETAIL = (
|
||||
"Nastala interná chyba servera."
|
||||
)
|
||||
|
||||
REINDEX_FAILED_DETAIL = (
|
||||
"Reindexovanie zlyhalo."
|
||||
)
|
||||
|
||||
WEBHOOK_CONFIGURATION_DETAIL = (
|
||||
"Webhook nie je správne nakonfigurovaný."
|
||||
)
|
||||
@ -103,7 +100,7 @@ class SearchRequest(
|
||||
le=50,
|
||||
)
|
||||
|
||||
published_only: bool = False
|
||||
published_only: bool = DEFAULT_PUBLISHED_ONLY
|
||||
|
||||
max_per_document: int = Field(
|
||||
default=1,
|
||||
@ -115,6 +112,7 @@ class SearchRequest(
|
||||
class RagRequest(
|
||||
StrictRequestModel
|
||||
):
|
||||
include_diagnostics: bool = False
|
||||
query: str = Field(
|
||||
...,
|
||||
min_length=1,
|
||||
@ -136,10 +134,10 @@ class RagRequest(
|
||||
)
|
||||
|
||||
published_only: bool = Field(
|
||||
default=False,
|
||||
default=DEFAULT_PUBLISHED_ONLY,
|
||||
description=(
|
||||
"Ak je true, použijú sa iba "
|
||||
"publikované dokumenty."
|
||||
"dokumenty okrem explicitného published=false; chýbajúca hodnota sa zahrnie."
|
||||
),
|
||||
)
|
||||
|
||||
@ -161,8 +159,8 @@ class SyncRequest(
|
||||
pull_git: bool = Field(
|
||||
default=False,
|
||||
description=(
|
||||
"Pred reindexovaním vykoná "
|
||||
"git pull --ff-only."
|
||||
"Pred reindexovaním stiahne očakávanú vetvu "
|
||||
"a aktualizuje ju iba fast-forward."
|
||||
),
|
||||
)
|
||||
|
||||
@ -182,9 +180,11 @@ class HealthResponse(BaseModel):
|
||||
zpwiki_exists: bool
|
||||
|
||||
security_configured: bool
|
||||
index_version: dict[str, Any] | None = None
|
||||
tools: dict[str, Any]
|
||||
|
||||
|
||||
class RagSource(BaseModel):
|
||||
class RagSource(RetrievalSource):
|
||||
model_config = ConfigDict(
|
||||
extra="allow",
|
||||
)
|
||||
@ -205,7 +205,7 @@ class RagSource(BaseModel):
|
||||
] | None = None
|
||||
|
||||
|
||||
class RagResponse(BaseModel):
|
||||
class RagResponse(RetrievalResponse):
|
||||
model_config = ConfigDict(
|
||||
extra="forbid",
|
||||
)
|
||||
@ -231,9 +231,12 @@ class RagResponse(BaseModel):
|
||||
sources: list[
|
||||
RagSource
|
||||
]
|
||||
index_version: dict[str, Any] | None = None
|
||||
context_budget: dict[str, Any] | None = None
|
||||
diagnostics: dict[str, Any] | None = None
|
||||
|
||||
|
||||
class SearchResponse(BaseModel):
|
||||
class SearchResponse(RetrievalResponse):
|
||||
query: str
|
||||
engine: str
|
||||
|
||||
@ -246,57 +249,37 @@ class SearchResponse(BaseModel):
|
||||
results: list[
|
||||
dict[str, Any]
|
||||
]
|
||||
index_version: dict[str, Any] | None = None
|
||||
|
||||
|
||||
class SyncResponse(BaseModel):
|
||||
status: Literal[
|
||||
"ok"
|
||||
]
|
||||
|
||||
class SyncAcceptedResponse(BaseModel):
|
||||
status: Literal['accepted']
|
||||
job_id: str
|
||||
status_url: str
|
||||
pull_git: bool
|
||||
|
||||
duration_seconds: float
|
||||
|
||||
counts: dict[
|
||||
str,
|
||||
int,
|
||||
]
|
||||
coalesced: bool
|
||||
duplicate: bool
|
||||
event: str | None = None
|
||||
repository: str | None = None
|
||||
verified_by: Literal['hmac_sha256'] | None = None
|
||||
|
||||
|
||||
class WebhookSuccessResponse(
|
||||
BaseModel
|
||||
):
|
||||
status: Literal[
|
||||
"ok"
|
||||
]
|
||||
|
||||
class WebhookIgnoredResponse(BaseModel):
|
||||
status: Literal['ignored']
|
||||
reason: Literal['unsupported_event', 'unexpected_branch', 'deleted_branch']
|
||||
event: str
|
||||
repository: str
|
||||
|
||||
verified_by: Literal[
|
||||
"hmac_sha256"
|
||||
]
|
||||
|
||||
duration_seconds: float
|
||||
|
||||
counts: dict[
|
||||
str,
|
||||
int,
|
||||
]
|
||||
|
||||
|
||||
class WebhookIgnoredResponse(
|
||||
BaseModel
|
||||
):
|
||||
status: Literal[
|
||||
"ignored"
|
||||
]
|
||||
|
||||
reason: Literal[
|
||||
"unsupported_event"
|
||||
]
|
||||
|
||||
event: str
|
||||
def enqueue_sync(request: Request, **kwargs) -> dict:
|
||||
try:
|
||||
accepted = request.app.state.sync_jobs.enqueue(**kwargs)
|
||||
except (sqlite3.Error, OSError):
|
||||
logger.exception('Prijatie synchronizácie do fronty zlyhalo.')
|
||||
raise HTTPException(status_code=503, detail='Synchronizačná fronta nie je dostupná')
|
||||
job = accepted['job']
|
||||
return {'status': 'accepted', 'job_id': job['id'],
|
||||
'status_url': f"/sync/jobs/{job['id']}", 'pull_git': job['pull_git'],
|
||||
'coalesced': accepted['coalesced'], 'duplicate': accepted['duplicate']}
|
||||
|
||||
|
||||
def raise_retrieval_error(
|
||||
@ -355,36 +338,6 @@ def raise_retrieval_error(
|
||||
) from error
|
||||
|
||||
|
||||
def raise_reindex_error(
|
||||
error: Exception,
|
||||
) -> NoReturn:
|
||||
if isinstance(
|
||||
error,
|
||||
ReindexInProgressError,
|
||||
):
|
||||
raise HTTPException(
|
||||
status_code=(
|
||||
status.HTTP_409_CONFLICT
|
||||
),
|
||||
detail=str(
|
||||
error
|
||||
),
|
||||
) from error
|
||||
|
||||
logger.exception(
|
||||
"Reindexovanie zlyhalo."
|
||||
)
|
||||
|
||||
raise HTTPException(
|
||||
status_code=(
|
||||
status.HTTP_500_INTERNAL_SERVER_ERROR
|
||||
),
|
||||
detail=(
|
||||
REINDEX_FAILED_DETAIL
|
||||
),
|
||||
) from error
|
||||
|
||||
|
||||
def webhook_secret() -> str:
|
||||
try:
|
||||
return validate_secret(
|
||||
@ -507,7 +460,7 @@ async def read_webhook_body(
|
||||
include_in_schema=False,
|
||||
response_model=HealthResponse,
|
||||
)
|
||||
def health() -> dict[str, Any]:
|
||||
def health(request: Request) -> dict[str, Any]:
|
||||
database_exists = (
|
||||
DB_FILE.exists()
|
||||
)
|
||||
@ -524,15 +477,15 @@ def health() -> dict[str, Any]:
|
||||
except RuntimeError:
|
||||
security_configured = False
|
||||
|
||||
ready = (
|
||||
database_exists
|
||||
and zpwiki_exists
|
||||
and security_configured
|
||||
)
|
||||
tools, version = tools_readiness(DB_FILE, security_configured=security_configured,
|
||||
embedding_ready=getattr(request.app.state, 'embedding_ready', False))
|
||||
ready = tools['rag']['ready'] and tools['graphrag']['ready']
|
||||
|
||||
return {
|
||||
"status": "ok",
|
||||
"ready": ready,
|
||||
"index_version": version,
|
||||
"tools": tools,
|
||||
"database_exists": (
|
||||
database_exists
|
||||
),
|
||||
@ -573,27 +526,32 @@ def health() -> dict[str, Any]:
|
||||
),
|
||||
responses={
|
||||
400: {
|
||||
"model": RetrievalErrorResponse,
|
||||
"description": (
|
||||
"Neplatný dotaz."
|
||||
),
|
||||
},
|
||||
401: {
|
||||
"model": RetrievalErrorResponse,
|
||||
"description": (
|
||||
"Chýbajúci alebo neplatný "
|
||||
"API kľúč."
|
||||
),
|
||||
},
|
||||
422: {
|
||||
"model": RetrievalErrorResponse,
|
||||
"description": (
|
||||
"Neplatná štruktúra requestu."
|
||||
),
|
||||
},
|
||||
500: {
|
||||
"model": RetrievalErrorResponse,
|
||||
"description": (
|
||||
"Interná chyba servera."
|
||||
),
|
||||
},
|
||||
503: {
|
||||
"model": RetrievalErrorResponse,
|
||||
"description": (
|
||||
"Retrieval nie je momentálne "
|
||||
"dostupný."
|
||||
@ -608,9 +566,10 @@ def health() -> dict[str, Any]:
|
||||
)
|
||||
def rag(
|
||||
request: RagRequest,
|
||||
http_request: Request,
|
||||
) -> dict[str, Any]:
|
||||
try:
|
||||
return build_rag_context(
|
||||
result = build_rag_context(
|
||||
DB_FILE,
|
||||
request.query,
|
||||
limit=request.limit,
|
||||
@ -621,6 +580,8 @@ def rag(
|
||||
request.max_per_document
|
||||
),
|
||||
)
|
||||
http_request.app.state.embedding_ready = True
|
||||
return compact_rag_payload(result, include_diagnostics=request.include_diagnostics)
|
||||
|
||||
except Exception as error:
|
||||
raise_retrieval_error(
|
||||
@ -640,6 +601,7 @@ def rag(
|
||||
)
|
||||
def search(
|
||||
request: SearchRequest,
|
||||
http_request: Request,
|
||||
) -> dict[str, Any]:
|
||||
try:
|
||||
response = search_database(
|
||||
@ -653,6 +615,7 @@ def search(
|
||||
request.max_per_document
|
||||
),
|
||||
)
|
||||
http_request.app.state.embedding_ready = True
|
||||
|
||||
except Exception as error:
|
||||
raise_retrieval_error(
|
||||
@ -664,6 +627,7 @@ def search(
|
||||
]
|
||||
|
||||
return {
|
||||
**{key: response[key] for key in RetrievalResponse.model_fields if key in response},
|
||||
"query": request.query,
|
||||
"engine": response[
|
||||
"engine"
|
||||
@ -675,6 +639,7 @@ def search(
|
||||
results
|
||||
),
|
||||
"results": results,
|
||||
**({'index_version': response['index_version']} if response.get('index_version') else {}),
|
||||
}
|
||||
|
||||
|
||||
@ -686,43 +651,34 @@ def search(
|
||||
)
|
||||
],
|
||||
include_in_schema=False,
|
||||
response_model=SyncResponse,
|
||||
response_model=SyncAcceptedResponse,
|
||||
status_code=202,
|
||||
)
|
||||
def sync(
|
||||
request: SyncRequest,
|
||||
http_request: Request,
|
||||
) -> dict[str, Any]:
|
||||
try:
|
||||
result = rebuild_index(
|
||||
pull_git=(
|
||||
request.pull_git
|
||||
)
|
||||
)
|
||||
return enqueue_sync(http_request, pull_git=request.pull_git)
|
||||
|
||||
except Exception as error:
|
||||
raise_reindex_error(
|
||||
error
|
||||
)
|
||||
|
||||
return {
|
||||
"status": "ok",
|
||||
"pull_git": (
|
||||
request.pull_git
|
||||
),
|
||||
"duration_seconds": (
|
||||
result[
|
||||
"duration_seconds"
|
||||
]
|
||||
),
|
||||
"counts": result[
|
||||
"counts"
|
||||
],
|
||||
}
|
||||
@router.get('/sync/status', dependencies=[Depends(require_sync_api_key)], include_in_schema=False)
|
||||
def sync_status(request: Request) -> dict:
|
||||
return request.app.state.sync_jobs.overview()
|
||||
|
||||
|
||||
@router.get('/sync/jobs/{job_id}', dependencies=[Depends(require_sync_api_key)], include_in_schema=False)
|
||||
def sync_job(job_id: str, request: Request) -> dict:
|
||||
job = request.app.state.sync_jobs.get(job_id)
|
||||
if job is None:
|
||||
raise HTTPException(status_code=404, detail='Synchronizačná úloha neexistuje')
|
||||
return job
|
||||
|
||||
|
||||
@router.post(
|
||||
"/webhook/gitea",
|
||||
status_code=202,
|
||||
response_model=(
|
||||
WebhookSuccessResponse
|
||||
SyncAcceptedResponse
|
||||
| WebhookIgnoredResponse
|
||||
),
|
||||
response_model_exclude_unset=True,
|
||||
@ -866,36 +822,21 @@ async def gitea_webhook(
|
||||
),
|
||||
)
|
||||
|
||||
try:
|
||||
result = await asyncio.to_thread(
|
||||
rebuild_index,
|
||||
pull_git=(
|
||||
webhook_should_pull_git()
|
||||
),
|
||||
)
|
||||
|
||||
except Exception as error:
|
||||
raise_reindex_error(
|
||||
error
|
||||
)
|
||||
|
||||
ref = payload.get('ref')
|
||||
if not isinstance(ref, str) or not ref.startswith('refs/heads/'):
|
||||
raise HTTPException(status_code=400, detail='Push payload musí obsahovať ref vetvy')
|
||||
if ref != f'refs/heads/{expected_branch()}':
|
||||
return {'status': 'ignored', 'reason': 'unexpected_branch', 'event': x_gitea_event}
|
||||
revision = payload.get('after')
|
||||
if payload.get('deleted') is True or (isinstance(revision, str) and revision and set(revision) == {'0'}):
|
||||
return {'status': 'ignored', 'reason': 'deleted_branch', 'event': x_gitea_event}
|
||||
if revision is not None and (not isinstance(revision, str) or not re.fullmatch(r'[0-9a-fA-F]{40}|[0-9a-fA-F]{64}', revision)):
|
||||
raise HTTPException(status_code=400, detail='Neplatná Git revízia v push payload')
|
||||
delivery = request.headers.get('X-Gitea-Delivery')
|
||||
if delivery is not None and (not delivery.strip() or len(delivery) > 200 or any(ord(c) < 32 for c in delivery)):
|
||||
raise HTTPException(status_code=400, detail='Neplatné ID webhook doručenia')
|
||||
return {
|
||||
"status": "ok",
|
||||
"event": (
|
||||
x_gitea_event
|
||||
),
|
||||
"repository": (
|
||||
repository_name
|
||||
),
|
||||
"verified_by": (
|
||||
"hmac_sha256"
|
||||
),
|
||||
"duration_seconds": (
|
||||
result[
|
||||
"duration_seconds"
|
||||
]
|
||||
),
|
||||
"counts": result[
|
||||
"counts"
|
||||
],
|
||||
**enqueue_sync(request, pull_git=webhook_should_pull_git(), requested_revision=revision,
|
||||
delivery_key=f'{repository_name.casefold()}:{delivery}' if delivery else None),
|
||||
'event': x_gitea_event, 'repository': repository_name, 'verified_by': 'hmac_sha256',
|
||||
}
|
||||
|
||||
@ -3,6 +3,7 @@ from __future__ import annotations
|
||||
import hashlib
|
||||
import hmac
|
||||
import os
|
||||
from tools.wiki_git import expected_branch
|
||||
from typing import Any
|
||||
|
||||
from fastapi import (
|
||||
@ -182,6 +183,7 @@ def validate_security_configuration() -> None:
|
||||
)
|
||||
|
||||
expected_gitea_repository()
|
||||
expected_branch()
|
||||
|
||||
# Validujeme aj voliteľnú boolean
|
||||
# konfiguráciu už pri štarte aplikácie.
|
||||
|
||||
@ -1,6 +1,12 @@
|
||||
services:
|
||||
zp-agent-api:
|
||||
build: .
|
||||
build:
|
||||
context: .
|
||||
args:
|
||||
EMBEDDING_MODEL: ${EMBEDDING_MODEL:-intfloat/multilingual-e5-small}
|
||||
EMBEDDING_REVISION: ${EMBEDDING_REVISION:-}
|
||||
CHUNK_TOKEN_ENCODING: ${CHUNK_TOKEN_ENCODING:-cl100k_base}
|
||||
RAG_LLM_TOKEN_ENCODING: ${RAG_LLM_TOKEN_ENCODING:-cl100k_base}
|
||||
container_name: zp-agent-api
|
||||
ports:
|
||||
- "8000:8000"
|
||||
@ -13,15 +19,81 @@ services:
|
||||
CHUNK_MAX_TOKENS: "450"
|
||||
CHUNK_OVERLAP_TOKENS: "70"
|
||||
CHUNK_MIN_TOKENS: "80"
|
||||
CHUNK_TOKEN_ENCODING: cl100k_base
|
||||
CHUNK_TOKEN_ENCODING: ${CHUNK_TOKEN_ENCODING:-cl100k_base}
|
||||
RAG_LLM_MAX_TOKENS: ${RAG_LLM_MAX_TOKENS:-12000}
|
||||
RAG_LLM_TOKEN_ENCODING: ${RAG_LLM_TOKEN_ENCODING:-cl100k_base}
|
||||
HF_HOME: /cache/huggingface
|
||||
HF_HUB_OFFLINE: "1"
|
||||
TRANSFORMERS_OFFLINE: "1"
|
||||
ZP_RUNTIME_ASSETS: /opt/zp-assets
|
||||
ZP_ASSETS_REQUIRED: "1"
|
||||
GIT_SSH_COMMAND: >-
|
||||
ssh -F /dev/null -i /run/secrets/zpwiki_ssh_key
|
||||
-o IdentitiesOnly=yes -o BatchMode=yes -o StrictHostKeyChecking=yes
|
||||
-o UserKnownHostsFile=/run/secrets/zpwiki_known_hosts -o ConnectTimeout=15
|
||||
NEO4J_URI: bolt://neo4j:7687
|
||||
NEO4J_USER: ${NEO4J_USER:-neo4j}
|
||||
NEO4J_PASSWORD: ${NEO4J_PASSWORD}
|
||||
NEO4J_DATABASE: ${NEO4J_DATABASE:-neo4j}
|
||||
|
||||
volumes:
|
||||
- ./data:/app/data
|
||||
- ../zpwiki:/zpwiki
|
||||
- hf-cache:/cache/huggingface
|
||||
- type: bind
|
||||
source: ${ZPWIKI_SSH_KEY:-${HOME}/.ssh/id_ed25519}
|
||||
target: /run/secrets/zpwiki_ssh_key
|
||||
read_only: true
|
||||
bind:
|
||||
create_host_path: false
|
||||
- type: bind
|
||||
source: ${ZPWIKI_KNOWN_HOSTS:-${HOME}/.ssh/known_hosts}
|
||||
target: /run/secrets/zpwiki_known_hosts
|
||||
read_only: true
|
||||
bind:
|
||||
create_host_path: false
|
||||
|
||||
restart: unless-stopped
|
||||
stop_grace_period: 5m
|
||||
depends_on:
|
||||
neo4j:
|
||||
condition: service_healthy
|
||||
healthcheck:
|
||||
test: ["CMD", "python", "-m", "tools.runtime_health"]
|
||||
interval: 15s
|
||||
timeout: 10s
|
||||
retries: 12
|
||||
start_period: 90s
|
||||
|
||||
neo4j:
|
||||
image: neo4j:2026.09.0
|
||||
container_name: zp-agent-neo4j
|
||||
|
||||
ports:
|
||||
- "127.0.0.1:7474:7474"
|
||||
- "127.0.0.1:7687:7687"
|
||||
|
||||
environment:
|
||||
NEO4J_AUTH: ${NEO4J_USER:-neo4j}/${NEO4J_PASSWORD}
|
||||
|
||||
volumes:
|
||||
- neo4j-data:/data
|
||||
- neo4j-logs:/logs
|
||||
|
||||
healthcheck:
|
||||
test:
|
||||
[
|
||||
"CMD-SHELL",
|
||||
"u=$${NEO4J_AUTH%%/*}; p=$${NEO4J_AUTH#*/}; cypher-shell -u \"$$u\" -p \"$$p\" 'RETURN 1' >/dev/null 2>&1"
|
||||
]
|
||||
interval: 10s
|
||||
timeout: 5s
|
||||
retries: 10
|
||||
start_period: 20s
|
||||
|
||||
restart: unless-stopped
|
||||
|
||||
volumes:
|
||||
hf-cache:
|
||||
neo4j-data:
|
||||
neo4j-logs:
|
||||
|
||||
@ -1,73 +0,0 @@
|
||||
id,category,mode,question,first_relevant_rank,reciprocal_rank,hit_at_1,hit_at_3,hit_at_5,recall_at_1,recall_at_3,recall_at_5,expected_documents,top_documents,top_source_urls
|
||||
q001,fact_year,fts,V akom roku robil Ján Holp diplomovú prácu?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q001,fact_year,vector,V akom roku robil Ján Holp diplomovú prácu?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2020/matus_suchanic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""]"
|
||||
q001,fact_year,hybrid,V akom roku robil Ján Holp diplomovú prácu?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md"", ""pages/students/2021/matej_novotny/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny""]"
|
||||
q002,fact_year,fts,V ktorom roku začal študovať Ján Holp?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q002,fact_year,vector,V ktorom roku začal študovať Ján Holp?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt""]"
|
||||
q002,fact_year,hybrid,V ktorom roku začal študovať Ján Holp?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]"
|
||||
q003,fact_title,fts,Aký je názov diplomovej práce Jána Holpa?,3,0.333333,0,1,1,0.0,1.0,1.0,"[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q003,fact_title,vector,Aký je názov diplomovej práce Jána Holpa?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2018/david_omasta/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]"
|
||||
q003,fact_title,hybrid,Aký je názov diplomovej práce Jána Holpa?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2016/mark_feher/README.md"", ""pages/students/2021/matej_novotny/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny""]"
|
||||
q004,fact_title,fts,Aký je názov diplomovej práce Maroša Harahusa?,5,0.2,0,0,1,0.0,0.0,1.0,"[""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q004,fact_title,vector,Aký je názov diplomovej práce Maroša Harahusa?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/dmytro_mural/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2019/samuel_horani/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani""]"
|
||||
q004,fact_title,hybrid,Aký je názov diplomovej práce Maroša Harahusa?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/students/2016/ediz_morochovic/README.md"", ""pages/students/2019/dmytro_mural/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural""]"
|
||||
q005,fact_topic,fts,Aká je téma diplomového projektu Jána Ptáka?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2022/yevhenii_leonov/README.md"", ""pages/topics/steel/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/lukas_pokryvka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/topics/steel"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]"
|
||||
q005,fact_topic,vector,Aká je téma diplomového projektu Jána Ptáka?,5,0.2,0,0,1,0.0,0.0,1.0,"[""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]"
|
||||
q005,fact_topic,hybrid,Aká je téma diplomového projektu Jána Ptáka?,2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2016/jan_holp/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021""]"
|
||||
q006,fact_year,fts,V ktorom roku začal študovať Ján Pták?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/students/2018/david_omasta/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]"
|
||||
q006,fact_year,vector,V ktorom roku začal študovať Ján Pták?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2021/nikita_bodnar/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2018/ondrej_megela/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]"
|
||||
q006,fact_year,hybrid,V ktorom roku začal študovať Ján Pták?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2021/nikita_bodnar/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q007,fact_tool,fts,Aké používateľské rozhranie má Ján Pták použiť pre svojho agenta?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md"", ""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]"
|
||||
q007,fact_tool,vector,Aké používateľské rozhranie má Ján Pták použiť pre svojho agenta?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]"
|
||||
q007,fact_tool,hybrid,Aké používateľské rozhranie má Ján Pták použiť pre svojho agenta?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]"
|
||||
q008,paraphrase,fts,Kto pracuje na agentovi na zlepšenie správy záverečných prác v ZP Wiki?,3,0.333333,0,1,1,0.0,1.0,1.0,"[""pages/students/2022/jan_ptak/README.md""]","[""pages/topics/faq/README.md"", ""pages/topics/otvorene/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]"
|
||||
q008,paraphrase,vector,Kto pracuje na agentovi na zlepšenie správy záverečných prác v ZP Wiki?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/students/2022/jan_ptak/README.md""]","[""pages/topics/akopisat/README.md"", ""pages/students/2019/michal_stromko/vp2021/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko/vp2021"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]"
|
||||
q008,paraphrase,hybrid,Kto pracuje na agentovi na zlepšenie správy záverečných prác v ZP Wiki?,5,0.2,0,0,1,0.0,0.0,1.0,"[""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2019/michal_stromko/vp2021/README.md"", ""pages/topics/akopisat/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko/vp2021"", ""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]"
|
||||
q009,fact_topic,fts,Aká je téma diplomového projektu Jána Malinovského?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/yevhenii_leonov/README.md"", ""pages/topics/steel/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/lukas_pokryvka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/topics/steel"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]"
|
||||
q009,fact_topic,vector,Aká je téma diplomového projektu Jána Malinovského?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2020/kamil_tomcufcik/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2020/kamil_tomcufcik"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q009,fact_topic,hybrid,Aká je téma diplomového projektu Jána Malinovského?,2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2016/jan_holp/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/README.md"", ""pages/students/2020/kamil_tomcufcik/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2020/kamil_tomcufcik"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q010,paraphrase,fts,"Ktorý študent vytvára znalostný graf z oblasti vzdelávania a agenta, ktorý v ňom vyhľadáva?",3,0.333333,0,1,1,0.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q010,paraphrase,vector,"Ktorý študent vytvára znalostný graf z oblasti vzdelávania a agenta, ktorý v ňom vyhľadáva?",2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]"
|
||||
q010,paraphrase,hybrid,"Ktorý študent vytvára znalostný graf z oblasti vzdelávania a agenta, ktorý v ňom vyhľadáva?",2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]"
|
||||
q011,fact_title,fts,Ako sa volá diplomová práca Mateja Novotného?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/students/2021/matej_novotny/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]"
|
||||
q011,fact_title,vector,Ako sa volá diplomová práca Mateja Novotného?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/matej_novotny/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2020/david_kostilnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik""]"
|
||||
q011,fact_title,hybrid,Ako sa volá diplomová práca Mateja Novotného?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/matej_novotny/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2020/david_kostilnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik""]"
|
||||
q012,fact_year,fts,V ktorom roku je uvedená diplomová práca Mateja Novotného?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/students/2021/matej_novotny/README.md""]","[""pages/topics/faq/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]"
|
||||
q012,fact_year,vector,V ktorom roku je uvedená diplomová práca Mateja Novotného?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/matej_novotny/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2020/david_kostilnik/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021""]"
|
||||
q012,fact_year,hybrid,V ktorom roku je uvedená diplomová práca Mateja Novotného?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/matej_novotny/README.md""]","[""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/mark_feher/README.md"", ""pages/students/2020/matus_suchanic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""]"
|
||||
q013,fact_title,fts,Aký je názov diplomovej práce Dominika Nagya?,2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/students/2016/dominik_nagy/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/topics/question/nezodpovedatelne/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne""]"
|
||||
q013,fact_title,vector,Aký je názov diplomovej práce Dominika Nagya?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/dominik_nagy/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/mark_feher/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2018/david_omasta/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]"
|
||||
q013,fact_title,hybrid,Aký je názov diplomovej práce Dominika Nagya?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/dominik_nagy/README.md""]","[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/mark_feher/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2018/ondrej_megela/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]"
|
||||
q014,topic,fts,Nájdi dokumenty súvisiace so strojovým prekladom.,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/topics/translation/README.md""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/patrik_pavlisin/tp20/README.md"", ""pages/students/2016/patrik_pavlisin/dp22/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/tp20"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp22"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q014,topic,vector,Nájdi dokumenty súvisiace so strojovým prekladom.,3,0.333333,0,1,1,0.0,0.333333,0.333333,"[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/topics/translation/README.md""]","[""pages/students/2016/patrik_pavlisin/tp20/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2022/andrii_pervashov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/tp20"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]"
|
||||
q014,topic,hybrid,Nájdi dokumenty súvisiace so strojovým prekladom.,3,0.333333,0,1,1,0.0,0.333333,0.333333,"[""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/topics/translation/README.md""]","[""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/patrik_pavlisin/tp20/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/tp20"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q015,fact_goal,fts,Na čom pracoval Oliver Pejic počas IAESTE stáže?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/oliver_pejic/README.md""]","[""pages/interns/oliver_pejic/README.md"", ""pages/interns/cesar_gutierrez/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/interns/yussef_ressaissi/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic"", ""https://zp.kemt.fei.tuke.sk/interns/cesar_gutierrez"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi""]"
|
||||
q015,fact_goal,vector,Na čom pracoval Oliver Pejic počas IAESTE stáže?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/oliver_pejic/README.md""]","[""pages/interns/oliver_pejic/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]"
|
||||
q015,fact_goal,hybrid,Na čom pracoval Oliver Pejic počas IAESTE stáže?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/oliver_pejic/README.md""]","[""pages/interns/oliver_pejic/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]"
|
||||
q016,paraphrase,fts,Ktorý stážista pripravoval MTEB evaluačné úlohy pre slovenský hate speech a question answering?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/oliver_pejic/README.md""]","[""pages/interns/oliver_pejic/README.md"", ""pages/topics/hatespeech/README.md"", ""pages/topics/question/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic"", ""https://zp.kemt.fei.tuke.sk/topics/hatespeech"", ""https://zp.kemt.fei.tuke.sk/topics/question"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak""]"
|
||||
q016,paraphrase,vector,Ktorý stážista pripravoval MTEB evaluačné úlohy pre slovenský hate speech a question answering?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/oliver_pejic/README.md""]","[""pages/interns/oliver_pejic/README.md"", ""pages/topics/hatespeech/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/topics/question/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic"", ""https://zp.kemt.fei.tuke.sk/topics/hatespeech"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/topics/question"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q016,paraphrase,hybrid,Ktorý stážista pripravoval MTEB evaluačné úlohy pre slovenský hate speech a question answering?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/oliver_pejic/README.md""]","[""pages/interns/oliver_pejic/README.md"", ""pages/topics/hatespeech/README.md"", ""pages/topics/question/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic"", ""https://zp.kemt.fei.tuke.sk/topics/hatespeech"", ""https://zp.kemt.fei.tuke.sk/topics/question"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q017,fact_topic,fts,Aká bola téma stáže Bogdana Paula Chișa?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/bogdan_paul_chis/README.md""]","[""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/students/2018/adrian_remias/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q017,fact_topic,vector,Aká bola téma stáže Bogdana Paula Chișa?,4,0.25,0,0,1,0.0,0.0,1.0,"[""pages/interns/bogdan_paul_chis/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/interns/bogdan_paul_chis/README.md"", ""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]"
|
||||
q017,fact_topic,hybrid,Aká bola téma stáže Bogdana Paula Chișa?,5,0.2,0,0,1,0.0,0.0,1.0,"[""pages/interns/bogdan_paul_chis/README.md""]","[""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/lukas_pokryvka/README.md"", ""pages/interns/bogdan_paul_chis/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis""]"
|
||||
q018,fact_tool,fts,Akými nástrojmi mal Bogdan Paul Chiș vyhodnocovať svojho agenta?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/bogdan_paul_chis/README.md""]","[""pages/interns/bogdan_paul_chis/README.md"", ""pages/topics/otvorene/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2022/daniil_huzenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""]"
|
||||
q018,fact_tool,vector,Akými nástrojmi mal Bogdan Paul Chiș vyhodnocovať svojho agenta?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/bogdan_paul_chis/README.md""]","[""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]"
|
||||
q018,fact_tool,hybrid,Akými nástrojmi mal Bogdan Paul Chiș vyhodnocovať svojho agenta?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/bogdan_paul_chis/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q019,fact_goal,fts,Aký bol cieľ stáže Youssefa Ressaissiho?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt""]"
|
||||
q019,fact_goal,vector,Aký bol cieľ stáže Youssefa Ressaissiho?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q019,fact_goal,hybrid,Aký bol cieľ stáže Youssefa Ressaissiho?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q020,fact_goal,fts,Aké boli hlavné ciele stáže Cesara Abascala Gutierreza?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/cesar_gutierrez/README.md""]","[""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2016/patrik_pavlisin/tp20/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/tp20"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]"
|
||||
q020,fact_goal,vector,Aké boli hlavné ciele stáže Cesara Abascala Gutierreza?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/cesar_gutierrez/README.md""]","[""pages/interns/cesar_gutierrez/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2020/pavol_hudak/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/cesar_gutierrez"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2020/pavol_hudak"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q020,fact_goal,hybrid,Aké boli hlavné ciele stáže Cesara Abascala Gutierreza?,3,0.333333,0,1,1,0.0,1.0,1.0,"[""pages/interns/cesar_gutierrez/README.md""]","[""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/ronald_zalacko/README.md"", ""pages/interns/cesar_gutierrez/README.md"", ""pages/students/2019/dmytro_mural/README.md"", ""pages/students/2020/pavol_hudak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/interns/cesar_gutierrez"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2020/pavol_hudak""]"
|
||||
q021,fact_goal,fts,Aký je cieľ projektu AI4Steel?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/steel/README.md""]","[""pages/topics/steel/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2016/jakub_maruniak/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/steel"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""]"
|
||||
q021,fact_goal,vector,Aký je cieľ projektu AI4Steel?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/steel/README.md""]","[""pages/topics/steel/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/steel"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q021,fact_goal,hybrid,Aký je cieľ projektu AI4Steel?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/steel/README.md""]","[""pages/topics/steel/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/steel"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q022,fact_topic,fts,Čomu sa venuje dizertačná práca Maroša Harahusa?,2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2016/patrik_pavlisin/tp20/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/tp20"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q022,fact_topic,vector,Čomu sa venuje dizertačná práca Maroša Harahusa?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/dmytro_mural/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt""]"
|
||||
q022,fact_topic,hybrid,Čomu sa venuje dizertačná práca Maroša Harahusa?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/maros_harahus/README.md""]","[""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/dmytro_mural/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt""]"
|
||||
q023,multi_document,fts,"Nájdi dokumenty, v ktorých sa rieši Retrieval Augmented Generation alebo GraphRAG.",1,1.0,1,1,1,0.333333,0.333333,0.666667,"[""pages/interns/bogdan_paul_chis/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]"
|
||||
q023,multi_document,vector,"Nájdi dokumenty, v ktorých sa rieši Retrieval Augmented Generation alebo GraphRAG.",1,1.0,1,1,1,0.333333,0.333333,0.333333,"[""pages/interns/bogdan_paul_chis/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q023,multi_document,hybrid,"Nájdi dokumenty, v ktorých sa rieši Retrieval Augmented Generation alebo GraphRAG.",1,1.0,1,1,1,0.333333,0.333333,0.333333,"[""pages/interns/bogdan_paul_chis/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""pages/students/2022/jan_ptak/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q024,negative,fts,Akú diplomovú prácu robil Ján Holp v roku 2016?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q024,negative,vector,Akú diplomovú prácu robil Ján Holp v roku 2016?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt""]"
|
||||
q024,negative,hybrid,Akú diplomovú prácu robil Ján Holp v roku 2016?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/jan_holp/README.md""]","[""pages/students/2016/jan_holp/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2021/matej_novotny/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny""]"
|
||||
|
File diff suppressed because it is too large
Load Diff
File diff suppressed because it is too large
Load Diff
@ -1,883 +0,0 @@
|
||||
id,split,category,difficulty,mode,question,first_relevant_rank,reciprocal_rank,hit_at_1,hit_at_3,hit_at_5,recall_at_1,recall_at_3,recall_at_5,expected_documents,top_documents,top_source_urls
|
||||
q0052,test,entity_lookup,easy,fts,Nájdi dokument o osobe Lukáš Pokrývka.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2016/lukas_pokryvka/dp2021/README.md"", ""pages/topics/spacy/README.md"", ""pages/students/2018/oleh_bilykh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/dp2021"", ""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""]"
|
||||
q0052,test,entity_lookup,easy,vector,Nájdi dokument o osobe Lukáš Pokrývka.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/interns/oliver_pejic/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas""]"
|
||||
q0052,test,entity_lookup,easy,hybrid,Nájdi dokument o osobe Lukáš Pokrývka.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/interns/oliver_pejic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic""]"
|
||||
q0053,test,fact_title,easy,fts,Aký je názov diplomová práca osoby Lukáš Pokrývka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2016/lukas_pokryvka/dp2021/README.md"", ""pages/topics/spacy/README.md"", ""pages/students/2018/oleh_bilykh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/dp2021"", ""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""]"
|
||||
q0053,test,fact_title,easy,vector,Aký je názov diplomová práca osoby Lukáš Pokrývka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q0053,test,fact_title,easy,hybrid,Aký je názov diplomová práca osoby Lukáš Pokrývka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021""]"
|
||||
q0054,test,reverse_lookup,medium,fts,Kto sa venuje práci s názvom „Paralelné trénovanie neurónových sietí“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2016/dominik_nagy/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy""]"
|
||||
q0054,test,reverse_lookup,medium,vector,Kto sa venuje práci s názvom „Paralelné trénovanie neurónových sietí“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/patrik_pavlisin/dp21/README.md"", ""pages/students/2018/adrian_remias/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp21"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias""]"
|
||||
q0054,test,reverse_lookup,medium,hybrid,Kto sa venuje práci s názvom „Paralelné trénovanie neurónových sietí“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2018/adrian_remias/README.md"", ""pages/students/2021/eduard_matovka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka""]"
|
||||
q0055,test,topic_lookup,medium,fts,"Nájdi študenta alebo dokument, ktorý rieši tému „Paralelné trénovanie neurónových sietí“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]"
|
||||
q0055,test,topic_lookup,medium,vector,"Nájdi študenta alebo dokument, ktorý rieši tému „Paralelné trénovanie neurónových sietí“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2018/adrian_remias/README.md"", ""pages/students/2016/patrik_pavlisin/dp21/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp21"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0055,test,topic_lookup,medium,hybrid,"Nájdi študenta alebo dokument, ktorý rieši tému „Paralelné trénovanie neurónových sietí“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2018/adrian_remias/README.md"", ""pages/students/2016/patrik_pavlisin/dp21/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp21""]"
|
||||
q0056,test,paraphrase,medium,fts,O čom je práca osoby Lukáš Pokrývka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2016/lukas_pokryvka/dp2021/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/topics/spacy/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/topics/spacy""]"
|
||||
q0056,test,paraphrase,medium,vector,O čom je práca osoby Lukáš Pokrývka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0056,test,paraphrase,medium,hybrid,O čom je práca osoby Lukáš Pokrývka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak""]"
|
||||
q0057,test,fact_start_year,easy,fts,V ktorom roku začal študovať Lukáš Pokrývka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2016/lukas_pokryvka/dp2021/README.md"", ""pages/topics/spacy/README.md"", ""pages/students/2021/eduard_matovka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/dp2021"", ""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka""]"
|
||||
q0057,test,fact_start_year,easy,vector,V ktorom roku začal študovať Lukáš Pokrývka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021""]"
|
||||
q0057,test,fact_start_year,easy,hybrid,V ktorom roku začal študovať Lukáš Pokrývka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md"", ""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]"
|
||||
q0058,test,verification,medium,fts,Je pri osobe Lukáš Pokrývka uvedený rok začiatku štúdia 2016?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2016/lukas_pokryvka/dp2021/README.md"", ""pages/students/2018/oleh_bilykh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""]"
|
||||
q0058,test,verification,medium,vector,Je pri osobe Lukáš Pokrývka uvedený rok začiatku štúdia 2016?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md"", ""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]"
|
||||
q0058,test,verification,medium,hybrid,Je pri osobe Lukáš Pokrývka uvedený rok začiatku štúdia 2016?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]"
|
||||
q0059,test,fact_work_year,easy,fts,V ktorom roku je pri osobe Lukáš Pokrývka uvedená diplomová práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2016/lukas_pokryvka/dp2021/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/topics/spacy/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/topics/spacy""]"
|
||||
q0059,test,fact_work_year,easy,vector,V ktorom roku je pri osobe Lukáš Pokrývka uvedená diplomová práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q0059,test,fact_work_year,easy,hybrid,V ktorom roku je pri osobe Lukáš Pokrývka uvedená diplomová práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021""]"
|
||||
q0060,test,disambiguation_year,hard,fts,Rozlíš rok začiatku štúdia a rok práce osoby Lukáš Pokrývka.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2016/lukas_pokryvka/dp2021/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/dp2021""]"
|
||||
q0060,test,disambiguation_year,hard,vector,Rozlíš rok začiatku štúdia a rok práce osoby Lukáš Pokrývka.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/topics/legal/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/topics/legal""]"
|
||||
q0060,test,disambiguation_year,hard,hybrid,Rozlíš rok začiatku štúdia a rok práce osoby Lukáš Pokrývka.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/topics/legal/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/topics/legal""]"
|
||||
q0061,test,adversarial_year,hard,fts,Je rok 2016 rokom záverečnej práce osoby Lukáš Pokrývka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2016/lukas_pokryvka/dp2021/README.md"", ""pages/topics/faq/README.md"", ""pages/topics/spacy/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/dp2021"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/topics/spacy""]"
|
||||
q0061,test,adversarial_year,hard,vector,Je rok 2016 rokom záverečnej práce osoby Lukáš Pokrývka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak""]"
|
||||
q0061,test,adversarial_year,hard,hybrid,Je rok 2016 rokom záverečnej práce osoby Lukáš Pokrývka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/topics/faq/README.md"", ""pages/topics/akopisat/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q0062,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou PyTorch a osobou Lukáš Pokrývka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2016/lukas_pokryvka/dp2021/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2018/ondrej_megela/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]"
|
||||
q0062,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou PyTorch a osobou Lukáš Pokrývka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q0062,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou PyTorch a osobou Lukáš Pokrývka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q0063,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou NCCL a osobou Lukáš Pokrývka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2016/lukas_pokryvka/dp2021/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/dp2021""]"
|
||||
q0063,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou NCCL a osobou Lukáš Pokrývka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/topics/question/nezodpovedatelne/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne""]"
|
||||
q0063,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou NCCL a osobou Lukáš Pokrývka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]"
|
||||
q0064,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou GPU a osobou Lukáš Pokrývka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2016/lukas_pokryvka/dp2021/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/dp2021""]"
|
||||
q0064,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou GPU a osobou Lukáš Pokrývka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]"
|
||||
q0064,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou GPU a osobou Lukáš Pokrývka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q0065,test,specific_fact,medium,fts,Aký dataset používal Lukáš Pokrývka pri experimentoch s detekciou rakoviny pľúc?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2016/lukas_pokryvka/dp2021/README.md"", ""pages/topics/spacy/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/dp2021"", ""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0065,test,specific_fact,medium,vector,Aký dataset používal Lukáš Pokrývka pri experimentoch s detekciou rakoviny pľúc?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q0065,test,specific_fact,medium,hybrid,Aký dataset používal Lukáš Pokrývka pri experimentoch s detekciou rakoviny pľúc?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]"
|
||||
q0066,test,specific_fact,medium,fts,Aký backend použil Lukáš Pokrývka pri trénovaní na dvoch strojoch?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2016/lukas_pokryvka/dp2021/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2018/ondrej_megela/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]"
|
||||
q0066,test,specific_fact,medium,vector,Aký backend použil Lukáš Pokrývka pri trénovaní na dvoch strojoch?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0066,test,specific_fact,medium,hybrid,Aký backend použil Lukáš Pokrývka pri trénovaní na dvoch strojoch?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/lukas_pokryvka/README.md""]","[""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md"", ""pages/students/2022/andrii_pervashov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]"
|
||||
q0067,test,entity_lookup,easy,fts,Nájdi dokument o osobe Dárius Lindvai.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md"", ""pages/students/2016/darius_lindvai/dp2021/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0067,test,entity_lookup,easy,vector,Nájdi dokument o osobe Dárius Lindvai.,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/adrian_remias/README.md"", ""pages/students/2018/david_ilas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_ilas""]"
|
||||
q0067,test,entity_lookup,easy,hybrid,Nájdi dokument o osobe Dárius Lindvai.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/adrian_remias/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias""]"
|
||||
q0068,test,fact_title,easy,fts,Aký je názov diplomová práca osoby Dárius Lindvai?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/students/2016/darius_lindvai/dp2021/README.md"", ""pages/students/2020/matus_suchanic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""]"
|
||||
q0068,test,fact_title,easy,vector,Aký je názov diplomová práca osoby Dárius Lindvai?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/mark_feher/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2018/david_omasta/README.md"", ""pages/students/2018/david_ilas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_ilas""]"
|
||||
q0068,test,fact_title,easy,hybrid,Aký je názov diplomová práca osoby Dárius Lindvai?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/mark_feher/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2018/david_omasta/README.md"", ""pages/students/2018/david_ilas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_ilas""]"
|
||||
q0069,test,reverse_lookup,medium,fts,Kto sa venuje práci s názvom „Obnovenie interpunkcie pomocou hlbokých neurónových sietí“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/topics/steel/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md"", ""pages/students/2016/patrik_pavlisin/tp20/README.md"", ""pages/students/2020/matus_suchanic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/topics/steel"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/tp20"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""]"
|
||||
q0069,test,reverse_lookup,medium,vector,Kto sa venuje práci s názvom „Obnovenie interpunkcie pomocou hlbokých neurónových sietí“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2018/adrian_remias/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2017/stanislav_matsunych/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2017/stanislav_matsunych""]"
|
||||
q0069,test,reverse_lookup,medium,hybrid,Kto sa venuje práci s názvom „Obnovenie interpunkcie pomocou hlbokých neurónových sietí“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2018/adrian_remias/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/students/2017/stanislav_matsunych/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/students/2017/stanislav_matsunych""]"
|
||||
q0070,test,topic_lookup,medium,fts,"Nájdi študenta alebo dokument, ktorý rieši tému „Obnovenie interpunkcie pomocou hlbokých neurónových sietí“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/topics/steel/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/topics/steel"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]"
|
||||
q0070,test,topic_lookup,medium,vector,"Nájdi študenta alebo dokument, ktorý rieši tému „Obnovenie interpunkcie pomocou hlbokých neurónových sietí“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2018/adrian_remias/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/topics/otvorene/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene""]"
|
||||
q0070,test,topic_lookup,medium,hybrid,"Nájdi študenta alebo dokument, ktorý rieši tému „Obnovenie interpunkcie pomocou hlbokých neurónových sietí“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2018/adrian_remias/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2017/stanislav_matsunych/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2017/stanislav_matsunych""]"
|
||||
q0071,test,paraphrase,medium,fts,O čom je práca osoby Dárius Lindvai?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/students/2016/darius_lindvai/dp2021/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0071,test,paraphrase,medium,vector,O čom je práca osoby Dárius Lindvai?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]"
|
||||
q0071,test,paraphrase,medium,hybrid,O čom je práca osoby Dárius Lindvai?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]"
|
||||
q0072,test,fact_start_year,easy,fts,V ktorom roku začal študovať Dárius Lindvai?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md"", ""pages/students/2016/darius_lindvai/dp2021/README.md"", ""pages/students/2021/eduard_matovka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka""]"
|
||||
q0072,test,fact_start_year,easy,vector,V ktorom roku začal študovať Dárius Lindvai?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2020/david_kostilnik/README.md"", ""pages/students/2018/david_ilas/README.md"", ""pages/students/2017/dmytro_ushatenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_ilas"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko""]"
|
||||
q0072,test,fact_start_year,easy,hybrid,V ktorom roku začal študovať Dárius Lindvai?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2020/david_kostilnik/README.md"", ""pages/students/2018/david_ilas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_ilas""]"
|
||||
q0073,test,verification,medium,fts,Je pri osobe Dárius Lindvai uvedený rok začiatku štúdia 2016?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/students/2016/darius_lindvai/dp2021/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]"
|
||||
q0073,test,verification,medium,vector,Je pri osobe Dárius Lindvai uvedený rok začiatku štúdia 2016?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2018/david_ilas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_ilas""]"
|
||||
q0073,test,verification,medium,hybrid,Je pri osobe Dárius Lindvai uvedený rok začiatku štúdia 2016?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2018/ondrej_megela/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]"
|
||||
q0074,test,fact_work_year,easy,fts,V ktorom roku je pri osobe Dárius Lindvai uvedená diplomová práca?,2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md"", ""pages/students/2016/darius_lindvai/dp2021/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0074,test,fact_work_year,easy,vector,V ktorom roku je pri osobe Dárius Lindvai uvedená diplomová práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/mark_feher/README.md"", ""pages/students/2018/david_omasta/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]"
|
||||
q0074,test,fact_work_year,easy,hybrid,V ktorom roku je pri osobe Dárius Lindvai uvedená diplomová práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/mark_feher/README.md"", ""pages/students/2018/david_omasta/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]"
|
||||
q0075,test,disambiguation_year,hard,fts,Rozlíš rok začiatku štúdia a rok práce osoby Dárius Lindvai.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/darius_lindvai/dp2021/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]"
|
||||
q0075,test,disambiguation_year,hard,vector,Rozlíš rok začiatku štúdia a rok práce osoby Dárius Lindvai.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/david_ilas/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_ilas"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0075,test,disambiguation_year,hard,hybrid,Rozlíš rok začiatku štúdia a rok práce osoby Dárius Lindvai.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/david_ilas/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_ilas"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0076,test,adversarial_year,hard,fts,Je rok 2016 rokom záverečnej práce osoby Dárius Lindvai?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/students/2016/darius_lindvai/dp2021/README.md"", ""pages/topics/faq/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/dp2021"", ""https://zp.kemt.fei.tuke.sk/topics/faq""]"
|
||||
q0076,test,adversarial_year,hard,vector,Je rok 2016 rokom záverečnej práce osoby Dárius Lindvai?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0076,test,adversarial_year,hard,hybrid,Je rok 2016 rokom záverečnej práce osoby Dárius Lindvai?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/topics/faq/README.md"", ""pages/topics/akopisat/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]"
|
||||
q0077,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou interpunkcia a osobou Dárius Lindvai?,2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md"", ""pages/students/2016/darius_lindvai/dp2021/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0077,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou interpunkcia a osobou Dárius Lindvai?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2018/david_omasta/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0077,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou interpunkcia a osobou Dárius Lindvai?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]"
|
||||
q0078,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou BiLSTM a osobou Dárius Lindvai?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md"", ""pages/students/2016/darius_lindvai/dp2021/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0078,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou BiLSTM a osobou Dárius Lindvai?,2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2018/david_omasta/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]"
|
||||
q0078,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou BiLSTM a osobou Dárius Lindvai?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2018/david_omasta/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]"
|
||||
q0079,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou CRF a osobou Dárius Lindvai?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md"", ""pages/students/2016/darius_lindvai/dp2021/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0079,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou CRF a osobou Dárius Lindvai?,2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/topics/faq/README.md"", ""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0079,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou CRF a osobou Dárius Lindvai?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0080,test,specific_fact,medium,fts,Akú architektúru Dárius Lindvai trénoval pri obnove interpunkcie?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md"", ""pages/students/2016/darius_lindvai/dp2021/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]"
|
||||
q0080,test,specific_fact,medium,vector,Akú architektúru Dárius Lindvai trénoval pri obnove interpunkcie?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/students/2018/adrian_remias/README.md"", ""pages/students/2022/andrii_pervashov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]"
|
||||
q0080,test,specific_fact,medium,hybrid,Akú architektúru Dárius Lindvai trénoval pri obnove interpunkcie?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/students/2018/adrian_remias/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2022/andrii_pervashov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]"
|
||||
q0081,test,specific_fact,medium,fts,Akými metrikami mal Dárius Lindvai vyhodnocovať model pre jednotlivé triedy?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md"", ""pages/students/2016/darius_lindvai/dp2021/README.md"", ""pages/students/2022/daniil_huzenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""]"
|
||||
q0081,test,specific_fact,medium,vector,Akými metrikami mal Dárius Lindvai vyhodnocovať model pre jednotlivé triedy?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2020/david_kostilnik/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2021/artur_hyrenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko""]"
|
||||
q0081,test,specific_fact,medium,hybrid,Akými metrikami mal Dárius Lindvai vyhodnocovať model pre jednotlivé triedy?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/darius_lindvai/README.md""]","[""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2020/david_kostilnik/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2021/artur_hyrenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko""]"
|
||||
q0093,test,entity_lookup,easy,fts,Nájdi dokument o osobe Márk Fehér.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2019/david_stromp/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0093,test,entity_lookup,easy,vector,Nájdi dokument o osobe Márk Fehér.,2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2016/mark_feher/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0093,test,entity_lookup,easy,hybrid,Nájdi dokument o osobe Márk Fehér.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0094,test,fact_title,easy,fts,Aký je názov diplomová práca osoby Márk Fehér?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]"
|
||||
q0094,test,fact_title,easy,vector,Aký je názov diplomová práca osoby Márk Fehér?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2020/david_kostilnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik""]"
|
||||
q0094,test,fact_title,easy,hybrid,Aký je názov diplomová práca osoby Márk Fehér?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0095,test,reverse_lookup,medium,fts,Kto sa venuje práci s názvom „Klasifikácia textu metódami strojového učenia“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2016/patrik_pavlisin/dp21/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp21""]"
|
||||
q0095,test,reverse_lookup,medium,vector,Kto sa venuje práci s názvom „Klasifikácia textu metódami strojového učenia“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]"
|
||||
q0095,test,reverse_lookup,medium,hybrid,Kto sa venuje práci s názvom „Klasifikácia textu metódami strojového učenia“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]"
|
||||
q0096,test,topic_lookup,medium,fts,"Nájdi študenta alebo dokument, ktorý rieši tému „Klasifikácia textu metódami strojového učenia“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2016/patrik_pavlisin/tp20/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/tp20"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0096,test,topic_lookup,medium,vector,"Nájdi študenta alebo dokument, ktorý rieši tému „Klasifikácia textu metódami strojového učenia“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0096,test,topic_lookup,medium,hybrid,"Nájdi študenta alebo dokument, ktorý rieši tému „Klasifikácia textu metódami strojového učenia“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q0097,test,paraphrase,medium,fts,O čom je práca osoby Márk Fehér?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/ediz_morochovic/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]"
|
||||
q0097,test,paraphrase,medium,vector,O čom je práca osoby Márk Fehér?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2020/david_kostilnik/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0097,test,paraphrase,medium,hybrid,O čom je práca osoby Márk Fehér?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2020/david_kostilnik/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q0098,test,fact_work_year,easy,fts,V ktorom roku je pri osobe Márk Fehér uvedená diplomová práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2018/david_omasta/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers""]"
|
||||
q0098,test,fact_work_year,easy,vector,V ktorom roku je pri osobe Márk Fehér uvedená diplomová práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/dominik_nagy/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy""]"
|
||||
q0098,test,fact_work_year,easy,hybrid,V ktorom roku je pri osobe Márk Fehér uvedená diplomová práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0099,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou klasifikácia textu a osobou Márk Fehér?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0099,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou klasifikácia textu a osobou Márk Fehér?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0099,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou klasifikácia textu a osobou Márk Fehér?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0100,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou strojové učenie a osobou Márk Fehér?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/patrik_pavlisin/dp21/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp21"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt""]"
|
||||
q0100,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou strojové učenie a osobou Márk Fehér?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]"
|
||||
q0100,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou strojové učenie a osobou Márk Fehér?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0101,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou scikit a osobou Márk Fehér?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0101,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou scikit a osobou Márk Fehér?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0101,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou scikit a osobou Márk Fehér?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2016/mark_feher/README.md""]","[""pages/students/2016/mark_feher/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0112,test,entity_lookup,easy,fts,Nájdi dokument o osobe Dmytro Ushatenko.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2019/dmytro_mural/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2019/david_stromp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp""]"
|
||||
q0112,test,entity_lookup,easy,vector,Nájdi dokument o osobe Dmytro Ushatenko.,3,0.333333,0,1,1,0.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/interns/oliver_pejic/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q0112,test,entity_lookup,easy,hybrid,Nájdi dokument o osobe Dmytro Ushatenko.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/interns/oliver_pejic/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0113,test,fact_title,easy,fts,Aký je názov bakalárska práca osoby Dmytro Ushatenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2019/dmytro_mural/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0113,test,fact_title,easy,vector,Aký je názov bakalárska práca osoby Dmytro Ushatenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2019/dmytro_mural/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2020/matus_suchanic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""]"
|
||||
q0113,test,fact_title,easy,hybrid,Aký je názov bakalárska práca osoby Dmytro Ushatenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2019/dmytro_mural/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]"
|
||||
q0114,test,reverse_lookup,medium,fts,Kto sa venuje práci s názvom „Jednoduchý chatbot v jazyku Python“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas""]"
|
||||
q0114,test,reverse_lookup,medium,vector,Kto sa venuje práci s názvom „Jednoduchý chatbot v jazyku Python“?,5,0.2,0,0,1,0.0,0.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2017/dmytro_ushatenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko""]"
|
||||
q0114,test,reverse_lookup,medium,hybrid,Kto sa venuje práci s názvom „Jednoduchý chatbot v jazyku Python“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0115,test,topic_lookup,medium,fts,"Nájdi študenta alebo dokument, ktorý rieši tému „Jednoduchý chatbot v jazyku Python“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2019/samuel_horani/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani""]"
|
||||
q0115,test,topic_lookup,medium,vector,"Nájdi študenta alebo dokument, ktorý rieši tému „Jednoduchý chatbot v jazyku Python“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2019/samuel_horani/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani""]"
|
||||
q0115,test,topic_lookup,medium,hybrid,"Nájdi študenta alebo dokument, ktorý rieši tému „Jednoduchý chatbot v jazyku Python“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2019/samuel_horani/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani""]"
|
||||
q0116,test,paraphrase,medium,fts,O čom je práca osoby Dmytro Ushatenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2019/dmytro_mural/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0116,test,paraphrase,medium,vector,O čom je práca osoby Dmytro Ushatenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q0116,test,paraphrase,medium,hybrid,O čom je práca osoby Dmytro Ushatenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2019/dmytro_mural/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0117,test,fact_work_year,easy,fts,V ktorom roku je pri osobe Dmytro Ushatenko uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2019/dmytro_mural/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers""]"
|
||||
q0117,test,fact_work_year,easy,vector,V ktorom roku je pri osobe Dmytro Ushatenko uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2019/dmytro_mural/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/matus_suchanic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""]"
|
||||
q0117,test,fact_work_year,easy,hybrid,V ktorom roku je pri osobe Dmytro Ushatenko uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2019/dmytro_mural/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/matus_suchanic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""]"
|
||||
q0118,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou chatbot a osobou Dmytro Ushatenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2019/dmytro_mural/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0118,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou chatbot a osobou Dmytro Ushatenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/artur_hyrenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko""]"
|
||||
q0118,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou chatbot a osobou Dmytro Ushatenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0119,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou Python a osobou Dmytro Ushatenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2019/dmytro_mural/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0119,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou Python a osobou Dmytro Ushatenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2018/oleh_bilykh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""]"
|
||||
q0119,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou Python a osobou Dmytro Ushatenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0120,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou dialógový systém a osobou Dmytro Ushatenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2019/dmytro_mural/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0120,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou dialógový systém a osobou Dmytro Ushatenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]"
|
||||
q0120,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou dialógový systém a osobou Dmytro Ushatenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/topics/faq/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/topics/faq""]"
|
||||
q0121,test,specific_fact,medium,fts,O čom mal informovať chatbot Dmytra Ushatenka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0121,test,specific_fact,medium,vector,O čom mal informovať chatbot Dmytra Ushatenka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2021/artur_hyrenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko""]"
|
||||
q0121,test,specific_fact,medium,hybrid,O čom mal informovať chatbot Dmytra Ushatenka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2017/dmytro_ushatenko/README.md""]","[""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0132,test,entity_lookup,easy,fts,Nájdi dokument o osobe Martin Wencel.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/topics/spacy/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0132,test,entity_lookup,easy,vector,Nájdi dokument o osobe Martin Wencel.,2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]"
|
||||
q0132,test,entity_lookup,easy,hybrid,Nájdi dokument o osobe Martin Wencel.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q0133,test,fact_title,easy,fts,Aký je názov bakalárska práca osoby Martin Wencel?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/topics/spacy/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]"
|
||||
q0133,test,fact_title,easy,vector,Aký je názov bakalárska práca osoby Martin Wencel?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]"
|
||||
q0133,test,fact_title,easy,hybrid,Aký je názov bakalárska práca osoby Martin Wencel?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0134,test,reverse_lookup,medium,fts,Kto sa venuje práci s názvom „Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2018/NaN1name_buday/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday""]"
|
||||
q0134,test,reverse_lookup,medium,vector,Kto sa venuje práci s názvom „Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/topics/spacy/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/jakub_maruniak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""]"
|
||||
q0134,test,reverse_lookup,medium,hybrid,Kto sa venuje práci s názvom „Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/topics/spacy/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/jakub_maruniak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""]"
|
||||
q0135,test,topic_lookup,medium,fts,"Nájdi študenta alebo dokument, ktorý rieši tému „Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2018/NaN1name_buday/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday""]"
|
||||
q0135,test,topic_lookup,medium,vector,"Nájdi študenta alebo dokument, ktorý rieši tému „Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy“.",2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/topics/spacy/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2016/jakub_maruniak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""]"
|
||||
q0135,test,topic_lookup,medium,hybrid,"Nájdi študenta alebo dokument, ktorý rieši tému „Demonštrácia spracovania slovenského prirodzeného jazyka pomocou knižnice Spacy“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/topics/spacy/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]"
|
||||
q0136,test,paraphrase,medium,fts,O čom je práca osoby Martin Wencel?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/topics/spacy/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]"
|
||||
q0136,test,paraphrase,medium,vector,O čom je práca osoby Martin Wencel?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/kamil_tomcufcik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/kamil_tomcufcik""]"
|
||||
q0136,test,paraphrase,medium,hybrid,O čom je práca osoby Martin Wencel?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0137,test,fact_work_year,easy,fts,V ktorom roku je pri osobe Martin Wencel uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/topics/spacy/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0137,test,fact_work_year,easy,vector,V ktorom roku je pri osobe Martin Wencel uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2016/ediz_morochovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic""]"
|
||||
q0137,test,fact_work_year,easy,hybrid,V ktorom roku je pri osobe Martin Wencel uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0138,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou Spacy a osobou Martin Wencel?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/topics/spacy/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]"
|
||||
q0138,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou Spacy a osobou Martin Wencel?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/topics/spacy/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0138,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou Spacy a osobou Martin Wencel?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/topics/spacy/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0139,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou morfologická analýza a osobou Martin Wencel?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/topics/morphology/README.md"", ""pages/topics/otvorene/README.md"", ""pages/topics/spacy/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/topics/morphology"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/topics/spacy""]"
|
||||
q0139,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou morfologická analýza a osobou Martin Wencel?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/topics/morphology/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2020/kamil_tomcufcik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/topics/morphology"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2020/kamil_tomcufcik""]"
|
||||
q0139,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou morfologická analýza a osobou Martin Wencel?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/topics/morphology/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/topics/morphology"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0140,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou pomenované entity a osobou Martin Wencel?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/topics/named-entity/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/topics/spacy/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/topics/named-entity"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/topics/spacy""]"
|
||||
q0140,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou pomenované entity a osobou Martin Wencel?,2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2016/ediz_morochovic/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2020/kamil_tomcufcik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2020/kamil_tomcufcik""]"
|
||||
q0140,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou pomenované entity a osobou Martin Wencel?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/topics/named-entity/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/topics/named-entity"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]"
|
||||
q0141,test,specific_fact,medium,fts,Aké tri NLP úlohy mal Martin Wencel vysvetliť v práci?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/topics/spacy/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]"
|
||||
q0141,test,specific_fact,medium,vector,Aké tri NLP úlohy mal Martin Wencel vysvetliť v práci?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2018/oleh_bilykh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""]"
|
||||
q0141,test,specific_fact,medium,hybrid,Aké tri NLP úlohy mal Martin Wencel vysvetliť v práci?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2018/martin_wencel/README.md""]","[""pages/students/2018/martin_wencel/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]"
|
||||
q0153,test,entity_lookup,easy,fts,Nájdi dokument o osobe Filip Tomáš.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2019/david_stromp/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0153,test,entity_lookup,easy,vector,Nájdi dokument o osobe Filip Tomáš.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/interns/yussef_ressaissi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi""]"
|
||||
q0153,test,entity_lookup,easy,hybrid,Nájdi dokument o osobe Filip Tomáš.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/interns/yussef_ressaissi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi""]"
|
||||
q0154,test,fact_title,easy,fts,Aký je názov bakalárska práca osoby Filip Tomáš?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/jakub_maruniak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""]"
|
||||
q0154,test,fact_title,easy,vector,Aký je názov bakalárska práca osoby Filip Tomáš?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/david_stromp/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]"
|
||||
q0154,test,fact_title,easy,hybrid,Aký je názov bakalárska práca osoby Filip Tomáš?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2019/david_stromp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp""]"
|
||||
q0155,test,reverse_lookup,medium,fts,Kto sa venuje práci s názvom „Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0155,test,reverse_lookup,medium,vector,Kto sa venuje práci s názvom „Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2017/than_trung_thanh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh""]"
|
||||
q0155,test,reverse_lookup,medium,hybrid,Kto sa venuje práci s názvom „Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2018/oleh_bilykh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""]"
|
||||
q0156,test,topic_lookup,medium,fts,"Nájdi študenta alebo dokument, ktorý rieši tému „Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/topics/steel/README.md"", ""pages/topics/faq/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/topics/steel"", ""https://zp.kemt.fei.tuke.sk/topics/faq""]"
|
||||
q0156,test,topic_lookup,medium,vector,"Nájdi študenta alebo dokument, ktorý rieši tému „Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/annotation/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021/annotation""]"
|
||||
q0156,test,topic_lookup,medium,hybrid,"Nájdi študenta alebo dokument, ktorý rieši tému „Aplikačné testy v systémoch kontinuálnej integrácie a nasadenia“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0157,test,paraphrase,medium,fts,O čom je práca osoby Filip Tomáš?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/topics/question/README.md"", ""pages/students/2023/denis_le_thanh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/topics/question"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""]"
|
||||
q0157,test,paraphrase,medium,vector,O čom je práca osoby Filip Tomáš?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2020/matus_suchanic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""]"
|
||||
q0157,test,paraphrase,medium,hybrid,O čom je práca osoby Filip Tomáš?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2020/matus_suchanic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""]"
|
||||
q0158,test,fact_work_year,easy,fts,V ktorom roku je pri osobe Filip Tomáš uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/topics/faq/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/topics/faq""]"
|
||||
q0158,test,fact_work_year,easy,vector,V ktorom roku je pri osobe Filip Tomáš uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2019/david_stromp/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0158,test,fact_work_year,easy,hybrid,V ktorom roku je pri osobe Filip Tomáš uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2019/david_stromp/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0159,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou CI/CD a osobou Filip Tomáš?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0159,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou CI/CD a osobou Filip Tomáš?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2018/oleh_bilykh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""]"
|
||||
q0159,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou CI/CD a osobou Filip Tomáš?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2018/oleh_bilykh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""]"
|
||||
q0160,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou Docker Compose a osobou Filip Tomáš?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0160,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou Docker Compose a osobou Filip Tomáš?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2018/samuel_sirotnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik""]"
|
||||
q0160,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou Docker Compose a osobou Filip Tomáš?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2018/samuel_sirotnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik""]"
|
||||
q0161,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou microk8s a osobou Filip Tomáš?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0161,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou microk8s a osobou Filip Tomáš?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2018/samuel_sirotnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik""]"
|
||||
q0161,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou microk8s a osobou Filip Tomáš?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2018/samuel_sirotnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik""]"
|
||||
q0162,test,specific_fact,medium,fts,Aký systém pre orchestráciu klastra mal Filip Tomáš skúmať?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/topics/bert/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/topics/bert""]"
|
||||
q0162,test,specific_fact,medium,vector,Aký systém pre orchestráciu klastra mal Filip Tomáš skúmať?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2019/david_stromp/README.md"", ""pages/students/2018/samuel_sirotnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik""]"
|
||||
q0162,test,specific_fact,medium,hybrid,Aký systém pre orchestráciu klastra mal Filip Tomáš skúmať?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2019/david_stromp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp""]"
|
||||
q0163,test,specific_fact,medium,fts,Koľko jednotiek Raspberry Pi 4 mal Filip Tomáš k dispozícii pri návrhu klastra?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/topics/python/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/topics/python""]"
|
||||
q0163,test,specific_fact,medium,vector,Koľko jednotiek Raspberry Pi 4 mal Filip Tomáš k dispozícii pri návrhu klastra?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2019/david_stromp/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q0163,test,specific_fact,medium,hybrid,Koľko jednotiek Raspberry Pi 4 mal Filip Tomáš k dispozícii pri návrhu klastra?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/filip_tomas/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2019/david_stromp/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q0185,test,entity_lookup,easy,fts,Nájdi dokument o osobe Alina Vitko.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2019/david_stromp/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0185,test,entity_lookup,easy,vector,Nájdi dokument o osobe Alina Vitko.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2018/adrian_remias/README.md"", ""pages/interns/sevval_bulburu/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu""]"
|
||||
q0185,test,entity_lookup,easy,hybrid,Nájdi dokument o osobe Alina Vitko.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0186,test,fact_title,easy,fts,Aký je názov bakalárska práca osoby Alina Vitko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0186,test,fact_title,easy,vector,Aký je názov bakalárska práca osoby Alina Vitko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q0186,test,fact_title,easy,hybrid,Aký je názov bakalárska práca osoby Alina Vitko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2017/dmytro_ushatenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko""]"
|
||||
q0187,test,reverse_lookup,medium,fts,Kto sa venuje práci s názvom „Systémy pre generovanie odpovede na otázku v prirodzenom jazyku“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/topics/otvorene/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/topics/question/nezodpovedatelne/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne""]"
|
||||
q0187,test,reverse_lookup,medium,vector,Kto sa venuje práci s názvom „Systémy pre generovanie odpovede na otázku v prirodzenom jazyku“?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2017/stanislav_matsunych/README.md"", ""pages/topics/question/nezodpovedatelne/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2018/ondrej_megela/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2017/stanislav_matsunych"", ""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]"
|
||||
q0187,test,reverse_lookup,medium,hybrid,Kto sa venuje práci s názvom „Systémy pre generovanie odpovede na otázku v prirodzenom jazyku“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/topics/question/nezodpovedatelne/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/topics/otvorene/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene""]"
|
||||
q0188,test,topic_lookup,medium,fts,"Nájdi študenta alebo dokument, ktorý rieši tému „Systémy pre generovanie odpovede na otázku v prirodzenom jazyku“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/topics/otvorene/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/topics/question/nezodpovedatelne/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne""]"
|
||||
q0188,test,topic_lookup,medium,vector,"Nájdi študenta alebo dokument, ktorý rieši tému „Systémy pre generovanie odpovede na otázku v prirodzenom jazyku“.",,0.0,0,0,0,0.0,0.0,0.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/topics/question/nezodpovedatelne/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/topics/otvorene/README.md"", ""pages/topics/question/validacie/README.md"", ""pages/students/2017/stanislav_matsunych/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/topics/question/validacie"", ""https://zp.kemt.fei.tuke.sk/students/2017/stanislav_matsunych""]"
|
||||
q0188,test,topic_lookup,medium,hybrid,"Nájdi študenta alebo dokument, ktorý rieši tému „Systémy pre generovanie odpovede na otázku v prirodzenom jazyku“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/topics/question/nezodpovedatelne/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/topics/otvorene/README.md"", ""pages/topics/question/validacie/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/topics/question/validacie""]"
|
||||
q0189,test,paraphrase,medium,fts,O čom je práca osoby Alina Vitko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0189,test,paraphrase,medium,vector,O čom je práca osoby Alina Vitko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]"
|
||||
q0189,test,paraphrase,medium,hybrid,O čom je práca osoby Alina Vitko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]"
|
||||
q0190,test,fact_start_year,easy,fts,V ktorom roku začal študovať Alina Vitko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0190,test,fact_start_year,easy,vector,V ktorom roku začal študovať Alina Vitko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2021/nikita_bodnar/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/david_kostilnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik""]"
|
||||
q0190,test,fact_start_year,easy,hybrid,V ktorom roku začal študovať Alina Vitko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2021/nikita_bodnar/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0191,test,verification,medium,fts,Je pri osobe Alina Vitko uvedený rok začiatku štúdia 2019?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]"
|
||||
q0191,test,verification,medium,vector,Je pri osobe Alina Vitko uvedený rok začiatku štúdia 2019?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]"
|
||||
q0191,test,verification,medium,hybrid,Je pri osobe Alina Vitko uvedený rok začiatku štúdia 2019?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]"
|
||||
q0192,test,fact_work_year,easy,fts,V ktorom roku je pri osobe Alina Vitko uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/patrik_pavlisin/tp20/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/tp20""]"
|
||||
q0192,test,fact_work_year,easy,vector,V ktorom roku je pri osobe Alina Vitko uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0192,test,fact_work_year,easy,hybrid,V ktorom roku je pri osobe Alina Vitko uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0193,test,disambiguation_year,hard,fts,Rozlíš rok začiatku štúdia a rok práce osoby Alina Vitko.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2016/ediz_morochovic/README.md"", ""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]"
|
||||
q0193,test,disambiguation_year,hard,vector,Rozlíš rok začiatku štúdia a rok práce osoby Alina Vitko.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]"
|
||||
q0193,test,disambiguation_year,hard,hybrid,Rozlíš rok začiatku štúdia a rok práce osoby Alina Vitko.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]"
|
||||
q0194,test,adversarial_year,hard,fts,Je rok 2019 rokom záverečnej práce osoby Alina Vitko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/topics/faq/README.md"", ""pages/topics/akopisat/README.md"", ""pages/students/2019/dmytro_mural/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]"
|
||||
q0194,test,adversarial_year,hard,vector,Je rok 2019 rokom záverečnej práce osoby Alina Vitko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/topics/akopisat/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0194,test,adversarial_year,hard,hybrid,Je rok 2019 rokom záverečnej práce osoby Alina Vitko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/topics/akopisat/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0195,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou Question Answering a osobou Alina Vitko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/topics/question/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2018/david_omasta/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/topics/question"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]"
|
||||
q0195,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou Question Answering a osobou Alina Vitko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/topics/question/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/topics/question/navod/README.md"", ""pages/topics/question/nezodpovedatelne/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/topics/question"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/topics/question/navod"", ""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne""]"
|
||||
q0195,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou Question Answering a osobou Alina Vitko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/topics/question/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/topics/question/nezodpovedatelne/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/topics/question"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne""]"
|
||||
q0196,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou Streamlit a osobou Alina Vitko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0196,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou Streamlit a osobou Alina Vitko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/annotation/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021/annotation""]"
|
||||
q0196,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou Streamlit a osobou Alina Vitko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/annotation/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021/annotation"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]"
|
||||
q0197,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou Docker a osobou Alina Vitko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]"
|
||||
q0197,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou Docker a osobou Alina Vitko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0197,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou Docker a osobou Alina Vitko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/topics/faq/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/topics/faq""]"
|
||||
q0198,test,specific_fact,medium,fts,Aké webové rozhranie mala Alina Vitko použiť pre demo aplikáciu?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2018/oleh_bilykh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""]"
|
||||
q0198,test,specific_fact,medium,vector,Aké webové rozhranie mala Alina Vitko použiť pre demo aplikáciu?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/topics/faq/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/topics/faq""]"
|
||||
q0198,test,specific_fact,medium,hybrid,Aké webové rozhranie mala Alina Vitko použiť pre demo aplikáciu?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]"
|
||||
q0199,test,specific_fact,medium,fts,Aký slovenský model mala Alina Vitko vyskúšať podľa zadania?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/students/2018/ondrej_megela/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]"
|
||||
q0199,test,specific_fact,medium,vector,Aký slovenský model mala Alina Vitko vyskúšať podľa zadania?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/topics/bert/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/topics/bert"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]"
|
||||
q0199,test,specific_fact,medium,hybrid,Aký slovenský model mala Alina Vitko vyskúšať podľa zadania?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2019/alina_vitko/README.md""]","[""pages/students/2019/alina_vitko/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/topics/bert/README.md"", ""pages/students/2021/nikita_bodnar/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/topics/bert"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar""]"
|
||||
q0214,test,entity_lookup,easy,fts,Nájdi dokument o osobe Martin Šarišský.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/topics/chatbot/README.md"", ""pages/topics/legal/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/topics/legal"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0214,test,entity_lookup,easy,vector,Nájdi dokument o osobe Martin Šarišský.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/interns/sevval_bulburu/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu""]"
|
||||
q0214,test,entity_lookup,easy,hybrid,Nájdi dokument o osobe Martin Šarišský.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/interns/sevval_bulburu/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu""]"
|
||||
q0215,test,fact_title,easy,fts,Aký je názov diplomová práca osoby Martin Šarišský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2020/matus_suchanic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""]"
|
||||
q0215,test,fact_title,easy,vector,Aký je názov diplomová práca osoby Martin Šarišský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/mark_feher/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher""]"
|
||||
q0215,test,fact_title,easy,hybrid,Aký je názov diplomová práca osoby Martin Šarišský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/mark_feher/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]"
|
||||
q0216,test,reverse_lookup,medium,fts,Kto sa venuje práci s názvom „Agentové systémy pomocou veľkého jazykového modelu“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2019/david_stromp/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0216,test,reverse_lookup,medium,vector,Kto sa venuje práci s názvom „Agentové systémy pomocou veľkého jazykového modelu“?,2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2020/kamil_tomcufcik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2020/kamil_tomcufcik""]"
|
||||
q0216,test,reverse_lookup,medium,hybrid,Kto sa venuje práci s názvom „Agentové systémy pomocou veľkého jazykového modelu“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2020/kamil_tomcufcik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/kamil_tomcufcik""]"
|
||||
q0217,test,topic_lookup,medium,fts,"Nájdi študenta alebo dokument, ktorý rieši tému „Agentové systémy pomocou veľkého jazykového modelu“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2019/david_stromp/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2021/artur_hyrenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko""]"
|
||||
q0217,test,topic_lookup,medium,vector,"Nájdi študenta alebo dokument, ktorý rieši tému „Agentové systémy pomocou veľkého jazykového modelu“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2020/kamil_tomcufcik/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/kamil_tomcufcik"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q0217,test,topic_lookup,medium,hybrid,"Nájdi študenta alebo dokument, ktorý rieši tému „Agentové systémy pomocou veľkého jazykového modelu“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0218,test,paraphrase,medium,fts,O čom je práca osoby Martin Šarišský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2018/NaN1name_buday/README.md"", ""pages/topics/legal/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday"", ""https://zp.kemt.fei.tuke.sk/topics/legal""]"
|
||||
q0218,test,paraphrase,medium,vector,O čom je práca osoby Martin Šarišský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2018/NaN1name_buday/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]"
|
||||
q0218,test,paraphrase,medium,hybrid,O čom je práca osoby Martin Šarišský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2018/NaN1name_buday/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q0219,test,fact_start_year,easy,fts,V ktorom roku začal študovať Martin Šarišský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0219,test,fact_start_year,easy,vector,V ktorom roku začal študovať Martin Šarišský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2021/artur_hyrenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko""]"
|
||||
q0219,test,fact_start_year,easy,hybrid,V ktorom roku začal študovať Martin Šarišský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2018/martin_wencel/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]"
|
||||
q0220,test,verification,medium,fts,Je pri osobe Martin Šarišský uvedený rok začiatku štúdia 2021?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2018/NaN1name_buday/README.md"", ""pages/students/2018/martin_wencel/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]"
|
||||
q0220,test,verification,medium,vector,Je pri osobe Martin Šarišský uvedený rok začiatku štúdia 2021?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0220,test,verification,medium,hybrid,Je pri osobe Martin Šarišský uvedený rok začiatku štúdia 2021?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2018/NaN1name_buday/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0221,test,fact_work_year,easy,fts,V ktorom roku je pri osobe Martin Šarišský uvedená diplomová práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/topics/legal/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/topics/legal""]"
|
||||
q0221,test,fact_work_year,easy,vector,V ktorom roku je pri osobe Martin Šarišský uvedená diplomová práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0221,test,fact_work_year,easy,hybrid,V ktorom roku je pri osobe Martin Šarišský uvedená diplomová práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]"
|
||||
q0222,test,disambiguation_year,hard,fts,Rozlíš rok začiatku štúdia a rok práce osoby Martin Šarišský.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2018/NaN1name_buday/README.md"", ""pages/students/2018/martin_wencel/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]"
|
||||
q0222,test,disambiguation_year,hard,vector,Rozlíš rok začiatku štúdia a rok práce osoby Martin Šarišský.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q0222,test,disambiguation_year,hard,hybrid,Rozlíš rok začiatku štúdia a rok práce osoby Martin Šarišský.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q0223,test,adversarial_year,hard,fts,Je rok 2021 rokom záverečnej práce osoby Martin Šarišský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0223,test,adversarial_year,hard,vector,Je rok 2021 rokom záverečnej práce osoby Martin Šarišský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2018/martin_wencel/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]"
|
||||
q0223,test,adversarial_year,hard,hybrid,Je rok 2021 rokom záverečnej práce osoby Martin Šarišský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0224,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou agent a osobou Martin Šarišský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/topics/legal/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/topics/legal"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0224,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou agent a osobou Martin Šarišský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/topics/faq/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/topics/faq""]"
|
||||
q0224,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou agent a osobou Martin Šarišský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/topics/legal/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/topics/legal""]"
|
||||
q0225,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou právne informácie a osobou Martin Šarišský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/topics/legal/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/topics/legal""]"
|
||||
q0225,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou právne informácie a osobou Martin Šarišský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/topics/faq/README.md"", ""pages/topics/legal/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/topics/legal"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0225,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou právne informácie a osobou Martin Šarišský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/topics/legal/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/topics/legal"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]"
|
||||
q0226,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou DeepEval a osobou Martin Šarišský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]"
|
||||
q0226,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou DeepEval a osobou Martin Šarišský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0226,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou DeepEval a osobou Martin Šarišský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]"
|
||||
q0227,test,specific_fact,medium,fts,Aké tri metriky sa uvádzajú pri vyhodnotení systému Martina Šarišského?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2016/patrik_pavlisin/tp20/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/tp20"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0227,test,specific_fact,medium,vector,Aké tri metriky sa uvádzajú pri vyhodnotení systému Martina Šarišského?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0227,test,specific_fact,medium,hybrid,Aké tri metriky sa uvádzajú pri vyhodnotení systému Martina Šarišského?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2016/patrik_pavlisin/tp20/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/tp20"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0228,test,specific_fact,medium,fts,Aký parser mal Martin Šarišský zvážiť namiesto BeautifulSoup?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]"
|
||||
q0228,test,specific_fact,medium,vector,Aký parser mal Martin Šarišský zvážiť namiesto BeautifulSoup?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2018/NaN1name_buday/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]"
|
||||
q0228,test,specific_fact,medium,hybrid,Aký parser mal Martin Šarišský zvážiť namiesto BeautifulSoup?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/martin_sarissky/README.md""]","[""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2018/NaN1name_buday/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]"
|
||||
q0260,test,entity_lookup,easy,fts,Nájdi dokument o osobe Eduard Matovka.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2019/david_stromp/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0260,test,entity_lookup,easy,vector,Nájdi dokument o osobe Eduard Matovka.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/interns/oliver_pejic/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/interns/sevval_bulburu/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu""]"
|
||||
q0260,test,entity_lookup,easy,hybrid,Nájdi dokument o osobe Eduard Matovka.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/interns/oliver_pejic/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q0261,test,fact_title,easy,fts,Aký je názov bakalárska práca osoby Eduard Matovka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/jakub_maruniak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""]"
|
||||
q0261,test,fact_title,easy,vector,Aký je názov bakalárska práca osoby Eduard Matovka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2016/ediz_morochovic/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]"
|
||||
q0261,test,fact_title,easy,hybrid,Aký je názov bakalárska práca osoby Eduard Matovka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2016/ediz_morochovic/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q0262,test,reverse_lookup,medium,fts,Kto sa venuje práci s názvom „Slovenská konverzačná umelá inteligencia“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/topics/question/navod/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/topics/question/navod""]"
|
||||
q0262,test,reverse_lookup,medium,vector,Kto sa venuje práci s názvom „Slovenská konverzačná umelá inteligencia“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/topics/steel/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/topics/steel"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0262,test,reverse_lookup,medium,hybrid,Kto sa venuje práci s názvom „Slovenská konverzačná umelá inteligencia“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/topics/steel/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/topics/steel"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0263,test,topic_lookup,medium,fts,"Nájdi študenta alebo dokument, ktorý rieši tému „Slovenská konverzačná umelá inteligencia“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2016/patrik_pavlisin/dp21/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp21""]"
|
||||
q0263,test,topic_lookup,medium,vector,"Nájdi študenta alebo dokument, ktorý rieši tému „Slovenská konverzačná umelá inteligencia“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]"
|
||||
q0263,test,topic_lookup,medium,hybrid,"Nájdi študenta alebo dokument, ktorý rieši tému „Slovenská konverzačná umelá inteligencia“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/topics/steel/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/topics/steel""]"
|
||||
q0264,test,paraphrase,medium,fts,O čom je práca osoby Eduard Matovka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2020/pavol_hudak/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2020/pavol_hudak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0264,test,paraphrase,medium,vector,O čom je práca osoby Eduard Matovka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q0264,test,paraphrase,medium,hybrid,O čom je práca osoby Eduard Matovka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2016/ediz_morochovic/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0265,test,fact_start_year,easy,fts,V ktorom roku začal študovať Eduard Matovka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0265,test,fact_start_year,easy,vector,V ktorom roku začal študovať Eduard Matovka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2016/ediz_morochovic/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0265,test,fact_start_year,easy,hybrid,V ktorom roku začal študovať Eduard Matovka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2016/ediz_morochovic/README.md"", ""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0266,test,verification,medium,fts,Je pri osobe Eduard Matovka uvedený rok začiatku štúdia 2021?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas""]"
|
||||
q0266,test,verification,medium,vector,Je pri osobe Eduard Matovka uvedený rok začiatku štúdia 2021?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2018/martin_wencel/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]"
|
||||
q0266,test,verification,medium,hybrid,Je pri osobe Eduard Matovka uvedený rok začiatku štúdia 2021?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2020/matus_suchanic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""]"
|
||||
q0267,test,fact_work_year,easy,fts,V ktorom roku je pri osobe Eduard Matovka uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/topics/faq/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/topics/faq""]"
|
||||
q0267,test,fact_work_year,easy,vector,V ktorom roku je pri osobe Eduard Matovka uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2016/ediz_morochovic/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]"
|
||||
q0267,test,fact_work_year,easy,hybrid,V ktorom roku je pri osobe Eduard Matovka uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2016/ediz_morochovic/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q0268,test,disambiguation_year,hard,fts,Rozlíš rok začiatku štúdia a rok práce osoby Eduard Matovka.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2016/ediz_morochovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic""]"
|
||||
q0268,test,disambiguation_year,hard,vector,Rozlíš rok začiatku štúdia a rok práce osoby Eduard Matovka.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/ediz_morochovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic""]"
|
||||
q0268,test,disambiguation_year,hard,hybrid,Rozlíš rok začiatku štúdia a rok práce osoby Eduard Matovka.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/ediz_morochovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic""]"
|
||||
q0269,test,adversarial_year,hard,fts,Je rok 2021 rokom záverečnej práce osoby Eduard Matovka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/topics/faq/README.md"", ""pages/topics/akopisat/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0269,test,adversarial_year,hard,vector,Je rok 2021 rokom záverečnej práce osoby Eduard Matovka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q0269,test,adversarial_year,hard,hybrid,Je rok 2021 rokom záverečnej práce osoby Eduard Matovka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2020/matus_suchanic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""]"
|
||||
q0270,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou slovenský jazykový model a osobou Eduard Matovka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/topics/bert/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2020/pavol_hudak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/topics/bert"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2020/pavol_hudak""]"
|
||||
q0270,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou slovenský jazykový model a osobou Eduard Matovka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/topics/bert/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/topics/bert"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]"
|
||||
q0270,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou slovenský jazykový model a osobou Eduard Matovka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/topics/bert/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/topics/bert"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]"
|
||||
q0271,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou LLAMA a osobou Eduard Matovka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2020/pavol_hudak/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2020/pavol_hudak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0271,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou LLAMA a osobou Eduard Matovka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2018/david_omasta/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]"
|
||||
q0271,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou LLAMA a osobou Eduard Matovka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2018/david_omasta/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]"
|
||||
q0272,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou SlovakAlpaca a osobou Eduard Matovka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2020/pavol_hudak/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2020/pavol_hudak"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0272,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou SlovakAlpaca a osobou Eduard Matovka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/topics/resources/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/topics/resources""]"
|
||||
q0272,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou SlovakAlpaca a osobou Eduard Matovka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2021/matej_novotny/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny""]"
|
||||
q0273,test,specific_fact,medium,fts,Aký bol predbežný cieľ práce Eduarda Matovku?,4,0.25,0,0,1,0.0,0.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2016/jakub_maruniak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""]"
|
||||
q0273,test,specific_fact,medium,vector,Aký bol predbežný cieľ práce Eduarda Matovku?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/ediz_morochovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic""]"
|
||||
q0273,test,specific_fact,medium,hybrid,Aký bol predbežný cieľ práce Eduarda Matovku?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0274,test,specific_fact,medium,fts,Aké modely mal Eduard Matovka vyskúšať okrem LLAMA?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2020/pavol_hudak/README.md"", ""pages/students/2022/jakub_schwarc/README.md"", ""pages/students/2021/artur_hyrenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2020/pavol_hudak"", ""https://zp.kemt.fei.tuke.sk/students/2022/jakub_schwarc"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko""]"
|
||||
q0274,test,specific_fact,medium,vector,Aké modely mal Eduard Matovka vyskúšať okrem LLAMA?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2018/david_omasta/README.md"", ""pages/students/2020/pavol_hudak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2020/pavol_hudak""]"
|
||||
q0274,test,specific_fact,medium,hybrid,Aké modely mal Eduard Matovka vyskúšať okrem LLAMA?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2021/eduard_matovka/README.md""]","[""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2020/pavol_hudak/README.md"", ""pages/students/2018/david_omasta/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2020/pavol_hudak"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]"
|
||||
q0288,test,entity_lookup,easy,fts,Nájdi dokument o osobe Andrii Pervashov.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2021/nikita_bodnar/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2019/david_stromp/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0288,test,entity_lookup,easy,vector,Nájdi dokument o osobe Andrii Pervashov.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/students/2018/adrian_remias/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0288,test,entity_lookup,easy,hybrid,Nájdi dokument o osobe Andrii Pervashov.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/students/2018/adrian_remias/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0289,test,fact_title,easy,fts,Aký je názov diplomová práca osoby Andrii Pervashov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2021/nikita_bodnar/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2016/mark_feher/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]"
|
||||
q0289,test,fact_title,easy,vector,Aký je názov diplomová práca osoby Andrii Pervashov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/mark_feher/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher""]"
|
||||
q0289,test,fact_title,easy,hybrid,Aký je názov diplomová práca osoby Andrii Pervashov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2016/mark_feher/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]"
|
||||
q0290,test,reverse_lookup,medium,fts,Kto sa venuje práci s názvom „Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/topics/seq2seq/README.md"", ""pages/students/2018/adrian_remias/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/david_stromp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/topics/seq2seq"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp""]"
|
||||
q0290,test,reverse_lookup,medium,vector,Kto sa venuje práci s názvom „Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]"
|
||||
q0290,test,reverse_lookup,medium,hybrid,Kto sa venuje práci s názvom „Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2022/yevhenii_leonov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov""]"
|
||||
q0291,test,topic_lookup,medium,fts,"Nájdi študenta alebo dokument, ktorý rieši tému „Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/topics/seq2seq/README.md"", ""pages/students/2019/david_stromp/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/topics/seq2seq"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0291,test,topic_lookup,medium,vector,"Nájdi študenta alebo dokument, ktorý rieši tému „Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]"
|
||||
q0291,test,topic_lookup,medium,hybrid,"Nájdi študenta alebo dokument, ktorý rieši tému „Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0292,test,paraphrase,medium,fts,O čom je práca osoby Andrii Pervashov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2021/nikita_bodnar/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0292,test,paraphrase,medium,vector,O čom je práca osoby Andrii Pervashov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/topics/question/nezodpovedatelne/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2020/matus_suchanic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""]"
|
||||
q0292,test,paraphrase,medium,hybrid,O čom je práca osoby Andrii Pervashov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/topics/question/nezodpovedatelne/README.md"", ""pages/students/2020/matus_suchanic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""]"
|
||||
q0293,test,fact_start_year,easy,fts,V ktorom roku začal študovať Andrii Pervashov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/students/2021/nikita_bodnar/README.md"", ""pages/topics/faq/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""https://zp.kemt.fei.tuke.sk/topics/faq""]"
|
||||
q0293,test,fact_start_year,easy,vector,V ktorom roku začal študovať Andrii Pervashov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2017/stanislav_matsunych/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2021/nikita_bodnar/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2017/stanislav_matsunych"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]"
|
||||
q0293,test,fact_start_year,easy,hybrid,V ktorom roku začal študovať Andrii Pervashov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2017/stanislav_matsunych/README.md"", ""pages/students/2021/nikita_bodnar/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2017/stanislav_matsunych"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar""]"
|
||||
q0294,test,verification,medium,fts,Je pri osobe Andrii Pervashov uvedený rok začiatku štúdia 2022?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/tetiana_mohorian/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0294,test,verification,medium,vector,Je pri osobe Andrii Pervashov uvedený rok začiatku štúdia 2022?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2020/matus_suchanic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""]"
|
||||
q0294,test,verification,medium,hybrid,Je pri osobe Andrii Pervashov uvedený rok začiatku štúdia 2022?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2020/matus_suchanic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""]"
|
||||
q0295,test,fact_work_year,easy,fts,V ktorom roku je pri osobe Andrii Pervashov uvedená diplomová práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2021/nikita_bodnar/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2018/david_omasta/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers""]"
|
||||
q0295,test,fact_work_year,easy,vector,V ktorom roku je pri osobe Andrii Pervashov uvedená diplomová práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021""]"
|
||||
q0295,test,fact_work_year,easy,hybrid,V ktorom roku je pri osobe Andrii Pervashov uvedená diplomová práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021""]"
|
||||
q0296,test,disambiguation_year,hard,fts,Rozlíš rok začiatku štúdia a rok práce osoby Andrii Pervashov.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2016/ediz_morochovic/README.md"", ""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]"
|
||||
q0296,test,disambiguation_year,hard,vector,Rozlíš rok začiatku štúdia a rok práce osoby Andrii Pervashov.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu""]"
|
||||
q0296,test,disambiguation_year,hard,hybrid,Rozlíš rok začiatku štúdia a rok práce osoby Andrii Pervashov.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu""]"
|
||||
q0297,test,adversarial_year,hard,fts,Je rok 2022 rokom záverečnej práce osoby Andrii Pervashov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/topics/faq/README.md"", ""pages/topics/akopisat/README.md"", ""pages/students/2021/nikita_bodnar/README.md"", ""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]"
|
||||
q0297,test,adversarial_year,hard,vector,Je rok 2022 rokom záverečnej práce osoby Andrii Pervashov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0297,test,adversarial_year,hard,hybrid,Je rok 2022 rokom záverečnej práce osoby Andrii Pervashov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0298,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou speech-to-text a osobou Andrii Pervashov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2021/nikita_bodnar/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0298,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou speech-to-text a osobou Andrii Pervashov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/topics/hatespeech/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/topics/hatespeech"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu""]"
|
||||
q0298,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou speech-to-text a osobou Andrii Pervashov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/topics/hatespeech/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/topics/hatespeech"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]"
|
||||
q0299,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou OpenWebUI a osobou Andrii Pervashov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2021/nikita_bodnar/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]"
|
||||
q0299,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou OpenWebUI a osobou Andrii Pervashov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]"
|
||||
q0299,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou OpenWebUI a osobou Andrii Pervashov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]"
|
||||
q0300,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou štruktúrované informácie a osobou Andrii Pervashov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2021/nikita_bodnar/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0300,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou štruktúrované informácie a osobou Andrii Pervashov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]"
|
||||
q0300,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou štruktúrované informácie a osobou Andrii Pervashov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]"
|
||||
q0301,test,specific_fact,medium,fts,Aké rozhranie alebo systém má Andrii Pervashov naštudovať pre svoju prácu?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2021/nikita_bodnar/README.md"", ""pages/topics/named-entity/navod/README.md"", ""pages/students/2019/samuel_horani/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""https://zp.kemt.fei.tuke.sk/topics/named-entity/navod"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani""]"
|
||||
q0301,test,specific_fact,medium,vector,Aké rozhranie alebo systém má Andrii Pervashov naštudovať pre svoju prácu?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]"
|
||||
q0301,test,specific_fact,medium,hybrid,Aké rozhranie alebo systém má Andrii Pervashov naštudovať pre svoju prácu?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2019/samuel_horani/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani""]"
|
||||
q0302,test,specific_fact,medium,fts,Do akej podoby má agent Andriiho Pervashova transformovať rečový vstup?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/patrik_pavlisin/tp20/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/tp20"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0302,test,specific_fact,medium,vector,Do akej podoby má agent Andriiho Pervashova transformovať rečový vstup?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]"
|
||||
q0302,test,specific_fact,medium,hybrid,Do akej podoby má agent Andriiho Pervashova transformovať rečový vstup?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/andrii_pervashov/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0317,test,entity_lookup,easy,fts,Nájdi dokument o osobe Oleh Poiasnik.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2018/oleh_bilykh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""]"
|
||||
q0317,test,entity_lookup,easy,vector,Nájdi dokument o osobe Oleh Poiasnik.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2018/adrian_remias/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q0317,test,entity_lookup,easy,hybrid,Nájdi dokument o osobe Oleh Poiasnik.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2018/adrian_remias/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias""]"
|
||||
q0318,test,fact_title,easy,fts,Aký je názov diplomová práca osoby Oleh Poiasnik?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2020/matus_suchanic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""]"
|
||||
q0318,test,fact_title,easy,vector,Aký je názov diplomová práca osoby Oleh Poiasnik?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2018/oleh_bilykh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""]"
|
||||
q0318,test,fact_title,easy,hybrid,Aký je názov diplomová práca osoby Oleh Poiasnik?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2022/yevhenii_leonov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov""]"
|
||||
q0319,test,reverse_lookup,medium,fts,Kto sa venuje práci s názvom „Expertný agentový systém na podporu rozhodovania v lekárni“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/topics/steel/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/topics/steel"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q0319,test,reverse_lookup,medium,vector,Kto sa venuje práci s názvom „Expertný agentový systém na podporu rozhodovania v lekárni“?,3,0.333333,0,1,1,0.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0319,test,reverse_lookup,medium,hybrid,Kto sa venuje práci s názvom „Expertný agentový systém na podporu rozhodovania v lekárni“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]"
|
||||
q0320,test,topic_lookup,medium,fts,"Nájdi študenta alebo dokument, ktorý rieši tému „Expertný agentový systém na podporu rozhodovania v lekárni“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/topics/steel/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/topics/steel"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0320,test,topic_lookup,medium,vector,"Nájdi študenta alebo dokument, ktorý rieši tému „Expertný agentový systém na podporu rozhodovania v lekárni“.",4,0.25,0,0,1,0.0,0.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0320,test,topic_lookup,medium,hybrid,"Nájdi študenta alebo dokument, ktorý rieši tému „Expertný agentový systém na podporu rozhodovania v lekárni“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]"
|
||||
q0321,test,paraphrase,medium,fts,O čom je práca osoby Oleh Poiasnik?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2022/yevhenii_leonov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov""]"
|
||||
q0321,test,paraphrase,medium,vector,O čom je práca osoby Oleh Poiasnik?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]"
|
||||
q0321,test,paraphrase,medium,hybrid,O čom je práca osoby Oleh Poiasnik?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q0322,test,fact_start_year,easy,fts,V ktorom roku začal študovať Oleh Poiasnik?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt""]"
|
||||
q0322,test,fact_start_year,easy,vector,V ktorom roku začal študovať Oleh Poiasnik?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0322,test,fact_start_year,easy,hybrid,V ktorom roku začal študovať Oleh Poiasnik?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0323,test,verification,medium,fts,Je pri osobe Oleh Poiasnik uvedený rok začiatku štúdia 2022?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2022/tetiana_mohorian/README.md"", ""pages/students/2022/daniil_huzenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""]"
|
||||
q0323,test,verification,medium,vector,Je pri osobe Oleh Poiasnik uvedený rok začiatku štúdia 2022?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0323,test,verification,medium,hybrid,Je pri osobe Oleh Poiasnik uvedený rok začiatku štúdia 2022?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0324,test,fact_work_year,easy,fts,V ktorom roku je pri osobe Oleh Poiasnik uvedená diplomová práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2018/oleh_bilykh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""]"
|
||||
q0324,test,fact_work_year,easy,vector,V ktorom roku je pri osobe Oleh Poiasnik uvedená diplomová práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0324,test,fact_work_year,easy,hybrid,V ktorom roku je pri osobe Oleh Poiasnik uvedená diplomová práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/yevhenii_leonov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov""]"
|
||||
q0325,test,disambiguation_year,hard,fts,Rozlíš rok začiatku štúdia a rok práce osoby Oleh Poiasnik.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]"
|
||||
q0325,test,disambiguation_year,hard,vector,Rozlíš rok začiatku štúdia a rok práce osoby Oleh Poiasnik.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/interns/oliver_pejic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic""]"
|
||||
q0325,test,disambiguation_year,hard,hybrid,Rozlíš rok začiatku štúdia a rok práce osoby Oleh Poiasnik.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2018/oleh_bilykh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""]"
|
||||
q0326,test,adversarial_year,hard,fts,Je rok 2022 rokom záverečnej práce osoby Oleh Poiasnik?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0326,test,adversarial_year,hard,vector,Je rok 2022 rokom záverečnej práce osoby Oleh Poiasnik?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0326,test,adversarial_year,hard,hybrid,Je rok 2022 rokom záverečnej práce osoby Oleh Poiasnik?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0327,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou lekáreň a osobou Oleh Poiasnik?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/yevhenii_leonov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov""]"
|
||||
q0327,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou lekáreň a osobou Oleh Poiasnik?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/topics/faq/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/topics/faq""]"
|
||||
q0327,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou lekáreň a osobou Oleh Poiasnik?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/topics/faq/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/topics/faq""]"
|
||||
q0328,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou znalostný graf a osobou Oleh Poiasnik?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]"
|
||||
q0328,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou znalostný graf a osobou Oleh Poiasnik?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]"
|
||||
q0328,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou znalostný graf a osobou Oleh Poiasnik?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]"
|
||||
q0329,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou LightRAG a osobou Oleh Poiasnik?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0329,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou LightRAG a osobou Oleh Poiasnik?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0329,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou LightRAG a osobou Oleh Poiasnik?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2022/yevhenii_leonov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov""]"
|
||||
q0330,test,specific_fact,medium,fts,Z akej databázy mal Oleh Poiasnik zostaviť znalostný graf?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0330,test,specific_fact,medium,vector,Z akej databázy mal Oleh Poiasnik zostaviť znalostný graf?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]"
|
||||
q0330,test,specific_fact,medium,hybrid,Z akej databázy mal Oleh Poiasnik zostaviť znalostný graf?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]"
|
||||
q0331,test,specific_fact,medium,fts,Aký nástroj použil Oleh Poiasnik na vytvorenie znalostného grafu?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]"
|
||||
q0331,test,specific_fact,medium,vector,Aký nástroj použil Oleh Poiasnik na vytvorenie znalostného grafu?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]"
|
||||
q0331,test,specific_fact,medium,hybrid,Aký nástroj použil Oleh Poiasnik na vytvorenie znalostného grafu?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]"
|
||||
q0332,test,specific_fact,medium,fts,Pre približne koľko liekov bol vytvorený znalostný graf v stave práce Oleha Poiasnika?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2016/lukas_pokryvka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]"
|
||||
q0332,test,specific_fact,medium,vector,Pre približne koľko liekov bol vytvorený znalostný graf v stave práce Oleha Poiasnika?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0332,test,specific_fact,medium,hybrid,Pre približne koľko liekov bol vytvorený znalostný graf v stave práce Oleha Poiasnika?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/oleh_poiasnik/README.md""]","[""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko""]"
|
||||
q0348,test,entity_lookup,easy,fts,Nájdi dokument o osobe Vladyslav Yanchenko.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2019/david_stromp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp""]"
|
||||
q0348,test,entity_lookup,easy,vector,Nájdi dokument o osobe Vladyslav Yanchenko.,3,0.333333,0,1,1,0.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/interns/sevval_bulburu/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0348,test,entity_lookup,easy,hybrid,Nájdi dokument o osobe Vladyslav Yanchenko.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0349,test,fact_title,easy,fts,Aký je názov bakalárska práca osoby Vladyslav Yanchenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0349,test,fact_title,easy,vector,Aký je názov bakalárska práca osoby Vladyslav Yanchenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0349,test,fact_title,easy,hybrid,Aký je názov bakalárska práca osoby Vladyslav Yanchenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]"
|
||||
q0350,test,reverse_lookup,medium,fts,Kto sa venuje práci s názvom „Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/topics/named-entity/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/topics/named-entity"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0350,test,reverse_lookup,medium,vector,Kto sa venuje práci s názvom „Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0350,test,reverse_lookup,medium,hybrid,Kto sa venuje práci s názvom „Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0351,test,topic_lookup,medium,fts,"Nájdi študenta alebo dokument, ktorý rieši tému „Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/topics/faq/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/topics/faq""]"
|
||||
q0351,test,topic_lookup,medium,vector,"Nájdi študenta alebo dokument, ktorý rieši tému „Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0351,test,topic_lookup,medium,hybrid,"Nájdi študenta alebo dokument, ktorý rieši tému „Kontinuálne nasadenie a testovanie aplikácie v klaudovom prostredí“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu""]"
|
||||
q0352,test,paraphrase,medium,fts,O čom je práca osoby Vladyslav Yanchenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0352,test,paraphrase,medium,vector,O čom je práca osoby Vladyslav Yanchenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]"
|
||||
q0352,test,paraphrase,medium,hybrid,O čom je práca osoby Vladyslav Yanchenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2021/artur_hyrenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko""]"
|
||||
q0353,test,fact_start_year,easy,fts,V ktorom roku začal študovať Vladyslav Yanchenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q0353,test,fact_start_year,easy,vector,V ktorom roku začal študovať Vladyslav Yanchenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]"
|
||||
q0353,test,fact_start_year,easy,hybrid,V ktorom roku začal študovať Vladyslav Yanchenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]"
|
||||
q0354,test,verification,medium,fts,Je pri osobe Vladyslav Yanchenko uvedený rok začiatku štúdia 2022?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2022/samuel_vasil/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""]"
|
||||
q0354,test,verification,medium,vector,Je pri osobe Vladyslav Yanchenko uvedený rok začiatku štúdia 2022?,2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2022/yevhenii_leonov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov""]"
|
||||
q0354,test,verification,medium,hybrid,Je pri osobe Vladyslav Yanchenko uvedený rok začiatku štúdia 2022?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]"
|
||||
q0355,test,fact_work_year,easy,fts,V ktorom roku je pri osobe Vladyslav Yanchenko uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers""]"
|
||||
q0355,test,fact_work_year,easy,vector,V ktorom roku je pri osobe Vladyslav Yanchenko uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0355,test,fact_work_year,easy,hybrid,V ktorom roku je pri osobe Vladyslav Yanchenko uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2019/artem_yatsenko/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0356,test,disambiguation_year,hard,fts,Rozlíš rok začiatku štúdia a rok práce osoby Vladyslav Yanchenko.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2016/ediz_morochovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic""]"
|
||||
q0356,test,disambiguation_year,hard,vector,Rozlíš rok začiatku štúdia a rok práce osoby Vladyslav Yanchenko.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q0356,test,disambiguation_year,hard,hybrid,Rozlíš rok začiatku štúdia a rok práce osoby Vladyslav Yanchenko.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q0357,test,adversarial_year,hard,fts,Je rok 2022 rokom záverečnej práce osoby Vladyslav Yanchenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/topics/akopisat/README.md"", ""pages/students/2022/jan_malinovsky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""]"
|
||||
q0357,test,adversarial_year,hard,vector,Je rok 2022 rokom záverečnej práce osoby Vladyslav Yanchenko?,2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0357,test,adversarial_year,hard,hybrid,Je rok 2022 rokom záverečnej práce osoby Vladyslav Yanchenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0358,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou cloud a osobou Vladyslav Yanchenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0358,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou cloud a osobou Vladyslav Yanchenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2016/lukas_pokryvka/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0358,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou cloud a osobou Vladyslav Yanchenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q0359,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou Kubernetes a osobou Vladyslav Yanchenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2022/daniil_huzenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""]"
|
||||
q0359,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou Kubernetes a osobou Vladyslav Yanchenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q0359,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou Kubernetes a osobou Vladyslav Yanchenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0360,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou Azure a osobou Vladyslav Yanchenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0360,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou Azure a osobou Vladyslav Yanchenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0360,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou Azure a osobou Vladyslav Yanchenko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2022/daniil_huzenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""]"
|
||||
q0361,test,specific_fact,medium,fts,Aké technológie používal Vladyslav Yanchenko pre backend a frontend?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2018/martin_wencel/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]"
|
||||
q0361,test,specific_fact,medium,vector,Aké technológie používal Vladyslav Yanchenko pre backend a frontend?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas""]"
|
||||
q0361,test,specific_fact,medium,hybrid,Aké technológie používal Vladyslav Yanchenko pre backend a frontend?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]"
|
||||
q0362,test,specific_fact,medium,fts,Akú databázovú službu v Azure Vladyslav Yanchenko aktivoval?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2019/michal_stromko/vp2021/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko/vp2021"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0362,test,specific_fact,medium,vector,Akú databázovú službu v Azure Vladyslav Yanchenko aktivoval?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2016/lukas_pokryvka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]"
|
||||
q0362,test,specific_fact,medium,hybrid,Akú databázovú službu v Azure Vladyslav Yanchenko aktivoval?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/vladyslav_yanchenko/README.md""]","[""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2022/daniil_huzenko/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0394,test,entity_lookup,easy,fts,Nájdi dokument o osobe Ján Malinovský.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0394,test,entity_lookup,easy,vector,Nájdi dokument o osobe Ján Malinovský.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2018/adrian_remias/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias""]"
|
||||
q0394,test,entity_lookup,easy,hybrid,Nájdi dokument o osobe Ján Malinovský.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2018/adrian_remias/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias""]"
|
||||
q0395,test,fact_title,easy,fts,Aký je názov diplomový projekt osoby Ján Malinovský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt""]"
|
||||
q0395,test,fact_title,easy,vector,Aký je názov diplomový projekt osoby Ján Malinovský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0395,test,fact_title,easy,hybrid,Aký je názov diplomový projekt osoby Ján Malinovský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/annotation/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021/annotation"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0396,test,reverse_lookup,medium,fts,Kto sa venuje práci s názvom „Grafové vyhľadávanie pre podporu vzdelávania“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2019/dmytro_mural/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0396,test,reverse_lookup,medium,vector,Kto sa venuje práci s názvom „Grafové vyhľadávanie pre podporu vzdelávania“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0396,test,reverse_lookup,medium,hybrid,Kto sa venuje práci s názvom „Grafové vyhľadávanie pre podporu vzdelávania“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2019/dmytro_mural/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0397,test,topic_lookup,medium,fts,"Nájdi študenta alebo dokument, ktorý rieši tému „Grafové vyhľadávanie pre podporu vzdelávania“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]"
|
||||
q0397,test,topic_lookup,medium,vector,"Nájdi študenta alebo dokument, ktorý rieši tému „Grafové vyhľadávanie pre podporu vzdelávania“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]"
|
||||
q0397,test,topic_lookup,medium,hybrid,"Nájdi študenta alebo dokument, ktorý rieši tému „Grafové vyhľadávanie pre podporu vzdelávania“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]"
|
||||
q0398,test,paraphrase,medium,fts,O čom je práca osoby Ján Malinovský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0398,test,paraphrase,medium,vector,O čom je práca osoby Ján Malinovský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q0398,test,paraphrase,medium,hybrid,O čom je práca osoby Ján Malinovský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]"
|
||||
q0399,test,fact_start_year,easy,fts,V ktorom roku začal študovať Ján Malinovský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/students/2018/david_omasta/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]"
|
||||
q0399,test,fact_start_year,easy,vector,V ktorom roku začal študovať Ján Malinovský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2018/oleh_bilykh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""]"
|
||||
q0399,test,fact_start_year,easy,hybrid,V ktorom roku začal študovať Ján Malinovský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0400,test,verification,medium,fts,Je pri osobe Ján Malinovský uvedený rok začiatku štúdia 2022?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2022/tetiana_mohorian/README.md"", ""pages/students/2022/daniil_huzenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""]"
|
||||
q0400,test,verification,medium,vector,Je pri osobe Ján Malinovský uvedený rok začiatku štúdia 2022?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2018/martin_wencel/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]"
|
||||
q0400,test,verification,medium,hybrid,Je pri osobe Ján Malinovský uvedený rok začiatku štúdia 2022?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0401,test,fact_work_year,easy,fts,V ktorom roku je pri osobe Ján Malinovský uvedená diplomový projekt?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2018/david_omasta/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]"
|
||||
q0401,test,fact_work_year,easy,vector,V ktorom roku je pri osobe Ján Malinovský uvedená diplomový projekt?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0401,test,fact_work_year,easy,hybrid,V ktorom roku je pri osobe Ján Malinovský uvedená diplomový projekt?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0402,test,disambiguation_year,hard,fts,Rozlíš rok začiatku štúdia a rok práce osoby Ján Malinovský.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]"
|
||||
q0402,test,disambiguation_year,hard,vector,Rozlíš rok začiatku štúdia a rok práce osoby Ján Malinovský.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]"
|
||||
q0402,test,disambiguation_year,hard,hybrid,Rozlíš rok začiatku štúdia a rok práce osoby Ján Malinovský.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0403,test,adversarial_year,hard,fts,Je rok 2022 rokom záverečnej práce osoby Ján Malinovský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/topics/akopisat/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/topics/akopisat""]"
|
||||
q0403,test,adversarial_year,hard,vector,Je rok 2022 rokom záverečnej práce osoby Ján Malinovský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2021/eduard_matovka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka""]"
|
||||
q0403,test,adversarial_year,hard,hybrid,Je rok 2022 rokom záverečnej práce osoby Ján Malinovský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2021/eduard_matovka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka""]"
|
||||
q0404,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou RAG a osobou Ján Malinovský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]"
|
||||
q0404,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou RAG a osobou Ján Malinovský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]"
|
||||
q0404,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou RAG a osobou Ján Malinovský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0405,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou GraphRAG a osobou Ján Malinovský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]"
|
||||
q0405,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou GraphRAG a osobou Ján Malinovský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0405,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou GraphRAG a osobou Ján Malinovský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0406,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou znalostný graf a osobou Ján Malinovský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0406,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou znalostný graf a osobou Ján Malinovský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]"
|
||||
q0406,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou znalostný graf a osobou Ján Malinovský?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]"
|
||||
q0407,test,specific_fact,medium,fts,Z akej oblasti má Ján Malinovský zostaviť malý znalostný graf?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]"
|
||||
q0407,test,specific_fact,medium,vector,Z akej oblasti má Ján Malinovský zostaviť malý znalostný graf?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0407,test,specific_fact,medium,hybrid,Z akej oblasti má Ján Malinovský zostaviť malý znalostný graf?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]"
|
||||
q0408,test,specific_fact,medium,fts,Aké príklady oblastí obsahu sú uvedené pri práci Jána Malinovského?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/students/2016/patrik_pavlisin/tp20/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2016/patrik_pavlisin/dp22/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/tp20"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp22""]"
|
||||
q0408,test,specific_fact,medium,vector,Aké príklady oblastí obsahu sú uvedené pri práci Jána Malinovského?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0408,test,specific_fact,medium,hybrid,Aké príklady oblastí obsahu sú uvedené pri práci Jána Malinovského?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/jan_malinovsky/README.md""]","[""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]"
|
||||
q0409,test,entity_lookup,easy,fts,Nájdi dokument o osobe Maksym Zatirka.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2019/david_stromp/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0409,test,entity_lookup,easy,vector,Nájdi dokument o osobe Maksym Zatirka.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/interns/oliver_pejic/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]"
|
||||
q0409,test,entity_lookup,easy,hybrid,Nájdi dokument o osobe Maksym Zatirka.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/interns/oliver_pejic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic""]"
|
||||
q0410,test,fact_title,easy,fts,Aký je názov bakalárska práca osoby Maksym Zatirka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0410,test,fact_title,easy,vector,Aký je názov bakalárska práca osoby Maksym Zatirka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q0410,test,fact_title,easy,hybrid,Aký je názov bakalárska práca osoby Maksym Zatirka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/ediz_morochovic/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0411,test,reverse_lookup,medium,fts,Kto sa venuje práci s názvom „Grafová databáza pre podporu generovania slovenského jazyka“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q0411,test,reverse_lookup,medium,vector,Kto sa venuje práci s názvom „Grafová databáza pre podporu generovania slovenského jazyka“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2017/stanislav_matsunych/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2017/stanislav_matsunych"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0411,test,reverse_lookup,medium,hybrid,Kto sa venuje práci s názvom „Grafová databáza pre podporu generovania slovenského jazyka“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2017/stanislav_matsunych/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/topics/bert/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2017/stanislav_matsunych"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/topics/bert""]"
|
||||
q0412,test,topic_lookup,medium,fts,"Nájdi študenta alebo dokument, ktorý rieši tému „Grafová databáza pre podporu generovania slovenského jazyka“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0412,test,topic_lookup,medium,vector,"Nájdi študenta alebo dokument, ktorý rieši tému „Grafová databáza pre podporu generovania slovenského jazyka“.",2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0412,test,topic_lookup,medium,hybrid,"Nájdi študenta alebo dokument, ktorý rieši tému „Grafová databáza pre podporu generovania slovenského jazyka“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2017/stanislav_matsunych/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/andrii_pervashov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2017/stanislav_matsunych"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]"
|
||||
q0413,test,paraphrase,medium,fts,O čom je práca osoby Maksym Zatirka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0413,test,paraphrase,medium,vector,O čom je práca osoby Maksym Zatirka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]"
|
||||
q0413,test,paraphrase,medium,hybrid,O čom je práca osoby Maksym Zatirka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]"
|
||||
q0414,test,fact_start_year,easy,fts,V ktorom roku začal študovať Maksym Zatirka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0414,test,fact_start_year,easy,vector,V ktorom roku začal študovať Maksym Zatirka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2021/nikita_bodnar/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/david_kostilnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik""]"
|
||||
q0414,test,fact_start_year,easy,hybrid,V ktorom roku začal študovať Maksym Zatirka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2021/nikita_bodnar/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/david_kostilnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik""]"
|
||||
q0415,test,verification,medium,fts,Je pri osobe Maksym Zatirka uvedený rok začiatku štúdia 2023?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]"
|
||||
q0415,test,verification,medium,vector,Je pri osobe Maksym Zatirka uvedený rok začiatku štúdia 2023?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q0415,test,verification,medium,hybrid,Je pri osobe Maksym Zatirka uvedený rok začiatku štúdia 2023?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2018/martin_wencel/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]"
|
||||
q0416,test,fact_work_year,easy,fts,V ktorom roku je pri osobe Maksym Zatirka uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/patrik_pavlisin/tp20/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/tp20""]"
|
||||
q0416,test,fact_work_year,easy,vector,V ktorom roku je pri osobe Maksym Zatirka uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2016/ediz_morochovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic""]"
|
||||
q0416,test,fact_work_year,easy,hybrid,V ktorom roku je pri osobe Maksym Zatirka uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]"
|
||||
q0417,test,disambiguation_year,hard,fts,Rozlíš rok začiatku štúdia a rok práce osoby Maksym Zatirka.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2016/ediz_morochovic/README.md"", ""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]"
|
||||
q0417,test,disambiguation_year,hard,vector,Rozlíš rok začiatku štúdia a rok práce osoby Maksym Zatirka.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0417,test,disambiguation_year,hard,hybrid,Rozlíš rok začiatku štúdia a rok práce osoby Maksym Zatirka.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0418,test,adversarial_year,hard,fts,Je rok 2023 rokom záverečnej práce osoby Maksym Zatirka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/topics/faq/README.md"", ""pages/topics/akopisat/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0418,test,adversarial_year,hard,vector,Je rok 2023 rokom záverečnej práce osoby Maksym Zatirka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0418,test,adversarial_year,hard,hybrid,Je rok 2023 rokom záverečnej práce osoby Maksym Zatirka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2021/vladimir_ferko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""]"
|
||||
q0419,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou grafová databáza a osobou Maksym Zatirka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/train_experiments/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021/train_experiments""]"
|
||||
q0419,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou grafová databáza a osobou Maksym Zatirka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0419,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou grafová databáza a osobou Maksym Zatirka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0420,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou slovenské právo a osobou Maksym Zatirka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/topics/bert/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/topics/bert"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0420,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou slovenské právo a osobou Maksym Zatirka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0420,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou slovenské právo a osobou Maksym Zatirka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0421,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou znalostný graf a osobou Maksym Zatirka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]"
|
||||
q0421,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou znalostný graf a osobou Maksym Zatirka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0421,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou znalostný graf a osobou Maksym Zatirka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/topics/faq/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/topics/faq""]"
|
||||
q0422,test,specific_fact,medium,fts,Pre akú doménu má Maksym Zatirka zostaviť znalostný graf?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0422,test,specific_fact,medium,vector,Pre akú doménu má Maksym Zatirka zostaviť znalostný graf?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0422,test,specific_fact,medium,hybrid,Pre akú doménu má Maksym Zatirka zostaviť znalostný graf?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/maksym_zatirka/README.md""]","[""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0452,test,entity_lookup,easy,fts,Nájdi dokument o osobe Ronald Zalacko.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2019/david_stromp/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0452,test,entity_lookup,easy,vector,Nájdi dokument o osobe Ronald Zalacko.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2018/adrian_remias/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias""]"
|
||||
q0452,test,entity_lookup,easy,hybrid,Nájdi dokument o osobe Ronald Zalacko.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]"
|
||||
q0453,test,fact_title,easy,fts,Aký je názov bakalárska práca osoby Ronald Zalacko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0453,test,fact_title,easy,vector,Aký je názov bakalárska práca osoby Ronald Zalacko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0453,test,fact_title,easy,hybrid,Aký je názov bakalárska práca osoby Ronald Zalacko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2021/eduard_matovka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka""]"
|
||||
q0454,test,reverse_lookup,medium,fts,Kto sa venuje práci s názvom „Skórovací online systém pre robotické súťaže“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/students/2016/patrik_pavlisin/dp21/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp21"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt""]"
|
||||
q0454,test,reverse_lookup,medium,vector,Kto sa venuje práci s názvom „Skórovací online systém pre robotické súťaže“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0454,test,reverse_lookup,medium,hybrid,Kto sa venuje práci s názvom „Skórovací online systém pre robotické súťaže“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0455,test,topic_lookup,medium,fts,"Nájdi študenta alebo dokument, ktorý rieši tému „Skórovací online systém pre robotické súťaže“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2021/artur_hyrenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko""]"
|
||||
q0455,test,topic_lookup,medium,vector,"Nájdi študenta alebo dokument, ktorý rieši tému „Skórovací online systém pre robotické súťaže“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/topics/legal/README.md"", ""pages/students/2022/andrii_pervashov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/topics/legal"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]"
|
||||
q0455,test,topic_lookup,medium,hybrid,"Nájdi študenta alebo dokument, ktorý rieši tému „Skórovací online systém pre robotické súťaže“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/topics/legal/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/topics/legal""]"
|
||||
q0456,test,paraphrase,medium,fts,O čom je práca osoby Ronald Zalacko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0456,test,paraphrase,medium,vector,O čom je práca osoby Ronald Zalacko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2019/alina_vitko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]"
|
||||
q0456,test,paraphrase,medium,hybrid,O čom je práca osoby Ronald Zalacko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]"
|
||||
q0457,test,fact_start_year,easy,fts,V ktorom roku začal študovať Ronald Zalacko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0457,test,fact_start_year,easy,vector,V ktorom roku začal študovať Ronald Zalacko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]"
|
||||
q0457,test,fact_start_year,easy,hybrid,V ktorom roku začal študovať Ronald Zalacko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2022/andrii_pervashov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]"
|
||||
q0458,test,verification,medium,fts,Je pri osobe Ronald Zalacko uvedený rok začiatku štúdia 2023?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/denis_le_thanh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""]"
|
||||
q0458,test,verification,medium,vector,Je pri osobe Ronald Zalacko uvedený rok začiatku štúdia 2023?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0458,test,verification,medium,hybrid,Je pri osobe Ronald Zalacko uvedený rok začiatku štúdia 2023?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]"
|
||||
q0459,test,fact_work_year,easy,fts,V ktorom roku je pri osobe Ronald Zalacko uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/patrik_pavlisin/tp20/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/tp20""]"
|
||||
q0459,test,fact_work_year,easy,vector,V ktorom roku je pri osobe Ronald Zalacko uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0459,test,fact_work_year,easy,hybrid,V ktorom roku je pri osobe Ronald Zalacko uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0460,test,disambiguation_year,hard,fts,Rozlíš rok začiatku štúdia a rok práce osoby Ronald Zalacko.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2016/ediz_morochovic/README.md"", ""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]"
|
||||
q0460,test,disambiguation_year,hard,vector,Rozlíš rok začiatku štúdia a rok práce osoby Ronald Zalacko.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2022/andrii_pervashov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]"
|
||||
q0460,test,disambiguation_year,hard,hybrid,Rozlíš rok začiatku štúdia a rok práce osoby Ronald Zalacko.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2022/andrii_pervashov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]"
|
||||
q0461,test,adversarial_year,hard,fts,Je rok 2023 rokom záverečnej práce osoby Ronald Zalacko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/topics/faq/README.md"", ""pages/topics/akopisat/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0461,test,adversarial_year,hard,vector,Je rok 2023 rokom záverečnej práce osoby Ronald Zalacko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2019/alina_vitko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]"
|
||||
q0461,test,adversarial_year,hard,hybrid,Je rok 2023 rokom záverečnej práce osoby Ronald Zalacko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/topics/akopisat/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q0462,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou robotické súťaže a osobou Ronald Zalacko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q0462,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou robotické súťaže a osobou Ronald Zalacko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0462,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou robotické súťaže a osobou Ronald Zalacko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0463,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou Docker a osobou Ronald Zalacko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]"
|
||||
q0463,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou Docker a osobou Ronald Zalacko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]"
|
||||
q0463,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou Docker a osobou Ronald Zalacko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q0464,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou webová aplikácia a osobou Ronald Zalacko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0464,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou webová aplikácia a osobou Ronald Zalacko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/jan_holp/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]"
|
||||
q0464,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou webová aplikácia a osobou Ronald Zalacko?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/jan_holp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""]"
|
||||
q0465,test,specific_fact,medium,fts,Na akú oblasť je zameraná aplikácia Ronalda Zalacka?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/topics/named-entity/navod/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/topics/named-entity/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/topics/named-entity/navod"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/topics/named-entity""]"
|
||||
q0465,test,specific_fact,medium,vector,Na akú oblasť je zameraná aplikácia Ronalda Zalacka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/jakub_schwarc/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/jakub_schwarc""]"
|
||||
q0465,test,specific_fact,medium,hybrid,Na akú oblasť je zameraná aplikácia Ronalda Zalacka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/ronald_zalacko/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/jakub_schwarc/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/jakub_schwarc""]"
|
||||
q0466,test,entity_lookup,easy,fts,Nájdi dokument o osobe Oleksandr Dorybohov.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/topics/legal/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2019/david_stromp/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/topics/legal"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp""]"
|
||||
q0466,test,entity_lookup,easy,vector,Nájdi dokument o osobe Oleksandr Dorybohov.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/students/2018/david_ilas/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_ilas"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]"
|
||||
q0466,test,entity_lookup,easy,hybrid,Nájdi dokument o osobe Oleksandr Dorybohov.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/topics/legal/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/topics/legal""]"
|
||||
q0467,test,fact_title,easy,fts,Aký je názov bakalárska práca osoby Oleksandr Dorybohov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/topics/legal/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/topics/legal"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0467,test,fact_title,easy,vector,Aký je názov bakalárska práca osoby Oleksandr Dorybohov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2023/maksym_zatirka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""]"
|
||||
q0467,test,fact_title,easy,hybrid,Aký je názov bakalárska práca osoby Oleksandr Dorybohov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2016/ediz_morochovic/README.md"", ""pages/students/2018/oleh_bilykh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""]"
|
||||
q0468,test,reverse_lookup,medium,fts,Kto sa venuje práci s názvom „Automatické odpovede na otázky v právnej oblasti“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2018/david_omasta/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0468,test,reverse_lookup,medium,vector,Kto sa venuje práci s názvom „Automatické odpovede na otázky v právnej oblasti“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/topics/question/nezodpovedatelne/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0468,test,reverse_lookup,medium,hybrid,Kto sa venuje práci s názvom „Automatické odpovede na otázky v právnej oblasti“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/topics/question/nezodpovedatelne/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0469,test,topic_lookup,medium,fts,"Nájdi študenta alebo dokument, ktorý rieši tému „Automatické odpovede na otázky v právnej oblasti“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers""]"
|
||||
q0469,test,topic_lookup,medium,vector,"Nájdi študenta alebo dokument, ktorý rieši tému „Automatické odpovede na otázky v právnej oblasti“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/topics/question/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/topics/question""]"
|
||||
q0469,test,topic_lookup,medium,hybrid,"Nájdi študenta alebo dokument, ktorý rieši tému „Automatické odpovede na otázky v právnej oblasti“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/topics/faq/README.md"", ""pages/topics/question/nezodpovedatelne/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0470,test,paraphrase,medium,fts,O čom je práca osoby Oleksandr Dorybohov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/topics/legal/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/topics/legal"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0470,test,paraphrase,medium,vector,O čom je práca osoby Oleksandr Dorybohov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/topics/chatbot/README.md"", ""pages/students/2017/dmytro_ushatenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/topics/chatbot"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko""]"
|
||||
q0470,test,paraphrase,medium,hybrid,O čom je práca osoby Oleksandr Dorybohov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/oleh_bilykh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""]"
|
||||
q0471,test,fact_start_year,easy,fts,V ktorom roku začal študovať Oleksandr Dorybohov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/topics/legal/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/topics/legal"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko""]"
|
||||
q0471,test,fact_start_year,easy,vector,V ktorom roku začal študovať Oleksandr Dorybohov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q0471,test,fact_start_year,easy,hybrid,V ktorom roku začal študovať Oleksandr Dorybohov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q0472,test,verification,medium,fts,Je pri osobe Oleksandr Dorybohov uvedený rok začiatku štúdia 2023?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/topics/legal/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/topics/legal"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]"
|
||||
q0472,test,verification,medium,vector,Je pri osobe Oleksandr Dorybohov uvedený rok začiatku štúdia 2023?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2018/david_ilas/README.md"", ""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_ilas"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0472,test,verification,medium,hybrid,Je pri osobe Oleksandr Dorybohov uvedený rok začiatku štúdia 2023?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2018/david_ilas/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2017/dmytro_ushatenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_ilas"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko""]"
|
||||
q0473,test,fact_work_year,easy,fts,V ktorom roku je pri osobe Oleksandr Dorybohov uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/topics/legal/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/topics/legal"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers""]"
|
||||
q0473,test,fact_work_year,easy,vector,V ktorom roku je pri osobe Oleksandr Dorybohov uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2016/ediz_morochovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic""]"
|
||||
q0473,test,fact_work_year,easy,hybrid,V ktorom roku je pri osobe Oleksandr Dorybohov uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2016/ediz_morochovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic""]"
|
||||
q0474,test,disambiguation_year,hard,fts,Rozlíš rok začiatku štúdia a rok práce osoby Oleksandr Dorybohov.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/topics/legal/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/topics/legal""]"
|
||||
q0474,test,disambiguation_year,hard,vector,Rozlíš rok začiatku štúdia a rok práce osoby Oleksandr Dorybohov.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/topics/legal/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/topics/legal"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu""]"
|
||||
q0474,test,disambiguation_year,hard,hybrid,Rozlíš rok začiatku štúdia a rok práce osoby Oleksandr Dorybohov.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/topics/legal/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/topics/legal"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu""]"
|
||||
q0475,test,adversarial_year,hard,fts,Je rok 2023 rokom záverečnej práce osoby Oleksandr Dorybohov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/topics/legal/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/topics/akopisat/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/topics/legal"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/topics/akopisat""]"
|
||||
q0475,test,adversarial_year,hard,vector,Je rok 2023 rokom záverečnej práce osoby Oleksandr Dorybohov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2018/oleh_bilykh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""]"
|
||||
q0475,test,adversarial_year,hard,hybrid,Je rok 2023 rokom záverečnej práce osoby Oleksandr Dorybohov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2016/dominik_nagy/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0476,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou právo a osobou Oleksandr Dorybohov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/topics/legal/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/topics/legal"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0476,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou právo a osobou Oleksandr Dorybohov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/topics/legal/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/topics/legal""]"
|
||||
q0476,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou právo a osobou Oleksandr Dorybohov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/topics/faq/README.md"", ""pages/topics/legal/README.md"", ""pages/students/2018/david_omasta/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/topics/legal"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""]"
|
||||
q0477,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou agent a osobou Oleksandr Dorybohov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/topics/legal/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/topics/legal"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0477,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou agent a osobou Oleksandr Dorybohov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/topics/legal/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/topics/legal""]"
|
||||
q0477,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou agent a osobou Oleksandr Dorybohov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/topics/legal/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2018/oleh_bilykh/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/topics/legal"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""]"
|
||||
q0478,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou API a osobou Oleksandr Dorybohov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/topics/legal/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/topics/legal"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0478,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou API a osobou Oleksandr Dorybohov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/topics/legal/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/topics/legal""]"
|
||||
q0478,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou API a osobou Oleksandr Dorybohov?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/topics/legal/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/topics/legal""]"
|
||||
q0479,test,specific_fact,medium,fts,Pre akú doménu má agent Oleksandra Dorybohova odpovedať na otázky?,2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/topics/question/validacie/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/topics/question/validacie""]"
|
||||
q0479,test,specific_fact,medium,vector,Pre akú doménu má agent Oleksandra Dorybohova odpovedať na otázky?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/topics/question/nezodpovedatelne/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0479,test,specific_fact,medium,hybrid,Pre akú doménu má agent Oleksandra Dorybohova odpovedať na otázky?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/oleksandr_dorybohov/README.md""]","[""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]"
|
||||
q0510,test,entity_lookup,easy,fts,Nájdi dokument o osobe Samuel Vasiľ.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0510,test,entity_lookup,easy,vector,Nájdi dokument o osobe Samuel Vasiľ.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2019/samuel_horani/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani""]"
|
||||
q0510,test,entity_lookup,easy,hybrid,Nájdi dokument o osobe Samuel Vasiľ.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu""]"
|
||||
q0511,test,fact_title,easy,fts,Aký je názov bakalárska práca osoby Samuel Vasiľ?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2019/samuel_horani/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani""]"
|
||||
q0511,test,fact_title,easy,vector,Aký je názov bakalárska práca osoby Samuel Vasiľ?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q0511,test,fact_title,easy,hybrid,Aký je názov bakalárska práca osoby Samuel Vasiľ?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]"
|
||||
q0512,test,reverse_lookup,medium,fts,Kto sa venuje práci s názvom „Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md"", ""pages/students/2020/kamil_tomcufcik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian"", ""https://zp.kemt.fei.tuke.sk/students/2020/kamil_tomcufcik""]"
|
||||
q0512,test,reverse_lookup,medium,vector,Kto sa venuje práci s názvom „Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/topics/bert/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2022/andrii_pervashov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/topics/bert"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]"
|
||||
q0512,test,reverse_lookup,medium,hybrid,Kto sa venuje práci s názvom „Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]"
|
||||
q0513,test,topic_lookup,medium,fts,"Nájdi študenta alebo dokument, ktorý rieši tému „Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md"", ""pages/students/2022/tetiana_mohorian/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0513,test,topic_lookup,medium,vector,"Nájdi študenta alebo dokument, ktorý rieši tému „Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/topics/bert/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/topics/bert""]"
|
||||
q0513,test,topic_lookup,medium,hybrid,"Nájdi študenta alebo dokument, ktorý rieši tému „Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]"
|
||||
q0514,test,paraphrase,medium,fts,O čom je práca osoby Samuel Vasiľ?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0514,test,paraphrase,medium,vector,O čom je práca osoby Samuel Vasiľ?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q0514,test,paraphrase,medium,hybrid,O čom je práca osoby Samuel Vasiľ?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q0515,test,fact_start_year,easy,fts,V ktorom roku začal študovať Samuel Vasiľ?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/students/2018/samuel_sirotnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik""]"
|
||||
q0515,test,fact_start_year,easy,vector,V ktorom roku začal študovať Samuel Vasiľ?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2021/nikita_bodnar/README.md"", ""pages/students/2020/david_kostilnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik""]"
|
||||
q0515,test,fact_start_year,easy,hybrid,V ktorom roku začal študovať Samuel Vasiľ?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q0516,test,verification,medium,fts,Je pri osobe Samuel Vasiľ uvedený rok začiatku štúdia 2022?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2022/tetiana_mohorian/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""]"
|
||||
q0516,test,verification,medium,vector,Je pri osobe Samuel Vasiľ uvedený rok začiatku štúdia 2022?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0516,test,verification,medium,hybrid,Je pri osobe Samuel Vasiľ uvedený rok začiatku štúdia 2022?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2018/samuel_sirotnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik""]"
|
||||
q0517,test,fact_work_year,easy,fts,V ktorom roku je pri osobe Samuel Vasiľ uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2018/samuel_sirotnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik""]"
|
||||
q0517,test,fact_work_year,easy,vector,V ktorom roku je pri osobe Samuel Vasiľ uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q0517,test,fact_work_year,easy,hybrid,V ktorom roku je pri osobe Samuel Vasiľ uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q0518,test,disambiguation_year,hard,fts,Rozlíš rok začiatku štúdia a rok práce osoby Samuel Vasiľ.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]"
|
||||
q0518,test,disambiguation_year,hard,vector,Rozlíš rok začiatku štúdia a rok práce osoby Samuel Vasiľ.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q0518,test,disambiguation_year,hard,hybrid,Rozlíš rok začiatku štúdia a rok práce osoby Samuel Vasiľ.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2018/samuel_sirotnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik""]"
|
||||
q0519,test,adversarial_year,hard,fts,Je rok 2022 rokom záverečnej práce osoby Samuel Vasiľ?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/topics/akopisat/README.md"", ""pages/students/2019/samuel_horani/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani""]"
|
||||
q0519,test,adversarial_year,hard,vector,Je rok 2022 rokom záverečnej práce osoby Samuel Vasiľ?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q0519,test,adversarial_year,hard,hybrid,Je rok 2022 rokom záverečnej práce osoby Samuel Vasiľ?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q0520,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou OpenWebUI a osobou Samuel Vasiľ?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2019/samuel_horani/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani""]"
|
||||
q0520,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou OpenWebUI a osobou Samuel Vasiľ?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2018/samuel_sirotnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik""]"
|
||||
q0520,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou OpenWebUI a osobou Samuel Vasiľ?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2018/samuel_sirotnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik""]"
|
||||
q0521,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou MCP a osobou Samuel Vasiľ?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2018/samuel_sirotnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik""]"
|
||||
q0521,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou MCP a osobou Samuel Vasiľ?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q0521,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou MCP a osobou Samuel Vasiľ?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/martin_wencel/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]"
|
||||
q0522,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou RAG a osobou Samuel Vasiľ?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2022/oleh_poiasnik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""]"
|
||||
q0522,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou RAG a osobou Samuel Vasiľ?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2022/jan_ptak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""]"
|
||||
q0522,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou RAG a osobou Samuel Vasiľ?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0523,test,specific_fact,medium,fts,Aké rozhranie má Samuel Vasiľ nasadiť pomocou Docker Compose?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]"
|
||||
q0523,test,specific_fact,medium,vector,Aké rozhranie má Samuel Vasiľ nasadiť pomocou Docker Compose?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]"
|
||||
q0523,test,specific_fact,medium,hybrid,Aké rozhranie má Samuel Vasiľ nasadiť pomocou Docker Compose?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2018/samuel_sirotnik/README.md"", ""pages/students/2023/ronald_zalacko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""]"
|
||||
q0524,test,specific_fact,medium,fts,Aké rozšírenia má systém Samuela Vasiľa podporovať?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0524,test,specific_fact,medium,vector,Aké rozšírenia má systém Samuela Vasiľa podporovať?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/artur_hyrenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko""]"
|
||||
q0524,test,specific_fact,medium,hybrid,Aké rozšírenia má systém Samuela Vasiľa podporovať?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2022/samuel_vasil/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0525,test,entity_lookup,easy,fts,Nájdi dokument o osobe Denis Le Thanh.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2019/david_stromp/README.md"", ""pages/students/2016/patrik_pavlisin/dp21/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp21""]"
|
||||
q0525,test,entity_lookup,easy,vector,Nájdi dokument o osobe Denis Le Thanh.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/students/2021/matej_novotny/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny""]"
|
||||
q0525,test,entity_lookup,easy,hybrid,Nájdi dokument o osobe Denis Le Thanh.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2016/dominik_nagy/timovy_projekt/README.md"", ""pages/interns/sevval_bulburu/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu""]"
|
||||
q0526,test,fact_title,easy,fts,Aký je názov bakalárska práca osoby Denis Le Thanh?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/jakub_maruniak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""]"
|
||||
q0526,test,fact_title,easy,vector,Aký je názov bakalárska práca osoby Denis Le Thanh?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2016/ediz_morochovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic""]"
|
||||
q0526,test,fact_title,easy,hybrid,Aký je názov bakalárska práca osoby Denis Le Thanh?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2016/ediz_morochovic/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]"
|
||||
q0527,test,reverse_lookup,medium,fts,Kto sa venuje práci s názvom „Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/students/2019/alina_vitko/README.md"", ""pages/topics/otvorene/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene""]"
|
||||
q0527,test,reverse_lookup,medium,vector,Kto sa venuje práci s názvom „Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/topics/bert/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2017/stanislav_matsunych/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/topics/bert"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2017/stanislav_matsunych""]"
|
||||
q0527,test,reverse_lookup,medium,hybrid,Kto sa venuje práci s názvom „Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/topics/bert/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2021/artur_hyrenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/topics/bert"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko""]"
|
||||
q0528,test,topic_lookup,medium,fts,"Nájdi študenta alebo dokument, ktorý rieši tému „Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt""]"
|
||||
q0528,test,topic_lookup,medium,vector,"Nájdi študenta alebo dokument, ktorý rieši tému „Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/topics/bert/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2022/andrii_pervashov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/topics/bert"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]"
|
||||
q0528,test,topic_lookup,medium,hybrid,"Nájdi študenta alebo dokument, ktorý rieši tému „Trénovanie jazykového modelu pre spracovanie inštrukcií v prirodzenom jazyku“.",1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2021/matej_novotny/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2021/artur_hyrenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko""]"
|
||||
q0529,test,paraphrase,medium,fts,O čom je práca osoby Denis Le Thanh?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/patrik_pavlisin/dp21/README.md"", ""pages/students/2016/dominik_nagy/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp21"", ""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy/timovy_projekt""]"
|
||||
q0529,test,paraphrase,medium,vector,O čom je práca osoby Denis Le Thanh?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2022/tetiana_mohorian/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q0529,test,paraphrase,medium,hybrid,O čom je práca osoby Denis Le Thanh?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2022/tetiana_mohorian/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q0530,test,fact_start_year,easy,fts,V ktorom roku začal študovať Denis Le Thanh?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/topics/faq/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/topics/faq""]"
|
||||
q0530,test,fact_start_year,easy,vector,V ktorom roku začal študovať Denis Le Thanh?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2020/kamil_tomcufcik/README.md"", ""pages/students/2018/martin_wencel/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2020/kamil_tomcufcik"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]"
|
||||
q0530,test,fact_start_year,easy,hybrid,V ktorom roku začal študovať Denis Le Thanh?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2020/kamil_tomcufcik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2020/kamil_tomcufcik""]"
|
||||
q0531,test,verification,medium,fts,Je pri osobe Denis Le Thanh uvedený rok začiatku štúdia 2023?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]"
|
||||
q0531,test,verification,medium,vector,Je pri osobe Denis Le Thanh uvedený rok začiatku štúdia 2023?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0531,test,verification,medium,hybrid,Je pri osobe Denis Le Thanh uvedený rok začiatku štúdia 2023?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0532,test,fact_work_year,easy,fts,V ktorom roku je pri osobe Denis Le Thanh uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md"", ""pages/topics/faq/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/topics/faq""]"
|
||||
q0532,test,fact_work_year,easy,vector,V ktorom roku je pri osobe Denis Le Thanh uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2016/ediz_morochovic/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas""]"
|
||||
q0532,test,fact_work_year,easy,hybrid,V ktorom roku je pri osobe Denis Le Thanh uvedená bakalárska práca?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2016/ediz_morochovic/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas""]"
|
||||
q0533,test,disambiguation_year,hard,fts,Rozlíš rok začiatku štúdia a rok práce osoby Denis Le Thanh.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2016/ediz_morochovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic""]"
|
||||
q0533,test,disambiguation_year,hard,vector,Rozlíš rok začiatku štúdia a rok práce osoby Denis Le Thanh.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2018/martin_wencel/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]"
|
||||
q0533,test,disambiguation_year,hard,hybrid,Rozlíš rok začiatku štúdia a rok práce osoby Denis Le Thanh.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2018/martin_wencel/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]"
|
||||
q0534,test,adversarial_year,hard,fts,Je rok 2023 rokom záverečnej práce osoby Denis Le Thanh?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/topics/akopisat/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""]"
|
||||
q0534,test,adversarial_year,hard,vector,Je rok 2023 rokom záverečnej práce osoby Denis Le Thanh?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]"
|
||||
q0534,test,adversarial_year,hard,hybrid,Je rok 2023 rokom záverečnej práce osoby Denis Le Thanh?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2021/vladimir_ferko/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0535,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou Slovak Mistral a osobou Denis Le Thanh?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak""]"
|
||||
q0535,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou Slovak Mistral a osobou Denis Le Thanh?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2018/martin_wencel/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]"
|
||||
q0535,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou Slovak Mistral a osobou Denis Le Thanh?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0536,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou inštrukcie a osobou Denis Le Thanh?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/patrik_pavlisin/dp21/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp21""]"
|
||||
q0536,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou inštrukcie a osobou Denis Le Thanh?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2021/matej_scislak/README.md"", ""pages/students/2022/andrii_pervashov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]"
|
||||
q0536,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou inštrukcie a osobou Denis Le Thanh?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2018/david_omasta/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0537,test,keyword_grounding,medium,fts,Ktorý dokument alebo študent súvisí s témou kyberbezpečnosť a osobou Denis Le Thanh?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/patrik_pavlisin/dp21/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp21""]"
|
||||
q0537,test,keyword_grounding,medium,vector,Ktorý dokument alebo študent súvisí s témou kyberbezpečnosť a osobou Denis Le Thanh?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/lukas_pokryvka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]"
|
||||
q0537,test,keyword_grounding,medium,hybrid,Ktorý dokument alebo študent súvisí s témou kyberbezpečnosť a osobou Denis Le Thanh?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/topics/faq/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/topics/faq""]"
|
||||
q0538,test,specific_fact,medium,fts,Aký slovenský generatívny model chce Denis Le Thanh dotrénovať?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/students/2018/david_omasta/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0538,test,specific_fact,medium,vector,Aký slovenský generatívny model chce Denis Le Thanh dotrénovať?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2018/david_omasta/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2021/eduard_matovka/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka""]"
|
||||
q0538,test,specific_fact,medium,hybrid,Aký slovenský generatívny model chce Denis Le Thanh dotrénovať?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/students/2023/denis_le_thanh/README.md""]","[""pages/students/2023/denis_le_thanh/README.md"", ""pages/students/2018/david_omasta/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2021/matej_novotny/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny""]"
|
||||
q0539,test,entity_lookup,easy,fts,Nájdi dokument o stážistovi Youssef Ressaissi.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/interns/yussef_ressaissi/README.md"", ""pages/students/2019/david_stromp/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0539,test,entity_lookup,easy,vector,Nájdi dokument o stážistovi Youssef Ressaissi.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/interns/yussef_ressaissi/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/interns/oliver_pejic/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q0539,test,entity_lookup,easy,hybrid,Nájdi dokument o stážistovi Youssef Ressaissi.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/interns/yussef_ressaissi/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/interns/oliver_pejic/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q0540,test,internship_year,easy,fts,V ktorom roku prebiehala stáž osoby Youssef Ressaissi?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/interns/yussef_ressaissi/README.md"", ""pages/students/2016/patrik_pavlisin/dp22/README.md"", ""pages/topics/prodigy/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp22"", ""https://zp.kemt.fei.tuke.sk/topics/prodigy"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0540,test,internship_year,easy,vector,V ktorom roku prebiehala stáž osoby Youssef Ressaissi?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2020/matej_kobylan/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""]"
|
||||
q0540,test,internship_year,easy,hybrid,V ktorom roku prebiehala stáž osoby Youssef Ressaissi?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/interns/yussef_ressaissi/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0541,test,internship_topic,medium,fts,Akému problému alebo téme sa venovala stáž osoby Youssef Ressaissi?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/interns/yussef_ressaissi/README.md"", ""pages/topics/prodigy/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/patrik_pavlisin/dp22/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi"", ""https://zp.kemt.fei.tuke.sk/topics/prodigy"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp22"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]"
|
||||
q0541,test,internship_topic,medium,vector,Akému problému alebo téme sa venovala stáž osoby Youssef Ressaissi?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/students/2019/alina_vitko/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/topics/question/nezodpovedatelne/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne""]"
|
||||
q0541,test,internship_topic,medium,hybrid,Akému problému alebo téme sa venovala stáž osoby Youssef Ressaissi?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/interns/yussef_ressaissi/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/students/2019/alina_vitko/README.md"", ""pages/students/2022/yevhenii_leonov/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov""]"
|
||||
q0542,test,reverse_lookup,medium,fts,Kto pracoval na téme sumarizácia v slovenskej medicínskej alebo právnej doméne?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/students/2022/valerii_kutsenko/README.md"", ""pages/topics/otvorene/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial""]"
|
||||
q0542,test,reverse_lookup,medium,vector,Kto pracoval na téme sumarizácia v slovenskej medicínskej alebo právnej doméne?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/topics/legal/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2022/andrii_pervashov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/topics/legal"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""]"
|
||||
q0542,test,reverse_lookup,medium,hybrid,Kto pracoval na téme sumarizácia v slovenskej medicínskej alebo právnej doméne?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/topics/legal/README.md"", ""pages/students/2020/matus_suchanic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/topics/legal"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""]"
|
||||
q0543,test,keyword_grounding,medium,fts,Ktorá stáž osoby Youssef Ressaissi súvisela s témou summarization?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/interns/yussef_ressaissi/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/topics/prodigy/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/topics/prodigy"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0543,test,keyword_grounding,medium,vector,Ktorá stáž osoby Youssef Ressaissi súvisela s témou summarization?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/interns/yussef_ressaissi/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0543,test,keyword_grounding,medium,hybrid,Ktorá stáž osoby Youssef Ressaissi súvisela s témou summarization?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/interns/yussef_ressaissi/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/topics/legal/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/topics/legal"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]"
|
||||
q0544,test,keyword_grounding,medium,fts,Ktorá stáž osoby Youssef Ressaissi súvisela s témou Slovak?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/interns/yussef_ressaissi/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/topics/prodigy/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/topics/prodigy"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0544,test,keyword_grounding,medium,vector,Ktorá stáž osoby Youssef Ressaissi súvisela s témou Slovak?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2019/samuel_horani/README.md"", ""pages/topics/resources/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""https://zp.kemt.fei.tuke.sk/topics/resources"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0544,test,keyword_grounding,medium,hybrid,Ktorá stáž osoby Youssef Ressaissi súvisela s témou Slovak?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/interns/yussef_ressaissi/README.md"", ""pages/topics/resources/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi"", ""https://zp.kemt.fei.tuke.sk/topics/resources"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]"
|
||||
q0545,test,keyword_grounding,medium,fts,Ktorá stáž osoby Youssef Ressaissi súvisela s témou ROUGE?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/interns/yussef_ressaissi/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/topics/prodigy/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/topics/prodigy"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0545,test,keyword_grounding,medium,vector,Ktorá stáž osoby Youssef Ressaissi súvisela s témou ROUGE?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/students/2022/yevhenii_leonov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov""]"
|
||||
q0545,test,keyword_grounding,medium,hybrid,Ktorá stáž osoby Youssef Ressaissi súvisela s témou ROUGE?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/interns/yussef_ressaissi/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2021/eduard_matovka/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka""]"
|
||||
q0546,test,specific_fact,medium,fts,Aký bol hlavný cieľ stáže Youssefa Ressaissiho?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2016/jan_holp/timovy_projekt/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q0546,test,specific_fact,medium,vector,Aký bol hlavný cieľ stáže Youssefa Ressaissiho?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/students/2019/filip_tomas/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q0546,test,specific_fact,medium,hybrid,Aký bol hlavný cieľ stáže Youssefa Ressaissiho?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2019/filip_tomas/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q0547,test,specific_fact,medium,fts,Aké dve klasické metriky používal Youssef Ressaissi pri sumarizácii?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/interns/yussef_ressaissi/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2020/kamil_tomcufcik/README.md"", ""pages/students/2021/eduard_matovka/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2020/kamil_tomcufcik"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka""]"
|
||||
q0547,test,specific_fact,medium,vector,Aké dve klasické metriky používal Youssef Ressaissi pri sumarizácii?,3,0.333333,0,1,1,0.0,1.0,1.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/interns/yussef_ressaissi/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2022/yevhenii_leonov/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov""]"
|
||||
q0547,test,specific_fact,medium,hybrid,Aké dve klasické metriky používal Youssef Ressaissi pri sumarizácii?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/interns/yussef_ressaissi/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/students/2022/yevhenii_leonov/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0548,test,specific_fact,medium,fts,Ktoré modely podľa stavu vyzerali najlepšie pri práci Youssefa Ressaissiho?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/topics/steel/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2016/patrik_pavlisin/tp20/README.md"", ""pages/topics/akopisat/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/steel"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/tp20"", ""https://zp.kemt.fei.tuke.sk/topics/akopisat""]"
|
||||
q0548,test,specific_fact,medium,vector,Ktoré modely podľa stavu vyzerali najlepšie pri práci Youssefa Ressaissiho?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/train_experiments/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2021/artur_hyrenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021/train_experiments"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko""]"
|
||||
q0548,test,specific_fact,medium,hybrid,Ktoré modely podľa stavu vyzerali najlepšie pri práci Youssefa Ressaissiho?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/yussef_ressaissi/README.md""]","[""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2022/oleh_poiasnik/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0558,test,entity_lookup,easy,fts,Nájdi dokument o stážistovi Sevval Bulburu.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/interns/sevval_bulburu/README.md"", ""pages/topics/hatespeech/README.md"", ""pages/students/2019/david_stromp/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/topics/hatespeech"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0558,test,entity_lookup,easy,vector,Nájdi dokument o stážistovi Sevval Bulburu.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/interns/sevval_bulburu/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/interns/oliver_pejic/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q0558,test,entity_lookup,easy,hybrid,Nájdi dokument o stážistovi Sevval Bulburu.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/interns/sevval_bulburu/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/interns/oliver_pejic/README.md"", ""pages/students/2023/samuel_dzurina/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q0559,test,internship_year,easy,fts,V ktorom roku prebiehala stáž osoby Sevval Bulburu?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/interns/sevval_bulburu/README.md"", ""pages/topics/hatespeech/README.md"", ""pages/students/2016/patrik_pavlisin/dp22/README.md"", ""pages/topics/prodigy/README.md"", ""pages/topics/faq/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/topics/hatespeech"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp22"", ""https://zp.kemt.fei.tuke.sk/topics/prodigy"", ""https://zp.kemt.fei.tuke.sk/topics/faq""]"
|
||||
q0559,test,internship_year,easy,vector,V ktorom roku prebiehala stáž osoby Sevval Bulburu?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md"", ""pages/students/2022/serhii_yemets/README.md"", ""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi"", ""https://zp.kemt.fei.tuke.sk/students/2022/serhii_yemets"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]"
|
||||
q0559,test,internship_year,easy,hybrid,V ktorom roku prebiehala stáž osoby Sevval Bulburu?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/interns/sevval_bulburu/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md"", ""pages/students/2022/serhii_yemets/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi"", ""https://zp.kemt.fei.tuke.sk/students/2022/serhii_yemets""]"
|
||||
q0560,test,internship_topic,medium,fts,Akému problému alebo téme sa venovala stáž osoby Sevval Bulburu?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/interns/sevval_bulburu/README.md"", ""pages/topics/hatespeech/README.md"", ""pages/topics/prodigy/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2016/patrik_pavlisin/dp22/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/topics/hatespeech"", ""https://zp.kemt.fei.tuke.sk/topics/prodigy"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp22""]"
|
||||
q0560,test,internship_topic,medium,vector,Akému problému alebo téme sa venovala stáž osoby Sevval Bulburu?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/students/2018/oleh_bilykh/README.md"", ""pages/topics/question/nezodpovedatelne/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2019/alina_vitko/README.md"", ""pages/students/2019/filip_tomas/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""]"
|
||||
q0560,test,internship_topic,medium,hybrid,Akému problému alebo téme sa venovala stáž osoby Sevval Bulburu?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/interns/sevval_bulburu/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/topics/question/nezodpovedatelne/README.md"", ""pages/students/2020/vladyslav_krupko/README.md"", ""pages/students/2019/alina_vitko/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]"
|
||||
q0562,test,keyword_grounding,medium,fts,Ktorá stáž osoby Sevval Bulburu súvisela s témou Hate Speech?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/interns/sevval_bulburu/README.md"", ""pages/topics/hatespeech/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md"", ""pages/interns/oliver_pejic/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/topics/hatespeech"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak"", ""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic""]"
|
||||
q0562,test,keyword_grounding,medium,vector,Ktorá stáž osoby Sevval Bulburu súvisela s témou Hate Speech?,2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/topics/hatespeech/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/interns/oliver_pejic/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/hatespeech"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic""]"
|
||||
q0562,test,keyword_grounding,medium,hybrid,Ktorá stáž osoby Sevval Bulburu súvisela s témou Hate Speech?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/interns/sevval_bulburu/README.md"", ""pages/topics/hatespeech/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md"", ""pages/students/2021/manohar_gowdru_shridharu/README.md"", ""pages/students/2017/martin_jancura/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/topics/hatespeech"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""]"
|
||||
q0563,test,keyword_grounding,medium,fts,Ktorá stáž osoby Sevval Bulburu súvisela s témou BERT?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/interns/sevval_bulburu/README.md"", ""pages/topics/hatespeech/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/topics/prodigy/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/topics/hatespeech"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/topics/prodigy"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0563,test,keyword_grounding,medium,vector,Ktorá stáž osoby Sevval Bulburu súvisela s témou BERT?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md"", ""pages/students/2022/serhii_yemets/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas"", ""https://zp.kemt.fei.tuke.sk/students/2022/serhii_yemets""]"
|
||||
q0563,test,keyword_grounding,medium,hybrid,Ktorá stáž osoby Sevval Bulburu súvisela s témou BERT?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/interns/sevval_bulburu/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2020/matus_suchanic/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]"
|
||||
q0564,test,keyword_grounding,medium,fts,Ktorá stáž osoby Sevval Bulburu súvisela s témou SMOTE?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/interns/sevval_bulburu/README.md"", ""pages/topics/hatespeech/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/topics/prodigy/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/topics/hatespeech"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/topics/prodigy"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0564,test,keyword_grounding,medium,vector,Ktorá stáž osoby Sevval Bulburu súvisela s témou SMOTE?,4,0.25,0,0,1,0.0,0.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/students/2019/michal_stromko/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/students/2019/alina_vitko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""]"
|
||||
q0564,test,keyword_grounding,medium,hybrid,Ktorá stáž osoby Sevval Bulburu súvisela s témou SMOTE?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/interns/sevval_bulburu/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2023/simona_bobrovcanova/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""]"
|
||||
q0565,test,specific_fact,medium,fts,Akú metódu upsamplingu Sevval Bulburu vyskúšala a nefungovala?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/interns/sevval_bulburu/README.md"", ""pages/topics/hatespeech/README.md"", ""pages/students/2018/adrian_remias/README.md"", ""pages/topics/faq/README.md"", ""pages/topics/akopisat/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/topics/hatespeech"", ""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/topics/akopisat""]"
|
||||
q0565,test,specific_fact,medium,vector,Akú metódu upsamplingu Sevval Bulburu vyskúšala a nefungovala?,2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/students/2018/oleh_bilykh/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]"
|
||||
q0565,test,specific_fact,medium,hybrid,Akú metódu upsamplingu Sevval Bulburu vyskúšala a nefungovala?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/interns/sevval_bulburu/README.md"", ""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2018/oleh_bilykh/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]"
|
||||
q0566,test,specific_fact,medium,fts,Aký webový framework použila Sevval Bulburu pre aplikáciu?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/interns/sevval_bulburu/README.md"", ""pages/topics/hatespeech/README.md"", ""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/topics/hatespeech"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]"
|
||||
q0566,test,specific_fact,medium,vector,Aký webový framework použila Sevval Bulburu pre aplikáciu?,2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/students/2022/samuel_vasil/README.md"", ""pages/interns/sevval_bulburu/README.md"", ""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2022/jan_ptak/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""]"
|
||||
q0566,test,specific_fact,medium,hybrid,Aký webový framework použila Sevval Bulburu pre aplikáciu?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/interns/sevval_bulburu/README.md"", ""pages/students/2023/ronald_zalacko/README.md"", ""pages/students/2019/alina_vitko/README.md"", ""pages/students/2022/samuel_vasil/README.md"", ""pages/students/2023/oleksandr_dorybohov/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""]"
|
||||
q0567,test,specific_fact,medium,fts,Aký anotačný nástroj si Sevval Bulburu naštudovala?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/interns/sevval_bulburu/README.md"", ""pages/topics/hatespeech/README.md"", ""pages/topics/named-entity/README.md"", ""pages/topics/nlp/README.md"", ""pages/students/2018/NaN1name_buday/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/topics/hatespeech"", ""https://zp.kemt.fei.tuke.sk/topics/named-entity"", ""https://zp.kemt.fei.tuke.sk/topics/nlp"", ""https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday""]"
|
||||
q0567,test,specific_fact,medium,vector,Aký anotačný nástroj si Sevval Bulburu naštudovala?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/interns/sevval_bulburu/README.md"", ""pages/students/2022/serhii_yemets/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/README.md"", ""pages/students/2019/artem_yatsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2022/serhii_yemets"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""]"
|
||||
q0567,test,specific_fact,medium,hybrid,Aký anotačný nástroj si Sevval Bulburu naštudovala?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/interns/sevval_bulburu/README.md""]","[""pages/interns/sevval_bulburu/README.md"", ""pages/students/2022/vladyslav_yanchenko/README.md"", ""pages/students/2022/serhii_yemets/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/README.md""]","[""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/serhii_yemets"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021""]"
|
||||
q0606,test,topic_page_lookup,easy,fts,Nájdi projektovú alebo informačnú stránku „Podpora slovenčiny v knižnici Spacy“.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/spacy/README.md""]","[""pages/topics/spacy/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2017/martin_jancura/README.md"", ""pages/students/2017/than_trung_thanh/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh""]"
|
||||
q0606,test,topic_page_lookup,easy,vector,Nájdi projektovú alebo informačnú stránku „Podpora slovenčiny v knižnici Spacy“.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/spacy/README.md""]","[""pages/topics/spacy/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0606,test,topic_page_lookup,easy,hybrid,Nájdi projektovú alebo informačnú stránku „Podpora slovenčiny v knižnici Spacy“.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/spacy/README.md""]","[""pages/topics/spacy/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt""]"
|
||||
q0607,test,topic_page_lookup,medium,fts,Ktorý dokument v ZP Wiki sa priamo venuje téme „Podpora slovenčiny v knižnici Spacy“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/spacy/README.md""]","[""pages/topics/spacy/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2019/samuel_horani/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani""]"
|
||||
q0607,test,topic_page_lookup,medium,vector,Ktorý dokument v ZP Wiki sa priamo venuje téme „Podpora slovenčiny v knižnici Spacy“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/spacy/README.md""]","[""pages/topics/spacy/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/topics/resources/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/topics/resources"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt""]"
|
||||
q0607,test,topic_page_lookup,medium,hybrid,Ktorý dokument v ZP Wiki sa priamo venuje téme „Podpora slovenčiny v knižnici Spacy“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/spacy/README.md""]","[""pages/topics/spacy/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/topics/resources/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/topics/resources""]"
|
||||
q0608,test,source_url,easy,fts,Aký source_url patrí k stránke „Podpora slovenčiny v knižnici Spacy“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/spacy/README.md""]","[""pages/topics/spacy/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt""]"
|
||||
q0608,test,source_url,easy,vector,Aký source_url patrí k stránke „Podpora slovenčiny v knižnici Spacy“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/spacy/README.md""]","[""pages/topics/spacy/README.md"", ""pages/topics/resources/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/students/2016/jakub_maruniak/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/topics/resources"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""]"
|
||||
q0608,test,source_url,easy,hybrid,Aký source_url patrí k stránke „Podpora slovenčiny v knižnici Spacy“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/spacy/README.md""]","[""pages/topics/spacy/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2017/than_trung_thanh/README.md"", ""pages/topics/resources/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/topics/resources""]"
|
||||
q0612,test,specific_fact,medium,fts,Aké dve hlavné štatistické úlohy má projekt podpory slovenčiny v Spacy trénovať?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/spacy/README.md""]","[""pages/topics/spacy/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/students/2016/lukas_pokryvka/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]"
|
||||
q0612,test,specific_fact,medium,vector,Aké dve hlavné štatistické úlohy má projekt podpory slovenčiny v Spacy trénovať?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/spacy/README.md""]","[""pages/topics/spacy/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2016/jakub_maruniak/dp2021/annotation/README.md"", ""pages/students/2016/jakub_maruniak/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/dp2021/annotation"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""]"
|
||||
q0612,test,specific_fact,medium,hybrid,Aké dve hlavné štatistické úlohy má projekt podpory slovenčiny v Spacy trénovať?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/spacy/README.md""]","[""pages/topics/spacy/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2018/martin_wencel/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""]"
|
||||
q0613,test,specific_fact,medium,fts,Aké slovné vektory boli zahrnuté do modelu Spacy?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/spacy/README.md""]","[""pages/topics/spacy/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2022/serhii_yemets/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2022/serhii_yemets"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0613,test,specific_fact,medium,vector,Aké slovné vektory boli zahrnuté do modelu Spacy?,2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/topics/spacy/README.md""]","[""pages/students/2019/kristian_sopkovic/README.md"", ""pages/topics/spacy/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0613,test,specific_fact,medium,hybrid,Aké slovné vektory boli zahrnuté do modelu Spacy?,2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/topics/spacy/README.md""]","[""pages/students/2019/kristian_sopkovic/README.md"", ""pages/topics/spacy/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2022/serhii_yemets/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2022/serhii_yemets""]"
|
||||
q0614,test,specific_fact,medium,fts,Ktorí ľudia sú uvedení pri projekte podpory slovenčiny v Spacy?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/spacy/README.md""]","[""pages/topics/spacy/README.md"", ""pages/students/2019/michal_stromko/vp2021/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/topics/faq/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko/vp2021"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/topics/faq""]"
|
||||
q0614,test,specific_fact,medium,vector,Ktorí ľudia sú uvedení pri projekte podpory slovenčiny v Spacy?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/spacy/README.md""]","[""pages/topics/spacy/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2019/kristian_sopkovic/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0614,test,specific_fact,medium,hybrid,Ktorí ľudia sú uvedení pri projekte podpory slovenčiny v Spacy?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/spacy/README.md""]","[""pages/topics/spacy/README.md"", ""pages/students/2016/jakub_maruniak/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2019/kristian_sopkovic/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/spacy"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""]"
|
||||
q0625,test,topic_page_lookup,easy,fts,Nájdi projektovú alebo informačnú stránku „Morfologická analýza slovenského jazyka“.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/morphology/README.md""]","[""pages/topics/morphology/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/topics/otvorene/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/topics/bert/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/morphology"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/topics/bert""]"
|
||||
q0625,test,topic_page_lookup,easy,vector,Nájdi projektovú alebo informačnú stránku „Morfologická analýza slovenského jazyka“.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/morphology/README.md""]","[""pages/topics/morphology/README.md"", ""pages/topics/otvorene/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/topics/hatespeech/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/morphology"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/topics/hatespeech"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0625,test,topic_page_lookup,easy,hybrid,Nájdi projektovú alebo informačnú stránku „Morfologická analýza slovenského jazyka“.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/morphology/README.md""]","[""pages/topics/morphology/README.md"", ""pages/topics/otvorene/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/topics/bert/README.md"", ""pages/students/2020/vladyslav_krupko/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/morphology"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/topics/bert"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""]"
|
||||
q0626,test,topic_page_lookup,medium,fts,Ktorý dokument v ZP Wiki sa priamo venuje téme „Morfologická analýza slovenského jazyka“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/morphology/README.md""]","[""pages/topics/morphology/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/topics/otvorene/README.md"", ""pages/topics/bert/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/morphology"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/topics/bert"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0626,test,topic_page_lookup,medium,vector,Ktorý dokument v ZP Wiki sa priamo venuje téme „Morfologická analýza slovenského jazyka“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/morphology/README.md""]","[""pages/topics/morphology/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/topics/resources/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/jakub_maruniak/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/morphology"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/topics/resources"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""]"
|
||||
q0626,test,topic_page_lookup,medium,hybrid,Ktorý dokument v ZP Wiki sa priamo venuje téme „Morfologická analýza slovenského jazyka“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/morphology/README.md""]","[""pages/topics/morphology/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/topics/faq/README.md"", ""pages/topics/bert/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/morphology"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/topics/bert""]"
|
||||
q0627,test,source_url,easy,fts,Aký source_url patrí k stránke „Morfologická analýza slovenského jazyka“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/morphology/README.md""]","[""pages/topics/morphology/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/topics/otvorene/README.md"", ""pages/topics/bert/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/morphology"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/topics/bert"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0627,test,source_url,easy,vector,Aký source_url patrí k stránke „Morfologická analýza slovenského jazyka“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/morphology/README.md""]","[""pages/topics/morphology/README.md"", ""pages/topics/resources/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/topics/bert/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/morphology"", ""https://zp.kemt.fei.tuke.sk/topics/resources"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/topics/bert"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0627,test,source_url,easy,hybrid,Aký source_url patrí k stránke „Morfologická analýza slovenského jazyka“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/morphology/README.md""]","[""pages/topics/morphology/README.md"", ""pages/topics/bert/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/topics/resources/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/morphology"", ""https://zp.kemt.fei.tuke.sk/topics/bert"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/topics/resources"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0631,test,specific_fact,medium,fts,Aké tri prístupy alebo nástroje sú uvedené pri morfologickej analýze slovenského jazyka?,,0.0,0,0,0,0.0,0.0,0.0,"[""pages/topics/morphology/README.md""]","[""pages/topics/otvorene/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/topics/bert/README.md"", ""pages/topics/nlp/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/topics/bert"", ""https://zp.kemt.fei.tuke.sk/topics/nlp""]"
|
||||
q0631,test,specific_fact,medium,vector,Aké tri prístupy alebo nástroje sú uvedené pri morfologickej analýze slovenského jazyka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/morphology/README.md""]","[""pages/topics/morphology/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/topics/resources/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/morphology"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/topics/resources""]"
|
||||
q0631,test,specific_fact,medium,hybrid,Aké tri prístupy alebo nástroje sú uvedené pri morfologickej analýze slovenského jazyka?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/morphology/README.md""]","[""pages/topics/morphology/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/students/2018/martin_wencel/README.md"", ""pages/topics/nlp/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/morphology"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/topics/nlp""]"
|
||||
q0642,test,topic_page_lookup,easy,fts,Nájdi projektovú alebo informačnú stránku „Jazyk Python“.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/python/README.md""]","[""pages/topics/python/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/students/2021/matej_scislak/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/python"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""]"
|
||||
q0642,test,topic_page_lookup,easy,vector,Nájdi projektovú alebo informačnú stránku „Jazyk Python“.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/python/README.md""]","[""pages/topics/python/README.md"", ""pages/students/2022/tetiana_mohorian/README.md"", ""pages/students/2017/stanislav_matsunych/README.md"", ""pages/students/2016/darius_lindvai/README.md"", ""pages/topics/otvorene/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/python"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian"", ""https://zp.kemt.fei.tuke.sk/students/2017/stanislav_matsunych"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene""]"
|
||||
q0642,test,topic_page_lookup,easy,hybrid,Nájdi projektovú alebo informačnú stránku „Jazyk Python“.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/python/README.md""]","[""pages/topics/python/README.md"", ""pages/students/2021/oleksandr_hryshchenko/README.md"", ""pages/students/2022/tetiana_mohorian/README.md"", ""pages/topics/nlp/README.md"", ""pages/students/2021/eduard_matovka/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/python"", ""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian"", ""https://zp.kemt.fei.tuke.sk/topics/nlp"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka""]"
|
||||
q0643,test,topic_page_lookup,medium,fts,Ktorý dokument v ZP Wiki sa priamo venuje téme „Jazyk Python“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/python/README.md""]","[""pages/topics/python/README.md"", ""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2019/michal_stromko/vp2021/README.md"", ""pages/students/2016/patrik_pavlisin/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/python"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko/vp2021"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""]"
|
||||
q0643,test,topic_page_lookup,medium,vector,Ktorý dokument v ZP Wiki sa priamo venuje téme „Jazyk Python“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/python/README.md""]","[""pages/topics/python/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2019/michal_stromko/vp2021/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/python"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko/vp2021""]"
|
||||
q0643,test,topic_page_lookup,medium,hybrid,Ktorý dokument v ZP Wiki sa priamo venuje téme „Jazyk Python“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/python/README.md""]","[""pages/topics/python/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2019/michal_stromko/vp2021/README.md"", ""pages/students/2023/maksym_zatirka/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/python"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko/vp2021"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt""]"
|
||||
q0644,test,source_url,easy,fts,Aký source_url patrí k stránke „Jazyk Python“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/python/README.md""]","[""pages/topics/python/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/python"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial""]"
|
||||
q0644,test,source_url,easy,vector,Aký source_url patrí k stránke „Jazyk Python“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/python/README.md""]","[""pages/topics/python/README.md"", ""pages/topics/nlp/README.md"", ""pages/topics/resources/README.md"", ""pages/students/2017/stanislav_matsunych/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/python"", ""https://zp.kemt.fei.tuke.sk/topics/nlp"", ""https://zp.kemt.fei.tuke.sk/topics/resources"", ""https://zp.kemt.fei.tuke.sk/students/2017/stanislav_matsunych"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas""]"
|
||||
q0644,test,source_url,easy,hybrid,Aký source_url patrí k stránke „Jazyk Python“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/python/README.md""]","[""pages/topics/python/README.md"", ""pages/students/2017/stanislav_matsunych/README.md"", ""pages/topics/nlp/README.md"", ""pages/topics/resources/README.md"", ""pages/students/2020/jakub_kristian_lukas/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/python"", ""https://zp.kemt.fei.tuke.sk/students/2017/stanislav_matsunych"", ""https://zp.kemt.fei.tuke.sk/topics/nlp"", ""https://zp.kemt.fei.tuke.sk/topics/resources"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas""]"
|
||||
q0646,test,topic_page_lookup,easy,fts,Nájdi projektovú alebo informačnú stránku „Záverečné práce a projekty“.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/akopisat/README.md""]","[""pages/topics/akopisat/README.md"", ""pages/topics/otvorene/README.md"", ""pages/students/2021/martin_sarissky/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2018/ondrej_megela/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""]"
|
||||
q0646,test,topic_page_lookup,easy,vector,Nájdi projektovú alebo informačnú stránku „Záverečné práce a projekty“.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/akopisat/README.md""]","[""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/topics/otvorene/README.md"", ""pages/students/2019/michal_stromko/vp2021/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko/vp2021""]"
|
||||
q0646,test,topic_page_lookup,easy,hybrid,Nájdi projektovú alebo informačnú stránku „Záverečné práce a projekty“.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/akopisat/README.md""]","[""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md"", ""pages/topics/otvorene/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2019/michal_stromko/vp2021/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko/vp2021""]"
|
||||
q0647,test,topic_page_lookup,medium,fts,Ktorý dokument v ZP Wiki sa priamo venuje téme „Záverečné práce a projekty“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/akopisat/README.md""]","[""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2017/dmytro_ushatenko/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/topics/otvorene/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene""]"
|
||||
q0647,test,topic_page_lookup,medium,vector,Ktorý dokument v ZP Wiki sa priamo venuje téme „Záverečné práce a projekty“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/akopisat/README.md""]","[""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2019/michal_stromko/vp2021/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko/vp2021"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0647,test,topic_page_lookup,medium,hybrid,Ktorý dokument v ZP Wiki sa priamo venuje téme „Záverečné práce a projekty“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/akopisat/README.md""]","[""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2019/michal_stromko/vp2021/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/topics/otvorene/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko/vp2021"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene""]"
|
||||
q0648,test,source_url,easy,fts,Aký source_url patrí k stránke „Záverečné práce a projekty“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/akopisat/README.md""]","[""pages/topics/akopisat/README.md"", ""pages/topics/otvorene/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2023/yevhenii_medushivskyi/README.md"", ""pages/topics/bert/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi"", ""https://zp.kemt.fei.tuke.sk/topics/bert""]"
|
||||
q0648,test,source_url,easy,vector,Aký source_url patrí k stránke „Záverečné práce a projekty“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/akopisat/README.md""]","[""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md"", ""pages/topics/otvorene/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2019/michal_stromko/vp2021/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko/vp2021""]"
|
||||
q0648,test,source_url,easy,hybrid,Aký source_url patrí k stránke „Záverečné práce a projekty“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/akopisat/README.md""]","[""pages/topics/akopisat/README.md"", ""pages/topics/faq/README.md"", ""pages/topics/otvorene/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2019/michal_stromko/vp2021/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko/vp2021""]"
|
||||
q0654,test,topic_page_lookup,easy,fts,Nájdi projektovú alebo informačnú stránku „Prepis postupností“.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/seq2seq/README.md""]","[""pages/topics/seq2seq/README.md"", ""pages/students/2022/andrii_pervashov/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/patrik_pavlisin/dp22/README.md"", ""pages/topics/question/navod/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/seq2seq"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp22"", ""https://zp.kemt.fei.tuke.sk/topics/question/navod""]"
|
||||
q0654,test,topic_page_lookup,easy,vector,Nájdi projektovú alebo informačnú stránku „Prepis postupností“.,3,0.333333,0,1,1,0.0,1.0,1.0,"[""pages/topics/seq2seq/README.md""]","[""pages/topics/akopisat/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/topics/seq2seq/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/topics/faq/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/topics/seq2seq"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/topics/faq""]"
|
||||
q0654,test,topic_page_lookup,easy,hybrid,Nájdi projektovú alebo informačnú stránku „Prepis postupností“.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/seq2seq/README.md""]","[""pages/topics/seq2seq/README.md"", ""pages/topics/akopisat/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/topics/faq/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/seq2seq"", ""https://zp.kemt.fei.tuke.sk/topics/akopisat"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/topics/faq""]"
|
||||
q0655,test,topic_page_lookup,medium,fts,Ktorý dokument v ZP Wiki sa priamo venuje téme „Prepis postupností“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/seq2seq/README.md""]","[""pages/topics/seq2seq/README.md"", ""pages/students/2016/patrik_pavlisin/dp22/README.md"", ""pages/topics/steel/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/patrik_pavlisin/dp21/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/seq2seq"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp22"", ""https://zp.kemt.fei.tuke.sk/topics/steel"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp21""]"
|
||||
q0655,test,topic_page_lookup,medium,vector,Ktorý dokument v ZP Wiki sa priamo venuje téme „Prepis postupností“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/seq2seq/README.md""]","[""pages/topics/seq2seq/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2022/jan_malinovsky/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/seq2seq"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0655,test,topic_page_lookup,medium,hybrid,Ktorý dokument v ZP Wiki sa priamo venuje téme „Prepis postupností“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/seq2seq/README.md""]","[""pages/topics/seq2seq/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2016/jakub_maruniak/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/seq2seq"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""]"
|
||||
q0656,test,source_url,easy,fts,Aký source_url patrí k stránke „Prepis postupností“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/seq2seq/README.md""]","[""pages/topics/seq2seq/README.md"", ""pages/students/2016/patrik_pavlisin/dp21/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2016/patrik_pavlisin/dp22/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/seq2seq"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp21"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp22"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak""]"
|
||||
q0656,test,source_url,easy,vector,Aký source_url patrí k stránke „Prepis postupností“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/seq2seq/README.md""]","[""pages/topics/seq2seq/README.md"", ""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/seq2seq"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q0656,test,source_url,easy,hybrid,Aký source_url patrí k stránke „Prepis postupností“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/seq2seq/README.md""]","[""pages/topics/seq2seq/README.md"", ""pages/students/2016/darius_lindvai/README.md"", ""pages/students/2023/rostyslav_rodzhuk/README.md"", ""pages/students/2018/ondrej_megela/README.md"", ""pages/students/2023/samuel_dzurina/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/seq2seq"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""]"
|
||||
q0664,test,topic_page_lookup,easy,fts,Nájdi projektovú alebo informačnú stránku „Nástroje a zdroje pre spracovanie prirodzeného jazyka“.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/nlp/README.md""]","[""pages/topics/nlp/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/students/2021/eduard_matovka/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2018/NaN1name_buday/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/nlp"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday""]"
|
||||
q0664,test,topic_page_lookup,easy,vector,Nájdi projektovú alebo informačnú stránku „Nástroje a zdroje pre spracovanie prirodzeného jazyka“.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/nlp/README.md""]","[""pages/topics/nlp/README.md"", ""pages/topics/otvorene/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/students/2018/NaN1name_buday/README.md"", ""pages/topics/hatespeech/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/nlp"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday"", ""https://zp.kemt.fei.tuke.sk/topics/hatespeech""]"
|
||||
q0664,test,topic_page_lookup,easy,hybrid,Nájdi projektovú alebo informačnú stránku „Nástroje a zdroje pre spracovanie prirodzeného jazyka“.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/nlp/README.md""]","[""pages/topics/nlp/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/students/2018/NaN1name_buday/README.md"", ""pages/topics/otvorene/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/nlp"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt""]"
|
||||
q0665,test,topic_page_lookup,medium,fts,Ktorý dokument v ZP Wiki sa priamo venuje téme „Nástroje a zdroje pre spracovanie prirodzeného jazyka“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/nlp/README.md""]","[""pages/topics/nlp/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/students/2016/maros_harahus/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/nlp"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""]"
|
||||
q0665,test,topic_page_lookup,medium,vector,Ktorý dokument v ZP Wiki sa priamo venuje téme „Nástroje a zdroje pre spracovanie prirodzeného jazyka“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/nlp/README.md""]","[""pages/topics/nlp/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/topics/resources/README.md"", ""pages/students/2019/michal_stromko/vp2021/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/nlp"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/topics/resources"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko/vp2021"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt""]"
|
||||
q0665,test,topic_page_lookup,medium,hybrid,Ktorý dokument v ZP Wiki sa priamo venuje téme „Nástroje a zdroje pre spracovanie prirodzeného jazyka“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/nlp/README.md""]","[""pages/topics/nlp/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/topics/resources/README.md"", ""pages/students/2016/lukas_pokryvka/timovy_projekt/README.md"", ""pages/students/2016/lukas_pokryvka/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/nlp"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/topics/resources"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]"
|
||||
q0666,test,source_url,easy,fts,Aký source_url patrí k stránke „Nástroje a zdroje pre spracovanie prirodzeného jazyka“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/nlp/README.md""]","[""pages/topics/nlp/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/students/2016/maros_harahus/README.md"", ""pages/students/2018/NaN1name_buday/README.md"", ""pages/students/2016/patrik_pavlisin/tp20/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/nlp"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/tp20""]"
|
||||
q0666,test,source_url,easy,vector,Aký source_url patrí k stránke „Nástroje a zdroje pre spracovanie prirodzeného jazyka“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/nlp/README.md""]","[""pages/topics/nlp/README.md"", ""pages/topics/resources/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/interns/sevval_bulburu/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/nlp"", ""https://zp.kemt.fei.tuke.sk/topics/resources"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu""]"
|
||||
q0666,test,source_url,easy,hybrid,Aký source_url patrí k stránke „Nástroje a zdroje pre spracovanie prirodzeného jazyka“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/nlp/README.md""]","[""pages/topics/nlp/README.md"", ""pages/students/2016/maros_harahus/timovy_projekt/README.md"", ""pages/students/2016/jakub_maruniak/timovy_projekt/README.md"", ""pages/topics/resources/README.md"", ""pages/students/2016/lukas_pokryvka/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/nlp"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/topics/resources"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""]"
|
||||
q0670,test,topic_page_lookup,easy,fts,Nájdi projektovú alebo informačnú stránku „Tvorba nezodpovedateľných otázok“.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/question/nezodpovedatelne/README.md""]","[""pages/topics/question/nezodpovedatelne/README.md"", ""pages/topics/question/navod/README.md"", ""pages/topics/otvorene/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/topics/question/navod"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0670,test,topic_page_lookup,easy,vector,Nájdi projektovú alebo informačnú stránku „Tvorba nezodpovedateľných otázok“.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/question/nezodpovedatelne/README.md""]","[""pages/topics/question/nezodpovedatelne/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/topics/otvorene/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0670,test,topic_page_lookup,easy,hybrid,Nájdi projektovú alebo informačnú stránku „Tvorba nezodpovedateľných otázok“.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/question/nezodpovedatelne/README.md""]","[""pages/topics/question/nezodpovedatelne/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/topics/otvorene/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0671,test,topic_page_lookup,medium,fts,Ktorý dokument v ZP Wiki sa priamo venuje téme „Tvorba nezodpovedateľných otázok“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/question/nezodpovedatelne/README.md""]","[""pages/topics/question/nezodpovedatelne/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/topics/otvorene/README.md"", ""pages/topics/question/navod/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/topics/otvorene"", ""https://zp.kemt.fei.tuke.sk/topics/question/navod""]"
|
||||
q0671,test,topic_page_lookup,medium,vector,Ktorý dokument v ZP Wiki sa priamo venuje téme „Tvorba nezodpovedateľných otázok“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/question/nezodpovedatelne/README.md""]","[""pages/topics/question/nezodpovedatelne/README.md"", ""pages/topics/faq/README.md"", ""pages/topics/question/navod/README.md"", ""pages/topics/question/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/topics/question/navod"", ""https://zp.kemt.fei.tuke.sk/topics/question"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0671,test,topic_page_lookup,medium,hybrid,Ktorý dokument v ZP Wiki sa priamo venuje téme „Tvorba nezodpovedateľných otázok“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/question/nezodpovedatelne/README.md""]","[""pages/topics/question/nezodpovedatelne/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/michal_stromko/vp2021/README.md"", ""pages/topics/question/validacie/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko/vp2021"", ""https://zp.kemt.fei.tuke.sk/topics/question/validacie""]"
|
||||
q0672,test,source_url,easy,fts,Aký source_url patrí k stránke „Tvorba nezodpovedateľných otázok“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/question/nezodpovedatelne/README.md""]","[""pages/topics/question/nezodpovedatelne/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2016/patrik_pavlisin/dp22/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin/dp22""]"
|
||||
q0672,test,source_url,easy,vector,Aký source_url patrí k stránke „Tvorba nezodpovedateľných otázok“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/question/nezodpovedatelne/README.md""]","[""pages/topics/question/nezodpovedatelne/README.md"", ""pages/topics/question/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/topics/question"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0672,test,source_url,easy,hybrid,Aký source_url patrí k stránke „Tvorba nezodpovedateľných otázok“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/question/nezodpovedatelne/README.md""]","[""pages/topics/question/nezodpovedatelne/README.md"", ""pages/topics/question/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/topics/question"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0680,test,topic_page_lookup,easy,fts,Nájdi projektovú alebo informačnú stránku „Validácia otázok a odpovedí“.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/question/validacie/README.md""]","[""pages/topics/question/validacie/README.md"", ""pages/topics/question/navod/README.md"", ""pages/students/2021/artur_hyrenko/README.md"", ""pages/students/2019/michal_stromko/README.md"", ""pages/students/2016/tomas_kucharik/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/question/validacie"", ""https://zp.kemt.fei.tuke.sk/topics/question/navod"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""]"
|
||||
q0680,test,topic_page_lookup,easy,vector,Nájdi projektovú alebo informačnú stránku „Validácia otázok a odpovedí“.,2,0.5,0,1,1,0.0,1.0,1.0,"[""pages/topics/question/validacie/README.md""]","[""pages/students/2016/tomas_kucharik/README.md"", ""pages/topics/question/validacie/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2020/matej_kobylan/README.md"", ""pages/students/2021/martin_sarissky/README.md""]","[""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/topics/question/validacie"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""]"
|
||||
q0680,test,topic_page_lookup,easy,hybrid,Nájdi projektovú alebo informačnú stránku „Validácia otázok a odpovedí“.,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/question/validacie/README.md""]","[""pages/topics/question/validacie/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2022/valerii_kutsenko/README.md"", ""pages/topics/question/nezodpovedatelne/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/question/validacie"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne""]"
|
||||
q0681,test,topic_page_lookup,medium,fts,Ktorý dokument v ZP Wiki sa priamo venuje téme „Validácia otázok a odpovedí“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/question/validacie/README.md""]","[""pages/topics/question/validacie/README.md"", ""pages/topics/question/navod/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/topics/faq/README.md"", ""pages/students/2019/michal_stromko/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/question/validacie"", ""https://zp.kemt.fei.tuke.sk/topics/question/navod"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""]"
|
||||
q0681,test,topic_page_lookup,medium,vector,Ktorý dokument v ZP Wiki sa priamo venuje téme „Validácia otázok a odpovedí“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/question/validacie/README.md""]","[""pages/topics/question/validacie/README.md"", ""pages/topics/faq/README.md"", ""pages/topics/question/nezodpovedatelne/README.md"", ""pages/topics/question/navod/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/question/validacie"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/topics/question/navod"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0681,test,topic_page_lookup,medium,hybrid,Ktorý dokument v ZP Wiki sa priamo venuje téme „Validácia otázok a odpovedí“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/question/validacie/README.md""]","[""pages/topics/question/validacie/README.md"", ""pages/topics/faq/README.md"", ""pages/topics/question/navod/README.md"", ""pages/topics/question/nezodpovedatelne/README.md"", ""pages/students/2022/valerii_kutsenko/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/question/validacie"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/topics/question/navod"", ""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""]"
|
||||
q0682,test,source_url,easy,fts,Aký source_url patrí k stránke „Validácia otázok a odpovedí“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/question/validacie/README.md""]","[""pages/topics/question/validacie/README.md"", ""pages/topics/question/navod/README.md"", ""pages/students/2016/patrik_pavlisin/README.md"", ""pages/students/2016/tomas_kucharik/README.md"", ""pages/students/2019/patrik_pokrivcak/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/question/validacie"", ""https://zp.kemt.fei.tuke.sk/topics/question/navod"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak""]"
|
||||
q0682,test,source_url,easy,vector,Aký source_url patrí k stránke „Validácia otázok a odpovedí“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/question/validacie/README.md""]","[""pages/topics/question/validacie/README.md"", ""pages/topics/faq/README.md"", ""pages/topics/question/README.md"", ""pages/topics/resources/README.md"", ""pages/topics/question/navod/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/question/validacie"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/topics/question"", ""https://zp.kemt.fei.tuke.sk/topics/resources"", ""https://zp.kemt.fei.tuke.sk/topics/question/navod""]"
|
||||
q0682,test,source_url,easy,hybrid,Aký source_url patrí k stránke „Validácia otázok a odpovedí“?,1,1.0,1,1,1,1.0,1.0,1.0,"[""pages/topics/question/validacie/README.md""]","[""pages/topics/question/validacie/README.md"", ""pages/topics/question/navod/README.md"", ""pages/topics/question/nezodpovedatelne/README.md"", ""pages/topics/faq/README.md"", ""pages/topics/question/README.md""]","[""https://zp.kemt.fei.tuke.sk/topics/question/validacie"", ""https://zp.kemt.fei.tuke.sk/topics/question/navod"", ""https://zp.kemt.fei.tuke.sk/topics/question/nezodpovedatelne"", ""https://zp.kemt.fei.tuke.sk/topics/faq"", ""https://zp.kemt.fei.tuke.sk/topics/question""]"
|
||||
|
Can't render this file because it is too large.
|
File diff suppressed because it is too large
Load Diff
@ -6,3 +6,4 @@ tiktoken>=0.8,<1
|
||||
uvicorn[standard]==0.48.0
|
||||
numpy==2.2.6
|
||||
sentence-transformers==5.7.0
|
||||
neo4j==6.3.1
|
||||
|
||||
16
scripts/start_project.sh
Executable file
16
scripts/start_project.sh
Executable file
@ -0,0 +1,16 @@
|
||||
#!/usr/bin/env bash
|
||||
set -euo pipefail
|
||||
|
||||
project_root="$(cd -- "$(dirname -- "${BASH_SOURCE[0]}")/.." && pwd)"
|
||||
docker_context="${ZP_DOCKER_CONTEXT:-default}"
|
||||
compose=(docker --context "$docker_context" compose --project-name zp-agent
|
||||
--project-directory "$project_root" -f "$project_root/docker-compose.yml")
|
||||
|
||||
docker --context "$docker_context" info --format '{{.ServerVersion}}' >/dev/null
|
||||
"${compose[@]}" version >/dev/null
|
||||
"${compose[@]}" config --quiet
|
||||
"${compose[@]}" build zp-agent-api
|
||||
"${compose[@]}" up -d --wait neo4j
|
||||
"${compose[@]}" run --rm -T --no-deps zp-agent-api python -m tools.bootstrap_indexes
|
||||
"${compose[@]}" up -d --no-build --wait zp-agent-api
|
||||
"${compose[@]}" ps
|
||||
@ -41,3 +41,21 @@ def security_environment(
|
||||
"WEBHOOK_PULL_GIT",
|
||||
"false",
|
||||
)
|
||||
monkeypatch.setenv('EXPECTED_GITEA_BRANCH', 'master')
|
||||
|
||||
|
||||
@pytest.fixture(autouse=True)
|
||||
def isolated_sync_queue(monkeypatch, tmp_path):
|
||||
"""API tests never start a real index rebuild or share production job state."""
|
||||
import app.main as main
|
||||
from tools.sync_jobs import SyncJobs
|
||||
|
||||
class PausedJobs(SyncJobs):
|
||||
def __init__(self, data_dir, **kwargs):
|
||||
super().__init__(tmp_path / 'jobs', runner=lambda **kw:
|
||||
main.rebuild_index(pull_git=kw['pull_git']))
|
||||
|
||||
def start(self):
|
||||
pass
|
||||
|
||||
monkeypatch.setattr(main, 'SyncJobs', PausedJobs)
|
||||
|
||||
297
test/test_api.py
297
test/test_api.py
@ -9,7 +9,7 @@ from fastapi.testclient import TestClient
|
||||
|
||||
import app.main as main
|
||||
import app.routes as routes
|
||||
from scripts.rebuild_index import (
|
||||
from tools.rag.rebuild_index import (
|
||||
ReindexInProgressError,
|
||||
)
|
||||
|
||||
@ -482,126 +482,40 @@ def test_sync_rejects_wrong_api_key(
|
||||
)
|
||||
|
||||
|
||||
def test_sync_accepts_valid_api_key(
|
||||
client: TestClient,
|
||||
monkeypatch: pytest.MonkeyPatch,
|
||||
) -> None:
|
||||
monkeypatch.setattr(
|
||||
routes,
|
||||
"rebuild_index",
|
||||
lambda pull_git=False: (
|
||||
fake_rebuild_result()
|
||||
),
|
||||
)
|
||||
|
||||
response = client.post(
|
||||
"/sync",
|
||||
headers={
|
||||
"X-API-Key": (
|
||||
SYNC_API_KEY
|
||||
),
|
||||
},
|
||||
json={
|
||||
"pull_git": False,
|
||||
},
|
||||
)
|
||||
|
||||
assert (
|
||||
response.status_code
|
||||
== 200
|
||||
)
|
||||
|
||||
assert (
|
||||
response.json()[
|
||||
"status"
|
||||
]
|
||||
== "ok"
|
||||
)
|
||||
def test_sync_accepts_valid_api_key(client, monkeypatch):
|
||||
monkeypatch.setattr(main, 'rebuild_index', lambda **kw: fake_rebuild_result())
|
||||
response = client.post('/sync', headers={'X-API-Key': SYNC_API_KEY}, json={'pull_git': False})
|
||||
assert response.status_code == 202
|
||||
assert response.json()['status'] == 'accepted'
|
||||
assert main.app.state.sync_jobs.run_once()
|
||||
result = client.get(response.json()['status_url'], headers={'X-API-Key': SYNC_API_KEY})
|
||||
assert result.json()['status'] == 'succeeded'
|
||||
assert result.json()['result'] == fake_rebuild_result()
|
||||
|
||||
|
||||
def test_sync_returns_conflict_when_reindex_is_running(
|
||||
client: TestClient,
|
||||
monkeypatch: pytest.MonkeyPatch,
|
||||
) -> None:
|
||||
def busy(
|
||||
*args,
|
||||
**kwargs,
|
||||
):
|
||||
raise (
|
||||
ReindexInProgressError(
|
||||
"Reindexovanie už prebieha"
|
||||
)
|
||||
)
|
||||
|
||||
monkeypatch.setattr(
|
||||
routes,
|
||||
"rebuild_index",
|
||||
busy,
|
||||
)
|
||||
|
||||
response = client.post(
|
||||
"/sync",
|
||||
headers={
|
||||
"X-API-Key": (
|
||||
SYNC_API_KEY
|
||||
),
|
||||
},
|
||||
json={
|
||||
"pull_git": False,
|
||||
},
|
||||
)
|
||||
|
||||
assert (
|
||||
response.status_code
|
||||
== 409
|
||||
)
|
||||
def test_sync_waits_when_reindex_is_running(client, monkeypatch):
|
||||
def busy(**kw): raise ReindexInProgressError('Reindexovanie už prebieha')
|
||||
monkeypatch.setattr(main, 'rebuild_index', busy)
|
||||
response = client.post('/sync', headers={'X-API-Key': SYNC_API_KEY}, json={})
|
||||
assert response.status_code == 202
|
||||
main.app.state.sync_jobs.run_once()
|
||||
job = client.get(response.json()['status_url'], headers={'X-API-Key': SYNC_API_KEY}).json()
|
||||
assert job['status'] == 'queued' and job['phase'] == 'waiting_for_lock'
|
||||
|
||||
|
||||
def test_sync_returns_generic_500_when_rebuild_fails(
|
||||
client: TestClient,
|
||||
monkeypatch: pytest.MonkeyPatch,
|
||||
) -> None:
|
||||
def failed_rebuild(
|
||||
*args,
|
||||
**kwargs,
|
||||
):
|
||||
raise RuntimeError(
|
||||
"private rebuild error"
|
||||
)
|
||||
|
||||
monkeypatch.setattr(
|
||||
routes,
|
||||
"rebuild_index",
|
||||
failed_rebuild,
|
||||
)
|
||||
|
||||
response = client.post(
|
||||
"/sync",
|
||||
headers={
|
||||
"X-API-Key": (
|
||||
SYNC_API_KEY
|
||||
),
|
||||
},
|
||||
json={
|
||||
"pull_git": False,
|
||||
},
|
||||
)
|
||||
|
||||
assert (
|
||||
response.status_code
|
||||
== 500
|
||||
)
|
||||
|
||||
assert response.json()[
|
||||
"detail"
|
||||
] == (
|
||||
routes.REINDEX_FAILED_DETAIL
|
||||
)
|
||||
|
||||
assert (
|
||||
"private rebuild error"
|
||||
not in response.text
|
||||
)
|
||||
def test_sync_records_failure_without_exposing_private_error(client, monkeypatch):
|
||||
def fail(**kw): raise RuntimeError('private rebuild error')
|
||||
monkeypatch.setattr(main, 'rebuild_index', fail)
|
||||
response = client.post('/sync', headers={'X-API-Key': SYNC_API_KEY}, json={})
|
||||
assert response.status_code == 202
|
||||
queue = main.app.state.sync_jobs
|
||||
for _ in range(3):
|
||||
with queue.connect() as conn: conn.execute('UPDATE jobs SET available_at=0')
|
||||
queue.run_once()
|
||||
status = client.get(response.json()['status_url'], headers={'X-API-Key': SYNC_API_KEY})
|
||||
assert status.json()['status'] == 'failed'
|
||||
assert status.json()['reason'] == 'sync_failed'
|
||||
assert 'private rebuild error' not in status.text
|
||||
|
||||
|
||||
def test_webhook_rejects_invalid_signature(
|
||||
@ -609,6 +523,7 @@ def test_webhook_rejects_invalid_signature(
|
||||
) -> None:
|
||||
body = json.dumps(
|
||||
{
|
||||
"ref": "refs/heads/master",
|
||||
"repository": {
|
||||
"full_name": (
|
||||
"KEMT/zpwiki"
|
||||
@ -675,6 +590,7 @@ def test_webhook_requires_event_header(
|
||||
) -> None:
|
||||
body = json.dumps(
|
||||
{
|
||||
"ref": "refs/heads/master",
|
||||
"repository": {
|
||||
"full_name": (
|
||||
"KEMT/zpwiki"
|
||||
@ -725,13 +641,14 @@ def test_webhook_ignores_non_push_event(
|
||||
)
|
||||
|
||||
monkeypatch.setattr(
|
||||
routes,
|
||||
main,
|
||||
"rebuild_index",
|
||||
fake_rebuild,
|
||||
)
|
||||
|
||||
body = json.dumps(
|
||||
{
|
||||
"ref": "refs/heads/master",
|
||||
"repository": {
|
||||
"full_name": (
|
||||
"KEMT/zpwiki"
|
||||
@ -780,6 +697,7 @@ def test_webhook_rejects_unexpected_repository(
|
||||
) -> None:
|
||||
body = json.dumps(
|
||||
{
|
||||
"ref": "refs/heads/master",
|
||||
"repository": {
|
||||
"full_name": (
|
||||
"OTHER/repository"
|
||||
@ -819,7 +737,7 @@ def test_webhook_accepts_signed_push(
|
||||
monkeypatch: pytest.MonkeyPatch,
|
||||
) -> None:
|
||||
monkeypatch.setattr(
|
||||
routes,
|
||||
main,
|
||||
"rebuild_index",
|
||||
lambda pull_git=False: (
|
||||
fake_rebuild_result()
|
||||
@ -828,6 +746,7 @@ def test_webhook_accepts_signed_push(
|
||||
|
||||
body = json.dumps(
|
||||
{
|
||||
"ref": "refs/heads/master",
|
||||
"repository": {
|
||||
"full_name": (
|
||||
"KEMT/zpwiki"
|
||||
@ -858,7 +777,7 @@ def test_webhook_accepts_signed_push(
|
||||
|
||||
assert (
|
||||
response.status_code
|
||||
== 200
|
||||
== 202
|
||||
)
|
||||
|
||||
payload = response.json()
|
||||
@ -878,122 +797,26 @@ def test_webhook_accepts_signed_push(
|
||||
)
|
||||
|
||||
|
||||
def test_webhook_returns_conflict_when_reindex_is_running(
|
||||
client: TestClient,
|
||||
monkeypatch: pytest.MonkeyPatch,
|
||||
) -> None:
|
||||
def busy(
|
||||
*args,
|
||||
**kwargs,
|
||||
):
|
||||
raise (
|
||||
ReindexInProgressError(
|
||||
"Reindexovanie už prebieha"
|
||||
)
|
||||
)
|
||||
|
||||
monkeypatch.setattr(
|
||||
routes,
|
||||
"rebuild_index",
|
||||
busy,
|
||||
)
|
||||
|
||||
body = json.dumps(
|
||||
{
|
||||
"repository": {
|
||||
"full_name": (
|
||||
"KEMT/zpwiki"
|
||||
),
|
||||
}
|
||||
}
|
||||
).encode(
|
||||
"utf-8"
|
||||
)
|
||||
|
||||
response = client.post(
|
||||
"/webhook/gitea",
|
||||
content=body,
|
||||
headers={
|
||||
"Content-Type": (
|
||||
"application/json"
|
||||
),
|
||||
"X-Gitea-Event": (
|
||||
"push"
|
||||
),
|
||||
"X-Gitea-Signature": (
|
||||
sign(
|
||||
body
|
||||
)
|
||||
),
|
||||
},
|
||||
)
|
||||
|
||||
assert (
|
||||
response.status_code
|
||||
== 409
|
||||
)
|
||||
def test_webhook_queues_while_reindex_is_running(client, monkeypatch):
|
||||
def busy(**kw): raise ReindexInProgressError('Reindexovanie už prebieha')
|
||||
monkeypatch.setattr(main, 'rebuild_index', busy)
|
||||
body = json.dumps({'repository': {'full_name': 'KEMT/zpwiki'}, 'ref': 'refs/heads/master'}).encode()
|
||||
response = client.post('/webhook/gitea', content=body,
|
||||
headers={'X-Gitea-Event': 'push', 'X-Gitea-Signature': sign(body)})
|
||||
assert response.status_code == 202
|
||||
main.app.state.sync_jobs.run_once()
|
||||
job = main.app.state.sync_jobs.get(response.json()['job_id'])
|
||||
assert job['status'] == 'queued' and job['phase'] == 'waiting_for_lock'
|
||||
|
||||
|
||||
def test_webhook_returns_generic_500_when_rebuild_fails(
|
||||
client: TestClient,
|
||||
monkeypatch: pytest.MonkeyPatch,
|
||||
) -> None:
|
||||
def failed_rebuild(
|
||||
*args,
|
||||
**kwargs,
|
||||
):
|
||||
raise RuntimeError(
|
||||
"private webhook error"
|
||||
)
|
||||
|
||||
monkeypatch.setattr(
|
||||
routes,
|
||||
"rebuild_index",
|
||||
failed_rebuild,
|
||||
)
|
||||
|
||||
body = json.dumps(
|
||||
{
|
||||
"repository": {
|
||||
"full_name": (
|
||||
"KEMT/zpwiki"
|
||||
),
|
||||
}
|
||||
}
|
||||
).encode(
|
||||
"utf-8"
|
||||
)
|
||||
|
||||
response = client.post(
|
||||
"/webhook/gitea",
|
||||
content=body,
|
||||
headers={
|
||||
"Content-Type": (
|
||||
"application/json"
|
||||
),
|
||||
"X-Gitea-Event": (
|
||||
"push"
|
||||
),
|
||||
"X-Gitea-Signature": (
|
||||
sign(
|
||||
body
|
||||
)
|
||||
),
|
||||
},
|
||||
)
|
||||
|
||||
assert (
|
||||
response.status_code
|
||||
== 500
|
||||
)
|
||||
|
||||
assert response.json()[
|
||||
"detail"
|
||||
] == (
|
||||
routes.REINDEX_FAILED_DETAIL
|
||||
)
|
||||
|
||||
assert (
|
||||
"private webhook error"
|
||||
not in response.text
|
||||
)
|
||||
def test_webhook_rebuild_failure_is_visible_in_job(client, monkeypatch):
|
||||
def fail(**kw): raise RuntimeError('private webhook error')
|
||||
monkeypatch.setattr(main, 'rebuild_index', fail)
|
||||
body = json.dumps({'repository': {'full_name': 'KEMT/zpwiki'}, 'ref': 'refs/heads/master'}).encode()
|
||||
response = client.post('/webhook/gitea', content=body,
|
||||
headers={'X-Gitea-Event': 'push', 'X-Gitea-Signature': sign(body)})
|
||||
assert response.status_code == 202
|
||||
main.app.state.sync_jobs.run_once()
|
||||
status = client.get(response.json()['status_url'], headers={'X-API-Key': SYNC_API_KEY})
|
||||
assert status.json()['phase'] == 'retry_wait'
|
||||
assert 'private webhook error' not in status.text
|
||||
|
||||
113
test/test_bod3_closure.py
Normal file
113
test/test_bod3_closure.py
Normal file
@ -0,0 +1,113 @@
|
||||
import copy
|
||||
import json
|
||||
|
||||
import pytest
|
||||
|
||||
from tools.answer_evaluation.context_policy import answer_context_issues, citation_check, coverage_issues, prose_issues, text_contains_value
|
||||
from tools.answer_evaluation.checked_generation import generate_checked_answer
|
||||
from tools.answer_evaluation.render_answer import render_graph_answer
|
||||
from tools.graphrag.graph_search import extract_query_constraints
|
||||
from tools.graphrag.graphrag import extract_start_year
|
||||
|
||||
|
||||
@pytest.fixture
|
||||
def context():
|
||||
return {'status': 'ok', 'complete': True, 'truncated': False, 'aggregation': None,
|
||||
'sources': [{'source_url': 'https://example.test/students/2018/eva'}],
|
||||
'facts': [{'person': 'Eva Nová', 'year': 2026, 'title': 'Práca o 3 modeloch',
|
||||
'source_url': 'https://example.test/students/2018/eva'}], 'answer_candidates': []}
|
||||
|
||||
|
||||
@pytest.fixture
|
||||
def answer(context):
|
||||
return {'answer': '', 'status': 'ok', 'claims': [{'person': 'Eva Nová', 'year': 2026, 'title': 'Práca o 3 modeloch'}],
|
||||
'source_urls': [context['sources'][0]['source_url']], 'count': None}
|
||||
|
||||
|
||||
@pytest.mark.parametrize('year', [1899, 1999, 2099, 2100, 9999])
|
||||
def test_year_constraint_is_never_silently_dropped(year):
|
||||
assert extract_query_constraints(f'Aká práca je v roku {year}?')['years'] == [year]
|
||||
|
||||
|
||||
@pytest.mark.parametrize('text', ['Toto je úplný zoznam. Výpis je neúplný.',
|
||||
'Uvádzam všetkých študentov. Výpis je neúplný.',
|
||||
'Úplný zoznam, ale dôkazy sú orezané.'])
|
||||
def test_caveat_does_not_license_contradictory_exhaustive_claim(text):
|
||||
assert 'unsupported_exhaustive_statement' in coverage_issues({'answer': text, 'status': 'ok'}, {'complete': False})
|
||||
|
||||
|
||||
@pytest.mark.parametrize('text', ['Výpis je neúplný.', 'Toto nie je úplný zoznam.', 'Nie je to úplný zoznam.'])
|
||||
def test_truthful_scope_notice_is_not_rejected(text):
|
||||
assert coverage_issues({'answer': text, 'status': 'ok'}, {'complete': False}) == []
|
||||
|
||||
|
||||
@pytest.mark.parametrize('text', ['[zdroj][s]\n\n[s]: /vymysleny', '<a href="/vymysleny">zdroj</a>',
|
||||
'<img src="//evil.test/x">', '[s]: javascript:alert(1)',
|
||||
'<a href="https://evil.test/x">x</a>'])
|
||||
def test_all_citation_syntaxes_are_checked(text):
|
||||
assert not citation_check({'answer': text, 'source_urls': []}, {'https://example.test/a'})['citations_ok']
|
||||
|
||||
|
||||
def test_legitimate_balanced_parentheses_and_reference_html_links():
|
||||
url = 'https://example.test/a_(b)'
|
||||
text = f'[x]({url}) a {url}.\n[s]: <{url}>\n<a href="{url}">x</a>'
|
||||
assert citation_check({'answer': text, 'source_urls': [url]}, {url})['citations_ok']
|
||||
|
||||
|
||||
def test_count_requires_explicit_complete_aggregation(context, answer):
|
||||
answer['count'] = 98765
|
||||
assert 'unsupported_total_count' in answer_context_issues(answer, context, check_text=False)
|
||||
|
||||
|
||||
@pytest.mark.parametrize('field,issue', [('claims', 'missing_required_claims'), ('source_urls', 'missing_required_citations')])
|
||||
def test_positive_answer_needs_facts_and_citations(context, answer, field, issue):
|
||||
answer[field] = []
|
||||
assert issue in answer_context_issues(answer, context, check_text=False)
|
||||
|
||||
|
||||
def test_every_claim_field_needs_its_source(context, answer):
|
||||
context['facts'].append({'person': 'Eva Nová', 'keyword': 'python', 'source_url': 'https://example.test/child'})
|
||||
context['sources'].append({'source_url': 'https://example.test/child'})
|
||||
answer['claims'][0]['keyword'] = 'python'
|
||||
assert 'missing_claim_source' in answer_context_issues(answer, context, check_text=False)
|
||||
answer['source_urls'].append('https://example.test/child')
|
||||
assert answer_context_issues(answer, context, check_text=False) == []
|
||||
|
||||
|
||||
def test_wrong_extra_prose_year_is_rejected_but_citation_path_year_is_not(context, answer):
|
||||
answer['answer'] = 'Eva Nová má prácu z roku 2026. ' + answer['source_urls'][0]
|
||||
assert prose_issues(answer) == []
|
||||
answer['answer'] += ' Obhajoba bola v roku 2099.'
|
||||
assert prose_issues(answer) == ['unsupported_prose_number']
|
||||
|
||||
|
||||
def test_renderer_uses_only_validated_fields_and_preserves_model_reply(context, answer):
|
||||
original = copy.deepcopy(answer)
|
||||
def complete(_): return {'choices': [{'message': {'content': json.dumps(answer)}}]}
|
||||
result = generate_checked_answer('Názov a rok?', context, 'Pokyny', complete)
|
||||
parsed_original = {key: value for key, value in original.items() if value is not None}
|
||||
assert result['accepted_for_delivery'] and result['model_answer'] == parsed_original
|
||||
assert result['attempts'][0]['answer'] == parsed_original
|
||||
assert result['attempts'][0]['response']['choices'][0]['message']['content'] == json.dumps(original)
|
||||
assert '2026' in result['answer']['answer'] and 'Práca o 3 modeloch' in result['answer']['answer']
|
||||
assert answer == original
|
||||
|
||||
|
||||
def test_zero_count_is_valid_without_claims_or_sources():
|
||||
context = {'status': 'ok', 'facts': [], 'sources': [], 'complete': True,
|
||||
'aggregation': {'count': 0, 'complete': True}}
|
||||
answer = {'answer': '', 'status': 'ok', 'claims': [], 'source_urls': [], 'count': 0}
|
||||
rendered = render_graph_answer(answer, context)
|
||||
assert answer_context_issues(rendered, context) == []
|
||||
|
||||
|
||||
def test_directory_cohort_does_not_become_study_start():
|
||||
assert extract_start_year('pages/students/2016/eva/README.md', [{'text': 'Diplomová práca 2026'}]) is None
|
||||
assert extract_start_year('pages/students/2016/eva/README.md', [{'text': 'Rok začiatku štúdia: 2017'}]) == 2017
|
||||
assert extract_start_year('pages/students/2016/eva/README.md', [{'text': 'Beginning of the study: 2018'}]) == 2018
|
||||
|
||||
|
||||
def test_person_inflection_keeps_distinct_names_distinct():
|
||||
assert text_contains_value('Adriána Remiáša a Martina NaN1', 'Martin NaN1', person=True)
|
||||
assert not text_contains_value('Martin Jančura', 'Martin NaN1', person=True)
|
||||
assert not text_contains_value('Martin Malinovský', 'Martin Malý', person=True)
|
||||
@ -81,7 +81,11 @@ def test_runtime_requirements_contain_only_direct_dependencies() -> None:
|
||||
|
||||
|
||||
def test_all_application_python_files_compile() -> None:
|
||||
targets = [PROJECT_ROOT / "app", PROJECT_ROOT / "scripts"]
|
||||
targets = [
|
||||
PROJECT_ROOT / "app",
|
||||
PROJECT_ROOT / "tools" / "rag",
|
||||
PROJECT_ROOT / "tools" / "graphrag",
|
||||
]
|
||||
|
||||
for directory in targets:
|
||||
for path in directory.rglob("*.py"):
|
||||
|
||||
191
test/test_context_policy.py
Normal file
191
test/test_context_policy.py
Normal file
@ -0,0 +1,191 @@
|
||||
import copy
|
||||
import json
|
||||
|
||||
import pytest
|
||||
|
||||
from tools.answer_evaluation.context_policy import citation_check, answer_context_issues, joined_candidates
|
||||
from tools.answer_evaluation.checked_generation import generate_checked_answer
|
||||
from tools.answer_evaluation.evaluate_graph_answers import graph_context,grade_answer
|
||||
|
||||
|
||||
@pytest.fixture
|
||||
def context():
|
||||
return {'status':'ok','reason':None,'complete':True,'truncated':False,'truncation_reasons':[],
|
||||
'index_version':{'version':'generation-1'},'aggregation':None,
|
||||
'sources':[{'source_id':'S1','document_path':'a.md','source_url':'https://example.test/a'}],
|
||||
'facts':[{'person':'Eva Nová','title':'Vyhľadávanie informácií','year':2026,
|
||||
'document_path':'a.md','source_url':'https://example.test/a'},
|
||||
{'person':'Eva Nová','keyword':'RAG','document_path':'a.md','source_url':'https://example.test/a'}],
|
||||
'answer_candidates':[]}
|
||||
|
||||
|
||||
@pytest.fixture
|
||||
def answer():
|
||||
return {'status':'ok','answer':'Eva Nová má prácu Vyhľadávanie informácií z roku 2026. https://example.test/a',
|
||||
'claims':[{'person':'Eva Nová','title':'Vyhľadávanie informácií','year':2026}],
|
||||
'source_urls':['https://example.test/a'],'count':None}
|
||||
|
||||
|
||||
def test_graph_context_forwards_exact_contract_without_inventing_version(context):
|
||||
raw={**context,'constraints':{'mentions_title':True,'mentions_academic_year':False,'years':[],
|
||||
'mentions_start_year':False},'documents':[]}
|
||||
out=graph_context(raw)
|
||||
for key in ['complete','truncated','truncation_reasons','index_version','sources']:
|
||||
assert out[key]==context[key]
|
||||
legacy=copy.deepcopy(raw);legacy.pop('index_version')
|
||||
assert graph_context(legacy)['index_version'] is None
|
||||
|
||||
|
||||
@pytest.mark.parametrize('location',['source_urls','answer'])
|
||||
def test_unknown_citation_is_rejected_in_list_and_prose(answer,location):
|
||||
if location=='source_urls':answer['source_urls'].append('https://invented.test/x')
|
||||
else:answer['answer']+=' https://invented.test/x'
|
||||
assert not citation_check(answer,{'https://example.test/a'})['citations_ok']
|
||||
|
||||
|
||||
def test_legitimate_markdown_quoted_and_punctuated_urls_are_accepted(answer):
|
||||
answer['answer']='[Zdroj](https://example.test/a), `https://example.test/a` a „https://example.test/a“. '
|
||||
assert citation_check(answer,{'https://example.test/a'})['citations_ok']
|
||||
|
||||
|
||||
@pytest.mark.parametrize('link', ['[zdroj](/invented)', 'www.invented.test/a', '[zdroj](mailto:fake@example.test)'])
|
||||
def test_non_http_and_relative_citations_are_checked(answer, link):
|
||||
answer['answer'] += ' ' + link
|
||||
assert not citation_check(answer, {'https://example.test/a'})['citations_ok']
|
||||
|
||||
|
||||
def test_rag_grader_rejects_extra_citation_despite_required_source_present():
|
||||
from tools.rag.evaluation.rag_metrics import evaluate_answer
|
||||
question = {'should_answer': True, 'expected_answer_contains': ['SQLite'],
|
||||
'expected_source_urls': ['https://example.test/a']}
|
||||
text = 'SQLite. https://example.test/a'
|
||||
assert evaluate_answer(question, text, tool_called=True,
|
||||
allowed_source_urls=['https://example.test/a'])['strict_pass']
|
||||
result = evaluate_answer(question, text + ' https://invented.test', tool_called=True,
|
||||
allowed_source_urls=['https://example.test/a'])
|
||||
assert not result['strict_pass'] and result['unsupported_urls'] == ['https://invented.test']
|
||||
|
||||
|
||||
@pytest.mark.parametrize('complete,reasons', [(None, []), (False, []), (False, ['source_limit'])])
|
||||
def test_rag_prompt_metadata_matches_top_level_contract(monkeypatch, tmp_path, complete, reasons):
|
||||
from tools.rag import rag_utils
|
||||
version = {'version': 'test-generation'}
|
||||
monkeypatch.setattr(rag_utils, 'search_database', lambda *a, **k: {
|
||||
'results': [], 'engine': 'test', 'strategies': [], 'complete': complete,
|
||||
'truncated': bool(reasons), 'truncation_reasons': reasons, 'index_version': version})
|
||||
result = rag_utils.build_rag_context(tmp_path / 'test.sqlite', 'Neznáma osoba')
|
||||
metadata = json.loads(result['context'].splitlines()[1])
|
||||
assert metadata == {key: result[key] for key in
|
||||
['complete', 'truncated', 'truncation_reasons', 'index_version']}
|
||||
assert metadata['index_version'] == version
|
||||
|
||||
|
||||
def test_known_wiki_url_outside_this_context_is_rejected(context,answer):
|
||||
answer['source_urls'].append('https://example.test/other-person')
|
||||
assert 'unsupported_citation' in answer_context_issues(answer,context)
|
||||
|
||||
|
||||
def test_type_of_work_cannot_become_a_keyword(context,answer):
|
||||
answer['claims'][0]['keyword']='diplomový projekt'
|
||||
assert 'unsupported_keyword' in answer_context_issues(answer,context)
|
||||
|
||||
|
||||
def test_title_and_year_must_share_one_actual_record(context,answer):
|
||||
context['facts'].append({'person':'Eva Nová','title':'Iný názov','year':2025})
|
||||
answer['claims'][0]['year']=2025
|
||||
assert 'unsupported_academic_binding' in answer_context_issues(answer,context)
|
||||
|
||||
|
||||
def test_person_join_supports_child_document_but_never_another_person(context,answer):
|
||||
context['facts'][1]['document_path']='child.md'
|
||||
intent={'mentions_title':True,'mentions_keyword':True}
|
||||
candidates=joined_candidates(context['facts'],intent)
|
||||
assert candidates[0]['evidence_documents']==['a.md','child.md']
|
||||
context['answer_candidates']=candidates
|
||||
answer['claims'][0]['keyword']='RAG'
|
||||
assert answer_context_issues(answer,context)==[]
|
||||
context['facts'][1]['person']='Boris Iný'
|
||||
assert joined_candidates(context['facts'],intent)==[]
|
||||
|
||||
|
||||
def test_year_and_keyword_join_does_not_require_a_title(context, answer):
|
||||
context['facts'][0].pop('title')
|
||||
context['facts'][1]['document_path'] = 'child.md'
|
||||
candidates = joined_candidates(context['facts'], {'years': [2026], 'mentions_keyword': True})
|
||||
assert candidates[0]['year'] == 2026 and 'title' not in candidates[0]
|
||||
assert candidates[0]['evidence_documents'] == ['a.md', 'child.md']
|
||||
context['answer_candidates'] = candidates
|
||||
answer.update(status='no_answer', claims=[])
|
||||
assert 'rejected_supported_person_join' in answer_context_issues(answer, context)
|
||||
answer.update(status='ok', claims=[{'person': 'Eva Nová', 'year': 2026, 'keyword': 'RAG'}])
|
||||
assert answer_context_issues(answer, context) == []
|
||||
|
||||
|
||||
def test_known_join_cannot_be_rejected_or_split(context,answer):
|
||||
context['answer_candidates']=joined_candidates(context['facts'],{'mentions_title':True,'mentions_keyword':True})
|
||||
answer['status']='no_answer';answer['claims']=[]
|
||||
assert 'rejected_supported_person_join' in answer_context_issues(answer,context)
|
||||
answer['status']='ok';answer['claims']=[{'person':'Eva Nová','title':'Vyhľadávanie informácií','year':2026},
|
||||
{'person':'Eva Nová','keyword':'RAG'}]
|
||||
assert 'split_or_missing_person_join' in answer_context_issues(answer,context)
|
||||
|
||||
|
||||
@pytest.mark.parametrize('complete,truncated',[(False,False),(True,True),(None,False)])
|
||||
def test_incomplete_or_unknown_context_cannot_claim_full_list(context,answer,complete,truncated):
|
||||
context.update(complete=complete,truncated=truncated)
|
||||
answer['answer']='Toto je úplný zoznam: Eva Nová.'
|
||||
assert 'unsupported_exhaustive_statement' in answer_context_issues(answer,context)
|
||||
answer['answer']='Eva Nová. Výpis je neúplný.'
|
||||
assert answer_context_issues(answer,context)==[]
|
||||
|
||||
|
||||
def test_exact_count_survives_truncated_evidence_with_notice(context,answer):
|
||||
context.update(complete=False,truncated=True,aggregation={'count':2,'complete':True})
|
||||
answer.update(count=2,answer='Počet je úplný, dôkazy sú orezané.')
|
||||
assert answer_context_issues(answer,context)==[]
|
||||
answer['count']=3
|
||||
assert 'incorrect_context_count' in answer_context_issues(answer,context)
|
||||
context['aggregation']['complete']=False
|
||||
assert 'unsupported_total_count' in answer_context_issues(answer,context)
|
||||
|
||||
|
||||
def response(answer):
|
||||
return {'choices':[{'message':{'content':answer if isinstance(answer,str) else json.dumps(answer)}}]}
|
||||
|
||||
|
||||
def test_one_correction_for_bad_citation_preserves_both_attempts(context,answer):
|
||||
bad=copy.deepcopy(answer);bad['source_urls'].append('https://invented.test/x')
|
||||
replies=iter([response(bad),response(answer)]);messages=[]
|
||||
def complete(rows):
|
||||
messages.append(copy.deepcopy(rows));return next(replies)
|
||||
out=generate_checked_answer('Otázka',context,'Pokyny',complete)
|
||||
assert out['accepted_for_delivery'] and len(out['attempts'])==2
|
||||
assert out['attempts'][0]['context_issues']==['unsupported_citation']
|
||||
assert len(messages[0])==2 and len(messages[1])==4
|
||||
assert 'expected_bindings' not in json.dumps(messages)
|
||||
|
||||
|
||||
def test_one_total_correction_covers_format_then_context_failure(context,answer):
|
||||
bad=copy.deepcopy(answer);bad['claims'][0]['year']=1901
|
||||
replies=iter([response('{bad json'),response(bad)])
|
||||
out=generate_checked_answer('Otázka',context,'Pokyny',lambda _:next(replies))
|
||||
assert not out['accepted_for_delivery'] and len(out['attempts'])==2
|
||||
assert out['attempts'][0]['format_error'] and out['context_rejected']
|
||||
|
||||
|
||||
def test_valid_context_answer_never_retries_based_on_gold(context,answer):
|
||||
calls=[]
|
||||
def complete(rows):calls.append(rows);return response(answer)
|
||||
out=generate_checked_answer('Otázka',context,'Pokyny',complete)
|
||||
assert out['accepted_for_delivery'] and len(calls)==1
|
||||
|
||||
|
||||
def test_grader_rejects_extra_url_without_rejecting_correct_answer(context,answer):
|
||||
oracle={'people':{'Eva Nová':{'documents':['a.md'],'academics':[{'year':2026,'title':'Vyhľadávanie informácií'}]}},
|
||||
'documents':{'a.md':{'source_url':'https://example.test/a','tags':[],'categories':[],'author':None}}}
|
||||
case={'expected_answer_contains':['Eva Nová','2026'],'graph':{
|
||||
'expected_bindings':[{'person':'Eva Nová','year':2026}],
|
||||
'expected_evidence_documents':[{'any_of':[{'source_url':'https://example.test/a'}]}]}}
|
||||
assert grade_answer(case,answer,oracle,context=context)['strict']
|
||||
answer['answer']+=' https://invented.test/x'
|
||||
assert not grade_answer(case,answer,oracle,context=context)['strict']
|
||||
115
test/test_embedding_budget.py
Normal file
115
test/test_embedding_budget.py
Normal file
@ -0,0 +1,115 @@
|
||||
import copy
|
||||
import json
|
||||
import sqlite3
|
||||
from pathlib import Path
|
||||
|
||||
import numpy as np
|
||||
import pytest
|
||||
|
||||
from tools.rag import build_chunks as chunking
|
||||
from tools.rag import build_sqlite_index as indexer
|
||||
from tools.rag import embedding_utils as embedding
|
||||
from tools.rag import search_core
|
||||
from tools.rag.embedding_cache import EmbeddingCache, cache_key
|
||||
from tools.text_budget import split_to_fit
|
||||
|
||||
|
||||
def test_unicode_split_is_lossless_and_respects_exact_counter():
|
||||
text = 'Príliš dlhý text 🧑🏽💻 漢字\n' * 30
|
||||
parts = split_to_fit(text, lambda value: chunking.TOKEN_COUNTER.count(value) <= 15)
|
||||
assert ''.join(parts) == text
|
||||
assert all(chunking.TOKEN_COUNTER.count(part) <= 15 for part in parts)
|
||||
assert '\ufffd' not in ''.join(parts)
|
||||
|
||||
|
||||
@pytest.mark.parametrize('body', ['a' * 12000, '```python\n' + 'x' * 12000 + '\n```',
|
||||
'| ' + 'stĺpec' * 2500 + ' |\n| --- |\n| hodnota |'])
|
||||
def test_pathological_chunks_have_hard_limit_without_lost_body(body):
|
||||
drafts = chunking.chunk_markdown(body, document_title='Test')
|
||||
assert drafts and max(map(chunking.token_count, drafts)) <= chunking.MAX_TOKENS
|
||||
combined = ''.join(draft.literal_text if draft.literal_text is not None else
|
||||
''.join(draft.units) for draft in drafts)
|
||||
# Newlines/context can be repeated by natural block splitting; every long
|
||||
# unbroken payload is retained in its original order by the fallback.
|
||||
payload = 'a' * 12000 if body.startswith('a') else ('x' * 12000 if '```' in body else 'stĺpec' * 2500)
|
||||
assert payload in combined
|
||||
|
||||
|
||||
def test_long_heading_is_preserved_in_content_and_metadata():
|
||||
heading = 'dlhy_nadpis_' * 700
|
||||
drafts = chunking.chunk_markdown('# ' + heading + '\n\nKoniec obsahu.', document_title='Test')
|
||||
assert max(map(chunking.token_count, drafts)) <= chunking.MAX_TOKENS
|
||||
assert heading in ''.join(draft.text for draft in drafts)
|
||||
assert 'Koniec obsahu.' in ''.join(draft.text for draft in drafts)
|
||||
assert all(draft.heading_paths == [[heading]] for draft in drafts)
|
||||
|
||||
|
||||
def test_real_embedding_tokenizer_counts_metadata_prefix_and_special_tokens():
|
||||
chunk = {'title': 'Dlhý názov ' * 160, 'tags': ['tag'] * 60, 'text': 'Text práce 🐈 ' * 230}
|
||||
text = embedding.build_embedding_text(chunk)
|
||||
parts = embedding.split_passage(text)
|
||||
assert len(parts) > 1 and ''.join(parts) == text
|
||||
assert max(map(embedding.passage_token_count, parts)) <= embedding.get_embedding_model(embedding.embedding_model_name()).max_seq_length
|
||||
with pytest.raises(ValueError, match='exceeds model limit'):
|
||||
embedding.embed_passages([text])
|
||||
|
||||
|
||||
def test_model_fingerprint_is_independent_of_last_tokenizer_call():
|
||||
name = embedding.embedding_model_name()
|
||||
embedding._model_profile.cache_clear()
|
||||
before = embedding.model_profile(name)['fingerprint']
|
||||
model = embedding.get_embedding_model(name)
|
||||
model.tokenizer(['query: krátky text', 'query: dlhší text na overenie'],
|
||||
truncation=True, padding=True, max_length=model.max_seq_length)
|
||||
embedding._model_profile.cache_clear()
|
||||
assert embedding.model_profile(name)['fingerprint'] == before
|
||||
|
||||
|
||||
def test_oversized_query_is_explicitly_rejected_instead_of_silently_truncated():
|
||||
with pytest.raises(ValueError, match='Query prekračuje tokenový limit'):
|
||||
embedding.embed_query('🧑🏽💻' * 200)
|
||||
|
||||
|
||||
def test_cache_key_binds_metadata_and_exact_model_and_checks_corruption(tmp_path):
|
||||
chunk = {'text': 'obsah', 'title': 'názov', 'author': 'autor', 'tags': ['tag'], 'categories': ['category']}
|
||||
profile = {'fingerprint': 'weights-and-tokenizer-a'}
|
||||
key = cache_key(profile, embedding.build_embedding_text(chunk))
|
||||
for field in chunk:
|
||||
changed = copy.deepcopy(chunk)
|
||||
changed[field] = ['other'] if isinstance(chunk[field], list) else 'other'
|
||||
assert cache_key(profile, embedding.build_embedding_text(changed)) != key
|
||||
assert cache_key({'fingerprint': 'new-model'}, embedding.build_embedding_text(chunk)) != key
|
||||
cache = EmbeddingCache(tmp_path / 'cache.sqlite')
|
||||
cache.save({key: np.array([1., 0.], dtype=np.float32)})
|
||||
assert key in cache.load([key])
|
||||
with sqlite3.connect(cache.path) as conn:
|
||||
conn.execute('UPDATE embeddings SET vector=?', (b'corrupted',))
|
||||
assert cache.load([key]) == {}
|
||||
|
||||
|
||||
def test_multi_segment_index_reuses_cache_and_returns_each_chunk_once(tmp_path, monkeypatch):
|
||||
calls = []
|
||||
monkeypatch.setattr(indexer, 'model_profile', lambda _: {'fingerprint': 'test-model'})
|
||||
monkeypatch.setattr(indexer, 'split_passage', lambda text, **kw: [text[:8], text[8:]])
|
||||
def encode(texts):
|
||||
calls.append(texts)
|
||||
return np.array([[1., 0.] for _ in texts], dtype=np.float32)
|
||||
monkeypatch.setattr(indexer, 'embed_passages', encode)
|
||||
monkeypatch.setattr(search_core, 'model_profile', lambda _: {'fingerprint': 'test-model'})
|
||||
monkeypatch.setattr(search_core, 'embed_query', lambda *a, **kw: np.array([1., 0.]))
|
||||
docs = [{'path': 'pages/test/README.md', 'title': 'Test', 'published': True}]
|
||||
chunks = [{'chunk_id': 'test::0', 'document_path': docs[0]['path'], 'chunk_index': 0,
|
||||
'text': 'celý dlhý obsah', 'title': 'Test'}]
|
||||
cache = tmp_path / 'cache.sqlite'
|
||||
for run in range(2):
|
||||
with sqlite3.connect(':memory:') as conn:
|
||||
conn.row_factory = sqlite3.Row
|
||||
indexer.create_tables(conn)
|
||||
indexer.insert_documents(conn, docs)
|
||||
indexer.insert_chunks(conn, chunks)
|
||||
stats = indexer.insert_embeddings(conn, chunks, cache_file=cache)
|
||||
assert conn.execute('SELECT COUNT(*) FROM chunk_embeddings').fetchone()[0] == 2
|
||||
assert stats == {'embedding_reused': 2 if run else 0, 'embedding_computed': 0 if run else 2}
|
||||
result = search_core.run_vector_query(conn, 'obsah', 5, True)
|
||||
assert len(result) == 1 and result[0]['chunk_id'] == 'test::0'
|
||||
assert len(calls) == 1
|
||||
34
test/test_graph_answer_evaluation.py
Normal file
34
test/test_graph_answer_evaluation.py
Normal file
@ -0,0 +1,34 @@
|
||||
from tools.answer_evaluation.evaluate_graph_answers import grade_answer, graph_context
|
||||
|
||||
|
||||
def test_context_does_not_present_profile_title_or_kind_as_an_academic_fact():
|
||||
result = {'status': 'ok', 'reason': None, 'aggregation': None,
|
||||
'constraints': {'mentions_title': False, 'mentions_academic_year': False, 'years': [], 'mentions_start_year': False},
|
||||
'facts': [{'fact_type': 'person_category', 'person': 'Eva Nová', 'category': 'dp2026',
|
||||
'category_year': 2026, 'category_type': 'diploma_thesis'}],
|
||||
'documents': [{'document_path': 'p.md', 'source_url': 'https://example.org/p', 'title': 'Eva Nová', 'person_kind': 'student'}]}
|
||||
context = graph_context(result)
|
||||
assert context['facts'] == [{'person': 'Eva Nová', 'category': 'dp2026'}]
|
||||
assert context['sources'] == [{'document_path': 'p.md', 'source_url': 'https://example.org/p'}]
|
||||
|
||||
|
||||
def test_null_is_not_a_false_positive_assertion_but_wrong_year_is():
|
||||
oracle = {'people': {'Eva Nová': {'start_year': 2020, 'academics': [{'year': 2026, 'title': 'Vyhľadávanie informácií'}]}}}
|
||||
case = {'expected_answer_contains': ['Eva Nová', '2026'], 'graph': {
|
||||
'expected_bindings': [{'person': 'Eva Nová', 'year': 2026}], 'expected_evidence_documents': []}}
|
||||
answer = {'answer': 'Eva Nová má prácu z roku 2026.', 'status': 'ok', 'source_urls': [],
|
||||
'claims': [{'person': 'Eva Nová', 'year': 2026, 'start_year': None, 'title': None}]}
|
||||
assert grade_answer(case, answer, oracle)['strict']
|
||||
answer['claims'][0]['year'] = 2025
|
||||
assert not grade_answer(case, answer, oracle)['strict']
|
||||
|
||||
|
||||
def test_correct_structured_category_does_not_excuse_a_wrong_prose_explanation():
|
||||
oracle = {'people': {'Eva Nová': {'documents': ['p.md']}},
|
||||
'documents': {'p.md': {'tags': [], 'categories': ['dp2026'], 'author': None}}}
|
||||
case = {'expected_answer_contains': ['Eva Nová', 'dp2026'], 'graph': {
|
||||
'expected_bindings': [{'person': 'Eva Nová', 'category': 'dp2026'}], 'expected_evidence_documents': []}}
|
||||
answer = {'answer': 'Eva Nová má dp2026, čo je dizertačná práca.', 'status': 'ok', 'source_urls': [],
|
||||
'claims': [{'person': 'Eva Nová', 'category': 'dp2026'}]}
|
||||
grade = grade_answer(case, answer, oracle)
|
||||
assert not grade['strict'] and grade['contradictory_thesis_label']
|
||||
241
test/test_index_sync.py
Normal file
241
test/test_index_sync.py
Normal file
@ -0,0 +1,241 @@
|
||||
"""Failure-injection tests for coordinated publication, not only happy paths."""
|
||||
from __future__ import annotations
|
||||
|
||||
import hashlib
|
||||
import hmac
|
||||
import json
|
||||
import sqlite3
|
||||
from pathlib import Path
|
||||
|
||||
import pytest
|
||||
|
||||
from tools import index_state as state
|
||||
from tools import sync_indexes as sync
|
||||
|
||||
|
||||
class Result:
|
||||
def __init__(self, value):
|
||||
self.value = value
|
||||
def single(self):
|
||||
return self.value
|
||||
|
||||
|
||||
class Session:
|
||||
def __init__(self, version):
|
||||
self.version = version; self.fail_commit = None; self.unavailable = False
|
||||
def run(self, query, **params):
|
||||
if self.unavailable:
|
||||
raise ConnectionError('lost database connection')
|
||||
return Result({'metadata': json.dumps(self.version)} if self.version else None)
|
||||
def begin_transaction(self):
|
||||
return Transaction(self)
|
||||
|
||||
|
||||
class Transaction:
|
||||
def __init__(self, session):
|
||||
self.session = session; self.version = session.version
|
||||
def __enter__(self):
|
||||
return self
|
||||
def __exit__(self, *args):
|
||||
pass # Uncommitted local state is discarded, as in the Neo4j driver.
|
||||
def commit(self):
|
||||
if self.session.fail_commit == 'unknown':
|
||||
self.session.unavailable = True
|
||||
raise ConnectionError('commit outcome unknown')
|
||||
self.session.version = self.version
|
||||
if self.session.fail_commit == 'response_lost':
|
||||
raise ConnectionError('committed but response lost')
|
||||
|
||||
|
||||
def snapshot(directory: Path, version: dict):
|
||||
directory.mkdir(parents=True, exist_ok=True)
|
||||
(directory / 'documents.json').write_text(json.dumps([version]))
|
||||
(directory / 'chunks.json').write_text(json.dumps([version]))
|
||||
with sqlite3.connect(directory / 'zp_index.sqlite') as conn:
|
||||
conn.execute('CREATE TABLE index_state (id INTEGER PRIMARY KEY, metadata_json TEXT)')
|
||||
conn.execute('INSERT INTO index_state VALUES (1,?)', (json.dumps(version),))
|
||||
state.durable_json(directory / state.VERSION_FILE, version)
|
||||
|
||||
|
||||
@pytest.fixture
|
||||
def publication(tmp_path, monkeypatch):
|
||||
data = tmp_path / 'data'; stage = data / '.sync-stage-test'
|
||||
old = {'version': 'old', 'git_revision': 'commit-old'}
|
||||
new = {'version': 'new', 'git_revision': 'commit-new'}
|
||||
snapshot(data, old); snapshot(stage, new)
|
||||
monkeypatch.setattr(sync, 'write_graph_transaction', lambda tx, payload, version: setattr(tx, 'version', version))
|
||||
monkeypatch.setattr(sync, 'graph_counts', lambda tx: ([('Person', 1)], [('HAS_DOCUMENT', 1)]))
|
||||
return data, stage, old, new, Session(old)
|
||||
|
||||
|
||||
def test_publish_makes_all_versions_agree(publication):
|
||||
data, stage, old, new, session = publication
|
||||
result = sync.publish_snapshot(data, stage, new, {}, session)
|
||||
assert result == {'nodes': 1, 'relationships': 1}
|
||||
assert state.read_version(data) == state.sqlite_version(data / 'zp_index.sqlite') == session.version == new
|
||||
with state.index_snapshot(data, db_file=data / 'zp_index.sqlite') as version:
|
||||
assert version == new
|
||||
assert not (data / state.PENDING_FILE).exists()
|
||||
|
||||
|
||||
def test_graph_write_failure_keeps_original_files_and_graph(publication, monkeypatch):
|
||||
data, stage, old, new, session = publication
|
||||
before = {name: (data / name).read_bytes() for name in sync.FILES}
|
||||
def fail(tx, payload, version):
|
||||
tx.version = new
|
||||
raise RuntimeError('failure halfway through graph write')
|
||||
monkeypatch.setattr(sync, 'write_graph_transaction', fail)
|
||||
with pytest.raises(RuntimeError, match='halfway'):
|
||||
sync.publish_snapshot(data, stage, new, {}, session)
|
||||
assert session.version == old
|
||||
assert before == {name: (data / name).read_bytes() for name in sync.FILES}
|
||||
assert not (data / state.PENDING_FILE).exists()
|
||||
|
||||
|
||||
def test_partial_file_publication_rolls_back_files_and_graph(publication, monkeypatch):
|
||||
data, stage, old, new, session = publication
|
||||
before = {name: (data / name).read_bytes() for name in sync.FILES}
|
||||
replace = sync.replace_file
|
||||
def fail(source, target):
|
||||
if target.name == 'zp_index.sqlite':
|
||||
raise OSError('disk write failed')
|
||||
replace(source, target)
|
||||
monkeypatch.setattr(sync, 'replace_file', fail)
|
||||
with pytest.raises(OSError, match='disk write'):
|
||||
sync.publish_snapshot(data, stage, new, {}, session)
|
||||
assert session.version == old
|
||||
assert before == {name: (data / name).read_bytes() for name in sync.FILES}
|
||||
assert not (data / state.PENDING_FILE).exists()
|
||||
|
||||
|
||||
def test_lost_commit_response_is_verified_before_restoring_any_files(publication):
|
||||
data, stage, old, new, session = publication
|
||||
session.fail_commit = 'response_lost'
|
||||
sync.publish_snapshot(data, stage, new, {}, session)
|
||||
assert session.version == state.sqlite_version(data / 'zp_index.sqlite') == new
|
||||
assert not (data / state.PENDING_FILE).exists()
|
||||
|
||||
|
||||
def test_unknown_commit_blocks_reads_until_next_successful_sync(publication):
|
||||
data, stage, old, new, session = publication
|
||||
session.fail_commit = 'unknown'
|
||||
with pytest.raises(ConnectionError):
|
||||
sync.publish_snapshot(data, stage, new, {}, session)
|
||||
assert (stage / 'previous/zp_index.sqlite').exists()
|
||||
with pytest.raises(state.IndexUnavailableError, match='nebola dokončená'):
|
||||
with state.index_snapshot(data):
|
||||
pytest.fail('Mixed generation must never be readable')
|
||||
session.unavailable = False; session.fail_commit = None
|
||||
repaired = {'version': 'repaired'}; next_stage = data / '.sync-stage-repaired'
|
||||
snapshot(next_stage, repaired)
|
||||
sync.publish_snapshot(data, next_stage, repaired, {}, session)
|
||||
assert session.version == state.sqlite_version(data / 'zp_index.sqlite') == state.read_version(data) == repaired
|
||||
assert not (data / state.PENDING_FILE).exists()
|
||||
|
||||
|
||||
def test_read_during_publication_is_unavailable(publication):
|
||||
data, *_ = publication
|
||||
with state.publication_lock(data, exclusive=True):
|
||||
with pytest.raises(state.IndexUnavailableError, match='aktivácia'):
|
||||
with state.index_snapshot(data):
|
||||
pytest.fail('Publication barrier bypassed')
|
||||
|
||||
|
||||
def test_reader_rejects_a_replaced_sqlite_database(publication):
|
||||
data, stage, old, new, session = publication
|
||||
state.durable_json(data / state.VERSION_FILE, new)
|
||||
with pytest.raises(state.IndexUnavailableError, match='SQLite'):
|
||||
with state.index_snapshot(data, db_file=data / 'zp_index.sqlite'):
|
||||
pass
|
||||
|
||||
|
||||
def test_staging_failure_never_touches_live_indices(tmp_path, monkeypatch):
|
||||
data = tmp_path / 'data'; snapshot(data, {'version': 'old'})
|
||||
before = {name: (data / name).read_bytes() for name in sync.FILES}
|
||||
def fail(wiki, stage):
|
||||
(stage / 'documents.json').write_text('new incomplete data')
|
||||
raise RuntimeError('embedding failed')
|
||||
monkeypatch.setattr(sync, 'prepare_snapshot', fail)
|
||||
with pytest.raises(RuntimeError, match='embedding failed'):
|
||||
sync.synchronize_indexes(tmp_path / 'wiki', data)
|
||||
assert before == {name: (data / name).read_bytes() for name in sync.FILES}
|
||||
assert not list(data.glob('.sync-stage-*'))
|
||||
|
||||
|
||||
def test_prepare_uses_one_frozen_source_and_records_versions(tmp_path, monkeypatch):
|
||||
import numpy as np
|
||||
import tools.rag.build_sqlite_index as indexer
|
||||
wiki = tmp_path / 'wiki'; page = wiki / 'pages/students/2020/eva/README.md'
|
||||
page.parent.mkdir(parents=True)
|
||||
page.write_text('---\ntitle: Eva Nová\npublished: true\ntaxonomy:\n category: [bp2024]\n---\n# Bakalárska práca 2024\n\nNázov: Overovanie synchronizácie indexov\n')
|
||||
monkeypatch.setattr(indexer, 'embed_passages', lambda texts: np.ones((len(texts), 4), dtype=np.float32))
|
||||
stage = tmp_path / 'stage'; stage.mkdir()
|
||||
version, counts, payload = sync.prepare_snapshot(wiki, stage)
|
||||
assert counts['documents'] == 1 and counts['chunks'] > 0
|
||||
assert version == state.sqlite_version(stage / 'zp_index.sqlite') == state.read_version(stage)
|
||||
assert version['documents_sha256'] == sync.digest(stage / 'documents.json')
|
||||
assert version['chunks_sha256'] == sync.digest(stage / 'chunks.json')
|
||||
assert payload['people'][0]['name'] == 'Eva Nová'
|
||||
assert payload['theses'][0]['year'] == 2024
|
||||
assert payload['documents'][0]['path'] == 'pages/students/2020/eva/README.md'
|
||||
|
||||
|
||||
def test_changed_source_is_not_activated(tmp_path, monkeypatch):
|
||||
import numpy as np
|
||||
import tools.rag.build_sqlite_index as indexer
|
||||
wiki = tmp_path / 'wiki'; page = wiki / 'pages/example/README.md'
|
||||
page.parent.mkdir(parents=True); page.write_text('---\ntitle: Source\n---\nInitial source text.')
|
||||
def embed(texts):
|
||||
page.write_text('Source changed during indexing.')
|
||||
return np.ones((len(texts), 4), dtype=np.float32)
|
||||
monkeypatch.setattr(indexer, 'embed_passages', embed)
|
||||
stage = tmp_path / 'stage'; stage.mkdir()
|
||||
with pytest.raises(RuntimeError, match='počas indexovania'):
|
||||
sync.prepare_snapshot(wiki, stage)
|
||||
|
||||
|
||||
def test_api_returns_503_while_publication_is_unresolved(tmp_path, monkeypatch):
|
||||
from fastapi.testclient import TestClient
|
||||
import app.main as main
|
||||
import app.routes as routes
|
||||
monkeypatch.setattr(main, 'embed_query', lambda q: None)
|
||||
for name, value in [('WEBHOOK_SECRET', 'w'), ('SEARCH_API_KEY', 'a'), ('SYNC_API_KEY', 's')]:
|
||||
monkeypatch.setenv(name, value * 64)
|
||||
data = tmp_path / 'data'; snapshot(data, {'version': 'old'})
|
||||
state.durable_json(data / state.PENDING_FILE, {'target_version': 'new'})
|
||||
monkeypatch.setattr(routes, 'DB_FILE', data / 'zp_index.sqlite')
|
||||
with TestClient(main.app) as client:
|
||||
response = client.post('/rag', json={'query': 'Aká práca?'},
|
||||
headers={'Authorization': 'Bearer ' + 'a' * 64})
|
||||
assert response.status_code == 503
|
||||
assert client.get('/health').json()['ready'] is False
|
||||
|
||||
|
||||
@pytest.mark.parametrize('endpoint', ['sync', 'webhook/gitea'])
|
||||
def test_sync_api_exposes_common_version_and_graph_counts(monkeypatch, endpoint):
|
||||
from fastapi.testclient import TestClient
|
||||
import app.main as main
|
||||
import app.routes as routes
|
||||
monkeypatch.setattr(main, 'embed_query', lambda q: None)
|
||||
for name, value in [('WEBHOOK_SECRET', 'w'), ('SEARCH_API_KEY', 'a'), ('SYNC_API_KEY', 's')]:
|
||||
monkeypatch.setenv(name, value * 64)
|
||||
monkeypatch.setenv('EXPECTED_GITEA_REPOSITORY', 'KEMT/zpwiki')
|
||||
monkeypatch.setenv('WEBHOOK_PULL_GIT', 'false')
|
||||
version = {'version': 'new', 'git_revision': 'commit'}
|
||||
monkeypatch.setattr(main, 'rebuild_index', lambda **kwargs: {
|
||||
'duration_seconds': 0.1, 'counts': {'documents': 1}, 'index_version': version,
|
||||
'graph_counts': {'nodes': 2, 'relationships': 1}})
|
||||
with TestClient(main.app) as client:
|
||||
if endpoint == 'sync':
|
||||
response = client.post('/sync', json={}, headers={'X-API-Key': 's' * 64})
|
||||
else:
|
||||
body = json.dumps({'repository': {'full_name': 'KEMT/zpwiki'}, 'ref': 'refs/heads/master'}).encode()
|
||||
signature = hmac.new(('w' * 64).encode(), body, hashlib.sha256).hexdigest()
|
||||
response = client.post('/webhook/gitea', content=body,
|
||||
headers={'X-Gitea-Event': 'push', 'X-Gitea-Signature': signature, 'Content-Type': 'application/json'})
|
||||
assert response.status_code == 202
|
||||
main.app.state.sync_jobs.run_once()
|
||||
job = client.get(response.json()['status_url'], headers={'X-API-Key': 's' * 64}).json()
|
||||
assert job['status'] == 'succeeded'
|
||||
assert job['result']['index_version'] == version
|
||||
assert job['result']['graph_counts'] == {'nodes': 2, 'relationships': 1}
|
||||
67
test/test_llm_context_budget.py
Normal file
67
test/test_llm_context_budget.py
Normal file
@ -0,0 +1,67 @@
|
||||
import copy
|
||||
import json
|
||||
|
||||
from tools.rag.build_chunks import TOKEN_COUNTER
|
||||
from tools.rag.llm_context import compact_rag_payload
|
||||
|
||||
|
||||
def response(text='Unikátny dôkaz o práci osoby. '):
|
||||
return {'status': 'ok', 'query': 'Práca?', 'engine': 'test', 'strategies': ['test'],
|
||||
'complete': None, 'truncated': False, 'truncation_reasons': [], 'index_version': {'version': 'test'},
|
||||
'instructions': ['Cituj iba dodané zdroje.'], 'answer_format': {},
|
||||
'sources': [{'source_id': 'S1', 'document_path': 'pages/eva/README.md', 'title': 'Eva',
|
||||
'source_url': 'https://example.test/eva', 'text': text,
|
||||
'query_evidence': {'huge_diagnostic': text * 10},
|
||||
'retrieval': {'rank': 1}}], 'context': text}
|
||||
|
||||
|
||||
def test_compact_payload_contains_evidence_once_and_preserves_sources():
|
||||
original = response()
|
||||
before = copy.deepcopy(original)
|
||||
compact = compact_rag_payload(original)
|
||||
assert original == before
|
||||
assert json.dumps(compact, ensure_ascii=False).count(original['sources'][0]['text']) == 1
|
||||
assert 'text' not in compact['sources'][0] and 'query_evidence' not in compact['sources'][0]
|
||||
assert compact['sources'][0]['source_url'] == 'https://example.test/eva'
|
||||
assert compact['index_version'] == original['index_version']
|
||||
assert compact_rag_payload(compact) == compact
|
||||
|
||||
|
||||
def test_entire_tool_json_is_bounded_and_marks_omitted_evidence():
|
||||
original = response('Veľmi dlhý dôkaz 🧑🏽💻. ' * 2000)
|
||||
original['sources'].append({**original['sources'][0], 'source_id': 'S2', 'text': 'Ďalší dôkaz'})
|
||||
compact = compact_rag_payload(original, max_tokens=700)
|
||||
used = TOKEN_COUNTER.count(json.dumps(compact, ensure_ascii=False, separators=(',', ':')))
|
||||
assert used <= 700 and compact['context_budget']['used_tokens'] == used
|
||||
assert compact['complete'] is False and compact['truncated'] is True
|
||||
assert 'llm_context_budget' in compact['truncation_reasons']
|
||||
assert 'KONIEC ZDROJA S1' in compact['context']
|
||||
assert compact['source_count'] == 1 and '[OBSAH ZDROJA OREZANÝ]' in compact['context']
|
||||
assert json.loads(compact['context'].splitlines()[1])['truncated'] is True
|
||||
|
||||
|
||||
def test_diagnostics_are_explicit_and_never_forwarded_by_projection():
|
||||
verbose = compact_rag_payload(response(), include_diagnostics=True)
|
||||
assert verbose['diagnostics']['sources'][0]['query_evidence']
|
||||
projected = compact_rag_payload(verbose)
|
||||
assert 'diagnostics' not in projected
|
||||
assert 'huge_diagnostic' not in json.dumps(projected)
|
||||
|
||||
|
||||
def test_http_serialization_stays_within_budget_and_diagnostics_are_opt_in(monkeypatch):
|
||||
from fastapi.testclient import TestClient
|
||||
import app.main as main
|
||||
import app.routes as routes
|
||||
original = response('Dlhý dôkaz 🐈 ' * 1800)
|
||||
monkeypatch.setattr(main, 'embed_query', lambda _: None)
|
||||
monkeypatch.setattr(routes, 'build_rag_context', lambda *a, **kw: original)
|
||||
monkeypatch.setenv('RAG_LLM_MAX_TOKENS', '700')
|
||||
with TestClient(main.app) as client:
|
||||
headers = {'X-API-Key': 'a' * 64}
|
||||
compact = client.post('/rag', json={'query': 'Práca?'}, headers=headers)
|
||||
assert compact.status_code == 200
|
||||
assert TOKEN_COUNTER.count(compact.text) <= 700
|
||||
assert 'diagnostics' not in compact.json()
|
||||
assert 'text' not in compact.json()['sources'][0]
|
||||
verbose = client.post('/rag', json={'query': 'Práca?', 'include_diagnostics': True}, headers=headers)
|
||||
assert verbose.status_code == 200 and verbose.json()['diagnostics'] == original
|
||||
166
test/test_publication_health.py
Normal file
166
test/test_publication_health.py
Normal file
@ -0,0 +1,166 @@
|
||||
import json
|
||||
import sqlite3
|
||||
from types import SimpleNamespace
|
||||
|
||||
import numpy as np
|
||||
import pytest
|
||||
from fastapi.testclient import TestClient
|
||||
|
||||
import app.main as main
|
||||
import app.routes as routes
|
||||
import tools.tool_health as health
|
||||
import tools.rag.build_sqlite_index as indexer
|
||||
import tools.rag.search_core as search_core
|
||||
from tools.index_state import durable_json, PENDING_FILE, VERSION_FILE
|
||||
from tools.publication import PUBLICATION_POLICY_VERSION, effective_published
|
||||
from tools.rag.search_utils import search_database
|
||||
from tools.rag.rag_utils import build_rag_context
|
||||
|
||||
|
||||
@pytest.fixture
|
||||
def corpus(tmp_path, monkeypatch):
|
||||
docs = []; chunks = []
|
||||
paths = ['pages/students/2020/eva/README.md', 'pages/topics/missing/README.md',
|
||||
'pages/topics/hidden/README.md', 'pages/students/2020/eva/private/README.md']
|
||||
for index, (path, published) in enumerate(zip(paths, [True, None, False, False])):
|
||||
title = ['Verejný profil', 'Chýbajúca značka', 'Skrytý dokument', 'Skrytá poznámka'][index]
|
||||
text = 'spoločný overovací výraz ' + ('SKRYTY_OVEROVACI_OBSAH' if published is False else title)
|
||||
docs.append({'path': path, 'title': title, 'published': published})
|
||||
chunks.append({'chunk_id': path+'::0', 'document_path': path, 'title': title,
|
||||
'published': published, 'chunk_index': 0, 'heading_paths': [['Úvod']],
|
||||
'text': text, 'text_length': len(text), 'token_count': 10,
|
||||
'content_hash': str(index), 'tags': [], 'categories': []})
|
||||
data = tmp_path / 'data'; data.mkdir()
|
||||
for name, rows in [('documents.json', docs), ('chunks.json', chunks)]:
|
||||
(data/name).write_text(json.dumps(rows))
|
||||
monkeypatch.setattr(indexer, 'embed_passages', lambda texts: np.ones((len(texts), 4), dtype=np.float32))
|
||||
monkeypatch.setattr(search_core, 'embed_query', lambda *args, **kwargs: np.ones(4, dtype=np.float32))
|
||||
db = data / 'zp_index.sqlite'
|
||||
indexer.build_database(documents_file=data/'documents.json', chunks_file=data/'chunks.json', db_file=db)
|
||||
version = {'version': 'test-generation', 'publication_policy': PUBLICATION_POLICY_VERSION}
|
||||
with sqlite3.connect(db) as conn:
|
||||
conn.execute('CREATE TABLE index_state (id INTEGER PRIMARY KEY, metadata_json TEXT)')
|
||||
conn.execute('INSERT INTO index_state VALUES (1,?)', (json.dumps(version),))
|
||||
durable_json(data/VERSION_FILE, version)
|
||||
monkeypatch.setattr(routes, 'DB_FILE', db)
|
||||
monkeypatch.setattr(main, 'embed_query', lambda *args: None)
|
||||
return db, version, paths
|
||||
|
||||
|
||||
@pytest.mark.parametrize('value,visible', [(True, True), (None, True), (False, False)])
|
||||
def test_publication_policy(value, visible):
|
||||
assert effective_published(value) is visible
|
||||
|
||||
|
||||
def test_rag_default_filters_both_fts_and_vectors_but_keeps_null(corpus):
|
||||
db, _, paths = corpus
|
||||
result = search_database(db, 'spoločný overovací výraz', limit=10)
|
||||
assert {r['document_path'] for r in result['results']} == set(paths[:2])
|
||||
assert any(r['published'] is None for r in result['results'])
|
||||
all_rows = search_database(db, 'spoločný overovací výraz', limit=10, published_only=False)
|
||||
assert {r['document_path'] for r in all_rows['results']} == set(paths)
|
||||
|
||||
|
||||
@pytest.mark.parametrize('query', ['spoločný overovací výraz', 'Skrytý dokument', 'Skrytá poznámka'])
|
||||
def test_rag_expansions_do_not_reintroduce_hidden_text(corpus, query):
|
||||
db, _, paths = corpus
|
||||
result = build_rag_context(db, query, limit=10)
|
||||
assert all(s['document_path'] not in paths[2:] for s in result['sources'])
|
||||
assert 'SKRYTY_OVEROVACI_OBSAH' not in result['context']
|
||||
all_rows = build_rag_context(db, query, limit=10, published_only=False)
|
||||
assert 'SKRYTY_OVEROVACI_OBSAH' in all_rows['context']
|
||||
|
||||
|
||||
def healthy_graph(version):
|
||||
return health.readiness(True), health.readiness(True, index_version=version, nodes=2)
|
||||
|
||||
|
||||
def test_neo4j_outage_does_not_disable_rag(corpus, monkeypatch):
|
||||
_, _, paths = corpus
|
||||
monkeypatch.setattr(health, 'neo4j_readiness', lambda v: (
|
||||
health.readiness(False, 'unreachable'), health.readiness(False, 'neo4j_unavailable')))
|
||||
with TestClient(main.app) as client:
|
||||
payload = client.get('/health').json()
|
||||
assert payload['tools']['rag']['ready'] is True
|
||||
assert payload['tools']['neo4j']['ready'] is False
|
||||
assert payload['tools']['graphrag']['ready'] is False
|
||||
assert payload['ready'] is False
|
||||
response = client.post('/rag', json={'query': 'spoločný overovací výraz'},
|
||||
headers={'Authorization': 'Bearer '+'a'*64})
|
||||
assert response.status_code == 200
|
||||
assert {s['document_path'] for s in response.json()['sources']} == set(paths[:2])
|
||||
|
||||
|
||||
def test_rag_index_outage_does_not_disable_graph(corpus, monkeypatch):
|
||||
db, version, _ = corpus
|
||||
monkeypatch.setattr(health, 'neo4j_readiness', healthy_graph)
|
||||
db.unlink()
|
||||
with TestClient(main.app) as client:
|
||||
payload = client.get('/health').json()
|
||||
assert payload['tools']['rag']['ready'] is False
|
||||
assert payload['tools']['neo4j']['ready'] is True
|
||||
assert payload['tools']['graphrag']['ready'] is True
|
||||
assert payload['ready'] is False
|
||||
|
||||
|
||||
def test_pending_sync_blocks_both_tools_but_reports_neo4j_service(corpus, monkeypatch):
|
||||
db, _, _ = corpus
|
||||
durable_json(db.parent/PENDING_FILE, {'target_version': 'next'})
|
||||
monkeypatch.setattr(health, 'neo4j_readiness', healthy_graph)
|
||||
with TestClient(main.app) as client:
|
||||
tools = client.get('/health').json()['tools']
|
||||
assert tools['rag']['reason'] == tools['graphrag']['reason'] == 'snapshot_unavailable'
|
||||
assert tools['neo4j']['ready'] is True
|
||||
|
||||
|
||||
def test_embedding_startup_failure_and_successful_query_recovery(corpus, monkeypatch):
|
||||
monkeypatch.setattr(health, 'neo4j_readiness', healthy_graph)
|
||||
def broken(*args):
|
||||
raise RuntimeError('transient warmup failure')
|
||||
monkeypatch.setattr(main, 'embed_query', broken)
|
||||
with TestClient(main.app) as client:
|
||||
tools = client.get('/health').json()['tools']
|
||||
assert tools['rag']['reason'] == 'embedding_not_ready'
|
||||
assert tools['graphrag']['ready'] is True
|
||||
response = client.post('/rag', json={'query': 'spoločný overovací výraz'},
|
||||
headers={'Authorization': 'Bearer '+'a'*64})
|
||||
assert response.status_code == 200
|
||||
assert client.get('/health').json()['tools']['rag']['ready'] is True
|
||||
|
||||
|
||||
def test_neo4j_probe_is_bounded_and_does_not_expose_errors(monkeypatch):
|
||||
monkeypatch.setattr(health, 'get_neo4j_settings', lambda: SimpleNamespace(database='neo4j'))
|
||||
captured = {}
|
||||
def fail(settings, **options):
|
||||
captured.update(options)
|
||||
raise RuntimeError('password=never-return-this')
|
||||
monkeypatch.setattr(health, 'create_neo4j_driver', fail)
|
||||
result = health.neo4j_readiness(None)
|
||||
assert not result[0]['ready'] and not result[1]['ready']
|
||||
assert captured['connection_timeout'] == captured['connection_acquisition_timeout'] == 2.0
|
||||
assert captured['max_transaction_retry_time'] == 0
|
||||
assert 'never-return-this' not in json.dumps(result)
|
||||
|
||||
|
||||
@pytest.mark.parametrize('actual,nodes,reason', [
|
||||
({'version': 'different'}, 2, 'version_mismatch'),
|
||||
(None, 0, 'graph_empty'),
|
||||
({'version': 'old'}, 2, 'publication_sync_required'),
|
||||
])
|
||||
def test_connection_readiness_is_distinct_from_graph_readiness(monkeypatch, actual, nodes, reason):
|
||||
class Result:
|
||||
def single(self):
|
||||
return {'nodes': nodes, 'metadata': json.dumps(actual) if actual else None}
|
||||
class Connection:
|
||||
def __enter__(self): return self
|
||||
def __exit__(self, *args): pass
|
||||
def verify_connectivity(self): pass
|
||||
def session(self, **kwargs): return self
|
||||
def run(self, query, **params):
|
||||
assert query.timeout == 2.0
|
||||
return Result()
|
||||
monkeypatch.setattr(health, 'get_neo4j_settings', lambda: SimpleNamespace(database='neo4j'))
|
||||
monkeypatch.setattr(health, 'create_neo4j_driver', lambda *args, **kwargs: Connection())
|
||||
expected = {'version': 'expected'} if reason=='version_mismatch' else actual
|
||||
neo, graph = health.neo4j_readiness(expected)
|
||||
assert neo['ready'] is True and graph['ready'] is False and graph['reason']==reason
|
||||
36
test/test_rag_delivery.py
Normal file
36
test/test_rag_delivery.py
Normal file
@ -0,0 +1,36 @@
|
||||
import copy
|
||||
import pytest
|
||||
|
||||
from tools.answer_evaluation.rag_delivery import finalize_rag_answer
|
||||
|
||||
|
||||
def test_notice_is_rendered_without_changing_facts_or_raw_answer():
|
||||
original = {'answer': 'Eva má prácu z roku 2026.', 'context_issues': ['missing_incompleteness_notice'],
|
||||
'citations_ok': True, 'accepted_for_delivery': False}
|
||||
before = copy.deepcopy(original)
|
||||
out = finalize_rag_answer(original)
|
||||
assert original == before
|
||||
assert out['model_answer'] == before['answer']
|
||||
assert out['answer'] == 'Výpis je neúplný.\n\n' + before['answer']
|
||||
assert out['accepted_for_delivery'] and out['display_notice_added']
|
||||
assert not out['first_pass_accepted_for_delivery']
|
||||
assert finalize_rag_answer(out) == out
|
||||
|
||||
|
||||
@pytest.mark.parametrize('issues,citations_ok', [
|
||||
(['unsupported_exhaustive_statement', 'missing_incompleteness_notice'], True),
|
||||
(['missing_incompleteness_notice'], False),
|
||||
([], False)])
|
||||
def test_notice_never_bypasses_other_rejections(issues, citations_ok):
|
||||
original = {'answer': 'Úplný zoznam.', 'context_issues': issues,
|
||||
'citations_ok': citations_ok, 'accepted_for_delivery': False}
|
||||
out = finalize_rag_answer(original)
|
||||
assert not out['accepted_for_delivery'] and not out['display_notice_added']
|
||||
assert out['answer'] == original['answer']
|
||||
|
||||
|
||||
def test_complete_valid_answer_does_not_get_a_notice():
|
||||
original = {'answer': 'Eva.', 'context_issues': [], 'citations_ok': True, 'accepted_for_delivery': True}
|
||||
out = finalize_rag_answer(original)
|
||||
assert out['answer'] == original['answer'] and not out['display_notice_added']
|
||||
assert out['accepted_for_delivery']
|
||||
134
test/test_retrieval_contract.py
Normal file
134
test/test_retrieval_contract.py
Normal file
@ -0,0 +1,134 @@
|
||||
"""Contract tests use real SQLite retrieval and API boundaries, not an LLM."""
|
||||
import json
|
||||
|
||||
import numpy as np
|
||||
import pytest
|
||||
from fastapi.testclient import TestClient
|
||||
|
||||
import app.main as main
|
||||
import app.routes as routes
|
||||
import tools.rag.build_sqlite_index as indexer
|
||||
import tools.rag.search_core as core
|
||||
import tools.rag.search_utils as search
|
||||
from tools.rag.rag_utils import build_rag_context
|
||||
from tools.retrieval_contract import RetrievalResponse, error_result
|
||||
|
||||
|
||||
@pytest.fixture
|
||||
def index(tmp_path, monkeypatch):
|
||||
documents = []; chunks = []
|
||||
for number in range(3):
|
||||
path = f'pages/topics/item{number}/README.md'
|
||||
doc = {'path': path, 'title': f'Contract {number}', 'published': True}
|
||||
documents.append(doc)
|
||||
for part in range(2):
|
||||
chunks.append({'chunk_id': path+f'::{part}', 'document_path': path,
|
||||
'title': doc['title'], 'published': True, 'chunk_index': part,
|
||||
'text': f'spoločný výraz {number} úsek {part}', 'heading_paths': [],
|
||||
'tags': [], 'categories': []})
|
||||
for name, rows in [('documents.json', documents), ('chunks.json', chunks)]:
|
||||
(tmp_path/name).write_text(json.dumps(rows))
|
||||
monkeypatch.setattr(indexer, 'embed_passages', lambda texts: np.ones((len(texts),4), dtype=np.float32))
|
||||
monkeypatch.setattr(core, 'embed_query', lambda *args, **kwargs: np.ones(4, dtype=np.float32))
|
||||
db = tmp_path/'zp_index.sqlite'
|
||||
indexer.build_database(documents_file=tmp_path/'documents.json', chunks_file=tmp_path/'chunks.json', db_file=db)
|
||||
monkeypatch.setattr(routes, 'DB_FILE', db)
|
||||
return db
|
||||
|
||||
|
||||
def test_rag_limits_are_reported_and_rich_sources_preserved(index):
|
||||
raw = search.search_database(index, 'spoločný výraz', limit=2, max_per_document=1)
|
||||
assert raw['status'] == 'ok' and raw['truncated'] and raw['complete'] is False
|
||||
assert set(raw['truncation_reasons']) == {'result_limit','per_document_limit'}
|
||||
assert len(raw['sources']) == len(raw['results']) == 2
|
||||
rag = build_rag_context(index, 'spoločný výraz', limit=2)
|
||||
RetrievalResponse.model_validate(rag)
|
||||
assert rag['truncated'] and rag['complete'] is False and rag['reason'] is None
|
||||
assert rag['index_version'] is None
|
||||
assert len(rag['sources']) == rag['source_count']
|
||||
assert 'retrieval' in rag['sources'][0] and 'text' in rag['sources'][0]
|
||||
|
||||
|
||||
def test_candidate_cap_detected_by_extra_row(index, monkeypatch):
|
||||
monkeypatch.setattr(search, 'MIN_CANDIDATES', 1)
|
||||
monkeypatch.setattr(search, 'DEFAULT_CANDIDATE_MULTIPLIER', 1)
|
||||
result = search.search_database(index, 'spoločný výraz', limit=1)
|
||||
assert result['truncation_reasons'] == ['candidate_limit']
|
||||
assert result['complete'] is False and len(result['results']) == 1
|
||||
|
||||
|
||||
def test_ranked_rag_never_promises_exhaustive_answer(index):
|
||||
result = build_rag_context(index, 'spoločný výraz', limit=20, max_per_document=0)
|
||||
assert result['status']=='ok' and not result['truncated']
|
||||
assert result['complete'] is None
|
||||
|
||||
|
||||
def test_empty_rag_result_has_reason_and_null_version(index):
|
||||
result = build_rag_context(index, ' ')
|
||||
assert result['status']=='no_answer' and result['sources']==[]
|
||||
assert result['reason']=='empty_query' and result['index_version'] is None
|
||||
|
||||
|
||||
@pytest.mark.parametrize('path', ['/rag','/search'])
|
||||
def test_api_success_contains_common_fields(index, path):
|
||||
with TestClient(main.app) as client:
|
||||
response = client.post(path, json={'query':'spoločný výraz','limit':2},
|
||||
headers={'X-API-Key':'a'*64})
|
||||
assert response.status_code==200
|
||||
body = response.json()
|
||||
assert set(RetrievalResponse.model_fields) <= body.keys()
|
||||
RetrievalResponse.model_validate(body)
|
||||
assert body['status']=='ok' and body['sources'] and body['complete'] is False
|
||||
|
||||
|
||||
@pytest.mark.parametrize('path', ['/rag','/search'])
|
||||
@pytest.mark.parametrize('code,reason,error', [
|
||||
(400,'invalid_query',ValueError('PRIVATE_ERROR')),
|
||||
(503,'retrieval_unavailable',RuntimeError('PRIVATE_ERROR')),
|
||||
(500,'internal_error',TypeError('PRIVATE_ERROR')),
|
||||
])
|
||||
def test_api_errors_have_contract_and_preserve_http_status(index, monkeypatch, path, code, reason, error):
|
||||
def fail(*args, **kwargs):
|
||||
raise error
|
||||
monkeypatch.setattr(routes, 'build_rag_context' if path=='/rag' else 'search_database', fail)
|
||||
with TestClient(main.app) as client:
|
||||
response = client.post(path, json={'query':'test'}, headers={'X-API-Key':'a'*64})
|
||||
assert response.status_code==code
|
||||
body = response.json()
|
||||
assert body['status']=='error' and body['reason']==reason and body['sources']==[]
|
||||
assert body['complete'] is False and body['index_version'] is None
|
||||
assert 'PRIVATE_ERROR' not in response.text
|
||||
assert 'detail' in body
|
||||
|
||||
|
||||
@pytest.mark.parametrize('path', ['/rag','/search'])
|
||||
def test_auth_and_validation_errors_use_same_envelope(index, path):
|
||||
with TestClient(main.app) as client:
|
||||
unauthorized = client.post(path, json={'query':'test'})
|
||||
invalid = client.post(path, json={'query':'test','unknown':'PRIVATE_INPUT'},
|
||||
headers={'X-API-Key':'a'*64})
|
||||
assert unauthorized.status_code==401 and unauthorized.json()['reason']=='unauthorized'
|
||||
assert invalid.status_code==422 and invalid.json()['reason']=='invalid_request'
|
||||
assert 'PRIVATE_INPUT' not in invalid.text
|
||||
for response in [unauthorized,invalid]:
|
||||
assert set(RetrievalResponse.model_fields) <= response.json().keys()
|
||||
|
||||
|
||||
def test_error_factory_does_not_invent_sources_or_active_version():
|
||||
result = error_result(RuntimeError('password=PRIVATE'))
|
||||
assert result['status']=='error' and result['sources']==[] and result['index_version'] is None
|
||||
assert not result['truncated'] and result['complete'] is False
|
||||
assert 'PRIVATE' not in json.dumps(result)
|
||||
|
||||
|
||||
@pytest.mark.parametrize('path', ['/rag','/search'])
|
||||
def test_malformed_backend_output_still_has_safe_error_contract(index, monkeypatch, path):
|
||||
monkeypatch.setattr(routes, 'build_rag_context' if path=='/rag' else 'search_database',
|
||||
lambda *args, **kwargs: {'unexpected':'PRIVATE_BACKEND_OUTPUT'})
|
||||
with TestClient(main.app) as client:
|
||||
response = client.post(path, json={'query':'test'}, headers={'X-API-Key':'a'*64})
|
||||
assert response.status_code==500
|
||||
assert set(RetrievalResponse.model_fields) <= response.json().keys()
|
||||
assert response.json()['reason']=='internal_error' and response.json()['status']=='error'
|
||||
assert 'PRIVATE_BACKEND_OUTPUT' not in response.text
|
||||
assert response.headers['Cache-Control']=='no-store'
|
||||
100
test/test_runtime_assets.py
Normal file
100
test/test_runtime_assets.py
Normal file
@ -0,0 +1,100 @@
|
||||
import hashlib
|
||||
import json
|
||||
import os
|
||||
import subprocess
|
||||
import sys
|
||||
from pathlib import Path
|
||||
|
||||
import pytest
|
||||
|
||||
from tools import runtime_assets as assets
|
||||
|
||||
|
||||
@pytest.fixture
|
||||
def bundle(tmp_path):
|
||||
files = {'model/config.json': b'{}', 'model/modules.json': b'[]',
|
||||
'model/tokenizer.json': b'{}', 'model/model.safetensors': b'weights',
|
||||
'tiktoken/token-file': b'tokenizer'}
|
||||
for name, value in files.items():
|
||||
path = tmp_path / name
|
||||
path.parent.mkdir(parents=True, exist_ok=True)
|
||||
path.write_bytes(value)
|
||||
manifest = {'schema_version': 1, 'embedding': {'model': assets.DEFAULT_MODEL, 'revision': assets.DEFAULT_REVISION},
|
||||
'encodings': ['cl100k_base'], 'files': {name: hashlib.sha256(value).hexdigest() for name, value in files.items()}}
|
||||
(tmp_path / 'manifest.json').write_text(json.dumps(manifest))
|
||||
return tmp_path, manifest
|
||||
|
||||
|
||||
def test_assets_verify_integrity_and_reject_corruption(bundle):
|
||||
root, manifest = bundle
|
||||
assert assets.verify(root) == manifest
|
||||
(root / 'model/model.safetensors').write_bytes(b'corrupted')
|
||||
with pytest.raises(RuntimeError, match='poškodený'):
|
||||
assets.verify(root)
|
||||
|
||||
|
||||
def test_prepared_assets_override_empty_user_cache_and_pin_revision(bundle, monkeypatch, tmp_path):
|
||||
root, _ = bundle
|
||||
monkeypatch.setenv('ZP_RUNTIME_ASSETS', str(root))
|
||||
monkeypatch.setenv('ZP_ASSETS_REQUIRED', '1')
|
||||
monkeypatch.setenv('TIKTOKEN_CACHE_DIR', str(tmp_path / 'empty'))
|
||||
assets.configure_tokenizer()
|
||||
assert os.environ['TIKTOKEN_CACHE_DIR'] == str(root / 'tiktoken')
|
||||
assert assets.local_model(assets.DEFAULT_MODEL, None) == str(root / 'model')
|
||||
with pytest.raises(RuntimeError, match='revízia'):
|
||||
assets.local_model(assets.DEFAULT_MODEL, 'a' * 40)
|
||||
with pytest.raises(RuntimeError, match='nie je v image'):
|
||||
assets.local_model('other/model', None)
|
||||
|
||||
|
||||
def test_required_assets_never_silently_fall_back_to_remote_download(tmp_path, monkeypatch):
|
||||
monkeypatch.setenv('ZP_RUNTIME_ASSETS', str(tmp_path))
|
||||
monkeypatch.setenv('ZP_ASSETS_REQUIRED', '1')
|
||||
with pytest.raises(RuntimeError, match='Chýbajú runtime assets'):
|
||||
assets.configure_tokenizer()
|
||||
|
||||
|
||||
def test_existing_assets_are_verified_without_download(bundle, monkeypatch):
|
||||
root, manifest = bundle
|
||||
probes = []
|
||||
monkeypatch.setattr(assets, 'offline_probe', lambda path: probes.append(path))
|
||||
assert assets.prepare(root, assets.DEFAULT_MODEL, None, ['cl100k_base']) == manifest
|
||||
assert probes == [root]
|
||||
|
||||
|
||||
def test_manifest_cannot_escape_asset_directory(bundle):
|
||||
root, manifest = bundle
|
||||
manifest['files']['../outside'] = 'a' * 64
|
||||
(root / 'manifest.json').write_text(json.dumps(manifest))
|
||||
with pytest.raises(RuntimeError, match='mimo runtime assets'):
|
||||
assets.verify(root)
|
||||
|
||||
|
||||
def test_fresh_api_lifespan_loads_model_and_tokenizer_without_network_or_user_cache(tmp_path):
|
||||
environment = {**os.environ, 'ZP_RUNTIME_ASSETS': str(assets.asset_root().resolve()),
|
||||
'ZP_ASSETS_REQUIRED': '1', 'HF_HOME': str(tmp_path / 'empty-hf'),
|
||||
'TIKTOKEN_CACHE_DIR': str(tmp_path / 'empty-tokenizer'),
|
||||
'HF_HUB_OFFLINE': '1', 'TRANSFORMERS_OFFLINE': '1', 'TEST_JOB_DIR': str(tmp_path / 'jobs')}
|
||||
code = '''
|
||||
import socket, asyncio, os
|
||||
from pathlib import Path
|
||||
def denied(*args, **kwargs): raise AssertionError('Unexpected network access')
|
||||
socket.socket.connect = denied
|
||||
socket.socket.connect_ex = denied
|
||||
socket.getaddrinfo = denied
|
||||
import app.main as main
|
||||
from tools.rag.build_chunks import TOKEN_COUNTER
|
||||
from tools.rag.embedding_utils import embed_query
|
||||
main.DATA_DIR = Path(os.environ['TEST_JOB_DIR'])
|
||||
async def run():
|
||||
async with main.lifespan(main.app):
|
||||
assert main.app.state.embedding_ready
|
||||
assert TOKEN_COUNTER.encoding is not None
|
||||
assert embed_query('štart bez siete').shape[0] == 384
|
||||
asyncio.run(run())
|
||||
print('offline API lifespan OK')
|
||||
'''
|
||||
result = subprocess.run([sys.executable, '-c', code], env=environment,
|
||||
capture_output=True, text=True, timeout=60)
|
||||
assert result.returncode == 0, result.stderr
|
||||
assert 'offline API lifespan OK' in result.stdout
|
||||
147
test/test_sync_jobs.py
Normal file
147
test/test_sync_jobs.py
Normal file
@ -0,0 +1,147 @@
|
||||
import hashlib
|
||||
import hmac
|
||||
import json
|
||||
import threading
|
||||
import time
|
||||
from concurrent.futures import ThreadPoolExecutor
|
||||
|
||||
import pytest
|
||||
from fastapi.testclient import TestClient
|
||||
|
||||
import app.main as main
|
||||
from tools.sync_jobs import SyncJobs
|
||||
from tools.rag.rebuild_index import acquire_reindex_lock
|
||||
|
||||
|
||||
def test_concurrent_enqueues_are_durable_and_coalesced(tmp_path):
|
||||
jobs = SyncJobs(tmp_path)
|
||||
with ThreadPoolExecutor(max_workers=8) as pool:
|
||||
accepted = list(pool.map(lambda n: jobs.enqueue(pull_git=n % 2 == 0,
|
||||
delivery_key=f'delivery-{n}', requested_revision=str(n)), range(24)))
|
||||
assert len({row['job']['id'] for row in accepted}) == 1
|
||||
job = SyncJobs(tmp_path).get(accepted[0]['job']['id'])
|
||||
assert job['request_count'] == 24 and job['pull_git']
|
||||
duplicate = SyncJobs(tmp_path).enqueue(pull_git=True, delivery_key='delivery-1')
|
||||
assert duplicate['duplicate'] and duplicate['job']['request_count'] == 24
|
||||
|
||||
|
||||
def test_push_during_running_job_schedules_followup_and_workers_do_not_overlap(tmp_path):
|
||||
entered, release = threading.Event(), threading.Event()
|
||||
phases = []
|
||||
def runner(**kw):
|
||||
kw['progress']('building_indexes')
|
||||
phases.append('run')
|
||||
entered.set()
|
||||
assert release.wait(5)
|
||||
return {'index_version': {'version': str(len(phases))}}
|
||||
jobs = SyncJobs(tmp_path, runner=runner)
|
||||
first = jobs.enqueue(pull_git=True)['job']['id']
|
||||
worker = threading.Thread(target=jobs.run_once)
|
||||
worker.start()
|
||||
try:
|
||||
assert entered.wait(5)
|
||||
assert jobs.get(first)['phase'] == 'building_indexes'
|
||||
second = jobs.enqueue(pull_git=True)['job']['id']
|
||||
third = jobs.enqueue(pull_git=True)['job']['id']
|
||||
assert second != first and third == second
|
||||
assert not SyncJobs(tmp_path, runner=runner).run_once()
|
||||
finally:
|
||||
release.set()
|
||||
worker.join(5)
|
||||
assert jobs.get(first)['status'] == 'succeeded'
|
||||
assert jobs.run_once() and jobs.get(second)['status'] == 'succeeded'
|
||||
assert len(phases) == 2
|
||||
|
||||
|
||||
def test_interrupted_job_recovers_and_preserves_delivery_dedup(tmp_path):
|
||||
jobs = SyncJobs(tmp_path)
|
||||
job_id = jobs.enqueue(pull_git=True, delivery_key='one')['job']['id']
|
||||
with jobs.connect() as conn:
|
||||
conn.execute("UPDATE jobs SET status='running',phase='publishing_indexes'")
|
||||
recovered = SyncJobs(tmp_path, runner=lambda **kw: {'index_version': {'version': 'recovered'}})
|
||||
assert recovered.run_once()
|
||||
assert recovered.get(job_id)['status'] == 'succeeded'
|
||||
assert recovered.enqueue(pull_git=True, delivery_key='one')['duplicate']
|
||||
|
||||
|
||||
def test_cli_lock_defers_instead_of_losing_job(tmp_path):
|
||||
def runner(**kw):
|
||||
with acquire_reindex_lock(tmp_path / '.reindex.lock'):
|
||||
return {'counts': {'documents': 1}}
|
||||
jobs = SyncJobs(tmp_path, runner=runner)
|
||||
job_id = jobs.enqueue(pull_git=False)['job']['id']
|
||||
with acquire_reindex_lock(tmp_path / '.reindex.lock'):
|
||||
assert jobs.run_once()
|
||||
job = jobs.get(job_id)
|
||||
assert job['status'] == 'queued' and job['attempts'] == 0
|
||||
with jobs.connect() as conn:
|
||||
conn.execute('UPDATE jobs SET available_at=0')
|
||||
jobs.run_once()
|
||||
assert jobs.get(job_id)['status'] == 'succeeded'
|
||||
|
||||
|
||||
def test_background_worker_processes_and_stops(tmp_path):
|
||||
completed = threading.Event()
|
||||
def runner(**kw):
|
||||
completed.set()
|
||||
return {'counts': {'documents': 1}}
|
||||
jobs = SyncJobs(tmp_path, runner=runner)
|
||||
job_id = jobs.enqueue(pull_git=False)['job']['id']
|
||||
jobs.start()
|
||||
try:
|
||||
assert completed.wait(5)
|
||||
finally:
|
||||
jobs.stop()
|
||||
assert not jobs.thread.is_alive() and jobs.get(job_id)['status'] == 'succeeded'
|
||||
|
||||
|
||||
@pytest.fixture
|
||||
def api(monkeypatch):
|
||||
monkeypatch.setattr(main, 'embed_query', lambda _: None)
|
||||
with TestClient(main.app) as client:
|
||||
yield client
|
||||
|
||||
|
||||
def post_push(api, *, ref='refs/heads/master', delivery='one', **extra):
|
||||
body = json.dumps({'repository': {'full_name': 'KEMT/zpwiki'}, 'ref': ref,
|
||||
'after': 'a' * 40, **extra}).encode()
|
||||
signature = hmac.new(('w' * 64).encode(), body, hashlib.sha256).hexdigest()
|
||||
return api.post('/webhook/gitea', content=body, headers={
|
||||
'X-Gitea-Event': 'push', 'X-Gitea-Signature': signature, 'X-Gitea-Delivery': delivery})
|
||||
|
||||
|
||||
def test_api_returns_before_slow_rebuild_and_rejects_unauthed_status(api, monkeypatch):
|
||||
import app.routes as routes
|
||||
def forbidden(**kw):
|
||||
pytest.fail('HTTP request must not execute the rebuild')
|
||||
monkeypatch.setattr(main, 'rebuild_index', forbidden)
|
||||
response = post_push(api)
|
||||
assert response.status_code == 202
|
||||
assert api.get(response.json()['status_url']).status_code == 401
|
||||
assert api.get('/sync/status').status_code == 401
|
||||
assert api.get(response.json()['status_url'], headers={'X-API-Key': 's' * 64}).json()['status'] == 'queued'
|
||||
assert api.get('/sync/jobs/missing', headers={'X-API-Key': 's' * 64}).status_code == 404
|
||||
|
||||
|
||||
def test_api_deduplicates_delivery_and_enables_git_pull(api, monkeypatch):
|
||||
monkeypatch.setenv('WEBHOOK_PULL_GIT', 'true')
|
||||
first = post_push(api)
|
||||
repeated = post_push(api)
|
||||
assert first.json()['job_id'] == repeated.json()['job_id']
|
||||
assert repeated.json()['duplicate'] and first.json()['pull_git']
|
||||
assert main.app.state.sync_jobs.get(first.json()['job_id'])['requested_revision'] == 'a' * 40
|
||||
|
||||
|
||||
@pytest.mark.parametrize('extra,reason', [
|
||||
({'ref': 'refs/heads/other'}, 'unexpected_branch'),
|
||||
({'deleted': True}, 'deleted_branch'), ({'after': '0' * 40}, 'deleted_branch')])
|
||||
def test_other_branches_and_deletions_do_not_queue(api, extra, reason):
|
||||
response = post_push(api, **extra)
|
||||
assert response.status_code == 202 and response.json()['reason'] == reason
|
||||
assert main.app.state.sync_jobs.overview()['active'] == []
|
||||
|
||||
|
||||
@pytest.mark.parametrize('extra', [{'ref': None}, {'ref': 'refs/tags/v1'}, {'after': 'not-a-commit'}])
|
||||
def test_malformed_push_is_rejected(api, extra):
|
||||
assert post_push(api, **extra).status_code == 400
|
||||
assert main.app.state.sync_jobs.overview()['active'] == []
|
||||
81
test/test_wiki_git.py
Normal file
81
test/test_wiki_git.py
Normal file
@ -0,0 +1,81 @@
|
||||
import subprocess
|
||||
from pathlib import Path
|
||||
|
||||
import pytest
|
||||
|
||||
import tools.wiki_git as wiki_git
|
||||
|
||||
|
||||
@pytest.mark.parametrize('value', ['', '../master', '-main', 'a..b', 'a b', 'a.lock', 'a/@{x', 'a//b'])
|
||||
def test_invalid_branch_configuration_is_rejected(monkeypatch, value):
|
||||
monkeypatch.setenv('EXPECTED_GITEA_BRANCH', value)
|
||||
with pytest.raises(RuntimeError, match='EXPECTED_GITEA_BRANCH'):
|
||||
wiki_git.expected_branch()
|
||||
|
||||
|
||||
@pytest.mark.parametrize('url', ['git@git.kemt.fei.tuke.sk:jp170na/zpwiki.git',
|
||||
'ssh://git@git.kemt.fei.tuke.sk/jp170na/zpwiki.git', 'https://git.kemt.fei.tuke.sk/jp170na/zpwiki'])
|
||||
def test_repository_identity_from_transport_url(url):
|
||||
assert wiki_git.repository_from_url(url) == 'jp170na/zpwiki'
|
||||
|
||||
|
||||
def test_real_git_fetch_fast_forward_and_local_change_protection(tmp_path, monkeypatch):
|
||||
run = subprocess.run
|
||||
def git(root, *args):
|
||||
return run(['git', '-C', str(root), *args], capture_output=True, text=True, check=True).stdout.strip()
|
||||
bare, author, checkout = (tmp_path / name for name in ('remote.git', 'author', 'checkout'))
|
||||
run(['git', 'init', '--bare', str(bare)], check=True, capture_output=True)
|
||||
run(['git', 'clone', str(bare), str(author)], check=True, capture_output=True)
|
||||
git(author, 'checkout', '-b', 'master')
|
||||
git(author, 'config', 'user.name', 'Sync test')
|
||||
git(author, 'config', 'user.email', 'sync@example.test')
|
||||
(author / 'README.md').write_text('old')
|
||||
git(author, 'add', '.')
|
||||
git(author, 'commit', '-m', 'initial')
|
||||
git(author, 'push', 'origin', 'master')
|
||||
run(['git', 'clone', str(bare), str(checkout)], check=True, capture_output=True)
|
||||
git(checkout, 'remote', 'set-url', 'origin', 'git@example.test:KEMT/zpwiki.git')
|
||||
(author / 'README.md').write_text('new')
|
||||
git(author, 'commit', '-am', 'update')
|
||||
git(author, 'push', 'origin', 'master')
|
||||
wanted = git(author, 'rev-parse', 'HEAD')
|
||||
# Exercise real Git fetch/merge against a local bare remote. Only transport
|
||||
# is redirected, so the production origin/branch validation still runs.
|
||||
def local_transport(args, **kw):
|
||||
if args[:2] == ['git', 'fetch']:
|
||||
args = [str(bare) if arg == 'origin' else arg for arg in args]
|
||||
return run(args, **kw)
|
||||
monkeypatch.setattr(wiki_git.subprocess, 'run', local_transport)
|
||||
wiki_git.update_wiki(checkout)
|
||||
assert git(checkout, 'rev-parse', 'HEAD') == wanted
|
||||
assert (checkout / 'README.md').read_text() == 'new'
|
||||
(checkout / 'untracked.md').write_text('local notes')
|
||||
with pytest.raises(RuntimeError, match='lokálne zmeny'):
|
||||
wiki_git.update_wiki(checkout)
|
||||
(checkout / 'untracked.md').unlink()
|
||||
(checkout / 'README.md').write_text('local modification')
|
||||
with pytest.raises(RuntimeError, match='lokálne zmeny'):
|
||||
wiki_git.update_wiki(checkout)
|
||||
assert (checkout / 'README.md').read_text() == 'local modification'
|
||||
git(checkout, 'restore', 'README.md')
|
||||
monkeypatch.setenv('EXPECTED_GITEA_BRANCH', 'other')
|
||||
with pytest.raises(RuntimeError, match='Aktívna Git vetva'):
|
||||
wiki_git.update_wiki(checkout)
|
||||
monkeypatch.setenv('EXPECTED_GITEA_BRANCH', 'master')
|
||||
monkeypatch.setenv('EXPECTED_GITEA_REPOSITORY', 'OTHER/zpwiki')
|
||||
with pytest.raises(RuntimeError, match='origin nezodpovedá'):
|
||||
wiki_git.update_wiki(checkout)
|
||||
monkeypatch.setenv('EXPECTED_GITEA_REPOSITORY', 'KEMT/zpwiki')
|
||||
git(checkout, 'config', 'user.name', 'Local author')
|
||||
git(checkout, 'config', 'user.email', 'local@example.test')
|
||||
(checkout / 'local.md').write_text('local commit')
|
||||
git(checkout, 'add', 'local.md')
|
||||
git(checkout, 'commit', '-m', 'local')
|
||||
local_head = git(checkout, 'rev-parse', 'HEAD')
|
||||
(author / 'README.md').write_text('remote update')
|
||||
git(author, 'commit', '-am', 'remote')
|
||||
git(author, 'push', 'origin', 'master')
|
||||
with pytest.raises(RuntimeError, match='Git operácia merge zlyhala'):
|
||||
wiki_git.update_wiki(checkout)
|
||||
assert git(checkout, 'rev-parse', 'HEAD') == local_head
|
||||
assert (checkout / 'local.md').read_text() == 'local commit'
|
||||
0
tools/__init__.py
Normal file
0
tools/__init__.py
Normal file
112
tools/answer_evaluation/README.md
Normal file
112
tools/answer_evaluation/README.md
Normal file
@ -0,0 +1,112 @@
|
||||
# Generovanie odpovedí nad zmrazeným grafom
|
||||
|
||||
Aktuálne meranie **v7** používa 46 známych DEV otázok, nový query-group TEST
|
||||
80 otázok a oddelenú historickú regresiu 320 otázok.
|
||||
Model vracia štruktúrované tvrdenia, `answer` je prázdne. Aplikácia overí
|
||||
fakty, väzby, počty a citácie a vykreslí prirodzený text deterministicky.
|
||||
Voľná próza modelu sa ako finálna odpoveď nedoručuje. Pôvodné HTTP odpovede,
|
||||
parsované aj vykreslené odpovede a každý opravný pokus sú uložené.
|
||||
|
||||
Nový TEST má prvý pokus **77/80 (96,25 %)** a finálny výsledok **80/80**;
|
||||
jednu opravu potrebovali tri otázky. Historická regresia má 319/320,
|
||||
s jedným odmietnutým nepodloženým akademickým názvom. Nejde o meranie voľnej jazykovej
|
||||
formulácie ani neznámeho korpusu. Modelový DEV má 46/46.
|
||||
[Správa v7](../graphrag/evaluation/results/final_v7_2026-10-26/REPORT.md).
|
||||
|
||||
Všetky evaluačné vstupy treba zvoliť explicitne. Nový TEST používa
|
||||
`--split test`; známa regresia `--split regression --regression-ids ...`.
|
||||
Oba potrebujú dokončený `--dev-results` s rovnakými hashmi a modelom.
|
||||
Príkazy sú v [pracovnom zázname v7](../../docs/graphrag_v7_2026-10-26_worklog.md).
|
||||
Budúci OpenWebUI agent musí dodržať `accepted_for_delivery` a odovzdať
|
||||
overený text; nekontrolované prepísanie rendererovej odpovede by tieto
|
||||
záruky obišlo. Natívny výber nástrojov ostáva ďalším blokom.
|
||||
|
||||
## Historická v6
|
||||
|
||||
Meranie **v6** je historická regresia 320 známych otázok vrátane
|
||||
42 DEV otázok. [Výsledná správa](../graphrag/evaluation/results/final_v6_2026-10-25/REPORT.md)
|
||||
uvádza samostatne prvý pokus, výsledok po jednom povolenom opravnom požiadavku,
|
||||
odmietnuté odpovede a JSON chyby. Žiadna chyba sa nevynecháva z menovateľa.
|
||||
Finálny strict výsledok je **316/320 (98,75 %)**: tri neplatné JSON/schema
|
||||
výstupy a jedno prísne odmietnutie skloňovaného mena pri správnych claims.
|
||||
|
||||
Spoločný adaptér prenáša úplnosť, orezanie, dôvody aj verziu dát. Guard používa
|
||||
iba skutočný kontext; kontroluje všetky citované URL, typy hodnôt, ich väzby
|
||||
a upozornenie pri neúplnom výpise. Môže vyžiadať najviac jednu opravu spolu
|
||||
pre formát alebo porušenie kontextu. Gold sa používa až pri hodnotení.
|
||||
Oba evaluačné grafové vstupy používajú tento istý adaptér a guard.
|
||||
|
||||
`accepted_for_delivery=false` zakazuje považovať výstup za overenú odpoveď.
|
||||
Integrácia tejto kontroly do budúceho natívneho OpenWebUI agenta je súčasťou
|
||||
bodu 4; dnešné meranie grafu dodáva kontext cez lokálny klient.
|
||||
Klasický RAG pred doručením používa `finalize_rag_answer()`: môže pridať iba
|
||||
chýbajúce upozornenie na neúplnosť, bez zmeny faktov. Zachová pôvodný text
|
||||
modelu a neobíde nepovolené URL ani tvrdenie o úplnom zozname.
|
||||
|
||||
[Podrobný postup a príkazy](../../docs/graphrag_v6_2026-10-25_worklog.md).
|
||||
Skripty `check_context_scenarios`, `check_rag_runtime`, `check_deployment`
|
||||
a `regrade_citations` oddeľujú syntetické funkčné kontroly, živý RAG smoke,
|
||||
overenie nasadenia a prepočet historických citácií od hlavnej presnosti.
|
||||
|
||||
## Historická v5.1
|
||||
|
||||
Meranie **v5.1** je historická regresia. Výsledky sú v
|
||||
[spoločnej správe](../graphrag/evaluation/results/final_v5_1_2026-10-25/REPORT.md).
|
||||
Používa 39 vopred vybraných DEV otázok (20 pôvodných a 19 historických zlyhaní)
|
||||
a 320 finálnych regresných otázok vrátane týchto 39. Nejde o nezávislý holdout.
|
||||
|
||||
Generovanie overí odtlačky kódu/promptu/dát voči kompletnému DEV. Parser prijíma
|
||||
platný typovaný JSON alebo jeden úplný JSON blok. Pri chybe formátu je povolený
|
||||
najviac jeden opravný požiadavok bez gold; pôvodné aj opravné odpovede sa ukladajú.
|
||||
Vecné zlyhanie hodnotenia neopakuje požiadavok. Report uvádza prvotnú aj konečnú
|
||||
úspešnosť a počet opráv. Natívny výber OpenWebUI nástrojov zostáva bodom 4.
|
||||
|
||||
Reprodukcia potrebuje zodpovedajúci release checkout a graf, načítanú konfiguráciu
|
||||
a nové výstupné adresáre. Najprv spustite `--split dev` s
|
||||
`--dev-ids tools/graphrag/evaluation/results/v5_1_preparation/generation_dev_ids.json`,
|
||||
`--audit tools/graphrag/evaluation/results/v5_1_preparation/source_audit.json`
|
||||
a `--freeze-manifest tools/graphrag/evaluation/frozen_v5_1.json`.
|
||||
Finálny beh používa rovnaké parametre, `--split regression` a povinné
|
||||
`--dev-results` smerujúce na tento dokončený DEV. Historické výsledky sa neprepisujú.
|
||||
|
||||
## Historický protokol v4
|
||||
|
||||
Nasledujúci text a pôvodný TEST 300 otázok opisujú v4; jej reprodukcia vyžaduje
|
||||
pôvodný kód aj graf. Týchto 300 otázok je pri ďalšom ladení historickou regresiou.
|
||||
|
||||
Tento experiment meria OpenWebUI chat API po dodaní skutočného grafového
|
||||
kontextu lokálnym skriptom. Neoveruje prehliadač ani automatický výber
|
||||
nainštalovaných nástrojov hlavným agentom. Klasický RAG sa nemení.
|
||||
|
||||
Pôvodná diagnostika použila 20 otázok. Všetkých 20 sa stalo DEV; zostávajúcich
|
||||
300 otázok zo zmrazeného grafového benchmarku tvorí nový TEST generovania.
|
||||
Predchádzajúce interné grafové meranie neposkytlo výstupy jazykového modelu.
|
||||
Žiadne očakávania, zdrojový oracle ani výsledky evaluatora sa modelu neposielajú.
|
||||
|
||||
`graph_answer_prompt.txt` určuje výstup. Kontext obsahuje iba skutočné relevantné
|
||||
fakty a zdroje, bez mien profilov vydávaných za názov akademickej práce či typu
|
||||
osoby zamieňaného za taxonomickú kategóriu. Štruktúrované tvrdenia musia spájať
|
||||
správne fakty pri tej istej osobe/práci/dokumente. Kontrolujú sa aj zdrojové
|
||||
odkazy, množiny, počty a povinné hodnoty v prirodzenom texte. Nepovinné `null`
|
||||
znamená neprítomnosť tvrdenia. Označenie diplomovej práce za dizertačnú sa odmieta.
|
||||
|
||||
Ide o prísne, ale stále pravidlové hodnotenie. Nejde o úplnú sémantickú kontrolu
|
||||
každej možnej vety. Zdrojový oracle je nezávislý od grafového buildera, nie od
|
||||
človeka, ktorý by nezávisle anotoval celý test. Osoby, korpus a šablóny sú známe.
|
||||
|
||||
Každý nový výstupný adresár obsahuje deklaráciu pred meraním, SHA kódu/promptu,
|
||||
presné DEV/TEST ID a výsledky všetkých otázok. Odpovede sa ukladajú priebežne;
|
||||
chyba ani prerušený beh sa nesmie zatajiť či premenovať na nezávislý nový TEST.
|
||||
Po odhalení TEST výsledkov patria tieto otázky pri ladení do DEV.
|
||||
|
||||
```bash
|
||||
set -a
|
||||
source .env
|
||||
set +a
|
||||
# Reprodukcia používa vždy nový adresár; nejde o nový nezávislý TEST.
|
||||
python -m tools.answer_evaluation.evaluate_graph_answers \
|
||||
--split test --output-dir /tmp/graphrag-answers-reproduction
|
||||
```
|
||||
|
||||
Model je `model120-fast`; presný názov modelu vrátený serverom, tokeny a pôvodné
|
||||
odpovede sú uložené vo výsledkoch. Prístupový kľúč zostáva iba v prostredí.
|
||||
1
tools/answer_evaluation/__init__.py
Normal file
1
tools/answer_evaluation/__init__.py
Normal file
@ -0,0 +1 @@
|
||||
"""Answer-generation evaluation kept separate from the frozen graph retriever."""
|
||||
41
tools/answer_evaluation/answer_format.py
Normal file
41
tools/answer_evaluation/answer_format.py
Normal file
@ -0,0 +1,41 @@
|
||||
"""Validate JSON without inventing facts or repairing values from benchmark gold."""
|
||||
import json
|
||||
import re
|
||||
from typing import Literal
|
||||
from pydantic import BaseModel, ConfigDict
|
||||
|
||||
|
||||
class Claim(BaseModel):
|
||||
model_config = ConfigDict(extra='forbid', strict=True)
|
||||
person: str
|
||||
title: str | None = None
|
||||
year: int | None = None
|
||||
start_year: int | None = None
|
||||
keyword: str | None = None
|
||||
category: str | None = None
|
||||
document_author: str | None = None
|
||||
|
||||
|
||||
class Answer(BaseModel):
|
||||
model_config = ConfigDict(extra='forbid', strict=True)
|
||||
answer: str
|
||||
status: Literal['ok','no_answer','ambiguous','error']
|
||||
claims: list[Claim]
|
||||
source_urls: list[str]
|
||||
count: int | None = None
|
||||
|
||||
|
||||
def parse_answer(text: str) -> tuple[dict, bool]:
|
||||
try:
|
||||
data=json.loads(text.strip())
|
||||
normalized=False
|
||||
except json.JSONDecodeError:
|
||||
# Exactly one complete JSON fence can be unwrapped. Never replace quotes,
|
||||
# append missing braces, extract fragments or silently alter assertions.
|
||||
blocks=re.findall(r'```(?:json)?\s*\n([\s\S]*?)```',text,flags=re.IGNORECASE)
|
||||
if len(blocks)!=1:
|
||||
raise
|
||||
data=json.loads(blocks[0].strip())
|
||||
normalized=True
|
||||
parsed=Answer.model_validate(data)
|
||||
return parsed.model_dump(exclude_none=True),normalized
|
||||
99
tools/answer_evaluation/check_context_scenarios.py
Normal file
99
tools/answer_evaluation/check_context_scenarios.py
Normal file
@ -0,0 +1,99 @@
|
||||
"""Live synthetic functional checks; separate from corpus accuracy metrics."""
|
||||
import argparse
|
||||
import concurrent.futures
|
||||
import copy
|
||||
import json
|
||||
import os
|
||||
from pathlib import Path
|
||||
|
||||
from tools.rag.evaluation.rag_runner import request_json, OPENWEBUI_URL, DEFAULT_MODEL
|
||||
from tools.graphrag.evaluation.reproducibility import sha256_file
|
||||
from .checked_generation import generate_checked_answer
|
||||
from .context_policy import joined_candidates
|
||||
|
||||
HERE = Path(__file__).parent
|
||||
|
||||
|
||||
def scenarios():
|
||||
base = {'status': 'ok', 'reason': None, 'complete': True, 'truncated': False,
|
||||
'truncation_reasons': [], 'index_version': {'version': 'synthetic-functional-fixture'},
|
||||
'sources': [{'source_id': 'S1', 'document_path': 'a.md', 'source_url': 'https://example.test/a'}],
|
||||
'facts': [{'person': 'Eva Vzorová', 'title': 'Vyhľadávanie informácií', 'year': 2026,
|
||||
'document_path': 'a.md', 'source_url': 'https://example.test/a'}],
|
||||
'aggregation': None, 'answer_candidates': []}
|
||||
query = 'Uveď názov práce osoby Eva Vzorová a rok práce.'
|
||||
result = []
|
||||
for name, fields in [
|
||||
('complete', {}), ('incomplete_without_truncated', {'complete': False}),
|
||||
('truncated', {'complete': False, 'truncated': True, 'truncation_reasons': ['limit']}),
|
||||
('unknown_completeness', {'complete': None})]:
|
||||
context = copy.deepcopy(base); context.update(fields)
|
||||
result.append({'id': name, 'question': query, 'context': context,
|
||||
'expected': {'status': 'ok', 'claims': [{'person': 'Eva Vzorová',
|
||||
'title': 'Vyhľadávanie informácií', 'year': 2026}]}})
|
||||
context = copy.deepcopy(base)
|
||||
context.update(complete=False, truncated=True, truncation_reasons=['evidence_limit'],
|
||||
aggregation={'count': 2, 'complete': True})
|
||||
result.append({'id': 'exact_count_partial_evidence', 'question': 'Aký je počet vyhovujúcich osôb?',
|
||||
'context': context, 'expected': {'status': 'ok', 'count': 2}})
|
||||
context = copy.deepcopy(base)
|
||||
context['sources'].append({'source_id': 'S2', 'document_path': 'child.md', 'source_url': 'https://example.test/child'})
|
||||
context['facts'].append({'person': 'Eva Vzorová', 'keyword': 'python',
|
||||
'document_path': 'child.md', 'source_url': 'https://example.test/child'})
|
||||
context['answer_candidates'] = joined_candidates(context['facts'], {'mentions_title': True, 'mentions_keyword': True})
|
||||
result.append({'id': 'same_person_child_tag',
|
||||
'question': 'Uveď názov práce osoby Eva Vzorová v roku 2026 s kľúčovým slovom python.',
|
||||
'context': context, 'expected': {'status': 'ok', 'claims': [
|
||||
{'person': 'Eva Vzorová', 'title': 'Vyhľadávanie informácií', 'year': 2026, 'keyword': 'python'}]}})
|
||||
context = copy.deepcopy(context)
|
||||
context['facts'][0].pop('title')
|
||||
context['answer_candidates'] = joined_candidates(context['facts'], {'years': [2026], 'mentions_keyword': True})
|
||||
result.append({'id': 'same_person_year_child_tag',
|
||||
'question': 'Ktorá osoba spĺňa kľúčové slovo python a rok práce 2026?',
|
||||
'context': context, 'expected': {'status': 'ok', 'claims': [
|
||||
{'person': 'Eva Vzorová', 'year': 2026, 'keyword': 'python'}]}})
|
||||
result.append({'id': 'type_is_not_keyword', 'question': 'Uveď názov diplomového projektu osoby Eva Vzorová a rok.',
|
||||
'context': copy.deepcopy(base), 'expected': {'status': 'ok', 'no_keyword': True}})
|
||||
context = copy.deepcopy(base)
|
||||
context.update(status='no_answer', reason='unknown_person', facts=[], sources=[])
|
||||
result.append({'id': 'no_answer', 'question': 'Akú prácu má Neexistujúca Osoba?',
|
||||
'context': context, 'expected': {'status': 'no_answer'}})
|
||||
return result
|
||||
|
||||
|
||||
def main():
|
||||
parser = argparse.ArgumentParser(description=__doc__)
|
||||
parser.add_argument('--output', type=Path, required=True)
|
||||
args = parser.parse_args()
|
||||
if args.output.exists():
|
||||
parser.error('Refusing to overwrite results.')
|
||||
files = [Path(__file__), HERE/'graph_answer_prompt.txt', HERE/'context_policy.py', HERE/'checked_generation.py', HERE/'answer_format.py', HERE/'render_answer.py']
|
||||
hashes = {str(p): sha256_file(p) for p in files}
|
||||
declared = scenarios()
|
||||
args.output.parent.mkdir(parents=True, exist_ok=True)
|
||||
args.output.with_suffix('.declaration.json').write_text(json.dumps(
|
||||
{'method': __doc__, 'model': DEFAULT_MODEL, 'hashes': hashes, 'scenarios': declared}, ensure_ascii=False, indent=2)+'\n')
|
||||
prompt = (HERE/'graph_answer_prompt.txt').read_text()
|
||||
def run(case):
|
||||
def complete(messages):
|
||||
return request_json(OPENWEBUI_URL, method='POST', timeout=90, max_attempts=2,
|
||||
headers={'Authorization': 'Bearer '+os.environ['OPENWEBUI_API_KEY'], 'Content-Type': 'application/json'},
|
||||
payload={'model': DEFAULT_MODEL, 'temperature': 0, 'stream': False,
|
||||
'response_format': {'type': 'json_object'}, 'messages': messages})
|
||||
out = generate_checked_answer(case['question'], case['context'], prompt, complete)
|
||||
answer = out.get('answer', {}); expected = case['expected']
|
||||
ok = answer.get('status') == expected['status']
|
||||
for binding in expected.get('claims', []):
|
||||
ok &= any(all(claim.get(k) == v for k, v in binding.items()) for claim in answer.get('claims', []))
|
||||
if 'count' in expected: ok &= answer.get('count') == expected['count']
|
||||
if expected.get('no_keyword'): ok &= not any(c.get('keyword') for c in answer.get('claims', []))
|
||||
return {'id': case['id'], **out, 'passed': bool(ok and out['accepted_for_delivery'])}
|
||||
with concurrent.futures.ThreadPoolExecutor(max_workers=3) as executor:
|
||||
rows = list(executor.map(run, declared))
|
||||
assert hashes == {str(p): sha256_file(p) for p in files}
|
||||
output = {'method': __doc__, 'questions': rows, 'summary': {'total': len(rows), 'passed': sum(r['passed'] for r in rows)}}
|
||||
args.output.write_text(json.dumps(output, ensure_ascii=False, indent=2)+'\n')
|
||||
print(json.dumps(output['summary']))
|
||||
|
||||
|
||||
if __name__ == '__main__': main()
|
||||
89
tools/answer_evaluation/check_deployment.py
Normal file
89
tools/answer_evaluation/check_deployment.py
Normal file
@ -0,0 +1,89 @@
|
||||
"""Verify the running API and graph library against a frozen release."""
|
||||
import argparse
|
||||
import json
|
||||
import os
|
||||
import platform
|
||||
from datetime import datetime, timezone
|
||||
from pathlib import Path
|
||||
from importlib.metadata import version as package_version
|
||||
|
||||
from tools.rag.evaluation.rag_runner import request_json
|
||||
from tools.graphrag.graph_db import create_neo4j_driver
|
||||
from tools.graphrag.graph_search import search_graph
|
||||
from tools.graphrag.build_graphrag import graph_version
|
||||
from tools.graphrag.evaluation.reproducibility import graph_fingerprint, run_metadata, verify_freeze, sha256_file
|
||||
from tools.index_state import read_version, sqlite_version
|
||||
from tools.rag.common import DB_FILE
|
||||
|
||||
|
||||
def main():
|
||||
parser = argparse.ArgumentParser(description=__doc__)
|
||||
parser.add_argument('--output', type=Path, required=True)
|
||||
parser.add_argument('--questions', type=Path, required=True)
|
||||
parser.add_argument('--audit', type=Path, required=True)
|
||||
parser.add_argument('--freeze-manifest', type=Path, required=True)
|
||||
parser.add_argument('--release-manifest', type=Path)
|
||||
args = parser.parse_args()
|
||||
if args.output.exists(): parser.error('Refusing to overwrite deployment verification.')
|
||||
base = Path('tools/graphrag/evaluation')
|
||||
release_path = args.release_manifest
|
||||
release_match = None
|
||||
if release_path is not None:
|
||||
release = json.loads(release_path.read_text())
|
||||
for path, digest in release['runtime_files'].items():
|
||||
assert sha256_file(Path(path)) == digest, f'Release code mismatch: {path}'
|
||||
assert sha256_file(args.freeze_manifest) == release['graph_freeze_sha256']
|
||||
release_match = True
|
||||
freeze = json.loads(args.freeze_manifest.read_text())
|
||||
health = request_json('http://localhost:8000/health')
|
||||
assert health['ready'] and all(v['ready'] for v in health['tools'].values())
|
||||
with create_neo4j_driver() as driver, driver.session() as session:
|
||||
graph = graph_fingerprint(session)
|
||||
verify_freeze(freeze, run_metadata(args.questions), graph,
|
||||
audit=args.audit, **freeze['parameters'])
|
||||
current = read_version(Path('data'))
|
||||
assert current == sqlite_version(DB_FILE) == graph_version(session) == health['index_version']
|
||||
documents = session.run('MATCH (d:Document {graph_scope:"zpwiki"}) RETURN d.path AS path, d.published AS published').data()
|
||||
headers = {'X-API-Key': os.environ['SEARCH_API_KEY'], 'Content-Type': 'application/json'}
|
||||
rag = request_json('http://localhost:8000/rag', method='POST', headers=headers,
|
||||
payload={'query': 'Aký je názov práce osoby Ján Holp a rok práce?', 'limit': 5}, timeout=120)
|
||||
assert rag['status'] == 'ok' and rag['sources'] and rag['index_version'] == current
|
||||
coverage = json.loads(rag['context'].splitlines()[1])
|
||||
assert coverage == {k: rag[k] for k in ['complete', 'truncated', 'truncation_reasons', 'index_version']}
|
||||
cases = {}
|
||||
for id, question, expected in [
|
||||
('known_title', 'Aký je názov práce osoby Ján Holp a rok práce?', 'ok'),
|
||||
('generic_label_not_title', 'Uveď názov práce osoby Dárius Lindvai v roku 2019 s kľúčovým slovom python.', 'no_answer'),
|
||||
('unknown_person', 'Akú prácu má osoba Jozef Neznámy Overovací?', 'no_answer'),
|
||||
('outside_century', 'Aký je názov práce osoby Ján Holp v roku 1999?', 'no_answer'),
|
||||
('unsupported_year', 'Aký je názov práce osoby Ján Holp v roku 10000?', 'no_answer'),
|
||||
('unknown_start', 'Aký je rok začiatku štúdia osoby Tomáš Kuchárik?', 'no_answer')]:
|
||||
result = search_graph(question)
|
||||
assert result['status'] == expected and result['index_version'] == current
|
||||
cases[id] = {'status': result['status'], 'reason': result['reason'], 'complete': result['complete']}
|
||||
hidden = {row['path'] for row in documents if row['published'] is False}
|
||||
raw_documents = json.loads(Path('data/documents.json').read_text())
|
||||
missing = sum(row['published'] is None for row in raw_documents)
|
||||
assert len(hidden) == 1 and missing == 16
|
||||
assert {row['path']: row['published'] for row in documents} == {
|
||||
row['path']: row['published'] is not False for row in raw_documents}
|
||||
hidden_rag = request_json('http://localhost:8000/rag', method='POST', headers=headers,
|
||||
payload={'query': 'Tvorba nezodpovedateľných otázok', 'limit': 5}, timeout=120)
|
||||
assert not hidden & {s['document_path'] for s in hidden_rag['sources']}
|
||||
result = {'checked_at_utc': datetime.now(timezone.utc).isoformat(), 'health': health,
|
||||
'index_version': current, 'frozen_implementation_inputs_and_graph_match': True,
|
||||
'graph': graph, 'graph_cases': cases, 'rag_live_query': 'ok',
|
||||
'release_code_match': release_match,
|
||||
'rag_context_metadata_matches_contract': True,
|
||||
'publication': {'documents': len(documents), 'explicit_false': len(hidden),
|
||||
'missing_included': missing, 'visible_by_policy': len(documents)-len(hidden),
|
||||
'hidden_document_absent_from_rag': True},
|
||||
'runtime': {'python': platform.python_version(), **{p: package_version(p) for p in
|
||||
['fastapi', 'pydantic', 'neo4j', 'sentence-transformers', 'torch']}},
|
||||
'scope': 'RAG HTTP API plus GraphRAG library/CLI; native OpenWebUI graph-tool routing is point 4.'}
|
||||
args.output.parent.mkdir(parents=True, exist_ok=True)
|
||||
args.output.write_text(json.dumps(result, ensure_ascii=False, indent=2)+'\n')
|
||||
print(json.dumps({'ready': True, 'version': current['version'], 'graph_cases': cases}))
|
||||
|
||||
|
||||
if __name__ == '__main__': main()
|
||||
49
tools/answer_evaluation/check_rag_runtime.py
Normal file
49
tools/answer_evaluation/check_rag_runtime.py
Normal file
@ -0,0 +1,49 @@
|
||||
"""Five preselected historical RAG smoke cases; not a new accuracy estimate."""
|
||||
import argparse
|
||||
import concurrent.futures
|
||||
import json
|
||||
import os
|
||||
from pathlib import Path
|
||||
|
||||
from tools.rag.evaluation.rag_runner import build_rag_tool, request_json, run_question, LOCAL_OPENAPI_URL, DEFAULT_MODEL
|
||||
from tools.rag.evaluation.rag_metrics import evaluate_answer
|
||||
from tools.graphrag.evaluation.reproducibility import sha256_file
|
||||
from .rag_delivery import finalize_rag_answer
|
||||
|
||||
|
||||
def main():
|
||||
parser = argparse.ArgumentParser(description=__doc__)
|
||||
parser.add_argument('--output', type=Path, required=True)
|
||||
args = parser.parse_args()
|
||||
if args.output.exists(): parser.error('Refusing to overwrite smoke results.')
|
||||
source = Path('tools/rag/evaluation/results/test_classic_rag_frozen/rag_answers_test.json')
|
||||
historic = json.loads(source.read_text())['results']
|
||||
selected = ['q0053', 'q0060', 'q0608', 'q1147', 'q0888']
|
||||
cases = [next(row for row in historic if row['id'] == id) for id in selected]
|
||||
operation, tool = build_rag_tool(request_json(LOCAL_OPENAPI_URL))
|
||||
metadata = {'method': __doc__, 'selected_ids': selected, 'model': DEFAULT_MODEL,
|
||||
'source_file': str(source), 'source_sha256': sha256_file(source),
|
||||
'generation_files': {str(p): sha256_file(p) for p in [Path(__file__),
|
||||
Path('tools/rag/evaluation/rag_runner.py'), Path('tools/rag/evaluation/rag_metrics.py'),
|
||||
Path('tools/answer_evaluation/context_policy.py'), Path('tools/answer_evaluation/rag_delivery.py')]}}
|
||||
args.output.parent.mkdir(parents=True, exist_ok=True)
|
||||
args.output.with_suffix('.declaration.json').write_text(json.dumps(metadata, ensure_ascii=False, indent=2)+'\n')
|
||||
def run(case):
|
||||
out = run_question(case['question'], model=DEFAULT_MODEL, operation_id=operation,
|
||||
rag_tool=tool, openwebui_api_key=os.environ['OPENWEBUI_API_KEY'],
|
||||
search_api_key=os.environ['SEARCH_API_KEY'], timeout=120, max_attempts=2)
|
||||
out = finalize_rag_answer(out)
|
||||
score = evaluate_answer(case, out['answer'], tool_called=out['tool_called'],
|
||||
allowed_source_urls=out['rag_source_urls'])
|
||||
return {'id': case['id'], 'question': case['question'], **out, **score,
|
||||
'strict_pass': bool(score['strict_pass'] and out['accepted_for_delivery'])}
|
||||
with concurrent.futures.ThreadPoolExecutor(max_workers=2) as executor:
|
||||
rows = list(executor.map(run, cases))
|
||||
assert metadata['generation_files'] == {p: sha256_file(Path(p)) for p in metadata['generation_files']}
|
||||
result = {'configuration': metadata, 'results': rows,
|
||||
'summary': {'questions': len(rows), 'strict_pass': sum(row['strict_pass'] for row in rows)}}
|
||||
args.output.write_text(json.dumps(result, ensure_ascii=False, indent=2)+'\n')
|
||||
print(json.dumps(result['summary']))
|
||||
|
||||
|
||||
if __name__ == '__main__': main()
|
||||
56
tools/answer_evaluation/checked_generation.py
Normal file
56
tools/answer_evaluation/checked_generation.py
Normal file
@ -0,0 +1,56 @@
|
||||
"""One bounded corrective request based solely on retrieval evidence."""
|
||||
import json
|
||||
from .answer_format import parse_answer, Answer
|
||||
from .context_policy import answer_context_issues
|
||||
from .render_answer import render_graph_answer
|
||||
|
||||
|
||||
def generate_checked_answer(question: str, context: dict, prompt: str, complete) -> dict:
|
||||
messages=[{'role':'system','content':prompt},{'role':'user','content':json.dumps(
|
||||
{'question':question,'graph_context':context},ensure_ascii=False)}]
|
||||
result={'attempts':[],'accepted_for_delivery':False}
|
||||
for number in range(2):
|
||||
record={};text=''
|
||||
try:
|
||||
response=complete(messages)
|
||||
result['response']=response;record['response']=response
|
||||
text=response['choices'][0]['message']['content'].strip()
|
||||
except Exception as error:
|
||||
result['error']=f'{type(error).__name__}: {str(error)[:500]}'
|
||||
result['attempts'].append(record)
|
||||
return result
|
||||
result['attempts'].append(record)
|
||||
try:
|
||||
answer,normalized=parse_answer(text)
|
||||
record['answer']=answer;record['format_normalized']=normalized
|
||||
except (ValueError,TypeError) as error:
|
||||
record['format_error']=type(error).__name__
|
||||
if number==1:
|
||||
result['error']='InvalidAnswerFormat: two invalid JSON/schema responses'
|
||||
return result
|
||||
feedback='Vráť jediný platný JSON objekt podľa schémy, bez zmeny faktov z pôvodného kontextu. Schéma: '+json.dumps(Answer.model_json_schema(),ensure_ascii=False)
|
||||
else:
|
||||
issues=answer_context_issues(answer,context,check_text=False)
|
||||
record['context_issues']=issues
|
||||
result['answer']=answer
|
||||
if not issues:
|
||||
rendered = render_graph_answer(answer, context)
|
||||
delivery_issues = answer_context_issues(rendered, context)
|
||||
if delivery_issues:
|
||||
issues = delivery_issues
|
||||
record['context_issues'] = issues
|
||||
else:
|
||||
record['rendered_answer'] = rendered
|
||||
result['model_answer'] = answer
|
||||
result['answer'] = rendered
|
||||
result['accepted_for_delivery']=True
|
||||
return result
|
||||
if number==1:
|
||||
result['context_rejected']=True
|
||||
return result
|
||||
feedback=('Odpoveď porušila pravidlá dodaného kontextu: '+', '.join(issues)+'. '
|
||||
'Oprav jediný JSON objekt výhradne z pôvodných podkladov. Použi iba source_urls zo sources. '
|
||||
'Typ práce nie je keyword. answer_candidates dokladajú spojenie požadovaného názvu alebo roku a tagu cez tú istú osobu. '
|
||||
'Answer ponechaj prázdny; text aj upozornenie zostaví aplikácia.')
|
||||
messages += [{'role':'assistant','content':text},{'role':'user','content':feedback}]
|
||||
return result
|
||||
189
tools/answer_evaluation/context_policy.py
Normal file
189
tools/answer_evaluation/context_policy.py
Normal file
@ -0,0 +1,189 @@
|
||||
"""Answer guards using only actual retrieval context; no benchmark or oracle."""
|
||||
from __future__ import annotations
|
||||
|
||||
import re
|
||||
from html import unescape
|
||||
from html.parser import HTMLParser
|
||||
import unicodedata
|
||||
|
||||
|
||||
def normalized(value) -> str:
|
||||
text=unicodedata.normalize('NFKD',str(value or ''))
|
||||
return ' '.join(re.findall(r'[a-z0-9]+',''.join(c for c in text if not unicodedata.combining(c)).casefold()))
|
||||
|
||||
|
||||
class _HTMLLinks(HTMLParser):
|
||||
def __init__(self):
|
||||
super().__init__(convert_charrefs=True)
|
||||
self.links = set()
|
||||
|
||||
def handle_starttag(self, tag, attrs):
|
||||
self.links.update(value for key, value in attrs if key in {'href', 'src'} and value)
|
||||
|
||||
|
||||
def text_urls(text: str) -> set[str]:
|
||||
"""Inspect absolute, inline, reference-style Markdown and HTML links."""
|
||||
text = unescape(text)
|
||||
urls = set()
|
||||
for url in re.findall(r'(?:[a-zA-Z][a-zA-Z0-9+.-]*://|www\.)[^\s<>"\x27`“”„«»‘’\]]+', text):
|
||||
url = url.rstrip('.,;:!?')
|
||||
while url.endswith(')') and url.count(')') > url.count('('):
|
||||
url = url[:-1]
|
||||
urls.add(url)
|
||||
for match in re.finditer(r'\]\(\s*', text):
|
||||
tail = text[match.end():]
|
||||
if tail.startswith('<'):
|
||||
urls.add(tail[1:].split('>', 1)[0]); continue
|
||||
level = 0; end = 0
|
||||
for end, char in enumerate(tail):
|
||||
if char.isspace() or (char == ')' and level == 0): break
|
||||
if char == '(': level += 1
|
||||
if char == ')': level -= 1
|
||||
else:
|
||||
end = len(tail)
|
||||
if tail[:end]: urls.add(tail[:end])
|
||||
for match in re.finditer(r'^\s{0,3}\[[^]\n]+\]:\s*(?:<([^>]+)>|(\S+))', text, flags=re.M):
|
||||
urls.add(match[1] or match[2])
|
||||
parser = _HTMLLinks(); parser.feed(text)
|
||||
return urls | parser.links
|
||||
|
||||
|
||||
def citation_check(answer: dict, allowed: set[str]) -> dict:
|
||||
declared=answer.get('source_urls',[])
|
||||
if not isinstance(declared,list) or any(not isinstance(url,str) for url in declared):
|
||||
return {'citations_ok':False,'unsupported_urls':[],'reason':'invalid_source_urls'}
|
||||
used=set(declared)|text_urls(str(answer.get('answer','')))
|
||||
unsupported=sorted(used-allowed)
|
||||
return {'citations_ok':not unsupported,'unsupported_urls':unsupported}
|
||||
|
||||
|
||||
def allowed_urls(context: dict) -> set[str]:
|
||||
return {row['source_url'] for row in context.get('sources',[]) if row.get('source_url')}
|
||||
|
||||
|
||||
def joined_candidates(facts: list[dict], intent: dict) -> list[dict]:
|
||||
"""Join requested academic fields and tag by person, retaining real sources."""
|
||||
needs_title = intent.get('mentions_title')
|
||||
needs_year = intent.get('mentions_academic_year') or intent.get('years')
|
||||
if not (needs_title or needs_year) or not (intent.get('mentions_keyword') or intent.get('keyword_phrase')):
|
||||
return []
|
||||
result=[]
|
||||
for record in facts:
|
||||
if (needs_title and not record.get('title')) or (not needs_title and record.get('year') is None):
|
||||
continue
|
||||
for tag in facts:
|
||||
if normalized(tag.get('person'))!=normalized(record.get('person')) or not tag.get('keyword'):
|
||||
continue
|
||||
fields = ['person', 'title', 'year'] if needs_title else ['person', 'year']
|
||||
candidate={k:record[k] for k in fields if record.get(k) is not None}
|
||||
candidate['keyword']=tag['keyword']
|
||||
candidate['evidence_documents']=sorted({p for p in [record.get('document_path'),tag.get('document_path')] if p})
|
||||
candidate['source_urls']=sorted({u for u in [record.get('source_url'),tag.get('source_url')] if u})
|
||||
if candidate not in result:result.append(candidate)
|
||||
return result
|
||||
|
||||
|
||||
def coverage_issues(answer: dict, context: dict) -> list[str]:
|
||||
incomplete = context.get('truncated') is True or context.get('complete') is False
|
||||
unknown = context.get('complete') is None
|
||||
clauses = [normalized(part) for part in re.split(r'[.!?;\n]+', answer.get('answer', ''))]
|
||||
caveat = any(re.search(r'(?:vypis|zoznam|vysled\w*|dokazy) (?:je |su |nie je |nie su )?(?:neupln\w*|orezan\w*)'
|
||||
r'|nie (?:je|su) (?:to )?upln\w*|nemozno zarucit uplnost|nemusi byt upln', clause)
|
||||
for clause in clauses)
|
||||
issues = []
|
||||
if incomplete and answer.get('status') == 'ok' and not caveat:
|
||||
issues.append('missing_incompleteness_notice')
|
||||
if incomplete or unknown:
|
||||
for clause in clauses:
|
||||
for match in re.finditer(r'(?:upln\w*|kompletn\w*) (?:zoznam|vypis|prehlad)'
|
||||
r'|vset(?:ci|ky|kych) (?:student\w*|osob\w*|prac\w*)', clause):
|
||||
prefix = clause[:match.start()]
|
||||
# Negation must qualify this particular assertion. A caveat in
|
||||
# another sentence never licenses a positive exhaustive claim.
|
||||
if not re.search(r'(?:nie (?:je|su)(?: to)?|nejde o|neuvadzam|'
|
||||
r'nemozno (?:zarucit|uviest)|nemozem (?:zarucit|poskytnut))\s*$', prefix):
|
||||
issues.append('unsupported_exhaustive_statement')
|
||||
return list(dict.fromkeys(issues))
|
||||
|
||||
|
||||
def prose_issues(answer: dict) -> list[str]:
|
||||
"""Conservative numeric consistency check; final prose is rendered from claims."""
|
||||
text = str(answer.get('answer', ''))
|
||||
for url in sorted(text_urls(text), key=len, reverse=True):
|
||||
text = text.replace(url, '')
|
||||
allowed_numbers = set()
|
||||
for claim in answer.get('claims', []):
|
||||
for key, value in claim.items():
|
||||
if value is None: continue
|
||||
if key in {'year', 'start_year'}: allowed_numbers.add(str(value))
|
||||
else: text = re.sub(re.escape(str(value)), '', text, flags=re.I)
|
||||
if answer.get('count') is not None: allowed_numbers.add(str(answer['count']))
|
||||
unsupported = set(re.findall(r'\b\d+\b', text)) - allowed_numbers
|
||||
return ['unsupported_prose_number'] if unsupported else []
|
||||
|
||||
|
||||
def text_contains_value(text: str, value: str, *, person: bool = False) -> bool:
|
||||
value = normalized(value); text = normalized(text)
|
||||
if not person: return value in text
|
||||
suffix = r'(?:a|u|ovi|om|e|ou|y|ovej|oveho|ym|emu)?'
|
||||
pattern = r'\b' + r'\s+'.join(re.escape(token) + (suffix if token.isalpha() else '')
|
||||
for token in value.split()) + r'\b'
|
||||
return bool(re.search(pattern, text))
|
||||
|
||||
|
||||
def answer_context_issues(answer: dict, context: dict, *, check_text: bool = True) -> list[str]:
|
||||
issues=[]
|
||||
if not citation_check(answer,allowed_urls(context))['citations_ok']:
|
||||
issues.append('unsupported_citation')
|
||||
facts=context.get('facts',[])
|
||||
aggregation=context.get('aggregation') or {}
|
||||
if answer.get('count') is not None:
|
||||
if aggregation.get('complete') is not True:
|
||||
issues.append('unsupported_total_count')
|
||||
elif answer['count']!=aggregation.get('count'):
|
||||
issues.append('incorrect_context_count')
|
||||
claims = answer.get('claims', [])
|
||||
cited = set(answer.get('source_urls', []))
|
||||
if answer.get('status') == 'ok' and facts and not claims:
|
||||
issues.append('missing_required_claims')
|
||||
if claims and not cited:
|
||||
issues.append('missing_required_citations')
|
||||
if answer.get('status') == 'no_answer' and claims:
|
||||
issues.append('claims_on_no_answer')
|
||||
if check_text and not str(answer.get('answer', '')).strip():
|
||||
issues.append('empty_answer_text')
|
||||
for claim in answer.get('claims',[]):
|
||||
person=normalized(claim.get('person'))
|
||||
rows=[f for f in facts if normalized(f.get('person'))==person]
|
||||
if not rows:
|
||||
issues.append('unsupported_person');continue
|
||||
for key in ['keyword','category','document_author','start_year']:
|
||||
if claim.get(key) is not None and not any(normalized(row.get(key))==normalized(claim[key]) for row in rows):
|
||||
issues.append('unsupported_'+key)
|
||||
for key in ['title', 'year', 'start_year', 'keyword', 'category', 'document_author']:
|
||||
if claim.get(key) is None: continue
|
||||
evidence = {row.get('source_url') for row in rows
|
||||
if normalized(row.get(key)) == normalized(claim[key]) and row.get('source_url')}
|
||||
if evidence and not evidence & cited:
|
||||
issues.append('missing_claim_source')
|
||||
academic={k:claim[k] for k in ['title','year'] if claim.get(k) is not None}
|
||||
if academic and not any(all(normalized(row.get(k))==normalized(v) for k,v in academic.items()) for row in rows):
|
||||
issues.append('unsupported_academic_binding')
|
||||
if claim.get('category') is not None and claim.get('document_author') is not None:
|
||||
if not any(a.get('document_path') and a.get('document_path')==b.get('document_path')
|
||||
for a in rows if normalized(a.get('category'))==normalized(claim['category'])
|
||||
for b in rows if normalized(b.get('document_author'))==normalized(claim['document_author'])):
|
||||
issues.append('disconnected_author_category')
|
||||
candidates=context.get('answer_candidates',[])
|
||||
if context.get('status')=='ok' and candidates:
|
||||
if answer.get('status')=='no_answer':
|
||||
issues.append('rejected_supported_person_join')
|
||||
elif not all(any(all(normalized(claim.get(k))==normalized(candidate[k]) for k in ['person','title','year','keyword'] if k in candidate)
|
||||
for claim in answer.get('claims',[])) for candidate in candidates):
|
||||
issues.append('split_or_missing_person_join')
|
||||
if context.get('status') in {'no_answer','ambiguous','error'} and answer.get('status')=='ok':
|
||||
issues.append('unsupported_positive_status')
|
||||
issues.extend(prose_issues(answer))
|
||||
if check_text or str(answer.get('answer', '')).strip():
|
||||
issues.extend(coverage_issues(answer,context))
|
||||
return list(dict.fromkeys(issues))
|
||||
253
tools/answer_evaluation/evaluate_graph_answers.py
Normal file
253
tools/answer_evaluation/evaluate_graph_answers.py
Normal file
@ -0,0 +1,253 @@
|
||||
"""Measure generated answers on a declared, frozen graph benchmark.
|
||||
|
||||
Regression mode repeats known questions; it is never a new independent TEST.
|
||||
The harness supplies retrieval context and does not test native tool routing.
|
||||
"""
|
||||
from __future__ import annotations
|
||||
|
||||
import argparse
|
||||
import concurrent.futures
|
||||
import csv
|
||||
import hashlib
|
||||
import json
|
||||
import os
|
||||
import time
|
||||
from collections import Counter
|
||||
from pathlib import Path
|
||||
|
||||
from tools.graphrag.graph_db import create_neo4j_driver, get_neo4j_settings
|
||||
from tools.graphrag.graph_search import search_graph_with_session
|
||||
from tools.graphrag.build_graphrag import graph_version
|
||||
from tools.graphrag.evaluation.benchmark_v2 import BASE
|
||||
from tools.graphrag.evaluation.check_openwebui import grade_claims
|
||||
from tools.graphrag.evaluation.reproducibility import graph_fingerprint, run_metadata, sha256_file, verify_freeze
|
||||
from tools.graphrag.evaluation.source_oracle import load_source_oracle, norm
|
||||
from tools.rag.evaluation.rag_runner import DEFAULT_MODEL, OPENWEBUI_URL, request_json
|
||||
from .checked_generation import generate_checked_answer
|
||||
from .context_policy import joined_candidates, citation_check, allowed_urls, answer_context_issues, prose_issues, text_contains_value
|
||||
|
||||
HERE = Path(__file__).resolve().parent
|
||||
|
||||
|
||||
def graph_context(result: dict) -> dict:
|
||||
"""Remove storage/profile metadata that cannot answer the actual question.
|
||||
|
||||
Uses only actual retrieval output and query intent, never gold annotations.
|
||||
Values/subjects/source paths are copied without inventing or rewriting facts.
|
||||
"""
|
||||
facts = []; intent = result['constraints']
|
||||
for row in result['facts']:
|
||||
kind = row.get('fact_type', '')
|
||||
if kind.startswith('shared_'):
|
||||
field = {'shared_keyword': 'keyword', 'shared_category': 'category',
|
||||
'shared_document_author': 'document_author'}.get(kind)
|
||||
if field:
|
||||
for side in ['left', 'right']:
|
||||
facts.append({'person': row[f'{side}_person'], field: row[field],
|
||||
'document_path': row.get(f'{side}_document_path'),
|
||||
'source_url': row.get(f'{side}_source_url')})
|
||||
continue
|
||||
if not row.get('person'):
|
||||
continue
|
||||
allowed = {'person', 'document_path', 'source_url', 'keyword', 'category', 'document_author'}
|
||||
if intent['mentions_title']:
|
||||
allowed.add('title')
|
||||
if intent['mentions_title'] or intent['mentions_academic_year'] or intent['years']:
|
||||
allowed.add('year')
|
||||
if intent['mentions_start_year']:
|
||||
allowed.add('start_year')
|
||||
fact = {k: v for k, v in row.items() if k in allowed and v is not None}
|
||||
if fact not in facts:
|
||||
facts.append(fact)
|
||||
sources=result.get('sources')
|
||||
if sources is None:
|
||||
sources=[{k:d[k] for k in ['document_path','source_url'] if d.get(k)} for d in result.get('documents',[])]
|
||||
context={'status':result['status'],'reason':result['reason'],'facts':facts,'sources':sources,
|
||||
'aggregation':result['aggregation'],'complete':result.get('complete'),
|
||||
'truncated':result.get('truncated',False),
|
||||
'truncation_reasons':result.get('truncation_reasons',[]),
|
||||
'index_version':result.get('index_version')}
|
||||
context['answer_candidates']=joined_candidates(facts,intent)
|
||||
return context
|
||||
|
||||
|
||||
def grade_answer(case: dict, answer: dict, oracle: dict, *, context: dict | None = None) -> dict:
|
||||
# JSON null is absence, not a positive factual assertion. The same rule is
|
||||
# applicable to all rounds, including the archived initial sample.
|
||||
normalized = dict(answer)
|
||||
if isinstance(answer.get('claims'), list):
|
||||
normalized['claims'] = [{k: v for k, v in claim.items() if v is not None}
|
||||
if isinstance(claim, dict) else claim for claim in answer['claims']]
|
||||
grade = grade_claims(case, normalized, oracle)
|
||||
urls=(allowed_urls(context) if context is not None else
|
||||
{d['source_url'] for d in oracle.get('documents',{}).values() if d.get('source_url')})
|
||||
citations=citation_check(answer,urls)
|
||||
grade.update(citations)
|
||||
policy_issues=answer_context_issues(normalized,context) if context is not None else []
|
||||
grade['context_issues']=policy_issues
|
||||
text = norm(answer.get('answer', ''))
|
||||
people = {str(b['person']) for b in case['graph']['expected_bindings'] if b.get('person')}
|
||||
missing = [v for v in case.get('expected_answer_contains', [])
|
||||
if not text_contains_value(answer.get('answer', ''), str(v), person=str(v) in people)]
|
||||
policy_issues.extend(prose_issues(normalized))
|
||||
# The initial sample exposed a real contradiction in otherwise correct
|
||||
# category claims. Check it explicitly rather than silently accepting prose.
|
||||
wrong_thesis_label = 'dizertac' in text and any(str(b.get('category', '')).startswith('dp')
|
||||
for b in case['graph']['expected_bindings']) and not any(
|
||||
str(b.get('category', '')).startswith('phd') for b in case['graph']['expected_bindings'])
|
||||
grade.update(text_values_ok=not missing, missing_text_values=missing,
|
||||
contradictory_thesis_label=wrong_thesis_label)
|
||||
grade['strict'] = bool(grade['strict'] and not missing and not wrong_thesis_label and citations['citations_ok'] and not policy_issues)
|
||||
return grade
|
||||
|
||||
|
||||
def main():
|
||||
parser = argparse.ArgumentParser(description=__doc__)
|
||||
parser.add_argument('--output-dir', type=Path, required=True)
|
||||
parser.add_argument('--workers', type=int, default=3)
|
||||
parser.add_argument('--model', default=DEFAULT_MODEL)
|
||||
parser.add_argument('--split', choices=['dev', 'test', 'regression'], default='test')
|
||||
parser.add_argument('--questions', type=Path, required=True)
|
||||
parser.add_argument('--audit', type=Path, required=True)
|
||||
parser.add_argument('--freeze-manifest', type=Path, required=True)
|
||||
parser.add_argument('--dev-ids', type=Path, required=True)
|
||||
parser.add_argument('--regression-ids', type=Path)
|
||||
parser.add_argument('--dev-results', type=Path, help='Required completed DEV before final regression.')
|
||||
args = parser.parse_args()
|
||||
if args.output_dir.exists():
|
||||
parser.error('Refusing to overwrite an answer-level TEST.')
|
||||
if not os.getenv('OPENWEBUI_API_KEY'):
|
||||
parser.error('OPENWEBUI_API_KEY missing.')
|
||||
if args.workers < 1:
|
||||
parser.error('--workers must be positive.')
|
||||
if args.split in {'regression', 'test'} and args.dev_results is None:
|
||||
parser.error('Final regression requires completed --dev-results.')
|
||||
dataset=args.questions; audit=args.audit; frozen=args.freeze_manifest
|
||||
manifest = json.loads(frozen.read_text())
|
||||
questions = json.loads(dataset.read_text()); oracle = load_source_oracle()
|
||||
development=set(json.loads(args.dev_ids.read_text()))
|
||||
test = [q for q in questions if q['split'] == 'test']
|
||||
if args.split == 'regression':
|
||||
if args.regression_ids is None: parser.error('Regression needs explicit --regression-ids.')
|
||||
regression_ids = set(json.loads(args.regression_ids.read_text()))
|
||||
selected = [q for q in questions if q['id'] in regression_ids]
|
||||
if len(selected) != len(regression_ids): parser.error('Unknown/duplicate regression IDs.')
|
||||
else:
|
||||
selected = test if args.split == 'test' else [q for q in questions if q['id'] in development]
|
||||
if not selected: parser.error('Empty selected split.')
|
||||
if args.split == 'test' and (manifest.get('evaluation_kind') != 'independent_holdout'
|
||||
or development & {q['id'] for q in selected}):
|
||||
parser.error('Fresh TEST requires independent freeze and zero DEV overlap.')
|
||||
if not development <= {q['id'] for q in questions if q['split'] == 'dev'}:
|
||||
parser.error('Generation DEV must be declared inside the dataset DEV split.')
|
||||
prompt_path = HERE / 'graph_answer_prompt.txt'; prompt = prompt_path.read_text()
|
||||
args.output_dir.mkdir(parents=True)
|
||||
metadata = run_metadata(dataset); settings = get_neo4j_settings(); contexts = {}
|
||||
with create_neo4j_driver(settings) as driver, driver.session(database=settings.database) as session:
|
||||
verify_freeze(manifest, metadata, graph_fingerprint(session), audit=audit, **manifest['parameters'])
|
||||
metadata['index_version']=graph_version(session)
|
||||
# Generate every context before making any external request.
|
||||
for case in selected:
|
||||
result=search_graph_with_session(session,case['question'],**manifest['parameters'])
|
||||
result['index_version']=metadata['index_version']
|
||||
contexts[case['id']]=graph_context(result)
|
||||
code_files = [Path(__file__), prompt_path, HERE/'answer_format.py',HERE/'context_policy.py',HERE/'checked_generation.py', HERE/'render_answer.py', Path('tools/rag/evaluation/rag_runner.py')]
|
||||
hashes = {str(p.resolve().relative_to(HERE.parents[1])): sha256_file(p) for p in code_files}
|
||||
if args.split in {'regression', 'test'}:
|
||||
dev=json.loads(args.dev_results.read_text())
|
||||
if (dev['configuration']['selected_split']!='dev'
|
||||
or set(dev['configuration']['selected_ids'])!=development
|
||||
or dev['summary']['questions']!=len(development)
|
||||
or {row['id'] for row in dev['questions']}!=development
|
||||
or len(dev['questions'])!=len(development)
|
||||
or dev['configuration']['generation_files']!=hashes
|
||||
or dev['run_metadata']['fingerprints']!=metadata['fingerprints']
|
||||
or dev['configuration']['graph_freeze_sha256']!=sha256_file(frozen)
|
||||
or dev['configuration']['model']!=args.model
|
||||
or dev['run_metadata'].get('index_version')!=metadata['index_version']):
|
||||
raise RuntimeError('Generation code, prompt, data or complete DEV differs; rerun DEV before final freeze.')
|
||||
declaration = {'method': ('Known-question development selection.' if args.split=='dev' else
|
||||
'Previously exposed LLM questions; regression, not independent TEST.'
|
||||
if args.split=='regression' else
|
||||
'Fresh query-group holdout over known sources and templates; zero DEV query-group overlap.'),
|
||||
'graph_freeze_sha256': sha256_file(frozen), 'audit_sha256': sha256_file(audit),
|
||||
'generation_files': hashes, 'model': args.model, 'temperature': 0, 'workers': args.workers,
|
||||
'dev_ids': sorted(development), 'test_ids': [q['id'] for q in test],
|
||||
'dev_count': len(development), 'test_count': len(test), 'target_accuracy': 0.92,
|
||||
'evaluation_kind': 'historical_regression' if args.split=='regression' else 'independent_query_group_holdout' if args.split=='test' else 'development',
|
||||
'rendering': 'Verified structured claims rendered deterministically; raw model outputs preserved.',
|
||||
'selected_split': args.split, 'selected_ids': [q['id'] for q in selected], 'selected_count':len(selected),
|
||||
'selected_dev_overlap': len(development & {q['id'] for q in selected}),
|
||||
'corrective_request_limit':1,'format_repair_limit':1,
|
||||
'repair_policy':'At most one total corrective request for format, citations or retrieval-context violations. Same question/context, no gold; retain all attempts.',
|
||||
'dev_results_sha256':sha256_file(args.dev_results) if args.dev_results else None,
|
||||
'policy': ('Evaluate every declared regression case, including DEV overlap; retain all failures and stop tuning after this freeze.'
|
||||
if args.split=='regression' else
|
||||
'Evaluate every declared fresh TEST case once; retain every failure; do not tune on this TEST.'),
|
||||
'selected_categories': dict(Counter(q['category'] for q in selected)),
|
||||
'limitations': [('Known development questions; not a holdout.' if args.split=='dev' else
|
||||
'All questions and previous model outputs are known; this is historical regression.'
|
||||
if args.split=='regression' else
|
||||
'Known corpus/profiles and templates; these query groups were not previously evaluated.'),
|
||||
'Harness supplies graph context; native OpenWebUI tool choice and browser UI are outside this experiment.',
|
||||
'Checks structured factual claims, their source support/citations and required prose values; not a general semantic judge of arbitrary prose.']}
|
||||
(args.output_dir / 'frozen_answers.json').write_text(json.dumps(declaration, ensure_ascii=False, indent=2) + '\n')
|
||||
results = {}
|
||||
def run(case):
|
||||
started = time.perf_counter(); context = contexts[case['id']]
|
||||
row = {'id': case['id'], 'category': case['category'], 'question': case['question'],
|
||||
'graph_context': context, 'strict': False}
|
||||
def complete(messages):
|
||||
return request_json(OPENWEBUI_URL, method='POST', timeout=90, max_attempts=2,
|
||||
headers={'Authorization':f'Bearer {os.environ["OPENWEBUI_API_KEY"]}','Content-Type':'application/json'},
|
||||
payload={'model':args.model,'temperature':0,'stream':False,
|
||||
'response_format':{'type':'json_object'},'messages':messages})
|
||||
generated=generate_checked_answer(case['question'],context,prompt,complete)
|
||||
row.update(generated)
|
||||
# Grading occurs after all generation/correction decisions, never inside
|
||||
# the generator. Gold cannot influence whether another request is sent.
|
||||
for attempt in row['attempts']:
|
||||
candidate = attempt.get('rendered_answer', attempt.get('answer'))
|
||||
attempt['strict']=(grade_answer(case,candidate,oracle,context=context)['strict']
|
||||
if candidate else False)
|
||||
if row.get('answer'):
|
||||
row.update(grade_answer(case,row['answer'],oracle,context=context))
|
||||
row['strict']=bool(row['strict'] and row['accepted_for_delivery'])
|
||||
row['latency_seconds'] = time.perf_counter() - started
|
||||
return row
|
||||
output = {'configuration': declaration, 'run_metadata': metadata, 'questions': []}
|
||||
with concurrent.futures.ThreadPoolExecutor(max_workers=args.workers) as executor:
|
||||
futures = [executor.submit(run, case) for case in selected]
|
||||
for future in concurrent.futures.as_completed(futures):
|
||||
row = future.result(); results[row['id']] = row
|
||||
output['questions'] = [results[q['id']] for q in selected if q['id'] in results]
|
||||
output['summary'] = {'questions': len(results), 'correct': sum(r['strict'] for r in results.values()),
|
||||
'accuracy': sum(r['strict'] for r in results.values()) / len(results),
|
||||
'errors': sum(bool(r.get('error')) for r in results.values()),
|
||||
'first_pass_correct':sum(bool(r.get('attempts') and r['attempts'][0].get('strict')) for r in results.values()),
|
||||
'format_repair_attempted':sum(bool(r.get('attempts') and r['attempts'][0].get('format_error') and len(r['attempts'])>1) for r in results.values()),
|
||||
'corrective_request_count':sum(len(r.get('attempts',[]))>1 for r in results.values()),
|
||||
'context_repair_attempted':sum(bool(r.get('attempts') and r['attempts'][0].get('context_issues') and len(r['attempts'])>1) for r in results.values()),
|
||||
'normalized_first_response':sum(bool(r.get('attempts') and r['attempts'][0].get('format_normalized')) for r in results.values())}
|
||||
(args.output_dir / f'answers_{args.split}.json').write_text(json.dumps(output, ensure_ascii=False, indent=2) + '\n')
|
||||
print(f'{len(results)}/{len(selected)} {row["id"]}: {"OK" if row["strict"] else "FAIL"} {row["latency_seconds"]:.1f}s', flush=True)
|
||||
with create_neo4j_driver(settings) as driver, driver.session(database=settings.database) as session:
|
||||
verify_freeze(manifest, run_metadata(dataset), graph_fingerprint(session), audit=audit, **manifest['parameters'])
|
||||
assert graph_version(session)==metadata['index_version'],'Index version changed during generation.'
|
||||
assert hashes == {str(p.resolve().relative_to(HERE.parents[1])): sha256_file(p) for p in code_files}, 'Generation code changed during TEST.'
|
||||
output['by_category'] = {category: {'questions': len(rows), 'correct': sum(r['strict'] for r in rows),
|
||||
'accuracy': sum(r['strict'] for r in rows) / len(rows)} for category in sorted({q['category'] for q in selected})
|
||||
for rows in [[r for r in output['questions'] if r['category'] == category]]}
|
||||
(args.output_dir / f'answers_{args.split}.json').write_text(json.dumps(output, ensure_ascii=False, indent=2) + '\n')
|
||||
fields=['id','category','strict','error','latency_seconds','attempts','first_pass_strict']
|
||||
with (args.output_dir/f'answers_{args.split}.csv').open('w',newline='',encoding='utf-8') as handle:
|
||||
writer=csv.DictWriter(handle,fieldnames=fields);writer.writeheader()
|
||||
for row in output['questions']:
|
||||
writer.writerow({**{k:row.get(k) for k in fields if k not in {'attempts','first_pass_strict'}},
|
||||
'attempts':len(row.get('attempts',[])),
|
||||
'first_pass_strict':bool(row.get('attempts') and row['attempts'][0].get('strict'))})
|
||||
print(json.dumps(output['summary']))
|
||||
|
||||
|
||||
if __name__ == '__main__':
|
||||
main()
|
||||
11
tools/answer_evaluation/graph_answer_prompt.txt
Normal file
11
tools/answer_evaluation/graph_answer_prompt.txt
Normal file
@ -0,0 +1,11 @@
|
||||
Vyber iba pravdivé štruktúrované tvrdenia z dodaného graph_context. Nepoužívaj vlastné vedomosti, zdrojový oracle ani údaje z otázky ako dôkaz.
|
||||
Vráť jediný platný JSON objekt: {"answer":"","status":"ok","claims":[],"source_urls":[],"count":null}. Answer MUSÍ zostať prázdny reťazec. Prirodzený text, citácie a upozornenie na úplnosť zostaví aplikácia z overených polí. Nepíš voľný text ani Markdown mimo JSON. Všetky reťazce ohraničuj ASCII dvojitými úvodzovkami; úvodzovky v hodnotách escapuj.
|
||||
Každá claim obsahuje person a len požadované polia, ktoré sú priamo doložené faktami: title, year, start_year, keyword, category, document_author. Nepovinné polia vynechaj. Roky a count sú celé čísla. Presne zachovaj mená, názvy, tagy a kódy kategórií. Nevytváraj nové osoby, hodnoty ani typy tvrdení.
|
||||
Title je názov akademickej práce/projektu, nikdy názov profilovej stránky alebo generický odkaz na rešerš. Year je rok tej istej práce ako title. Start_year je explicitne doložený začiatok štúdia; rok adresára nie je dôkaz. Keyword je skutočný tag osoby, nikdy typ práce ako diplomový projekt. Category je presný taxonomy.category kód. Document_author je autor dokumentu, nie automaticky študent.
|
||||
Všetky podmienky jednej claim patria tej istej osobe. Title a year patria rovnakému akademickému záznamu. Category a document_author musia byť doložené tým istým document_path.
|
||||
Tag patrí osobe cez jej profil aj dcérske dokumenty. Pre kombináciu názvu/roku a tagu nevyžaduj rovnaký dokument. Answer_candidates sú už doložené spojenia cez tú istú osobu; zachovaj ich person, year, keyword a prípadne title spolu v jednej claim. Neodmietaj toto spojenie len pre odlišné document_path.
|
||||
Claims musia pokryť všetky relevantné výsledky dotazu a požadované väzby. Pri porovnaní ľudí uveď každého v samostatnej claim. Pri výbere kandidátov vynechaj nevyhovujúce osoby. Pri názve práce uveď aj rok, ak je vo faktoch známy.
|
||||
Source_urls musí obsahovať konkrétne relevantné source_url zo sources pre všetky tvrdenia. Nevymýšľaj ani neupravuj URL. Ak názov/rok dokladá profil a tag dcérsky dokument, cituj oba potrebné zdroje. Nepoužívaj URL iných osôb ako náhradnú citáciu.
|
||||
Count môže byť číslo iba pri aggregation.complete=true a musí sa rovnať aggregation.count. Inak count=null, aj pri no_answer. Počet nie je počet zobrazených zdrojov. Presný agregovaný počet môže byť úplný aj pri orezanom výpise dôkazov.
|
||||
Pri status kontextu no_answer vráť status=no_answer, claims=[], count=null. Pri ambiguous alebo error zachovaj tento status a prázdne claims. Nevymýšľaj pozitívnu odpoveď. Nulová úplná agregácia so status=ok je platný výsledok s count=0.
|
||||
Complete, truncated, truncation_reasons a index_version nemenia pravdivosť faktov. Význam a obmedzenia výsledku oznámi aplikácia. Answer nechaj prázdne aj pri neúplnosti, nenájdení a chybe.
|
||||
65
tools/answer_evaluation/rag_delivery.py
Normal file
65
tools/answer_evaluation/rag_delivery.py
Normal file
@ -0,0 +1,65 @@
|
||||
"""Render a truthful coverage notice without altering the model's facts.
|
||||
|
||||
No gold or source oracle is accepted. Unsupported citations and unqualified
|
||||
exhaustive statements remain rejected. Keep the exact original model answer.
|
||||
"""
|
||||
import copy
|
||||
|
||||
|
||||
def finalize_rag_answer(result: dict) -> dict:
|
||||
out = copy.deepcopy(result)
|
||||
if out.get('display_notice_added'):
|
||||
return out
|
||||
issues = out.get('context_issues', [])
|
||||
out['model_answer'] = out['answer']
|
||||
out['first_pass_accepted_for_delivery'] = out.get('accepted_for_delivery')
|
||||
out['first_pass_context_issues'] = list(issues)
|
||||
out['display_notice_added'] = False
|
||||
# Only a missing notice can be rendered automatically. Adding a caveat to
|
||||
# a contradictory exhaustive statement would not repair that statement.
|
||||
if issues == ['missing_incompleteness_notice'] and out.get('citations_ok') is True:
|
||||
out['answer'] = 'Výpis je neúplný.\n\n' + out['model_answer']
|
||||
out['context_issues'] = []
|
||||
out['accepted_for_delivery'] = True
|
||||
out['display_notice_added'] = True
|
||||
return out
|
||||
|
||||
|
||||
def main():
|
||||
import argparse
|
||||
import json
|
||||
from pathlib import Path
|
||||
from tools.graphrag.evaluation.reproducibility import sha256_file
|
||||
from tools.rag.evaluation.rag_metrics import evaluate_answer
|
||||
|
||||
parser = argparse.ArgumentParser(description='Replay saved RAG outputs through the delivery layer; no model calls.')
|
||||
parser.add_argument('--input', type=Path, required=True)
|
||||
parser.add_argument('--output', type=Path, required=True)
|
||||
args = parser.parse_args()
|
||||
if args.output.exists(): parser.error('Refusing to overwrite a replay.')
|
||||
original = json.loads(args.input.read_text())
|
||||
source = Path(original['configuration']['source_file'])
|
||||
assert sha256_file(source) == original['configuration']['source_sha256']
|
||||
gold = {case['id']: case for case in json.loads(source.read_text())['results']}
|
||||
files = [Path(__file__), Path('tools/rag/evaluation/evaluate_rag_answers.py'),
|
||||
Path('tools/rag/evaluation/rag_metrics.py'), Path('tools/rag/evaluation/rag_runner.py'),
|
||||
Path('tools/answer_evaluation/context_policy.py')]
|
||||
rows = []
|
||||
for before in original['results']:
|
||||
after = finalize_rag_answer(before)
|
||||
score = evaluate_answer(gold[after['id']], after['answer'], tool_called=after['tool_called'],
|
||||
allowed_source_urls=after['rag_source_urls'])
|
||||
after.update(score)
|
||||
after['strict_pass'] = bool(score['strict_pass'] and after['accepted_for_delivery'])
|
||||
rows.append(after)
|
||||
result = {'configuration': {'method': 'Deterministic delivery replay on the same saved model responses, not new generation.',
|
||||
'input': str(args.input), 'input_sha256': sha256_file(args.input),
|
||||
'delivery_files': {str(p): sha256_file(p) for p in files}},
|
||||
'results': rows, 'summary': {'questions': len(rows), 'strict_pass': sum(r['strict_pass'] for r in rows),
|
||||
'display_notice_added': sum(r['display_notice_added'] for r in rows)}}
|
||||
args.output.parent.mkdir(parents=True, exist_ok=True)
|
||||
args.output.write_text(json.dumps(result, ensure_ascii=False, indent=2)+'\n')
|
||||
print(json.dumps(result['summary']))
|
||||
|
||||
|
||||
if __name__ == '__main__': main()
|
||||
46
tools/answer_evaluation/regrade_citations.py
Normal file
46
tools/answer_evaluation/regrade_citations.py
Normal file
@ -0,0 +1,46 @@
|
||||
"""Recheck archived citations against archived tool sources, without generation.
|
||||
|
||||
This changes only citation eligibility; it does not replace historical gold or
|
||||
claim a new full semantic evaluation. Missing archived context is unverifiable.
|
||||
"""
|
||||
import argparse
|
||||
import json
|
||||
from pathlib import Path
|
||||
|
||||
from tools.graphrag.evaluation.reproducibility import sha256_file
|
||||
from .context_policy import citation_check, allowed_urls
|
||||
|
||||
|
||||
def main():
|
||||
parser = argparse.ArgumentParser(description=__doc__)
|
||||
parser.add_argument('--input', type=Path, action='append', required=True)
|
||||
parser.add_argument('--output', type=Path, required=True)
|
||||
args = parser.parse_args()
|
||||
if args.output.exists(): parser.error('Refusing to overwrite regrading.')
|
||||
reports = []
|
||||
for path in args.input:
|
||||
data = json.loads(path.read_text()); rows = []
|
||||
for old in data.get('questions', data.get('results', [])):
|
||||
answer = old.get('answer') or ''
|
||||
if isinstance(answer, str): answer = {'answer': answer, 'source_urls': []}
|
||||
context = old.get('graph_context')
|
||||
legacy_sources = ({row['source_url'] for row in context.get('documents', []) if row.get('source_url')}
|
||||
if isinstance(context, dict) and 'documents' in context else None)
|
||||
urls = (allowed_urls(context) if isinstance(context, dict) and 'sources' in context else
|
||||
legacy_sources if legacy_sources is not None else
|
||||
set(old['rag_source_urls']) if isinstance(old.get('rag_source_urls'), list) else None)
|
||||
check = citation_check(answer, urls) if urls is not None else {'citations_ok': None, 'unsupported_urls': []}
|
||||
strict = bool(old.get('strict', old.get('strict_pass', False)))
|
||||
rows.append({'id': old['id'], 'previous_strict': strict, **check,
|
||||
'citation_adjusted_strict': (strict and check['citations_ok']) if urls is not None else None})
|
||||
reports.append({'file': str(path), 'sha256': sha256_file(path), 'rows': rows,
|
||||
'summary': {'questions': len(rows), 'checked': sum(r['citations_ok'] is not None for r in rows),
|
||||
'invalid_citations': sum(r['citations_ok'] is False for r in rows),
|
||||
'previous_strict': sum(r['previous_strict'] for r in rows),
|
||||
'strict_after_citation_check': sum(r['citation_adjusted_strict'] is True for r in rows)}})
|
||||
args.output.parent.mkdir(parents=True, exist_ok=True)
|
||||
args.output.write_text(json.dumps({'method': __doc__, 'files': reports}, ensure_ascii=False, indent=2)+'\n')
|
||||
print(json.dumps([{'file': r['file'], **r['summary']} for r in reports], ensure_ascii=False))
|
||||
|
||||
|
||||
if __name__ == '__main__': main()
|
||||
29
tools/answer_evaluation/render_answer.py
Normal file
29
tools/answer_evaluation/render_answer.py
Normal file
@ -0,0 +1,29 @@
|
||||
"""Render only validated structured facts; never infer facts or read gold."""
|
||||
from copy import deepcopy
|
||||
|
||||
|
||||
def render_graph_answer(answer: dict, context: dict) -> dict:
|
||||
out = deepcopy(answer)
|
||||
lines = []
|
||||
if out['status'] == 'ok':
|
||||
labels = {'title': 'názov práce', 'year': 'rok práce', 'start_year': 'začiatok štúdia',
|
||||
'keyword': 'kľúčové slovo', 'category': 'kategória', 'document_author': 'autor dokumentu'}
|
||||
for claim in out['claims']:
|
||||
values = [f'{label}: {claim[key]}' for key, label in labels.items() if claim.get(key) is not None]
|
||||
lines.append(claim['person'] + (' — ' + '; '.join(values) if values else '') + '.')
|
||||
if out.get('count') is not None:
|
||||
lines.append(f'Počet vyhovujúcich osôb: {out["count"]}.')
|
||||
if context.get('complete') is False or context.get('truncated'):
|
||||
lines.append('Výpis je neúplný.')
|
||||
elif context.get('complete') is None:
|
||||
lines.append('Úplnosť vyhľadania nemožno zaručiť.')
|
||||
elif out['status'] == 'ambiguous':
|
||||
lines.append('Požiadavka je nejednoznačná; údaje nemožno spoľahlivo určiť.')
|
||||
elif out['status'] == 'error':
|
||||
lines.append('Vyhľadanie zlyhalo; odpoveď nemožno pripraviť.')
|
||||
else:
|
||||
lines.append('Požadované údaje sa v dostupných podkladoch nenašli.')
|
||||
if out['source_urls']:
|
||||
lines.append('Zdroje: ' + ', '.join(out['source_urls']))
|
||||
out['answer'] = '\n'.join(lines)
|
||||
return out
|
||||
34
tools/bootstrap_indexes.py
Normal file
34
tools/bootstrap_indexes.py
Normal file
@ -0,0 +1,34 @@
|
||||
"""Keep a valid generation, or create both indexes before starting the API."""
|
||||
import hashlib
|
||||
import json
|
||||
|
||||
from app.security import validate_security_configuration
|
||||
from tools.rag.common import DATA_DIR, DB_FILE, ZPWIKI_ROOT
|
||||
from tools.rag.embedding_utils import embed_query
|
||||
from tools.rag.rebuild_index import rebuild_index
|
||||
from tools.runtime_assets import asset_root, verify
|
||||
from tools.sync_indexes import git_revision, source_files
|
||||
from tools.tool_health import tools_readiness
|
||||
|
||||
|
||||
def main():
|
||||
validate_security_configuration()
|
||||
verify(asset_root())
|
||||
embed_query('overenie pripravenosti')
|
||||
tools, version = tools_readiness(DB_FILE, security_configured=True, embedding_ready=True)
|
||||
source_hash = hashlib.sha256(json.dumps(source_files(ZPWIKI_ROOT), sort_keys=True).encode()).hexdigest()
|
||||
current = (all(value['ready'] for value in tools.values()) and version
|
||||
and version.get('git_revision') == git_revision(ZPWIKI_ROOT)
|
||||
and version.get('source_sha256') == source_hash)
|
||||
if not current:
|
||||
result = rebuild_index(pull_git=False)
|
||||
tools, version = tools_readiness(DB_FILE, security_configured=True, embedding_ready=True)
|
||||
if not all(value['ready'] for value in tools.values()):
|
||||
raise RuntimeError('Nové indexy nie sú pripravené; API sa nespustí.')
|
||||
print(json.dumps({'bootstrap': 'rebuilt', 'counts': result['counts'], 'index_version': version}))
|
||||
else:
|
||||
print(json.dumps({'bootstrap': 'existing', 'index_version': version}))
|
||||
|
||||
|
||||
if __name__ == '__main__':
|
||||
main()
|
||||
0
tools/graphrag/__init__.py
Normal file
0
tools/graphrag/__init__.py
Normal file
592
tools/graphrag/build_graphrag.py
Normal file
592
tools/graphrag/build_graphrag.py
Normal file
@ -0,0 +1,592 @@
|
||||
from __future__ import annotations
|
||||
|
||||
import argparse
|
||||
import json
|
||||
from pathlib import Path
|
||||
from typing import Any
|
||||
|
||||
from .graph_db import (
|
||||
create_neo4j_driver,
|
||||
get_neo4j_settings,
|
||||
)
|
||||
from .graphrag import (
|
||||
GRAPH_SCOPE,
|
||||
build_graph_payload,
|
||||
)
|
||||
from tools.index_state import DATA_DIR, PENDING_FILE, publication_lock, read_version
|
||||
|
||||
|
||||
PROJECT_ROOT = Path(
|
||||
__file__
|
||||
).resolve().parents[2]
|
||||
|
||||
DOCUMENTS_FILE = (
|
||||
PROJECT_ROOT
|
||||
/ "data"
|
||||
/ "documents.json"
|
||||
)
|
||||
|
||||
CHUNKS_FILE = (
|
||||
PROJECT_ROOT
|
||||
/ "data"
|
||||
/ "chunks.json"
|
||||
)
|
||||
|
||||
|
||||
CONSTRAINTS = (
|
||||
('zpwiki_index_state_unique', 'IndexState', 'id'),
|
||||
(
|
||||
"zpwiki_document_path_unique",
|
||||
"Document",
|
||||
"path",
|
||||
),
|
||||
(
|
||||
"zpwiki_person_id_unique",
|
||||
"Person",
|
||||
"id",
|
||||
),
|
||||
(
|
||||
"zpwiki_document_author_id_unique",
|
||||
"DocumentAuthor",
|
||||
"id",
|
||||
),
|
||||
(
|
||||
"zpwiki_category_name_unique",
|
||||
"Category",
|
||||
"name",
|
||||
),
|
||||
(
|
||||
"zpwiki_topic_id_unique",
|
||||
"Topic",
|
||||
"id",
|
||||
),
|
||||
(
|
||||
"zpwiki_keyword_id_unique",
|
||||
"Keyword",
|
||||
"id",
|
||||
),
|
||||
(
|
||||
"zpwiki_thesis_id_unique",
|
||||
"Thesis",
|
||||
"id",
|
||||
),
|
||||
(
|
||||
"zpwiki_work_id_unique",
|
||||
"Work",
|
||||
"id",
|
||||
),
|
||||
)
|
||||
|
||||
|
||||
LEGACY_CONSTRAINTS = (
|
||||
"zpwiki_author_id_unique",
|
||||
)
|
||||
|
||||
|
||||
def graph_version(session) -> dict | None:
|
||||
record = session.run('MATCH (s:IndexState {id:$scope}) RETURN s.metadata_json AS metadata',
|
||||
scope=GRAPH_SCOPE).single()
|
||||
return json.loads(record['metadata']) if record and record['metadata'] else None
|
||||
|
||||
|
||||
def write_graph_transaction(tx, payload: dict, *, replace: bool = True,
|
||||
version: dict | None = None) -> None:
|
||||
"""All destructive data changes belong to the caller's single transaction."""
|
||||
if replace:
|
||||
clear_managed_graph(tx)
|
||||
for key, query in NODE_QUERIES.items():
|
||||
write_rows(tx, query, payload[key])
|
||||
for key, query in RELATIONSHIP_QUERIES.items():
|
||||
write_rows(tx, query, payload[key])
|
||||
if replace:
|
||||
nodes, relationships = graph_counts(tx)
|
||||
labels = {'people': 'Person', 'document_authors': 'DocumentAuthor', 'documents': 'Document',
|
||||
'categories': 'Category', 'topics': 'Topic', 'keywords': 'Keyword',
|
||||
'theses': 'Thesis', 'works': 'Work'}
|
||||
types = {'person_documents': 'HAS_DOCUMENT', 'document_author_documents': 'AUTHORED_DOCUMENT',
|
||||
'document_categories': 'IN_CATEGORY', 'document_keywords': 'HAS_KEYWORD',
|
||||
'document_describes_topics': 'DESCRIBES', 'person_theses': 'AUTHORED',
|
||||
'person_works': 'HAS_WORK'}
|
||||
expected_nodes = {labels[key]: len(payload[key]) for key in labels if payload[key]}
|
||||
expected_relations = {types[key]: len(payload[key]) for key in types if payload[key]}
|
||||
evidenced = len(payload['thesis_documents']) + len(payload['work_documents'])
|
||||
if evidenced:
|
||||
expected_relations['EVIDENCED_BY'] = evidenced
|
||||
if dict(nodes) != expected_nodes or dict(relationships) != expected_relations:
|
||||
raise RuntimeError('Neo4j počty nezodpovedajú pripravenému grafu; transakcia sa zruší.')
|
||||
if version is None:
|
||||
tx.run('MATCH (s:IndexState {id:$scope}) DELETE s', scope=GRAPH_SCOPE).consume()
|
||||
else:
|
||||
# Operational state is deliberately outside the knowledge graph scope.
|
||||
tx.run('MERGE (s:IndexState {id:$scope}) SET s.metadata_json=$metadata',
|
||||
scope=GRAPH_SCOPE, metadata=json.dumps(version, sort_keys=True)).consume()
|
||||
|
||||
|
||||
NODE_QUERIES = {
|
||||
"people": """
|
||||
UNWIND $rows AS row
|
||||
MERGE (n:Person {id: row.id})
|
||||
SET n += row
|
||||
""",
|
||||
"document_authors": """
|
||||
UNWIND $rows AS row
|
||||
MERGE (n:DocumentAuthor {id: row.id})
|
||||
SET n += row
|
||||
""",
|
||||
"documents": """
|
||||
UNWIND $rows AS row
|
||||
MERGE (n:Document {path: row.path})
|
||||
SET n += row
|
||||
""",
|
||||
"categories": """
|
||||
UNWIND $rows AS row
|
||||
MERGE (n:Category {name: row.name})
|
||||
SET n += row
|
||||
""",
|
||||
"topics": """
|
||||
UNWIND $rows AS row
|
||||
MERGE (n:Topic {id: row.id})
|
||||
SET n += row
|
||||
""",
|
||||
"keywords": """
|
||||
UNWIND $rows AS row
|
||||
MERGE (n:Keyword {id: row.id})
|
||||
SET n += row
|
||||
""",
|
||||
"theses": """
|
||||
UNWIND $rows AS row
|
||||
MERGE (n:Thesis {id: row.id})
|
||||
SET n += row
|
||||
""",
|
||||
"works": """
|
||||
UNWIND $rows AS row
|
||||
MERGE (n:Work {id: row.id})
|
||||
SET n += row
|
||||
""",
|
||||
}
|
||||
|
||||
|
||||
RELATIONSHIP_QUERIES = {
|
||||
"person_documents": """
|
||||
UNWIND $rows AS row
|
||||
MATCH (a:Person {
|
||||
id: row.person_id
|
||||
})
|
||||
MATCH (b:Document {
|
||||
path: row.document_path
|
||||
})
|
||||
MERGE (a)-[:HAS_DOCUMENT]->(b)
|
||||
""",
|
||||
"document_author_documents": """
|
||||
UNWIND $rows AS row
|
||||
MATCH (a:DocumentAuthor {
|
||||
id: row.document_author_id
|
||||
})
|
||||
MATCH (b:Document {
|
||||
path: row.document_path
|
||||
})
|
||||
MERGE (a)-[:AUTHORED_DOCUMENT]->(b)
|
||||
""",
|
||||
"document_categories": """
|
||||
UNWIND $rows AS row
|
||||
MATCH (a:Document {
|
||||
path: row.document_path
|
||||
})
|
||||
MATCH (b:Category {
|
||||
name: row.category_name
|
||||
})
|
||||
MERGE (a)-[:IN_CATEGORY]->(b)
|
||||
""",
|
||||
"document_keywords": """
|
||||
UNWIND $rows AS row
|
||||
MATCH (a:Document {
|
||||
path: row.document_path
|
||||
})
|
||||
MATCH (b:Keyword {
|
||||
id: row.keyword_id
|
||||
})
|
||||
MERGE (a)-[:HAS_KEYWORD]->(b)
|
||||
""",
|
||||
"document_describes_topics": """
|
||||
UNWIND $rows AS row
|
||||
MATCH (a:Document {
|
||||
path: row.document_path
|
||||
})
|
||||
MATCH (b:Topic {
|
||||
id: row.topic_id
|
||||
})
|
||||
MERGE (a)-[:DESCRIBES]->(b)
|
||||
""",
|
||||
"person_theses": """
|
||||
UNWIND $rows AS row
|
||||
MATCH (a:Person {
|
||||
id: row.person_id
|
||||
})
|
||||
MATCH (b:Thesis {
|
||||
id: row.thesis_id
|
||||
})
|
||||
MERGE (a)-[:AUTHORED]->(b)
|
||||
""",
|
||||
"person_works": """
|
||||
UNWIND $rows AS row
|
||||
MATCH (a:Person {
|
||||
id: row.person_id
|
||||
})
|
||||
MATCH (b:Work {
|
||||
id: row.work_id
|
||||
})
|
||||
MERGE (a)-[:HAS_WORK]->(b)
|
||||
""",
|
||||
"thesis_documents": """
|
||||
UNWIND $rows AS row
|
||||
MATCH (a:Thesis {
|
||||
id: row.thesis_id
|
||||
})
|
||||
MATCH (b:Document {
|
||||
path: row.document_path
|
||||
})
|
||||
MERGE (a)-[:EVIDENCED_BY]->(b)
|
||||
""",
|
||||
"work_documents": """
|
||||
UNWIND $rows AS row
|
||||
MATCH (a:Work {
|
||||
id: row.work_id
|
||||
})
|
||||
MATCH (b:Document {
|
||||
path: row.document_path
|
||||
})
|
||||
MERGE (a)-[:EVIDENCED_BY]->(b)
|
||||
""",
|
||||
}
|
||||
|
||||
|
||||
def load_json(
|
||||
path: Path,
|
||||
) -> list[dict[str, Any]]:
|
||||
if not path.exists():
|
||||
raise FileNotFoundError(
|
||||
f"Missing file: {path}"
|
||||
)
|
||||
|
||||
data = json.loads(
|
||||
path.read_text(
|
||||
encoding="utf-8"
|
||||
)
|
||||
)
|
||||
|
||||
if not isinstance(
|
||||
data,
|
||||
list,
|
||||
):
|
||||
raise ValueError(
|
||||
f"Expected list in {path}"
|
||||
)
|
||||
|
||||
return data
|
||||
|
||||
|
||||
def create_constraints(
|
||||
session,
|
||||
) -> None:
|
||||
for (
|
||||
name,
|
||||
label,
|
||||
property_name,
|
||||
) in CONSTRAINTS:
|
||||
session.run(
|
||||
(
|
||||
f"CREATE CONSTRAINT "
|
||||
f"{name} IF NOT EXISTS "
|
||||
f"FOR (n:{label}) "
|
||||
f"REQUIRE n.{property_name} "
|
||||
f"IS UNIQUE"
|
||||
)
|
||||
).consume()
|
||||
|
||||
|
||||
def drop_legacy_constraints(
|
||||
session,
|
||||
) -> None:
|
||||
for name in LEGACY_CONSTRAINTS:
|
||||
session.run(
|
||||
(
|
||||
f"DROP CONSTRAINT "
|
||||
f"{name} IF EXISTS"
|
||||
)
|
||||
).consume()
|
||||
|
||||
|
||||
def clear_managed_graph(
|
||||
session,
|
||||
) -> None:
|
||||
session.run(
|
||||
"""
|
||||
MATCH (n)
|
||||
WHERE n.graph_scope = $scope
|
||||
DETACH DELETE n
|
||||
""",
|
||||
scope=GRAPH_SCOPE,
|
||||
).consume()
|
||||
|
||||
|
||||
def write_rows(
|
||||
session,
|
||||
query: str,
|
||||
rows: list[dict[str, Any]],
|
||||
) -> None:
|
||||
if not rows:
|
||||
return
|
||||
|
||||
session.run(
|
||||
query,
|
||||
rows=rows,
|
||||
).consume()
|
||||
|
||||
|
||||
def graph_counts(
|
||||
session,
|
||||
) -> tuple[
|
||||
list[tuple[str, int]],
|
||||
list[tuple[str, int]],
|
||||
]:
|
||||
node_rows = session.run(
|
||||
"""
|
||||
MATCH (n)
|
||||
WHERE n.graph_scope = $scope
|
||||
UNWIND labels(n) AS label
|
||||
RETURN
|
||||
label,
|
||||
count(*) AS count
|
||||
ORDER BY label
|
||||
""",
|
||||
scope=GRAPH_SCOPE,
|
||||
)
|
||||
|
||||
nodes = [
|
||||
(
|
||||
str(record["label"]),
|
||||
int(record["count"]),
|
||||
)
|
||||
for record in node_rows
|
||||
]
|
||||
|
||||
relationship_rows = session.run(
|
||||
"""
|
||||
MATCH (a)-[r]->(b)
|
||||
WHERE
|
||||
a.graph_scope = $scope
|
||||
AND b.graph_scope = $scope
|
||||
RETURN
|
||||
type(r) AS relationship,
|
||||
count(*) AS count
|
||||
ORDER BY relationship
|
||||
""",
|
||||
scope=GRAPH_SCOPE,
|
||||
)
|
||||
|
||||
relationships = [
|
||||
(
|
||||
str(
|
||||
record[
|
||||
"relationship"
|
||||
]
|
||||
),
|
||||
int(record["count"]),
|
||||
)
|
||||
for record in relationship_rows
|
||||
]
|
||||
|
||||
return nodes, relationships
|
||||
|
||||
|
||||
def titled_entity_counts(
|
||||
session,
|
||||
label: str,
|
||||
) -> tuple[int, int]:
|
||||
if label not in {
|
||||
"Thesis",
|
||||
"Work",
|
||||
}:
|
||||
raise ValueError(
|
||||
f"Unsupported label: {label}"
|
||||
)
|
||||
|
||||
record = session.run(
|
||||
f"""
|
||||
MATCH (n:{label})
|
||||
WHERE n.graph_scope = $scope
|
||||
RETURN
|
||||
count(n) AS total,
|
||||
count(n.title) AS with_title
|
||||
""",
|
||||
scope=GRAPH_SCOPE,
|
||||
).single()
|
||||
|
||||
if record is None:
|
||||
return 0, 0
|
||||
|
||||
return (
|
||||
int(record["total"]),
|
||||
int(record["with_title"]),
|
||||
)
|
||||
|
||||
|
||||
def print_payload_summary(
|
||||
payload: dict[
|
||||
str,
|
||||
list[dict[str, Any]],
|
||||
],
|
||||
) -> None:
|
||||
print()
|
||||
print("Prepared GraphRAG payload")
|
||||
print("=" * 60)
|
||||
|
||||
for key in (
|
||||
"people",
|
||||
"document_authors",
|
||||
"documents",
|
||||
"categories",
|
||||
"topics",
|
||||
"keywords",
|
||||
"theses",
|
||||
"works",
|
||||
):
|
||||
print(
|
||||
f"{key:<24}"
|
||||
f"{len(payload[key]):>6}"
|
||||
)
|
||||
|
||||
print()
|
||||
print("Relationships")
|
||||
|
||||
for key in (
|
||||
"person_documents",
|
||||
"document_author_documents",
|
||||
"document_categories",
|
||||
"document_keywords",
|
||||
"document_describes_topics",
|
||||
"person_theses",
|
||||
"person_works",
|
||||
"thesis_documents",
|
||||
"work_documents",
|
||||
):
|
||||
print(
|
||||
f"{key:<30}"
|
||||
f"{len(payload[key]):>6}"
|
||||
)
|
||||
|
||||
print("=" * 60)
|
||||
|
||||
|
||||
def print_database_summary(
|
||||
session,
|
||||
) -> None:
|
||||
nodes, relationships = (
|
||||
graph_counts(
|
||||
session
|
||||
)
|
||||
)
|
||||
|
||||
print()
|
||||
print("Neo4j GraphRAG knowledge graph")
|
||||
print("=" * 60)
|
||||
|
||||
print("Nodes")
|
||||
|
||||
for label, count in nodes:
|
||||
print(
|
||||
f" {label:<22}"
|
||||
f"{count:>6}"
|
||||
)
|
||||
|
||||
print()
|
||||
print("Relationships")
|
||||
|
||||
for relationship, count in relationships:
|
||||
print(
|
||||
f" {relationship:<22}"
|
||||
f"{count:>6}"
|
||||
)
|
||||
|
||||
thesis_total, thesis_with_title = (
|
||||
titled_entity_counts(
|
||||
session,
|
||||
"Thesis",
|
||||
)
|
||||
)
|
||||
|
||||
work_total, work_with_title = (
|
||||
titled_entity_counts(
|
||||
session,
|
||||
"Work",
|
||||
)
|
||||
)
|
||||
|
||||
print()
|
||||
print(
|
||||
"Theses with extracted title: "
|
||||
f"{thesis_with_title}/"
|
||||
f"{thesis_total}"
|
||||
)
|
||||
|
||||
print(
|
||||
"Works with extracted title: "
|
||||
f"{work_with_title}/"
|
||||
f"{work_total}"
|
||||
)
|
||||
|
||||
print("=" * 60)
|
||||
|
||||
|
||||
def main() -> None:
|
||||
parser = argparse.ArgumentParser()
|
||||
|
||||
parser.add_argument(
|
||||
"--replace",
|
||||
action=argparse.BooleanOptionalAction,
|
||||
default=True,
|
||||
)
|
||||
|
||||
args = parser.parse_args()
|
||||
|
||||
settings = get_neo4j_settings()
|
||||
|
||||
with create_neo4j_driver(
|
||||
settings
|
||||
) as driver:
|
||||
driver.verify_connectivity()
|
||||
|
||||
with driver.session(
|
||||
database=settings.database
|
||||
) as session:
|
||||
drop_legacy_constraints(
|
||||
session
|
||||
)
|
||||
|
||||
create_constraints(
|
||||
session
|
||||
)
|
||||
|
||||
import hashlib
|
||||
with publication_lock(DATA_DIR, exclusive=True):
|
||||
if (DATA_DIR / PENDING_FILE).exists():
|
||||
raise RuntimeError('Nedokončená spoločná synchronizácia; použite tools.rag.rebuild_index.')
|
||||
payload = build_graph_payload(load_json(DOCUMENTS_FILE), load_json(CHUNKS_FILE))
|
||||
print_payload_summary(payload)
|
||||
version = read_version(DATA_DIR)
|
||||
if not args.replace:
|
||||
version = None # An incremental merge cannot certify removed source records.
|
||||
if version and any(hashlib.sha256(path.read_bytes()).hexdigest() != version[key]
|
||||
for path, key in [(DOCUMENTS_FILE, 'documents_sha256'), (CHUNKS_FILE, 'chunks_sha256')]):
|
||||
version = None # A standalone rebuild must not claim stale provenance.
|
||||
with session.begin_transaction() as tx:
|
||||
write_graph_transaction(tx, payload, replace=args.replace, version=version)
|
||||
tx.commit()
|
||||
|
||||
print_database_summary(
|
||||
session
|
||||
)
|
||||
|
||||
|
||||
if __name__ == "__main__":
|
||||
main()
|
||||
136
tools/graphrag/evaluation/README.md
Normal file
136
tools/graphrag/evaluation/README.md
Normal file
@ -0,0 +1,136 @@
|
||||
# GraphRAG evaluácia
|
||||
|
||||
Aktuálna verzia je **v7**, tag `graphrag-v7-frozen`.
|
||||
[Správa v7](results/final_v7_2026-10-26/REPORT.md): graf DEV 1 046/1 046,
|
||||
nový query-group TEST 80/80, model DEV 46/46, finálne odpovede TEST 80/80
|
||||
(prvý pokus 77/80). Všetkých 591 testov prešlo. Stará regresia má 319/320;
|
||||
jeden nepodložený modelový názov sa nedoručil. TEST sa neprekrýva so žiadnou odhalenou query skupinou;
|
||||
korpus, ľudia a šablóny sú známe. Dve kategórie majú len 2 a 7 nových skupín.
|
||||
|
||||
CLI vyžaduje explicitné `--questions`, `--audit`, `--freeze-manifest`
|
||||
(pri TESTe) a nový výstupný adresár. Použite `graphrag_questions_v7.json`,
|
||||
`results/v7_preparation/source_audit.json`, `frozen_v7.json`.
|
||||
Generátor `benchmark_v7` vytvára otázky jednorazovo z raw zdrojov, bez
|
||||
predikcií. Odstránil sa odhad začiatku štúdia z adresára, nie nedokumentované
|
||||
otázky z merania. [Príkazy a postup](../../../docs/graphrag_v7_2026-10-26_worklog.md).
|
||||
|
||||
## Historická v6
|
||||
|
||||
Historická verzia je **v6**, tag `graphrag-v6-frozen`.
|
||||
[Finálna správa v6](results/final_v6_2026-10-25/REPORT.md) oddeľuje grafový
|
||||
DEV 722/722, regresiu 320/320 a generované odpovede modelu.
|
||||
Generovanie má strict **316/320 (98,75 %)**; všetkých **565 testov** prešlo.
|
||||
Benchmark v6 ponecháva všetkých 1 042 otázok, ich ID a rozdelenie. Opravuje
|
||||
15 očakávaní po priamom čítaní zdrojov; generický odkaz „rešerš“ nie je názov
|
||||
akademického projektu. Všetky staršie dáta a výsledky ostávajú zachované.
|
||||
Modelový DEV má 42 známych otázok; finálna regresia obsahuje všetkých 320.
|
||||
|
||||
Použite `--questions tools/graphrag/evaluation/graphrag_questions_v6.json`,
|
||||
`--audit tools/graphrag/evaluation/results/v6_preparation/source_audit.json`
|
||||
a `--freeze-manifest tools/graphrag/evaluation/frozen_v6.json`.
|
||||
[Postup, kontroly a zdrojová vzorka](../../../docs/graphrag_v6_2026-10-25_worklog.md).
|
||||
Kontrola vzorky je AI kontrola; ľudské posúdenie je pripravené v CSV, neprebehlo.
|
||||
Ročník adresára sa pri chýbajúcom explicitnom začiatku štúdia používa ako
|
||||
náhradná konvencia, nie ako nezávislý administratívny doklad.
|
||||
|
||||
## Historická v5.1
|
||||
|
||||
Historická verzia je **v5.1**, tag `graphrag-v5.1-frozen`.
|
||||
[Finálna správa](results/final_v5_1_2026-10-25/REPORT.md) a
|
||||
[strojový súhrn](results/final_v5_1_2026-10-25/summary.json) oddeľujú
|
||||
vyhľadávanie, zdrojovú kontrolu všetkých vrátených typovaných faktov a generovanie.
|
||||
|
||||
- Graf DEV: **722/722**.
|
||||
- Graf historická regresia: **320/320**, vrátane kontroly nadbytočných faktov.
|
||||
- Generovanie: 39 vopred deklarovaných DEV a finálna regresia všetkých 320
|
||||
historických otázok. Finálny výsledok: **317/320 (99,06 %)**, bez chýb JSON
|
||||
a bez opravného požiadavku. Všetky tri zlyhania zostávajú započítané.
|
||||
- Kompletné automatizované testy: **525 passed, 4 skipped**.
|
||||
|
||||
Všetky otázky sú už známe. V5.1 je regresia, nie nový nezávislý TEST; finálna
|
||||
regresia generovania obsahuje aj 39 DEV otázok. Pôvodné gold ani výsledky sa
|
||||
nemenili. Prvá iterácia v5 (319/320) zostáva uložená a má overený zdrojový patch.
|
||||
|
||||
Reprodukcia v5.1 vyžaduje zodpovedajúci release checkout, raw wiki, JSON vstupy
|
||||
aj graf podľa manifestu. Používajte vždy nový výstupný adresár:
|
||||
|
||||
```bash
|
||||
python -m tools.graphrag.evaluation.evaluate_graphrag \
|
||||
--split test \
|
||||
--audit tools/graphrag/evaluation/results/v5_1_preparation/source_audit.json \
|
||||
--freeze-manifest tools/graphrag/evaluation/frozen_v5_1.json \
|
||||
--output-dir /tmp/graphrag-v5-1-reproduction
|
||||
```
|
||||
|
||||
Nové zmrazenie po vývoji používa kompletný DEV a `--purpose historical_regression`.
|
||||
Odtlačky zahŕňajú spoločné moduly aj efektívnu publikačnú politiku. Každý reálny
|
||||
DEV výsledok musí prejsť nezávislou kontrolou všetkých vrátených typovaných faktov.
|
||||
Pri ďalšom nezávislom experimente treba nové, vopred zdrojovo overené otázky.
|
||||
|
||||
## Historický protokol v4
|
||||
|
||||
Nasledujúce merania a príkazy opisujú pôvodnú v4. Na reprodukciu použite jej
|
||||
pôvodný checkout/graf; aktuálny kód nezodpovedá odtlačkom frozen_v4.
|
||||
|
||||
Historická zmrazená verzia je **v4**. [Finálna správa](results/final_v4_2026-10-25/REPORT.md) obsahuje protokol, výsledky a obmedzenia.
|
||||
|
||||
| Meranie grafového vyhľadávania | Správne | Úspešnosť |
|
||||
|---|---:|---:|
|
||||
| DEV/regresia v4 | 722/722 | 100,00 % |
|
||||
| Širší TEST v4 | 320/320 | 100,00 % |
|
||||
|
||||
Cieľ ≥92 % grafového vyhľadávania bol splnený v prvom finálnom behu. TEST má desať kategórií, 288 kladných a 32 záporných otázok, bez runtime chýb. Osoby aj korpus sú známe; nové sú otázky a kombinácie faktov. Logické skupiny ani normalizované otázky sa medzi DEV a TEST neprekrývajú. Výsledok neznamená všeobecnú 100 % správnosť na ľubovoľnom vstupe.
|
||||
|
||||
Generovanie odpovedí dosiahlo **281/300 (93,67 %)** na novom externom TESTe; 20 DEV otázok malo 19/20. Všetkých 19 zlyhaní vrátane 7 neplatných JSON odpovedí ostáva započítaných. Doplnkový audit všetkých vrátených grafových kontextových faktov má **319/320 (99,69 %)**; strict 320/320 neznamená pravdivosť každej nadbytočnej hodnoty. Najslabšia LLM kategória je názov + tag (21/30).
|
||||
|
||||
Samostatne sa hodnotí generovanie odpovedí cez školské OpenWebUI API po dodaní skutočného grafového kontextu. [Protokol generovania](../../answer_evaluation/README.md) oddeľuje 20 DEV a 300 nových LLM TEST výstupov. Natívny výber nástrojov hlavným agentom je ďalší blok projektu.
|
||||
|
||||
## Reprodukcia zmrazeného grafu
|
||||
|
||||
Použi zodpovedajúci kód, rovnakú pôvodnú wiki, JSON vstupy a obsah Neo4j podľa manifestu. Súkromné kľúče ostávajú v `.env`.
|
||||
|
||||
```bash
|
||||
set -a
|
||||
source .env
|
||||
set +a
|
||||
python -m tools.graphrag.evaluation.evaluate_graphrag \
|
||||
--split test \
|
||||
--audit tools/graphrag/evaluation/results/v4_preparation/source_audit.json \
|
||||
--freeze-manifest tools/graphrag/evaluation/frozen_v4.json \
|
||||
--output-dir /tmp/graphrag-v4-reproduction
|
||||
```
|
||||
|
||||
Existujúce finálne výstupy a manifesty sa neprepisujú. Opakované spustenie rovnakého TESTu je reprodukcia, nie nové nezávislé overenie. Ak sa podľa odhalených TEST chýb ladí ďalšia verzia, tieto otázky sú od tej chvíle DEV.
|
||||
|
||||
## Zdrojový benchmark a história
|
||||
|
||||
- `graphrag_questions.json`: pôvodných 500 otázok. V2 opravila 137 nesúladov (128 tagových predpokladov a 9 neúplných množín kategórií). Zmeny sú v `results/v2_preparation/legacy_corrections.json`.
|
||||
- V2: 509 DEV a 80 profilovo oddelených TEST otázok; finálny TEST 67/80 (83,75 %). Po odhalení sa stal regresiou.
|
||||
- V3: 589 DEV a 13 **nových** doplnkových otázok vytvorených z pôvodných dokumentov posledných dvoch neodhalených profilov. Nešlo o výber trinástich z pôvodných 500. Meranie prebehlo interným skriptom nad Neo4j bez OpenWebUI či LLM. DEV 589/589, malý TEST 13/13; obmedzené pokrytie neumožňovalo tvrdiť všeobecnú 100 % presnosť.
|
||||
- V4: 722 DEV (602 historických + 120 nových), 320 nových TEST skupín nad všetkými známymi profilmi. `source_oracle.py` číta raw Markdown oddelene od buildera. `benchmark_v4.py` nepoužíva výsledky vyhľadávania pri tvorbe očakávaní ani výbere otázok. Kontrola surových zdrojov doplnila 45 zmien/rozšírení historických väzieb názvov; záznamy a mapovanie ID sú v `results/v4_preparation/`.
|
||||
|
||||
V1–v3 ostávajú v pôvodných adresároch s manifestmi a tagmi `graphrag-v1-frozen`, `graphrag-v2-frozen`, `graphrag-v3-frozen`. Na reprodukciu treba ich pôvodný kód a graf. Percentá rôznych verzií nie sú kontrolovaným porovnaním identických otázok. Klasický RAG a jeho referenčné experimenty ostávajú samostatné.
|
||||
|
||||
## Strict a zmrazenie
|
||||
|
||||
Správne hodnoty patria tej istej osobe/práci a majú prepojené typované dôkazy. Overuje sa význam roku, názov a typ práce, relácie, kategória a autor toho istého dokumentu, zdrojové alternatívy a URL, presné množiny a počet, explicitné no-answer a neorezaný výsledok. Rozpoznaná hodnota z otázky sama nie je dôkazom. Schema3 overuje strojové vzory ciest, nie iba textový zoznam očakávaných trás.
|
||||
|
||||
Freeze vyžaduje kompletný DEV, nulové runtime chyby, platný zdrojový audit a odtlačky kódu, otázok, pôvodných súborov, JSON vstupov, grafu a parametrov. V4 explicitne deklaruje prekryv 72 profilov a nulový prekryv logických skupín. Starší režim profilovo oddeleného holdoutu zostáva zachovaný.
|
||||
|
||||
Oracle aj evaluator sú pravidlové. Priama kontrola pôvodných riadkov a stratifikovaná kontrola anotácií nie sú náhradou nezávislej ľudskej anotácie celého datasetu.
|
||||
|
||||
## Vývoj ďalšej verzie
|
||||
|
||||
Generátory historických v1–v4 neregeneruj na pôvodných miestach. Nové dáta, manifesty a merania potrebujú nové cesty/verziu. `benchmark_v4 --extra-exposed` vie vyradiť ďalšie odhalené skupiny, ale množstvo nových zdrojových prípadov je konečné a kvóty sa nesmú meniť podľa úspechu vyhľadávania.
|
||||
|
||||
```bash
|
||||
python -m tools.graphrag.evaluation.evaluate_graphrag \
|
||||
--split dev --audit tools/graphrag/evaluation/results/v4_preparation/source_audit.json \
|
||||
--output-dir /tmp/graphrag-next
|
||||
python -m tools.graphrag.evaluation.freeze_graphrag \
|
||||
--dev-results /tmp/graphrag-next/graphrag_dev.json \
|
||||
--audit tools/graphrag/evaluation/results/v4_preparation/source_audit.json \
|
||||
--output /tmp/graphrag-next/frozen.json
|
||||
```
|
||||
|
||||
Záverečná kompletná automatizovaná sada: **448 passed, 4 skipped** (vrátane nových testov generovania). Neo4j integračné testy používajú izolovaný scope a rollback. Výsledky obsahujú úplné JSON/CSV a odtlačky pre reprodukciu.
|
||||
0
tools/graphrag/evaluation/__init__.py
Normal file
0
tools/graphrag/evaluation/__init__.py
Normal file
123
tools/graphrag/evaluation/audit_benchmark.py
Normal file
123
tools/graphrag/evaluation/audit_benchmark.py
Normal file
@ -0,0 +1,123 @@
|
||||
"""Check source consistency without changing questions or consulting search output."""
|
||||
from __future__ import annotations
|
||||
|
||||
import argparse
|
||||
import hashlib
|
||||
import json
|
||||
import re
|
||||
from collections import Counter, defaultdict
|
||||
from pathlib import Path
|
||||
from typing import Any
|
||||
|
||||
from ..graphrag import build_graph_payload
|
||||
from .graphrag_evaluator import normalize_text
|
||||
from .reproducibility import content_fingerprints
|
||||
|
||||
ROOT = Path(__file__).resolve().parents[3]
|
||||
|
||||
|
||||
def audit_questions(questions: list[dict], payload: dict) -> dict[str, Any]:
|
||||
people = {normalize_text(row['name']): row for row in payload['people']}
|
||||
documents = {row['path']: row for row in payload['documents']}
|
||||
person_docs: dict[str, set[str]] = defaultdict(set)
|
||||
for row in payload['person_documents']:
|
||||
person_docs[row['person_id']].add(row['document_path'])
|
||||
doc_keywords: dict[str, set[str]] = defaultdict(set)
|
||||
for row in payload['document_keywords']:
|
||||
doc_keywords[row['document_path']].add(row['keyword_id'])
|
||||
keywords = {normalize_text(row['name']): row['id'] for row in payload['keywords']}
|
||||
keywords.update({normalize_text(row['id']): row['id'] for row in payload['keywords']})
|
||||
academic: dict[str, list[dict]] = defaultdict(list)
|
||||
for row in payload['theses'] + payload['works']:
|
||||
academic[row['source_document']].append(row)
|
||||
rows = []
|
||||
for question in questions:
|
||||
graph = question['graph']
|
||||
issues = []
|
||||
starts = [people.get(normalize_text(item['value']))
|
||||
for item in graph.get('start_entities', []) if item['type'] == 'person']
|
||||
if any(person is None for person in starts):
|
||||
issues.append('unknown_start_person')
|
||||
starts = [person for person in starts if person]
|
||||
expected = graph.get('expected_entities', [])
|
||||
targets = [people.get(normalize_text(item['value'])) for item in expected if item['type'] == 'person']
|
||||
targets = [person for person in targets if person] or starts
|
||||
required_people = starts if question['category'] == 'shared_keyword_pair' else targets
|
||||
for entity in expected:
|
||||
if entity['type'] == 'keyword':
|
||||
key = keywords.get(normalize_text(entity['value']))
|
||||
if key is None:
|
||||
issues.append('keyword_not_in_frontmatter_catalog')
|
||||
elif any(not any(key in doc_keywords[path] for path in person_docs[person['id']])
|
||||
for person in required_people):
|
||||
issues.append('keyword_not_linked_to_expected_person')
|
||||
elif entity['type'] in {'thesis_title', 'work_title'}:
|
||||
records = payload['theses'] if entity['type'] == 'thesis_title' else payload['works']
|
||||
paths = {person['source_document'] for person in starts}
|
||||
if not any(row['source_document'] in paths
|
||||
and normalize_text(row.get('title')) == normalize_text(entity['value'])
|
||||
for row in records):
|
||||
issues.append('title_not_supported_by_source')
|
||||
category = question['category']
|
||||
if category == 'person_multiple_categories' and starts:
|
||||
actual = {normalize_text(cat) for path in person_docs[starts[0]['id']]
|
||||
for cat in documents[path]['categories']}
|
||||
expected_set = {normalize_text(value) for value in graph.get('expected_entity_set', [])}
|
||||
if graph.get('entity_set_mode') == 'exact' and actual != expected_set:
|
||||
issues.append('exact_categories_omit_or_add_source_categories')
|
||||
years = {int(value) for value in re.findall(r'\b20\d{2}\b', question['question'])}
|
||||
if category == 'same_academic_year_pair':
|
||||
expected_years = {int(item['value']) for item in expected if item['type'] == 'year'}
|
||||
if any(not expected_years <= {r['year'] for r in academic[p['source_document']]}
|
||||
for p in starts):
|
||||
issues.append('shared_year_not_supported_by_source')
|
||||
if category == 'person_title_year':
|
||||
expected_years = {int(item['value']) for item in expected if item['type'] == 'year'}
|
||||
titles = {normalize_text(item['value']) for item in expected
|
||||
if item['type'] in {'thesis_title', 'work_title'}}
|
||||
if starts and not any(normalize_text(r.get('title')) in titles and r['year'] in expected_years
|
||||
for p in starts for r in academic[p['source_document']]):
|
||||
issues.append('title_year_pair_not_supported_by_source')
|
||||
if category == 'candidate_set_aggregation':
|
||||
actual = {normalize_text(p['name']) for p in starts
|
||||
if any(r['year'] in years for r in academic[p['source_document']])}
|
||||
expected_set = {normalize_text(value) for value in graph.get('expected_entity_set', [])}
|
||||
if actual != expected_set or len(actual) != graph.get('expected_count'):
|
||||
issues.append('candidate_set_or_count_not_supported_by_source')
|
||||
for path in question.get('expected_documents', []):
|
||||
if path not in documents:
|
||||
issues.append('unknown_expected_document')
|
||||
rows.append({'id': question['id'], 'split': question['split'],
|
||||
'category': category, 'source_consistent': not issues,
|
||||
'issues': sorted(set(issues))})
|
||||
return {
|
||||
'method': 'Static source checks; no retrieval output, question rewriting or alias invention.',
|
||||
'questions': rows,
|
||||
'by_split': {
|
||||
split: {'questions': len(selected),
|
||||
'source_consistent': sum(row['source_consistent'] for row in selected),
|
||||
'issues': dict(Counter(issue for row in selected for issue in row['issues']))}
|
||||
for split in ['dev', 'test']
|
||||
for selected in [[row for row in rows if row['split'] == split]]
|
||||
},
|
||||
}
|
||||
|
||||
|
||||
def main() -> None:
|
||||
parser = argparse.ArgumentParser(description=__doc__)
|
||||
parser.add_argument('--questions', type=Path, default=Path(__file__).parent / 'graphrag_questions.json')
|
||||
parser.add_argument('--output', type=Path, required=True)
|
||||
args = parser.parse_args()
|
||||
questions = json.loads(args.questions.read_text())
|
||||
payload = build_graph_payload(json.loads((ROOT / 'data/documents.json').read_text()),
|
||||
json.loads((ROOT / 'data/chunks.json').read_text()))
|
||||
audit = audit_questions(questions, payload)
|
||||
audit['dataset_sha256'] = hashlib.sha256(args.questions.read_bytes()).hexdigest()
|
||||
audit['inputs'] = content_fingerprints(args.questions)['inputs']
|
||||
args.output.parent.mkdir(parents=True, exist_ok=True)
|
||||
args.output.write_text(json.dumps(audit, ensure_ascii=False, indent=2) + '\n')
|
||||
print(json.dumps(audit['by_split'], ensure_ascii=False, indent=2))
|
||||
|
||||
|
||||
if __name__ == '__main__':
|
||||
main()
|
||||
526
tools/graphrag/evaluation/benchmark_v2.py
Normal file
526
tools/graphrag/evaluation/benchmark_v2.py
Normal file
@ -0,0 +1,526 @@
|
||||
"""Build a source-grounded schema-v3 regression set and profile-disjoint holdout.
|
||||
|
||||
This module never imports graph construction/search code and never reads any
|
||||
retrieval output. Legacy cases remain development-only. New TEST subjects are
|
||||
student profiles absent from every legacy start entity. TEST is generated once
|
||||
from raw source facts, before the corrected implementation is evaluated.
|
||||
"""
|
||||
from __future__ import annotations
|
||||
|
||||
import argparse
|
||||
import copy
|
||||
import hashlib
|
||||
import itertools
|
||||
import json
|
||||
import random
|
||||
import re
|
||||
from collections import Counter
|
||||
from pathlib import Path
|
||||
from typing import Any
|
||||
|
||||
from .source_oracle import ROOT, DEFAULT_WIKI, load_source_oracle, norm, supporting_documents
|
||||
|
||||
BASE = Path(__file__).resolve().parent
|
||||
SEED = 20261024
|
||||
|
||||
|
||||
def fingerprint(value: Any) -> str:
|
||||
return hashlib.sha256(json.dumps(value, sort_keys=True, ensure_ascii=False, separators=(',', ':')).encode()).hexdigest()
|
||||
|
||||
|
||||
def people_for(question: dict, oracle: dict) -> list[str]:
|
||||
names = {norm(name): name for name in oracle['people']}
|
||||
return [names[norm(item['value'])] for item in question['graph'].get('start_entities', [])
|
||||
if item['type'] == 'person' and norm(item['value']) in names]
|
||||
|
||||
|
||||
def academics(oracle: dict, person: str, *, title: str | None = None, year: int | None = None,
|
||||
kind: str | None = None) -> list[dict]:
|
||||
rows = oracle['people'][person]['academics']
|
||||
return [row for row in rows if (title is None or norm(row['title']) == norm(title))
|
||||
and (year is None or row['year'] == year) and (kind is None or row['academic_kind'] == kind)]
|
||||
|
||||
|
||||
def has_tag(oracle: dict, person: str, keyword: str) -> bool:
|
||||
return norm(keyword) in {norm(tag) for tag in oracle['people'][person]['tags']}
|
||||
|
||||
|
||||
def academic_binding(person: str, record: dict, *, title: bool = False, keyword: str | None = None) -> dict:
|
||||
binding = {'person': person, 'academic_kind': record['academic_kind'],
|
||||
'academic_type': record['academic_type'], 'year': record['year']}
|
||||
if title:
|
||||
binding['title'] = record['title']
|
||||
if keyword is not None:
|
||||
binding['keyword'] = keyword
|
||||
return {key: value for key, value in binding.items() if value is not None}
|
||||
|
||||
|
||||
def path_patterns(bindings: list[dict]) -> list[dict]:
|
||||
patterns = []
|
||||
for index, binding in enumerate(bindings):
|
||||
if any(key in binding for key in ['year', 'title', 'academic_kind', 'academic_type']):
|
||||
kind = binding.get('academic_kind', 'Academic')
|
||||
relation = 'AUTHORED' if kind == 'Thesis' else 'HAS_WORK' if kind == 'Work' else 'AUTHORED|HAS_WORK'
|
||||
patterns.append({'binding_index': index, 'node_kinds': ['Person', kind, 'Document'],
|
||||
'relationships': [relation, 'EVIDENCED_BY']})
|
||||
for field, kind, relation in [('keyword', 'Keyword', 'HAS_KEYWORD'),
|
||||
('category', 'Category', 'IN_CATEGORY'),
|
||||
('document_author', 'DocumentAuthor', 'AUTHORED_DOCUMENT')]:
|
||||
if field in binding:
|
||||
patterns.append({'binding_index': index, 'node_kinds': ['Person', 'Document', kind],
|
||||
'relationships': ['HAS_DOCUMENT', relation]})
|
||||
return patterns
|
||||
|
||||
|
||||
def binding_source_evidence(binding: dict, oracle: dict) -> list[dict]:
|
||||
person = oracle['people'][binding['person']]
|
||||
evidence = []
|
||||
for field in ['keyword', 'category', 'document_author']:
|
||||
if field not in binding:
|
||||
continue
|
||||
docs = supporting_documents(oracle, binding['person'], **{field: binding[field]})
|
||||
if binding.get('document_path'):
|
||||
docs = [p for p in docs if p == binding['document_path']]
|
||||
for path in docs:
|
||||
evidence.append({'document_path': path, 'sha256': oracle['documents'][path]['sha256'],
|
||||
'field': {'keyword': 'taxonomy.tag', 'category': 'taxonomy.category',
|
||||
'document_author': 'taxonomy.author'}[field], 'value': binding[field]})
|
||||
if any(key in binding for key in ['year', 'title', 'academic_kind', 'academic_type']):
|
||||
rows = academics(oracle, binding['person'], title=binding.get('title'), year=binding.get('year'),
|
||||
kind=binding.get('academic_kind'))
|
||||
for row in rows:
|
||||
if binding.get('academic_type') and row['academic_type'] != binding['academic_type']:
|
||||
continue
|
||||
evidence.append({'document_path': row['document_path'],
|
||||
'sha256': oracle['documents'][row['document_path']]['sha256'],
|
||||
'field': 'academic_record', 'academic_kind': row['academic_kind'],
|
||||
'academic_type': row['academic_type'], 'title': row['title'], 'year': row['year'],
|
||||
'heading_line': row['heading_line'], 'title_line': row['title_line'],
|
||||
'year_basis': row['year_basis']})
|
||||
if 'start_year' in binding:
|
||||
evidence.append({'document_path': person['profile'], 'sha256': oracle['documents'][person['profile']]['sha256'],
|
||||
'field': 'start_year', 'value': binding['start_year'],
|
||||
'basis': person.get('start_year_basis', 'explicit_text'), 'confidence': 'documented'})
|
||||
return evidence
|
||||
|
||||
|
||||
def make_case(case_id: str, split: str, category: str, question: str, names: list[str], oracle: dict,
|
||||
bindings: list[dict], *, no_answer: bool = False, reason: str | None = None,
|
||||
expected_set: list[str] | None = None, set_field: str | None = None,
|
||||
count: int | None = None, context_documents: list[str] | None = None,
|
||||
negative_constraints: dict | None = None) -> dict:
|
||||
known = [name for name in names if name in oracle['people']]
|
||||
profiles = sorted({oracle['people'][name]['profile'] for name in known})
|
||||
paths = set(context_documents or profiles)
|
||||
evidence = [item for binding in bindings for item in binding_source_evidence(binding, oracle)]
|
||||
# Multiple documents can independently prove the same tag/category. Gold
|
||||
# sources are alternatives for each bound proof, not an obligation to cite
|
||||
# every duplicate occurrence. Context profiles still cover all candidates.
|
||||
evidence_choices = []
|
||||
roles = {'taxonomy.tag': 'keyword_document', 'taxonomy.category': 'category_document',
|
||||
'taxonomy.author': 'author_document', 'academic_record': 'academic_document',
|
||||
'start_year': 'person_document'}
|
||||
if not no_answer:
|
||||
for index, binding in enumerate(bindings):
|
||||
per_role: dict[str, set[str]] = {}
|
||||
for item in binding_source_evidence(binding, oracle):
|
||||
per_role.setdefault(roles[item['field']], set()).add(item['document_path'])
|
||||
for role, alternatives in per_role.items():
|
||||
evidence_choices.append({'binding_index': index, 'role': role, 'any_of': [
|
||||
{'document_path': path, 'source_url': oracle['documents'][path]['source_url']}
|
||||
for path in sorted(alternatives)]})
|
||||
expected_values = []
|
||||
expected_entities = []
|
||||
if not no_answer:
|
||||
for binding in bindings:
|
||||
for field in ['person', 'keyword', 'category', 'document_author', 'title', 'year', 'start_year']:
|
||||
if field in binding:
|
||||
value = str(binding[field])
|
||||
expected_values.append(value)
|
||||
kind = ('thesis_title' if binding.get('academic_kind') == 'Thesis' else 'work_title') if field == 'title' else field
|
||||
expected_entities.append({'type': kind, 'value': value})
|
||||
if count is not None:
|
||||
expected_values.append(str(count))
|
||||
graph = {'schema_version': 3, 'task': category, 'start_entities': [{'type': 'person', 'value': name} for name in names],
|
||||
'expected_bindings': bindings if not no_answer else [],
|
||||
'expected_evidence_documents': evidence_choices,
|
||||
'expected_path_patterns': path_patterns(bindings) if not no_answer else [],
|
||||
'expected_no_answer': no_answer, 'expected_status': 'no_answer' if no_answer else 'ok',
|
||||
'expected_entities': expected_entities, 'expected_relations': [], 'expected_properties': [],
|
||||
'source_profiles': profiles}
|
||||
if no_answer:
|
||||
graph['no_answer_basis'] = reason or 'No source record satisfies every requested condition.'
|
||||
graph['negative_constraints'] = negative_constraints or {}
|
||||
# Closed-world negative: retain all original metadata considered, not a fabricated positive fact.
|
||||
evidence = [{'document_path': path, 'sha256': oracle['documents'][path]['sha256'],
|
||||
'field': 'closed_world_metadata', 'tags': oracle['documents'][path]['tags'],
|
||||
'categories': oracle['documents'][path]['categories']}
|
||||
for name in known for path in oracle['people'][name]['documents']]
|
||||
if expected_set is not None:
|
||||
graph.update(expected_entity_set=sorted(expected_set, key=norm), entity_set_mode='exact', entity_set_field=set_field or 'person')
|
||||
if count is not None:
|
||||
graph['expected_count'] = count
|
||||
graph['partition_group'] = fingerprint({'category': category, 'people': sorted(names, key=norm),
|
||||
'bindings': bindings, 'negative': no_answer,
|
||||
'requested': question if no_answer else None})[:20]
|
||||
return {'id': case_id, 'split': split, 'category': category, 'difficulty': 'hard', 'question': question,
|
||||
'should_answer': not no_answer, 'expected_documents': sorted(paths),
|
||||
'expected_source_urls': sorted(oracle['documents'][path]['source_url'] for path in paths),
|
||||
'expected_answer_contains': list(dict.fromkeys(expected_values)), 'graph': graph,
|
||||
'source_evidence': evidence, 'evidence_basis': ['independent_raw_markdown_oracle_v2']}
|
||||
|
||||
|
||||
def correct_legacy(question: dict, oracle: dict) -> dict:
|
||||
names = people_for(question, oracle); cat = question['category']; old = question['graph']
|
||||
entities = old.get('expected_entities', [])
|
||||
keyword = next((item['value'] for item in entities if item['type'] == 'keyword'), None)
|
||||
years = [int(item['value']) for item in entities if item['type'] == 'year']
|
||||
bindings = []; expected_set = None; set_field = None; count = None; reason = None
|
||||
if cat == 'shared_keyword_pair':
|
||||
if keyword and all(has_tag(oracle, name, keyword) for name in names):
|
||||
bindings = [{'person': name, 'keyword': keyword} for name in names]
|
||||
else:
|
||||
reason = 'Requested shared keyword is absent from the raw frontmatter of at least one named person.'
|
||||
elif cat == 'same_start_year_pair':
|
||||
bindings = [{'person': name, 'start_year': oracle['people'][name]['start_year']} for name in names]
|
||||
elif cat == 'same_academic_year_pair':
|
||||
common = set.intersection(*[{row['year'] for row in academics(oracle, name) if row['year'] is not None} for name in names])
|
||||
bindings = [{'person': name, 'year': year} for year in sorted(common) for name in names]
|
||||
if not common:
|
||||
reason = 'No shared academic year is stated in the original sources.'
|
||||
elif cat in {'person_title_year', 'person_keyword_title'}:
|
||||
titles = [item for item in entities if item['type'] in {'thesis_title', 'work_title'}]
|
||||
for item in titles:
|
||||
kind = 'Thesis' if item['type'] == 'thesis_title' else 'Work'
|
||||
rows = academics(oracle, names[0], title=item['value'], kind=kind)
|
||||
if not rows and norm(item['value']) in norm(oracle['documents'][oracle['people'][names[0]]['profile']]['raw_text']):
|
||||
raise RuntimeError(f"Oracle extraction needs review for supported raw title: {question['id']}")
|
||||
if years:
|
||||
rows = [row for row in rows if row['year'] in years]
|
||||
if cat == 'person_keyword_title' and not has_tag(oracle, names[0], keyword or ''):
|
||||
reason = 'Requested keyword is not a raw frontmatter tag of this person.'
|
||||
break
|
||||
for row in rows:
|
||||
binding = academic_binding(names[0], row, title=True, keyword=keyword if cat == 'person_keyword_title' else None)
|
||||
if cat == 'person_keyword_title' and not years:
|
||||
binding.pop('year', None)
|
||||
bindings.append(binding)
|
||||
if not bindings and not reason:
|
||||
reason = 'Requested title/type/year combination is not independently supported by the source.'
|
||||
elif cat == 'document_author_category_multi_hop':
|
||||
category = next(item['value'] for item in entities if item['type'] == 'category')
|
||||
for path in supporting_documents(oracle, names[0], category=category):
|
||||
author = oracle['documents'][path]['author']
|
||||
if author:
|
||||
bindings.append({'person': names[0], 'category': category, 'document_author': author,
|
||||
'document_path': path, 'same_document': True})
|
||||
if not bindings:
|
||||
reason = 'No same document supports both the category and metadata author.'
|
||||
elif cat == 'person_multiple_categories':
|
||||
expected_set = oracle['people'][names[0]]['categories']; set_field = 'category'
|
||||
bindings = [{'person': names[0], 'category': category} for category in expected_set]
|
||||
elif cat == 'candidate_set_aggregation':
|
||||
query_years = [int(x) for x in re.findall(r'\b20\d{2}\b', question['question'])]
|
||||
year = query_years[-1]
|
||||
matches = [name for name in names if academics(oracle, name, year=year)]
|
||||
bindings = [{'person': name, 'year': year} for name in matches]
|
||||
expected_set = matches; set_field = 'person'; count = len(matches)
|
||||
elif cat == 'conjunctive_disambiguation':
|
||||
year = years[0]
|
||||
matches = [name for name in names if has_tag(oracle, name, keyword) and academics(oracle, name, year=year)]
|
||||
bindings = [{'person': name, 'keyword': keyword, 'year': year} for name in matches]
|
||||
if not matches:
|
||||
reason = 'No named person satisfies both raw frontmatter keyword and academic year.'
|
||||
else:
|
||||
raise ValueError(f'Unsupported legacy category: {cat}')
|
||||
case = make_case(question['id'], 'dev', cat, question['question'], names, oracle, bindings,
|
||||
no_answer=reason is not None, reason=reason, expected_set=expected_set,
|
||||
set_field=set_field, count=count,
|
||||
negative_constraints=({'keyword': keyword, 'require_all_people': True} if cat == 'shared_keyword_pair'
|
||||
else {'keyword': keyword} if cat == 'person_keyword_title'
|
||||
else {'keyword': keyword, 'year': years[0]} if cat == 'conjunctive_disambiguation'
|
||||
else {'shared_academic_year': True} if cat == 'same_academic_year_pair'
|
||||
else {}))
|
||||
case['legacy_split'] = question['split']
|
||||
case['legacy_role'] = 'previously_seen_regression_only'
|
||||
return case
|
||||
|
||||
|
||||
def independent_pool(oracle: dict, names: list[str]) -> dict[str, list[dict]]:
|
||||
pool: dict[str, list[dict]] = {category: [] for category in [
|
||||
'shared_keyword_pair', 'same_academic_year_pair', 'same_start_year_pair', 'person_title_year',
|
||||
'person_keyword_title', 'document_author_category_multi_hop', 'person_multiple_categories',
|
||||
'candidate_set_aggregation', 'conjunctive_disambiguation']}
|
||||
def add(category: str, text: str, people: list[str], bindings: list[dict], **kwargs):
|
||||
pool[category].append(make_case('', 'test', category, text, people, oracle, bindings, **kwargs))
|
||||
for left, right in itertools.combinations(names, 2):
|
||||
common_tags = sorted({norm(tag): tag for tag in oracle['people'][left]['tags']
|
||||
if has_tag(oracle, right, tag)}.values(), key=norm)
|
||||
for tag in common_tags:
|
||||
add('shared_keyword_pair', f'Over spoločné kľúčové slovo {tag} pri osobách {left} a {right}.',
|
||||
[left, right], [{'person': name, 'keyword': tag} for name in [left, right]])
|
||||
shared_years = {row['year'] for row in academics(oracle, left)} & {row['year'] for row in academics(oracle, right)} - {None}
|
||||
# A query for an unspecified shared year expects all supported intersections.
|
||||
if shared_years:
|
||||
add('same_academic_year_pair', f'Aké spoločné roky práce spájajú osoby {left} a {right}?',
|
||||
[left, right], [{'person': name, 'year': year} for year in sorted(shared_years) for name in [left, right]])
|
||||
start_l, start_r = oracle['people'][left]['start_year'], oracle['people'][right]['start_year']
|
||||
if start_l is not None and start_l == start_r:
|
||||
add('same_start_year_pair', f'Porovnaj rovnaký rok začiatku štúdia osôb {left} a {right}.',
|
||||
[left, right], [{'person': name, 'start_year': start_l} for name in [left, right]])
|
||||
for name in names:
|
||||
person = oracle['people'][name]
|
||||
if person['categories']:
|
||||
add('person_multiple_categories', f'Vypíš všetky kategórie dokumentov osoby {name}.', [name],
|
||||
[{'person': name, 'category': cat} for cat in person['categories']],
|
||||
expected_set=person['categories'], set_field='category')
|
||||
for category in person['categories']:
|
||||
for path in supporting_documents(oracle, name, category=category):
|
||||
author = oracle['documents'][path]['author']
|
||||
if author:
|
||||
add('document_author_category_multi_hop',
|
||||
f'Kto je autor dokumentu osoby {name}, ktorý patrí do kategórie {category}?', [name],
|
||||
[{'person': name, 'category': category, 'document_author': author,
|
||||
'document_path': path, 'same_document': True}])
|
||||
# Title-year cases use only explicit, nonconflicting title records.
|
||||
for record in person['academics']:
|
||||
if not record['title'] or record['year'] is None or record in person['year_conflicts']:
|
||||
continue
|
||||
year = record['year']
|
||||
kind_label = 'diplomového projektu' if record['academic_type'] == 'diploma_project' else 'práce'
|
||||
add('person_title_year', f'Aký názov {kind_label} a rok práce sú pri osobe {name} uvedené pre rok {year}?',
|
||||
[name], [academic_binding(name, record, title=True)])
|
||||
for tag in person['tags']:
|
||||
binding = academic_binding(name, record, title=True, keyword=tag)
|
||||
# Pin the academic year in the question as the independent source can contain several titles.
|
||||
add('person_keyword_title', f'Aký názov práce osoby {name} v roku {year} súvisí s kľúčovým slovom {tag}?',
|
||||
[name], [binding])
|
||||
# Candidate groups are source-derived; the query mentions every candidate.
|
||||
for year in sorted({row['year'] for name in names for row in academics(oracle, name) if row['year'] is not None}):
|
||||
matching = [name for name in names if academics(oracle, name, year=year)]
|
||||
other = [name for name in names if name not in matching]
|
||||
for selected in itertools.islice(itertools.combinations(matching, 2), 12):
|
||||
if other:
|
||||
candidates = list(selected) + [other[0]]
|
||||
add('candidate_set_aggregation',
|
||||
f'Z kandidátov {", ".join(candidates)} vyber osoby s prácou v roku {year}. Koľko ich je?',
|
||||
candidates, [{'person': name, 'year': year} for name in selected],
|
||||
expected_set=list(selected), set_field='person', count=len(selected))
|
||||
for name in names:
|
||||
person = oracle['people'][name]
|
||||
for year in sorted({record['year'] for record in person['academics'] if record['year'] is not None}):
|
||||
for tag in person['tags']:
|
||||
distractors = [other for other in names if other != name
|
||||
and (has_tag(oracle, other, tag) != bool(academics(oracle, other, year=year)))]
|
||||
for other in distractors[:2]:
|
||||
candidates = [name, other]
|
||||
add('conjunctive_disambiguation',
|
||||
f'Ktorá z osôb {name} a {other} má kľúčové slovo {tag} a jej práca je z roku {year}?',
|
||||
candidates, [{'person': name, 'keyword': tag, 'year': year}])
|
||||
return pool
|
||||
|
||||
|
||||
def necessary_negatives(oracle: dict, names: list[str], split: str) -> list[dict]:
|
||||
cases = []
|
||||
prefix = 'dev' if split == 'dev' else 'holdout'
|
||||
for i, name in enumerate(names[:4]):
|
||||
tag = next(iter(oracle['people'][name]['tags']), 'nlp')
|
||||
cases.append(make_case(f'{prefix}-negative-year-{i}', split, 'negative_lookup',
|
||||
f'Aký názov práce má osoba {name}, ak jej práca je z roku 2099 a jej dokument obsahuje kľúčové slovo {tag}?',
|
||||
[name], oracle, [], no_answer=True, reason='No source academic record has year 2099.',
|
||||
negative_constraints={'year': 2099, 'keyword': tag}))
|
||||
for i, name in enumerate(names[4:6]):
|
||||
cases.append(make_case(f'{prefix}-negative-tag-{i}', split, 'negative_lookup',
|
||||
f'Aký názov práce má osoba {name}, ak jej dokument obsahuje kľúčové slovo neexistujucitagvzor?',
|
||||
[name], oracle, [], no_answer=True, reason='Requested tag absent from complete raw frontmatter catalog.',
|
||||
negative_constraints={'keyword': 'neexistujucitagvzor'}))
|
||||
for i, unknown in enumerate(['Zuzana Neexistujúca Vzorová', 'Roman Neskutočný Testovací'] if split == 'dev'
|
||||
else ['Tibor Neexistujúci Skúšobný', 'Lenka Neskutočná Vzorová']):
|
||||
cases.append(make_case(f'{prefix}-negative-person-{i}', split, 'negative_lookup',
|
||||
f'Aký názov diplomovej práce má osoba {unknown}?', [unknown], oracle, [],
|
||||
no_answer=True, reason='Explicit full name absent from all raw profile frontmatter titles.',
|
||||
negative_constraints={'unknown_person': unknown}))
|
||||
candidates = names[:3]
|
||||
cases.append(make_case(f'{prefix}-zero-count', split, 'candidate_set_aggregation',
|
||||
f'Z kandidátov {", ".join(candidates)} vyber osoby s prácou v roku 2099. Koľko ich je?',
|
||||
candidates, oracle, [], expected_set=[], set_field='person', count=0))
|
||||
return cases
|
||||
|
||||
|
||||
def validate_case(case: dict, oracle: dict) -> list[str]:
|
||||
issues = []
|
||||
graph = case['graph']
|
||||
names = people_for(case, oracle)
|
||||
if set(graph.get('source_profiles', [])) != {oracle['people'][name]['profile'] for name in names}:
|
||||
issues.append('incorrect_source_profile_partition')
|
||||
for binding in graph.get('expected_bindings', []):
|
||||
person = binding['person']
|
||||
if person not in oracle['people']:
|
||||
issues.append('unknown_bound_person'); continue
|
||||
if 'start_year' in binding and oracle['people'][person]['start_year'] != binding['start_year']:
|
||||
issues.append('wrong_start_year')
|
||||
metadata = {key: binding[key] for key in ['keyword', 'category', 'document_author'] if key in binding}
|
||||
if binding.get('same_document') and not supporting_documents(oracle, person, **metadata):
|
||||
issues.append('metadata_not_connected_in_same_document')
|
||||
for key, value in metadata.items():
|
||||
if not supporting_documents(oracle, person, **{key: value}):
|
||||
issues.append('unsupported_' + key)
|
||||
if any(key in binding for key in ['title', 'year', 'academic_type', 'academic_kind']):
|
||||
records = academics(oracle, person, title=binding.get('title'), year=binding.get('year'), kind=binding.get('academic_kind'))
|
||||
if binding.get('academic_type'):
|
||||
records = [r for r in records if r['academic_type'] == binding['academic_type']]
|
||||
if not records:
|
||||
issues.append('unsupported_academic_binding')
|
||||
if graph.get('expected_no_answer'):
|
||||
if graph.get('expected_bindings') or case.get('expected_answer_contains') or graph.get('expected_entities'):
|
||||
issues.append('negative_contains_positive_expectations')
|
||||
constraints = graph.get('negative_constraints', {})
|
||||
names = people_for(case, oracle)
|
||||
if constraints.get('unknown_person'):
|
||||
if norm(constraints['unknown_person']) in {norm(name) for name in oracle['people']}:
|
||||
issues.append('negative_person_actually_exists')
|
||||
elif constraints.get('missing_start_year'):
|
||||
if names and all(oracle['people'][name]['start_year'] is not None for name in names):
|
||||
issues.append('negative_start_year_actually_documented')
|
||||
elif constraints.get('shared_academic_year'):
|
||||
year_sets = [{r['year'] for r in academics(oracle, name) if r['year'] is not None} for name in names]
|
||||
if year_sets and set.intersection(*year_sets):
|
||||
issues.append('negative_shared_year_actually_exists')
|
||||
elif constraints.get('require_all_people'):
|
||||
if not names or all(has_tag(oracle, name, constraints.get('keyword', '')) for name in names):
|
||||
issues.append('negative_shared_keyword_actually_exists')
|
||||
elif constraints:
|
||||
matching = []
|
||||
for name in names:
|
||||
valid = not constraints.get('keyword') or has_tag(oracle, name, constraints['keyword'])
|
||||
if any(key in constraints for key in ['year', 'title', 'academic_kind', 'title_required']):
|
||||
records = academics(oracle, name, year=constraints.get('year'),
|
||||
title=constraints.get('title'), kind=constraints.get('academic_kind'))
|
||||
if constraints.get('academic_type'):
|
||||
records = [r for r in records if r['academic_type'] == constraints['academic_type']]
|
||||
if constraints.get('title_required'):
|
||||
records = [r for r in records if r.get('title')]
|
||||
valid = valid and bool(records)
|
||||
if valid:
|
||||
matching.append(name)
|
||||
if matching:
|
||||
issues.append('negative_conjunction_actually_satisfied')
|
||||
else:
|
||||
issues.append('negative_without_machine_verifiable_false_premise')
|
||||
if graph.get('expected_entity_set') is not None and graph.get('entity_set_field') == 'category':
|
||||
names = people_for(case, oracle)
|
||||
if names and set(graph['expected_entity_set']) != set(oracle['people'][names[0]]['categories']):
|
||||
issues.append('incomplete_category_set')
|
||||
if graph.get('expected_count') is not None:
|
||||
years = re.findall(r'\b\d{4}\b', case['question'])
|
||||
if not years:
|
||||
issues.append('count_without_supported_year_constraint')
|
||||
else:
|
||||
matches = {name for name in names if academics(oracle, name, year=int(years[-1]))}
|
||||
if matches != set(graph.get('expected_entity_set', [])) or len(matches) != graph['expected_count']:
|
||||
issues.append('incorrect_candidate_set_or_count')
|
||||
return sorted(set(issues))
|
||||
|
||||
|
||||
def audit_dataset(questions: list[dict], oracle: dict, dataset_path: Path) -> dict:
|
||||
rows = [{'id': question['id'], 'split': question['split'], 'source_consistent': not (issues := validate_case(question, oracle)),
|
||||
'issues': issues, 'category': question['category']} for question in questions]
|
||||
inputs = {name: hashlib.sha256((ROOT / name).read_bytes()).hexdigest() for name in ['data/documents.json', 'data/chunks.json']}
|
||||
return {'method': 'Independent original Markdown frontmatter/heading/title oracle; no graph parser, chunks or retrieval results used for labels.',
|
||||
'dataset_sha256': hashlib.sha256(dataset_path.read_bytes()).hexdigest(),
|
||||
'inputs': inputs, 'source_corpus': oracle['source_corpus'], 'questions': rows,
|
||||
'by_split': {split: {'questions': len(selected), 'source_consistent': sum(row['source_consistent'] for row in selected),
|
||||
'issues': dict(Counter(issue for row in selected for issue in row['issues']))}
|
||||
for split in ['dev', 'test'] for selected in [[row for row in rows if row['split'] == split]]}}
|
||||
|
||||
|
||||
def write_json(path: Path, value: Any) -> None:
|
||||
path.parent.mkdir(parents=True, exist_ok=True)
|
||||
path.write_text(json.dumps(value, ensure_ascii=False, indent=2) + '\n')
|
||||
|
||||
|
||||
def main() -> None:
|
||||
parser = argparse.ArgumentParser(description=__doc__)
|
||||
parser.add_argument('--wiki-root', type=Path, default=DEFAULT_WIKI)
|
||||
parser.add_argument('--legacy', type=Path, default=BASE / 'graphrag_questions.json')
|
||||
parser.add_argument('--output', type=Path, default=BASE / 'graphrag_questions_v2.json')
|
||||
parser.add_argument('--artifacts', type=Path, default=BASE / 'results/v2_preparation')
|
||||
args = parser.parse_args()
|
||||
oracle = load_source_oracle(args.wiki_root)
|
||||
legacy = json.loads(args.legacy.read_text())
|
||||
corrected = [correct_legacy(question, oracle) for question in legacy]
|
||||
legacy_names = {name for question in legacy for name in people_for(question, oracle)}
|
||||
exposed_path = BASE / 'results/final_2026-10-24/holdout_failures.json'
|
||||
previously_exposed = set()
|
||||
if exposed_path.exists():
|
||||
for row in json.loads(exposed_path.read_text()).get('questions', []):
|
||||
previously_exposed.update(set(row.get('actual_documents', [])) - set(row.get('expected_documents', [])))
|
||||
reserved_names = sorted([name for name, person in oracle['people'].items()
|
||||
if name not in legacy_names and person['profile'] not in previously_exposed
|
||||
and person['profile'].startswith('pages/students/')], key=norm)
|
||||
dev_negatives = necessary_negatives(oracle, sorted(legacy_names, key=norm), 'dev')
|
||||
test_pool = independent_pool(oracle, reserved_names)
|
||||
rng = random.Random(SEED)
|
||||
holdout = []
|
||||
for category, cases in test_pool.items():
|
||||
unique = {case['graph']['partition_group']: case for case in cases}
|
||||
candidates = list(unique.values()); rng.shuffle(candidates)
|
||||
if len(candidates) < 8:
|
||||
raise RuntimeError(f'Insufficient independent source cases for {category}: {len(candidates)}')
|
||||
for case in candidates[:8]:
|
||||
case['id'] = f'h{len(holdout)+1:04d}'
|
||||
holdout.append(case)
|
||||
negative_cases = necessary_negatives(oracle, reserved_names, 'test')
|
||||
# A zero-result count is an answerable numeric result, not a no-answer.
|
||||
zero_count = negative_cases.pop()
|
||||
count_index = next(i for i, case in enumerate(holdout) if case['category'] == 'candidate_set_aggregation')
|
||||
zero_count['id'] = holdout[count_index]['id']
|
||||
holdout[count_index] = zero_count
|
||||
holdout.extend(negative_cases)
|
||||
dev = corrected + dev_negatives
|
||||
questions = dev + holdout
|
||||
all_issues = {case['id']: validate_case(case, oracle) for case in questions if validate_case(case, oracle)}
|
||||
if all_issues:
|
||||
raise RuntimeError(f'Source consistency issues: {all_issues}')
|
||||
dev_profiles = {p for case in dev for p in case['graph']['source_profiles']}
|
||||
test_profiles = {p for case in holdout for p in case['graph']['source_profiles']}
|
||||
assert not dev_profiles & test_profiles
|
||||
assert not ({case['graph']['partition_group'] for case in dev} & {case['graph']['partition_group'] for case in holdout})
|
||||
write_json(args.output, questions)
|
||||
corrections = []
|
||||
old_audit_path = BASE / 'results/final_2026-10-24/source_audit.json'
|
||||
old_issues = {row['id']: row['issues'] for row in json.loads(old_audit_path.read_text())['questions'] if row['issues']}
|
||||
for old, new in zip(legacy, corrected):
|
||||
corrections.append({'id': old['id'], 'legacy_split': old['split'], 'new_split': 'dev',
|
||||
'v1_source_audit_issues': old_issues.get(old['id'], []),
|
||||
'old_should_answer': old.get('should_answer', True), 'new_should_answer': new['should_answer'],
|
||||
'old_expected_values': old['expected_answer_contains'], 'new_expected_values': new['expected_answer_contains'],
|
||||
'new_expected_bindings': new['graph']['expected_bindings'],
|
||||
'no_answer_basis': new['graph'].get('no_answer_basis'),
|
||||
'source_evidence': new['source_evidence']})
|
||||
write_json(args.artifacts / 'legacy_corrections.json', {'legacy_count': len(legacy), 'v1_flagged_count': len(old_issues),
|
||||
'resolved_v1_flagged_count': sum(not validate_case(new, oracle) for new in corrected if new['id'] in old_issues),
|
||||
'negative_count': sum(not case['should_answer'] for case in corrected), 'questions': corrections})
|
||||
write_json(args.artifacts / 'source_audit.json', audit_dataset(questions, oracle, args.output))
|
||||
partition = {'seed': SEED, 'strategy': 'All previously seen 500 cases are DEV regression. TEST profiles never appeared in legacy start_entities; all real candidate profiles are disjoint.',
|
||||
'dev_count': len(dev), 'test_count': len(holdout), 'previously_exposed_profiles_excluded_from_test': sorted(previously_exposed),
|
||||
'dev_profiles': sorted(dev_profiles), 'test_profiles': sorted(test_profiles),
|
||||
'dev_groups': sorted({case['graph']['partition_group'] for case in dev}),
|
||||
'test_groups': sorted({case['graph']['partition_group'] for case in holdout}),
|
||||
'dev_categories': dict(Counter(case['category'] for case in dev)),
|
||||
'test_categories': dict(Counter(case['category'] for case in holdout)),
|
||||
'source_corpus': oracle['source_corpus'],
|
||||
'dataset_sha256': hashlib.sha256(args.output.read_bytes()).hexdigest(),
|
||||
'limitations': ['Same source corpus and shared tag/category/author vocabulary.',
|
||||
'Template families are known; TEST persons and their fact groups are withheld.',
|
||||
'Oracle is independent of graph extraction but still rule-based; provenance permits human review.']}
|
||||
write_json(args.artifacts / 'partition.json', partition)
|
||||
print(json.dumps({'dataset': str(args.output), 'dev': len(dev), 'test': len(holdout),
|
||||
'reserved_profile_count': len(test_profiles), 'source_issues': 0,
|
||||
'corrected_legacy_negatives': sum(not q['should_answer'] for q in corrected),
|
||||
'resolved_original_issues': len(old_issues),
|
||||
'test_categories': partition['test_categories']}, ensure_ascii=False, indent=2))
|
||||
|
||||
|
||||
if __name__ == '__main__':
|
||||
main()
|
||||
153
tools/graphrag/evaluation/benchmark_v3.py
Normal file
153
tools/graphrag/evaluation/benchmark_v3.py
Normal file
@ -0,0 +1,153 @@
|
||||
"""Continue after exposed v2: all old cases become DEV; reserve the last unseen profiles.
|
||||
|
||||
The small supplementary holdout cannot replace the broader independent v2
|
||||
measurement. It is kept profile-disjoint and must be reported with its size.
|
||||
"""
|
||||
from __future__ import annotations
|
||||
|
||||
import argparse
|
||||
import copy
|
||||
import hashlib
|
||||
import json
|
||||
import re
|
||||
from collections import Counter
|
||||
from pathlib import Path
|
||||
|
||||
from .benchmark_v2 import (BASE, make_case, correct_legacy, people_for, academics, has_tag,
|
||||
academic_binding, validate_case, audit_dataset, write_json)
|
||||
from .source_oracle import load_source_oracle, supporting_documents, norm
|
||||
|
||||
|
||||
def reannotate(case, oracle, original):
|
||||
if case['id'] in original:
|
||||
return correct_legacy(original[case['id']], oracle)
|
||||
category = case['category']; graph = case['graph']; names = people_for(case, oracle)
|
||||
bindings = []; negative = None; expected_set = None; field = None; count = None; constraints = {}
|
||||
old = graph.get('expected_bindings', [])
|
||||
years = [int(y) for y in re.findall(r'\b20\d{2}\b', case['question'])]
|
||||
keyword = next((row.get('keyword') for row in old if row.get('keyword')), None)
|
||||
if category == 'negative_lookup':
|
||||
corrected = copy.deepcopy(case); corrected['split'] = 'dev'
|
||||
return corrected
|
||||
if category == 'shared_keyword_pair':
|
||||
if all(has_tag(oracle, name, keyword) for name in names):
|
||||
bindings = [{'person': name, 'keyword': keyword} for name in names]
|
||||
else:
|
||||
negative = 'No common literal frontmatter tag.'; constraints = {'keyword': keyword, 'require_all_people': True}
|
||||
elif category == 'same_academic_year_pair':
|
||||
common = set.intersection(*[{r['year'] for r in academics(oracle, name) if r['year']} for name in names])
|
||||
bindings = [{'person': name, 'year': year} for year in sorted(common) for name in names]
|
||||
if not common:
|
||||
negative = 'No shared academic year in original sources.'; constraints = {'shared_academic_year': True}
|
||||
elif category == 'same_start_year_pair':
|
||||
bindings = [{'person': name, 'start_year': oracle['people'][name]['start_year']} for name in names]
|
||||
elif category in {'person_title_year', 'person_keyword_title'}:
|
||||
records = [r for r in academics(oracle, names[0], year=years[-1]) if r.get('title')]
|
||||
if 'diplomoveho projektu' in norm(case['question']):
|
||||
records = [r for r in records if r['academic_type'] == 'diploma_project']
|
||||
if category == 'person_keyword_title' and not has_tag(oracle, names[0], keyword):
|
||||
records = []
|
||||
bindings = [academic_binding(names[0], row, title=True, keyword=keyword) for row in records]
|
||||
if not bindings:
|
||||
negative = 'Requested year/type/title is absent; a project title is not a future thesis title.'
|
||||
constraints = {'year': years[-1], **({'keyword': keyword} if keyword else {})}
|
||||
elif category == 'document_author_category_multi_hop':
|
||||
for row in old:
|
||||
for path in supporting_documents(oracle, names[0], category=row['category']):
|
||||
author = oracle['documents'][path]['author']
|
||||
if author:
|
||||
bindings.append({'person': names[0], 'category': row['category'], 'document_author': author,
|
||||
'document_path': path, 'same_document': True})
|
||||
elif category == 'person_multiple_categories':
|
||||
expected_set = oracle['people'][names[0]]['categories']; field = 'category'
|
||||
bindings = [{'person': names[0], 'category': value} for value in expected_set]
|
||||
elif category == 'candidate_set_aggregation':
|
||||
expected_set = [name for name in names if academics(oracle, name, year=years[-1])]
|
||||
count = len(expected_set); field = 'person'
|
||||
bindings = [{'person': name, 'year': years[-1]} for name in expected_set]
|
||||
elif category == 'conjunctive_disambiguation':
|
||||
matches = [name for name in names if has_tag(oracle, name, keyword) and academics(oracle, name, year=years[-1])]
|
||||
bindings = [{'person': name, 'keyword': keyword, 'year': years[-1]} for name in matches]
|
||||
if not matches:
|
||||
negative = 'No candidate satisfies both source conditions.'
|
||||
constraints = {'keyword': keyword, 'year': years[-1]}
|
||||
else:
|
||||
raise ValueError(category)
|
||||
result = make_case(case['id'], 'dev', category, case['question'], names, oracle, bindings,
|
||||
no_answer=negative is not None, reason=negative, negative_constraints=constraints,
|
||||
expected_set=expected_set, set_field=field, count=count)
|
||||
result['legacy_role'] = 'exposed_v2_case_development_only'
|
||||
return result
|
||||
|
||||
|
||||
def main():
|
||||
parser = argparse.ArgumentParser(description=__doc__)
|
||||
parser.add_argument('--output', type=Path, default=BASE / 'graphrag_questions_v3.json')
|
||||
parser.add_argument('--artifacts', type=Path, default=BASE / 'results/v3_preparation')
|
||||
args = parser.parse_args()
|
||||
oracle = load_source_oracle()
|
||||
previous = json.loads((BASE / 'graphrag_questions_v2.json').read_text())
|
||||
original = {q['id']: q for q in json.loads((BASE / 'graphrag_questions.json').read_text())}
|
||||
dev = [reannotate(case, oracle, original) for case in previous]
|
||||
used = {p for case in previous for p in case['graph']['source_profiles']}
|
||||
used.update(json.loads((BASE / 'results/v2_preparation/partition.json').read_text())[
|
||||
'previously_exposed_profiles_excluded_from_test'])
|
||||
reserved = sorted([name for name, person in oracle['people'].items()
|
||||
if person['profile'].startswith('pages/students/') and person['profile'] not in used], key=norm)
|
||||
if len(reserved) != 2:
|
||||
raise RuntimeError('Unexpected remaining unseen profile population; review partition policy.')
|
||||
holdout = []
|
||||
def add(category, text, names, bindings, **kwargs):
|
||||
holdout.append(make_case(f'fresh-{len(holdout)+1:03d}', 'test', category, text, names,
|
||||
oracle, bindings, **kwargs))
|
||||
for name in reserved:
|
||||
person = oracle['people'][name]
|
||||
add('person_multiple_categories', f'Vypíš všetky kategórie dokumentov osoby {name}.', [name],
|
||||
[{'person': name, 'category': category} for category in person['categories']],
|
||||
expected_set=person['categories'], set_field='category')
|
||||
category = person['categories'][0]
|
||||
for path in supporting_documents(oracle, name, category=category)[:1]:
|
||||
author = oracle['documents'][path]['author']
|
||||
if author:
|
||||
add('document_author_category_multi_hop',
|
||||
f'Ktorý autor dokumentu je pri osobe {name} spojený s kategóriou {category}?', [name],
|
||||
[{'person': name, 'category': category, 'document_author': author,
|
||||
'document_path': path, 'same_document': True}])
|
||||
add('person_start_year', f'Aký rok začiatku štúdia je uvedený pri osobe {name}?', [name],
|
||||
[{'person': name, 'start_year': person['start_year']}])
|
||||
add('negative_lookup', f'Aký názov práce má osoba {name}, ak jej dokument obsahuje kľúčové slovo nenajdenyoverovacitag?',
|
||||
[name], [], no_answer=True, reason='Tag absent from raw frontmatter.',
|
||||
negative_constraints={'keyword': 'nenajdenyoverovacitag'})
|
||||
add('negative_lookup', f'Aký názov práce má osoba {name} v roku 2098?', [name], [],
|
||||
no_answer=True, reason='No academic record for requested year.', negative_constraints={'year': 2098})
|
||||
for name in ['Diana Neznáma Overovacia', 'Milan Neprítomný Vzorový']:
|
||||
add('negative_lookup', f'Aký názov diplomovej práce má osoba {name}?', [name], [],
|
||||
no_answer=True, reason='No profile with requested full name.', negative_constraints={'unknown_person': name})
|
||||
add('candidate_set_aggregation', f'Z kandidátov {", ".join(reserved)} vyber osoby s prácou v roku 2098. Koľko ich je?',
|
||||
reserved, [], expected_set=[], set_field='person', count=0)
|
||||
questions = dev + holdout
|
||||
issues = {q['id']: validate_case(q, oracle) for q in questions if validate_case(q, oracle)}
|
||||
if issues:
|
||||
raise RuntimeError(f'Independent source audit failed: {issues}')
|
||||
dev_profiles = {p for q in dev for p in q['graph']['source_profiles']}
|
||||
test_profiles = {p for q in holdout for p in q['graph']['source_profiles']}
|
||||
assert not dev_profiles & test_profiles
|
||||
write_json(args.output, questions)
|
||||
write_json(args.artifacts / 'source_audit.json', audit_dataset(questions, oracle, args.output))
|
||||
changes = [{'id': old['id'], 'old_bindings': old['graph']['expected_bindings'],
|
||||
'new_bindings': new['graph']['expected_bindings'], 'old_should_answer': old['should_answer'],
|
||||
'new_should_answer': new['should_answer'], 'source_evidence': new['source_evidence']}
|
||||
for old, new in zip(previous, dev) if old['graph']['expected_bindings'] != new['graph']['expected_bindings']
|
||||
or old['should_answer'] != new['should_answer']]
|
||||
write_json(args.artifacts / 'source_adjudications.json', {'method': 'Raw heading project/thesis distinction; no answer-output based relabeling.', 'changes': changes})
|
||||
partition = {'dev_count': len(dev), 'test_count': len(holdout), 'dev_profiles': sorted(dev_profiles),
|
||||
'test_profiles': sorted(test_profiles), 'source_profile_overlap': 0,
|
||||
'limitations': ['Only two entirely unseen profiles remain; supplementary holdout has limited category coverage.',
|
||||
'The broader v2 independent TEST remains 67/80; v2 cases are now DEV, never fresh TEST.']}
|
||||
write_json(args.artifacts / 'partition.json', partition)
|
||||
print(json.dumps({'dev': len(dev), 'test': len(holdout), 'unseen_profiles': len(reserved),
|
||||
'source_adjudications': len(changes), 'source_issues': 0}, indent=2))
|
||||
|
||||
|
||||
if __name__ == '__main__':
|
||||
main()
|
||||
217
tools/graphrag/evaluation/benchmark_v4.py
Normal file
217
tools/graphrag/evaluation/benchmark_v4.py
Normal file
@ -0,0 +1,217 @@
|
||||
"""Predeclare a broad source-grounded holdout, without reading retrieval outputs.
|
||||
|
||||
All profiles have already been exposed in v1-v3. This is a NEW QUERY-GROUP
|
||||
holdout over the same corpus, explicitly not an unseen-person experiment.
|
||||
Historic cases remain DEV; paraphrases of the same logical task stay together.
|
||||
"""
|
||||
from __future__ import annotations
|
||||
|
||||
import argparse
|
||||
import copy
|
||||
import json
|
||||
import random
|
||||
import re
|
||||
from collections import Counter
|
||||
from pathlib import Path
|
||||
|
||||
from .benchmark_v2 import BASE, academic_binding, academics, audit_dataset, fingerprint, independent_pool, make_case, validate_case, write_json
|
||||
from .source_oracle import load_source_oracle, norm
|
||||
|
||||
SEED = 20261025
|
||||
QUOTAS = {
|
||||
'shared_keyword_pair': 40, 'same_academic_year_pair': 40,
|
||||
'same_start_year_pair': 32, 'person_title_year': 24,
|
||||
'person_keyword_title': 32, 'document_author_category_multi_hop': 24,
|
||||
'person_multiple_categories': 24, 'candidate_set_aggregation': 32,
|
||||
'conjunctive_disambiguation': 40, 'negative_lookup': 32,
|
||||
}
|
||||
|
||||
|
||||
def logical_group(case: dict) -> str:
|
||||
"""Normalize task/subjects/constraints; never make paraphrases independent."""
|
||||
graph = case['graph']; category = case['category']
|
||||
names = sorted(norm(row['value']) for row in graph['start_entities'] if row['type'] == 'person')
|
||||
bindings = graph.get('expected_bindings', [])
|
||||
keywords = sorted({norm(row['keyword']) for row in bindings if row.get('keyword')})
|
||||
years = sorted({int(value) for value in re.findall(r'\b\d{4}\b', case['question'])})
|
||||
# A shared-year query has no requested year; its complete answer is derived.
|
||||
selectors = {'keywords': keywords, 'requested_years': years}
|
||||
if category == 'document_author_category_multi_hop':
|
||||
selectors['categories'] = sorted({norm(row['category']) for row in bindings if row.get('category')})
|
||||
if graph.get('expected_no_answer'):
|
||||
selectors['negative_constraints'] = {
|
||||
key: norm(value) if isinstance(value, str) else value
|
||||
for key, value in graph.get('negative_constraints', {}).items()}
|
||||
return fingerprint({'category': category, 'subjects': names, 'selectors': selectors})
|
||||
|
||||
|
||||
def paraphrase(case: dict, variant: int) -> str:
|
||||
names = [e['value'] for e in case['graph']['start_entities']]
|
||||
category = case['category']; rows = case['graph']['expected_bindings']
|
||||
year = next(iter(re.findall(r'\b20\d{2}\b', case['question'])), '')
|
||||
tag = next((r['keyword'] for r in rows if r.get('keyword')), '')
|
||||
if variant == 0 or category == 'negative_lookup':
|
||||
return case['question']
|
||||
if category == 'shared_keyword_pair':
|
||||
return (f'Majú osoby {names[0]} a {names[1]} spoločné kľúčové slovo {tag}?'
|
||||
if variant == 1 else f'Pre osoby {names[0]} a {names[1]} over rovnaké kľúčové slovo {tag}.')
|
||||
if category == 'same_academic_year_pair':
|
||||
return (f'Ktoré spoločné roky prác majú osoby {names[0]} a {names[1]}?'
|
||||
if variant == 1 else f'Porovnaj rovnaké roky práce pri osobách {names[0]} a {names[1]}.')
|
||||
if category == 'same_start_year_pair':
|
||||
return f'Aký spoločný rok začiatku štúdia majú osoby {names[0]} a {names[1]}?'
|
||||
if category == 'person_multiple_categories':
|
||||
return f'Aké všetky kategórie majú dokumenty osoby {names[0]}?'
|
||||
if category == 'document_author_category_multi_hop':
|
||||
return f'Ktorý autor dokumentu je pri osobe {names[0]} spojený s kategóriou {rows[0]["category"]}?'
|
||||
if category == 'person_title_year':
|
||||
# Preserve an explicit project selector, if present in the source query.
|
||||
label = 'diplomového projektu' if 'diplomoveho projektu' in norm(case['question']) else 'práce'
|
||||
return f'Uveď názov {label} osoby {names[0]} a rok práce pre rok {year}.'
|
||||
if category == 'person_keyword_title':
|
||||
return f'Uveď názov práce osoby {names[0]} v roku {year} s kľúčovým slovom {tag}.'
|
||||
if category == 'candidate_set_aggregation':
|
||||
return f'Z kandidátov {", ".join(names)} vyber osoby s prácou v roku {year}. Aký je ich počet?'
|
||||
if category == 'conjunctive_disambiguation':
|
||||
return f'Ktorá z osôb {names[0]} a {names[1]} spĺňa kľúčové slovo {tag} a rok práce {year}?'
|
||||
return case['question']
|
||||
|
||||
|
||||
def build_pool(oracle: dict) -> dict[str, list[dict]]:
|
||||
names = sorted(oracle['people'], key=norm)
|
||||
pool = independent_pool(oracle, names)
|
||||
negatives = []
|
||||
# Realistic absent combinations as well as unknown entities. Positive cases
|
||||
# make up 90% of TEST; no easy-negative inflation of the headline score.
|
||||
for index, name in enumerate(names):
|
||||
other_tags = sorted({tag for p in oracle['people'].values() for tag in p['tags']
|
||||
if norm(tag) not in {norm(t) for t in oracle['people'][name]['tags']}}, key=norm)
|
||||
if other_tags:
|
||||
tag = other_tags[index % len(other_tags)]
|
||||
negatives.append(make_case('', 'test', 'negative_lookup',
|
||||
f'Aký názov práce má osoba {name} s kľúčovým slovom {tag}?', [name], oracle, [],
|
||||
no_answer=True, reason='Requested literal tag is absent from this source document family.',
|
||||
negative_constraints={'keyword': tag}))
|
||||
observed = {r['year'] for r in academics(oracle, name)}
|
||||
absent_year = next(y for y in range(2018, 2027) if y not in observed)
|
||||
negatives.append(make_case('', 'test', 'negative_lookup',
|
||||
f'Aký názov práce má osoba {name} v roku {absent_year}?', [name], oracle, [],
|
||||
no_answer=True, reason='Requested academic year is absent from the original profile.',
|
||||
negative_constraints={'year': absent_year}))
|
||||
for first, last in [('Jozef', 'Neznámy Overovací'), ('Petra', 'Neznáma Overovacia'),
|
||||
('Juraj', 'Nevyskytujúci Skúšobný'), ('Lucia', 'Chýbajúca Vzorová'),
|
||||
('Adam', 'Nedostupný Kontrolný'), ('Eva', 'Neprítomná Kontrolná')]:
|
||||
name = f'{first} {last}'
|
||||
negatives.append(make_case('', 'test', 'negative_lookup', f'Aký názov práce má osoba {name}?',
|
||||
[name], oracle, [], no_answer=True, reason='Full name absent from all original profiles.',
|
||||
negative_constraints={'unknown_person': name}))
|
||||
pool['negative_lookup'] = negatives
|
||||
return pool
|
||||
|
||||
|
||||
def refresh_titles(case: dict, oracle: dict) -> dict:
|
||||
"""Adjudicate title gold from raw sources before looking at TEST predictions."""
|
||||
if case['category'] not in {'person_title_year', 'person_keyword_title'} or not case['should_answer']:
|
||||
return copy.deepcopy(case)
|
||||
name = case['graph']['start_entities'][0]['value']
|
||||
years = [int(v) for v in re.findall(r'\b20\d{2}\b', case['question'])]
|
||||
tag = next((b.get('keyword') for b in case['graph']['expected_bindings'] if b.get('keyword')), None)
|
||||
text = norm(case['question'])
|
||||
kind = next((kind for phrase, kind in [('diplomoveho projektu', 'diploma_project'),
|
||||
('diplomovej prace', 'diploma_thesis'), ('bakalarskej prace', 'bachelor_thesis')]
|
||||
if phrase in text), None)
|
||||
records = [r for r in academics(oracle, name) if r.get('title')
|
||||
and (not years or r['year'] in years) and (kind is None or r['academic_type'] == kind)]
|
||||
bindings = [academic_binding(name, r, title=True, keyword=tag) for r in records]
|
||||
return make_case(case['id'], case['split'], case['category'], case['question'], [name], oracle, bindings,
|
||||
no_answer=not bindings, reason='No explicit title for the requested academic record in original Markdown.',
|
||||
negative_constraints={'title_required': True, **({'year': years[-1]} if years else {}),
|
||||
**({'keyword': tag} if tag else {}), **({'academic_type': kind} if kind else {})})
|
||||
|
||||
|
||||
def main() -> None:
|
||||
parser = argparse.ArgumentParser(description=__doc__)
|
||||
parser.add_argument('--output', type=Path, default=BASE / 'graphrag_questions_v4.json')
|
||||
parser.add_argument('--artifacts', type=Path, default=BASE / 'results/v4_preparation')
|
||||
parser.add_argument('--seed', type=int, default=SEED)
|
||||
parser.add_argument('--extra-exposed', type=Path, action='append', default=[])
|
||||
args = parser.parse_args()
|
||||
if args.output.exists() or args.artifacts.exists():
|
||||
parser.error('Refusing to overwrite a declared benchmark or its preparation artifacts.')
|
||||
oracle = load_source_oracle()
|
||||
historic = json.loads((BASE / 'graphrag_questions_v3.json').read_text())
|
||||
for path in args.extra_exposed:
|
||||
historic.extend(json.loads(path.read_text()))
|
||||
old_questions = {norm(q['question']) for q in historic}
|
||||
exposed = {logical_group(q) for q in historic}
|
||||
adjudications = []
|
||||
for index, original in enumerate(historic):
|
||||
corrected = refresh_titles(original, oracle)
|
||||
if corrected['graph']['expected_bindings'] != original['graph']['expected_bindings']:
|
||||
adjudications.append({'id': original['id'], 'split': 'dev',
|
||||
'old_bindings': original['graph']['expected_bindings'], 'new_bindings': corrected['graph']['expected_bindings'],
|
||||
'source_evidence': corrected['source_evidence']})
|
||||
historic[index] = corrected
|
||||
exposed.update(logical_group(q) for q in historic)
|
||||
dev = []
|
||||
for index, original in enumerate(historic):
|
||||
case = copy.deepcopy(original); case['split'] = 'dev'
|
||||
case['id'] = f'regression-{index + 1:04d}'
|
||||
case['graph']['partition_group'] = logical_group(case)
|
||||
dev.append(case)
|
||||
rng = random.Random(args.seed); holdout = []; capacities = {}
|
||||
for category, cases in build_pool(oracle).items():
|
||||
unique = {logical_group(c): c for c in cases
|
||||
if logical_group(c) not in exposed and norm(c['question']) not in old_questions}
|
||||
candidates = sorted(unique.values(), key=lambda q: logical_group(q)); rng.shuffle(candidates)
|
||||
quota = QUOTAS[category]; capacities[category] = len(candidates)
|
||||
if len(candidates) < quota:
|
||||
raise RuntimeError(f'Insufficient unseen logical groups for {category}: {len(candidates)} < {quota}')
|
||||
# Random selection is committed before running either split. Never
|
||||
# select or remove a TEST question based on a retrieval outcome.
|
||||
for index, case in enumerate(candidates[:quota]):
|
||||
case = refresh_titles(case, oracle); case['split'] = 'test'
|
||||
case['id'] = f'wide-{len(holdout) + 1:03d}'
|
||||
case['question'] = paraphrase(case, index % 3)
|
||||
case['graph']['partition_group'] = logical_group(case)
|
||||
holdout.append(case)
|
||||
for index, case in enumerate(candidates[quota:quota + min(12, max(0, len(candidates) - quota))]):
|
||||
case = refresh_titles(case, oracle); case['split'] = 'dev'
|
||||
case['id'] = f'wide-dev-{len(dev) + 1:04d}'
|
||||
case['question'] = paraphrase(case, index % 3)
|
||||
case['graph']['partition_group'] = logical_group(case)
|
||||
dev.append(case)
|
||||
questions = dev + holdout
|
||||
problems = {q['id']: validate_case(q, oracle) for q in questions if validate_case(q, oracle)}
|
||||
if problems:
|
||||
raise RuntimeError(f'Source oracle rejected cases: {problems}')
|
||||
groups = {split: {q['graph']['partition_group'] for q in questions if q['split'] == split}
|
||||
for split in ['dev', 'test']}
|
||||
assert not groups['dev'] & groups['test']
|
||||
assert not {norm(q['question']) for q in dev} & {norm(q['question']) for q in holdout}
|
||||
write_json(args.output, questions)
|
||||
audit = audit_dataset(questions, oracle, args.output)
|
||||
audit['partition_policy'] = {'method': 'disjoint logical query groups',
|
||||
'shared_source_profiles': True, 'group_function': 'benchmark_v4.logical_group',
|
||||
'seed': args.seed, 'previously_exposed_groups': sorted(exposed),
|
||||
'limitations': ['Known source corpus, persons, vocabulary and template families.',
|
||||
'Fresh questions/fact combinations; not an unseen-person or LLM-answer benchmark.']}
|
||||
write_json(args.artifacts / 'source_audit.json', audit)
|
||||
write_json(args.artifacts / 'source_adjudications.json', {
|
||||
'reason': 'Raw-source review before any new TEST predictions; preserve historic datasets unchanged.',
|
||||
'questions': adjudications})
|
||||
write_json(args.artifacts / 'partition.json', {
|
||||
**audit['partition_policy'], 'dataset_sha256': audit['dataset_sha256'],
|
||||
'dev_count': len(dev), 'test_count': len(holdout), 'available_unseen_groups': capacities,
|
||||
'test_categories': dict(Counter(q['category'] for q in holdout)),
|
||||
'test_positive_count': sum(q['should_answer'] for q in holdout),
|
||||
'test_negative_count': sum(not q['should_answer'] for q in holdout),
|
||||
'dev_groups': sorted(groups['dev']), 'test_groups': sorted(groups['test']),
|
||||
'test_profile_count': len({p for q in holdout for p in q['graph']['source_profiles']}),
|
||||
'source_corpus': oracle['source_corpus']})
|
||||
print(json.dumps({'dev': len(dev), 'test': len(holdout), 'source_issues': 0,
|
||||
'available_unseen_groups': capacities}, ensure_ascii=False, indent=2))
|
||||
|
||||
|
||||
if __name__ == '__main__':
|
||||
main()
|
||||
52
tools/graphrag/evaluation/benchmark_v6.py
Normal file
52
tools/graphrag/evaluation/benchmark_v6.py
Normal file
@ -0,0 +1,52 @@
|
||||
"""Version known regression questions after independent source adjudication.
|
||||
|
||||
No retrieval output is used to choose, remove or relabel questions. Historical
|
||||
v4 remains immutable; all IDs, wording, categories and split membership remain.
|
||||
"""
|
||||
import copy
|
||||
import json
|
||||
from pathlib import Path
|
||||
|
||||
from .benchmark_v2 import BASE, audit_dataset, binding_source_evidence, validate_case, write_json
|
||||
from .benchmark_v4 import refresh_titles, logical_group
|
||||
from .source_oracle import load_source_oracle
|
||||
|
||||
|
||||
def main():
|
||||
output = BASE / 'graphrag_questions_v6.json'
|
||||
artifacts = BASE / 'results/v6_preparation'
|
||||
if output.exists():
|
||||
raise RuntimeError('Refusing to overwrite versioned questions.')
|
||||
original = json.loads((BASE / 'graphrag_questions_v4.json').read_text())
|
||||
oracle = load_source_oracle()
|
||||
cases = []; changes = []
|
||||
for before in original:
|
||||
after = refresh_titles(before, oracle)
|
||||
after['graph']['partition_group'] = logical_group(after)
|
||||
if after['should_answer']:
|
||||
after['source_evidence'] = [proof for binding in after['graph']['expected_bindings']
|
||||
for proof in binding_source_evidence(binding, oracle)]
|
||||
if (before['should_answer'], before['graph']['expected_bindings']) != (
|
||||
after['should_answer'], after['graph']['expected_bindings']):
|
||||
changes.append({'id': before['id'], 'split': before['split'],
|
||||
'before': copy.deepcopy(before), 'after': copy.deepcopy(after),
|
||||
'reason': 'Generic written-deliverable link label is not a supported academic title.'})
|
||||
assert before['question'] == after['question'] and before['category'] == after['category']
|
||||
issues = validate_case(after, oracle)
|
||||
if issues:
|
||||
raise RuntimeError(f'{after["id"]}: {issues}')
|
||||
cases.append(after)
|
||||
write_json(output, cases)
|
||||
write_json(artifacts / 'source_adjudications.json', {
|
||||
'reviewer': 'AI direct Markdown review; not a human adjudication',
|
||||
'policy': 'A bare artifact label (rešerš, tutoriál, projekt, dokument, repozitár) is not an academic title. '
|
||||
'Do not inherit a child-document title or category-year into its parent academic record.',
|
||||
'measurement': 'All questions are known historical regression; corrected gold prevents direct accuracy comparison.',
|
||||
'questions': changes})
|
||||
write_json(artifacts / 'source_audit.json', audit_dataset(cases, oracle, output))
|
||||
print(json.dumps({'questions': len(cases), 'source_issues': 0,
|
||||
'adjudicated_ids': [c['id'] for c in changes]}))
|
||||
|
||||
|
||||
if __name__ == '__main__':
|
||||
main()
|
||||
91
tools/graphrag/evaluation/benchmark_v7.py
Normal file
91
tools/graphrag/evaluation/benchmark_v7.py
Normal file
@ -0,0 +1,91 @@
|
||||
"""Declare a fresh query-group holdout using raw sources only, before retrieval.
|
||||
|
||||
All 1,042 previously exposed questions become DEV. No profile is new; this is
|
||||
a new-combination holdout over a known corpus, not an unseen-person experiment.
|
||||
"""
|
||||
import copy
|
||||
import json
|
||||
import random
|
||||
from collections import Counter
|
||||
|
||||
from .benchmark_v2 import BASE, audit_dataset, make_case, validate_case, write_json, binding_source_evidence
|
||||
from .benchmark_v4 import build_pool, logical_group, refresh_titles
|
||||
from .source_oracle import load_source_oracle, norm
|
||||
|
||||
QUOTAS = {'shared_keyword_pair': 10, 'same_academic_year_pair': 10,
|
||||
'same_start_year_pair': 10, 'person_title_year': 10, 'person_keyword_title': 10,
|
||||
'document_author_category_multi_hop': 2, 'person_multiple_categories': 7,
|
||||
'candidate_set_aggregation': 7, 'conjunctive_disambiguation': 6, 'negative_lookup': 8}
|
||||
SEED = 20261026
|
||||
|
||||
|
||||
def main():
|
||||
output = BASE/'graphrag_questions_v7.json'; artifacts = BASE/'results/v7_preparation'
|
||||
if output.exists(): raise RuntimeError('Refusing to overwrite declared questions.')
|
||||
oracle = load_source_oracle()
|
||||
old = json.loads((BASE/'graphrag_questions_v6.json').read_text())
|
||||
dev = []; changes = []
|
||||
exposed = {logical_group(q) for q in old}
|
||||
for original in old:
|
||||
case = copy.deepcopy(original); case['split'] = 'dev'
|
||||
names = [r['value'] for r in case['graph']['start_entities'] if r['type'] == 'person']
|
||||
if any(b.get('start_year') is not None and oracle['people'][b['person']]['start_year'] is None
|
||||
for b in case['graph']['expected_bindings']):
|
||||
case = make_case(case['id'], 'dev', case['category'], case['question'], names, oracle, [],
|
||||
no_answer=True, reason='The original Markdown does not explicitly document every requested study-start year.',
|
||||
negative_constraints={'missing_start_year': True})
|
||||
changes.append({'id': case['id'], 'old_bindings': original['graph']['expected_bindings'],
|
||||
'new_status': 'no_answer', 'reason': 'Directory cohort is not a documented study-start year.'})
|
||||
elif case['should_answer']:
|
||||
case['source_evidence'] = [e for b in case['graph']['expected_bindings'] for e in binding_source_evidence(b, oracle)]
|
||||
case['graph']['partition_group'] = logical_group(case); dev.append(case)
|
||||
# Fixed audit regressions; these are explicitly DEV, not extra easy TEST negatives.
|
||||
for year in [1999, 1899, 2100, 9999]:
|
||||
case = make_case(f'v7-dev-year-{year}', 'dev', 'negative_lookup',
|
||||
f'Aký je názov práce osoby Ján Holp v roku {year}?', ['Ján Holp'], oracle, [],
|
||||
no_answer=True, negative_constraints={'year': year})
|
||||
case['graph']['partition_group'] = logical_group(case); dev.append(case)
|
||||
exposed.update(logical_group(q) for q in dev)
|
||||
texts = {norm(q['question']) for q in dev}; rng = random.Random(SEED)
|
||||
holdout = []; capacity = {}
|
||||
for category, pool in build_pool(oracle).items():
|
||||
unique = {}
|
||||
for candidate in pool:
|
||||
case = refresh_titles(candidate, oracle); group = logical_group(case)
|
||||
if group not in exposed and norm(case['question']) not in texts:
|
||||
unique[group] = case
|
||||
capacity[category] = len(unique)
|
||||
candidates = [unique[key] for key in sorted(unique)]; rng.shuffle(candidates)
|
||||
quota = QUOTAS[category]
|
||||
if len(candidates) < quota: raise RuntimeError(f'Insufficient source capacity: {category}')
|
||||
for case in candidates[:quota]:
|
||||
case['id'] = f'fresh7-{len(holdout)+1:03d}'; case['split'] = 'test'
|
||||
case['graph']['partition_group'] = logical_group(case); holdout.append(case)
|
||||
questions = dev + holdout
|
||||
for case in questions:
|
||||
issues = validate_case(case, oracle)
|
||||
if issues: raise RuntimeError(f'{case["id"]}: {issues}')
|
||||
write_json(output, questions)
|
||||
audit = audit_dataset(questions, oracle, output)
|
||||
audit['partition_policy'] = {'method': 'disjoint logical query groups',
|
||||
'shared_source_profiles': True, 'seed': SEED, 'previously_exposed_groups': sorted(exposed),
|
||||
'limitations': ['Known corpus, persons and template families; only the query/fact combinations are fresh.',
|
||||
'Two remaining document-author/category groups and seven category-list groups constrain category coverage.',
|
||||
'AI source annotation, not human annotation. No tuning on this TEST.']}
|
||||
write_json(artifacts/'source_audit.json', audit)
|
||||
write_json(artifacts/'source_corrections.json', {'questions': changes,
|
||||
'policy': 'Only explicit study-start text is a fact. Cohort remains separate metadata; missing means unknown.'})
|
||||
write_json(artifacts/'regression_ids.json', [q['id'] for q in old if q['split'] == 'test'])
|
||||
ids = set(json.loads((BASE/'results/v6_preparation/generation_dev_ids.json').read_text()))
|
||||
ids.update(f'v7-dev-year-{year}' for year in [1999, 1899, 2100, 9999])
|
||||
write_json(artifacts/'generation_dev_ids.json', sorted(ids))
|
||||
write_json(artifacts/'protocol.json', {'seed': SEED, 'dev_count': len(dev), 'fresh_test_count': len(holdout),
|
||||
'test_categories': dict(Counter(q['category'] for q in holdout)), 'test_positives': sum(q['should_answer'] for q in holdout),
|
||||
'test_negatives': sum(not q['should_answer'] for q in holdout), 'available_groups': capacity,
|
||||
'old_gold_corrections': len(changes), 'regression_count': 320, 'llm_dev_count': len(ids),
|
||||
'target': .92, 'policy': 'Freeze after complete DEV; run fresh TEST once, retain every failure. Regression remains separate.',
|
||||
'annotation': 'Independent raw-source oracle plus AI source review; not human review.'})
|
||||
print(json.dumps({'dev': len(dev), 'test': len(holdout), 'source_corrections': len(changes), 'quotas': QUOTAS}))
|
||||
|
||||
|
||||
if __name__ == '__main__': main()
|
||||
152
tools/graphrag/evaluation/check_openwebui.py
Normal file
152
tools/graphrag/evaluation/check_openwebui.py
Normal file
@ -0,0 +1,152 @@
|
||||
"""Supplementary LLM check with graph context supplied by the local harness.
|
||||
|
||||
This exercises the school's OpenWebUI chat API and generated claims, NOT the
|
||||
WebUI browser, installed tools, or autonomous routing. Gold never enters a
|
||||
request. The primary experiment remains the complete frozen retrieval TEST.
|
||||
"""
|
||||
from __future__ import annotations
|
||||
|
||||
import argparse
|
||||
import json
|
||||
import os
|
||||
import time
|
||||
from collections import defaultdict
|
||||
from pathlib import Path
|
||||
|
||||
from tools.rag.evaluation.rag_runner import DEFAULT_MODEL, OPENWEBUI_URL, request_json
|
||||
from ..graph_db import create_neo4j_driver, get_neo4j_settings
|
||||
from ..graph_search import search_graph_with_session
|
||||
from .benchmark_v2 import BASE, academics, supporting_documents
|
||||
from .reproducibility import graph_fingerprint, run_metadata, verify_freeze
|
||||
from .source_oracle import load_source_oracle, norm
|
||||
from .source_validation import claim_issues
|
||||
from tools.answer_evaluation.context_policy import citation_check
|
||||
|
||||
SYSTEM = '''Odpovedaj po slovensky výhradne podľa dodaného výsledku grafového vyhľadávania.
|
||||
Nedoplňuj vedomosti ani údaje z otázky bez potvrdenia v kontexte. Pri no_answer oznám,
|
||||
že údaj nebol nájdený; nevymýšľaj názov. Zachovaj presné znenie mien, názvov, tagov a kategórií.
|
||||
Rozlišuj rok práce (year) od začiatku štúdia (start_year), autora dokumentu od študenta.
|
||||
Vráť JSON objekt s poľami answer (stručný prirodzený text), status (ok/no_answer/ambiguous),
|
||||
claims (zoznam objektov s person a len relevantnými faktami: title, year, start_year,
|
||||
keyword, category, document_author), source_urls (zoznam citovaných URL), count (číslo alebo null).
|
||||
Každá claim musí patriť jednej osobe; nespoj podmienky z rôznych osôb. Pri porovnaní
|
||||
uveď samostatné claims pre každú osobu; pri počte iba zodpovedajúcich kandidátov.
|
||||
Pri otázke na názov uveď aj rok, ak je známy. Pri no_answer vráť prázdne claims.
|
||||
V odpovedi aj source_urls cituj skutočné relevantné zdroje z kontextu.'''
|
||||
|
||||
|
||||
def grade_claims(case: dict, answer: dict, oracle: dict) -> dict:
|
||||
graph = case['graph']; claims = answer.get('claims', [])
|
||||
if not isinstance(claims, list) or any(not isinstance(c, dict) for c in claims):
|
||||
return {'strict': False, 'reason': 'invalid_claim_schema'}
|
||||
fields = ['person', 'title', 'year', 'start_year', 'keyword', 'category', 'document_author']
|
||||
def matches(binding, claim):
|
||||
return all(norm(claim.get(k, '')) == norm(binding[k]) for k in fields if k in binding)
|
||||
covered = all(any(matches(b, c) for c in claims) for b in graph['expected_bindings'])
|
||||
names = {norm(name): name for name in oracle['people']}
|
||||
unsupported = []
|
||||
for claim in claims:
|
||||
person = names.get(norm(claim.get('person')))
|
||||
valid = person is not None
|
||||
if valid and 'start_year' in claim:
|
||||
valid = norm(claim['start_year']) == norm(oracle['people'][person]['start_year'])
|
||||
metadata = {k: claim[k] for k in ['keyword', 'category', 'document_author'] if claim.get(k) is not None}
|
||||
if valid and metadata:
|
||||
valid = all(supporting_documents(oracle, person, **{k: v}) for k, v in metadata.items())
|
||||
if 'category' in metadata and 'document_author' in metadata:
|
||||
valid = valid and bool(supporting_documents(oracle, person, **metadata))
|
||||
if valid and any(claim.get(k) is not None for k in ['title', 'year']):
|
||||
records = academics(oracle, person)
|
||||
valid = any(all(norm(r.get(k)) == norm(claim[k]) for k in ['title', 'year']
|
||||
if claim.get(k) is not None) for r in records)
|
||||
if not valid:
|
||||
unsupported.append(claim)
|
||||
elif claim_issues(claim, oracle):
|
||||
unsupported.append(claim)
|
||||
urls = answer.get('source_urls', [])
|
||||
sources_ok = isinstance(urls, list) and all(any(a['source_url'] in urls for a in proof['any_of'])
|
||||
for proof in graph.get('expected_evidence_documents', []))
|
||||
sources_ok = sources_ok and citation_check(answer,{
|
||||
doc['source_url'] for doc in oracle.get('documents',{}).values() if doc.get('source_url')})['citations_ok']
|
||||
negative = graph.get('expected_no_answer', False)
|
||||
status_ok = (answer.get('status') == 'no_answer' and not claims) if negative else answer.get('status') == 'ok'
|
||||
count_ok = 'expected_count' not in graph or answer.get('count') == graph['expected_count']
|
||||
set_ok = True
|
||||
if graph.get('expected_entity_set') is not None:
|
||||
field = graph['entity_set_field']
|
||||
actual = {norm(c[field]) for c in claims if c.get(field) is not None}
|
||||
set_ok = actual == {norm(v) for v in graph['expected_entity_set']}
|
||||
return {'strict': bool(covered and not unsupported and sources_ok and status_ok and count_ok and set_ok),
|
||||
'bindings_ok': covered, 'unsupported_claims': unsupported, 'sources_ok': sources_ok,
|
||||
'status_ok': status_ok, 'count_ok': count_ok, 'set_ok': set_ok}
|
||||
|
||||
|
||||
def main():
|
||||
# Import the common adapter here: it imports grade_claims from this module.
|
||||
from tools.answer_evaluation.evaluate_graph_answers import graph_context, grade_answer, HERE
|
||||
from tools.answer_evaluation.checked_generation import generate_checked_answer
|
||||
from tools.graphrag.build_graphrag import graph_version
|
||||
|
||||
parser = argparse.ArgumentParser(description=__doc__)
|
||||
parser.add_argument('--questions', type=Path, required=True)
|
||||
parser.add_argument('--freeze-manifest', type=Path, required=True)
|
||||
parser.add_argument('--audit', type=Path, required=True)
|
||||
parser.add_argument('--output', type=Path, required=True)
|
||||
parser.add_argument('--per-category', type=int, default=2)
|
||||
parser.add_argument('--model', default=DEFAULT_MODEL)
|
||||
args = parser.parse_args()
|
||||
if args.output.exists():
|
||||
parser.error('Refusing to overwrite a previous external measurement.')
|
||||
if not os.getenv('OPENWEBUI_API_KEY'):
|
||||
parser.error('OPENWEBUI_API_KEY is not configured.')
|
||||
questions = json.loads(args.questions.read_text()); selected = []; counts = defaultdict(int)
|
||||
for case in questions:
|
||||
if case['split'] == 'test' and counts[case['category']] < args.per_category:
|
||||
selected.append(case); counts[case['category']] += 1
|
||||
oracle = load_source_oracle(); manifest = json.loads(args.freeze_manifest.read_text())
|
||||
settings = get_neo4j_settings(); rows = []
|
||||
prompt = (HERE / 'graph_answer_prompt.txt').read_text()
|
||||
payload = {'method': 'Supplementary known-query check with common context guards; no autonomous tool routing.',
|
||||
'model': args.model, 'selected_ids': [q['id'] for q in selected], 'system_prompt': prompt,
|
||||
'corrective_request_limit': 1,
|
||||
'limitations': ['Small stratified supplementary sample; not the primary 320-case accuracy.',
|
||||
'Structured claims, source citations and binding checks; free prose requires separate review.'],
|
||||
'questions': rows}
|
||||
args.output.parent.mkdir(parents=True, exist_ok=True)
|
||||
with create_neo4j_driver(settings) as driver, driver.session(database=settings.database) as session:
|
||||
metadata = run_metadata(args.questions)
|
||||
verify_freeze(manifest, metadata, graph_fingerprint(session), audit=args.audit, **manifest['parameters'])
|
||||
payload['run_metadata'] = metadata
|
||||
version = graph_version(session)
|
||||
for case in selected:
|
||||
started = time.perf_counter()
|
||||
result = search_graph_with_session(session, case['question'], **manifest['parameters'])
|
||||
result['index_version'] = version
|
||||
context = graph_context(result)
|
||||
row = {'id': case['id'], 'category': case['category'], 'question': case['question'],
|
||||
'graph_context': context, 'strict': False}
|
||||
try:
|
||||
def complete(messages):
|
||||
return request_json(OPENWEBUI_URL, method='POST', timeout=90, max_attempts=1,
|
||||
headers={'Authorization': f'Bearer {os.environ["OPENWEBUI_API_KEY"]}', 'Content-Type': 'application/json'},
|
||||
payload={'model': args.model, 'stream': False, 'response_format': {'type': 'json_object'},
|
||||
'messages': messages})
|
||||
row.update(generate_checked_answer(case['question'], context, prompt, complete))
|
||||
if row.get('answer'):
|
||||
row.update(grade_answer(case, row['answer'], oracle, context=context))
|
||||
row['strict'] = bool(row['strict'] and row['accepted_for_delivery'])
|
||||
except Exception as error:
|
||||
row['error'] = f'{type(error).__name__}: {str(error)[:500]}'
|
||||
row['latency_seconds'] = time.perf_counter() - started
|
||||
rows.append(row)
|
||||
payload['summary'] = {'questions': len(rows), 'correct': sum(r['strict'] for r in rows),
|
||||
'accuracy': sum(r['strict'] for r in rows) / len(rows)}
|
||||
args.output.write_text(json.dumps(payload, ensure_ascii=False, indent=2) + '\n')
|
||||
print(f'{case["id"]}: {"OK" if row["strict"] else "FAIL"} ({row["latency_seconds"]:.1f}s)', flush=True)
|
||||
verify_freeze(manifest, run_metadata(args.questions), graph_fingerprint(session), audit=args.audit, **manifest['parameters'])
|
||||
assert graph_version(session) == version, 'Index version changed during generation.'
|
||||
print(json.dumps(payload['summary']))
|
||||
|
||||
|
||||
if __name__ == '__main__':
|
||||
main()
|
||||
680
tools/graphrag/evaluation/evaluate_graphrag.py
Normal file
680
tools/graphrag/evaluation/evaluate_graphrag.py
Normal file
@ -0,0 +1,680 @@
|
||||
from __future__ import annotations
|
||||
|
||||
import argparse
|
||||
import csv
|
||||
import json
|
||||
import time
|
||||
from datetime import datetime, timezone
|
||||
from pathlib import Path
|
||||
from typing import Any
|
||||
|
||||
from ..graph_db import (
|
||||
create_neo4j_driver,
|
||||
get_neo4j_settings,
|
||||
)
|
||||
from ..graph_search import (
|
||||
DEFAULT_LIMIT,
|
||||
DEFAULT_MAX_ENTITIES,
|
||||
search_graph_with_session,
|
||||
)
|
||||
from .graphrag_evaluator import (
|
||||
aggregate_by_field,
|
||||
aggregate_rows,
|
||||
evaluate_result,
|
||||
filter_questions,
|
||||
load_questions,
|
||||
)
|
||||
from .reproducibility import graph_fingerprint, run_metadata, sha256_file, verify_freeze
|
||||
from .source_oracle import load_source_oracle
|
||||
|
||||
|
||||
EVALUATION_DIR = Path(
|
||||
__file__
|
||||
).resolve().parent
|
||||
|
||||
QUESTIONS_PATH = (
|
||||
EVALUATION_DIR
|
||||
/ "graphrag_questions_v4.json"
|
||||
)
|
||||
|
||||
RESULTS_DIR = (
|
||||
EVALUATION_DIR
|
||||
/ "results"
|
||||
)
|
||||
|
||||
|
||||
def parse_args() -> argparse.Namespace:
|
||||
parser = argparse.ArgumentParser(
|
||||
description=(
|
||||
"Vyhodnotenie GraphRAG vyhľadávania "
|
||||
"proti graphrag_questions.json."
|
||||
)
|
||||
)
|
||||
|
||||
parser.add_argument(
|
||||
"--questions",
|
||||
type=Path,
|
||||
required=True,
|
||||
)
|
||||
|
||||
parser.add_argument(
|
||||
"--output-dir",
|
||||
type=Path,
|
||||
required=True,
|
||||
)
|
||||
|
||||
parser.add_argument(
|
||||
"--split",
|
||||
choices=(
|
||||
"dev",
|
||||
"test",
|
||||
"all",
|
||||
),
|
||||
default="dev",
|
||||
help=(
|
||||
"Predvolene sa vyhodnocuje iba DEV. "
|
||||
"TEST používaj až po zmrazení GraphRAG."
|
||||
),
|
||||
)
|
||||
|
||||
parser.add_argument(
|
||||
"--limit",
|
||||
type=int,
|
||||
default=DEFAULT_LIMIT,
|
||||
)
|
||||
|
||||
parser.add_argument(
|
||||
"--max-entities",
|
||||
type=int,
|
||||
default=DEFAULT_MAX_ENTITIES,
|
||||
)
|
||||
|
||||
parser.add_argument(
|
||||
"--ids",
|
||||
type=str,
|
||||
default="",
|
||||
help=(
|
||||
"Voliteľný zoznam ID oddelených čiarkou."
|
||||
),
|
||||
)
|
||||
|
||||
parser.add_argument(
|
||||
"--max-questions",
|
||||
type=int,
|
||||
default=None,
|
||||
help=(
|
||||
"Voliteľne vyhodnotí iba prvých N "
|
||||
"otázok z vybraného splitu."
|
||||
),
|
||||
)
|
||||
|
||||
parser.add_argument('--audit', type=Path, help='Predeclared source-consistency audit.')
|
||||
parser.add_argument('--freeze-manifest', type=Path,
|
||||
help='Required for TEST/all; verifies code, data, graph and parameters.')
|
||||
parser.add_argument('--overwrite', action='store_true',
|
||||
help='Replace a previous DEV output; frozen TEST outputs are immutable.')
|
||||
args = parser.parse_args()
|
||||
if args.split in {'test', 'all'} and args.freeze_manifest is None:
|
||||
parser.error('TEST/all requires --freeze-manifest after complete DEV evaluation.')
|
||||
if args.split in {'test', 'all'} and (args.ids or args.max_questions):
|
||||
parser.error('Frozen holdout evaluation must cover the complete selected split.')
|
||||
if args.split in {'test', 'all'} and args.overwrite:
|
||||
parser.error('Use a fresh output directory to reproduce a frozen holdout.')
|
||||
|
||||
if args.limit < 1:
|
||||
parser.error(
|
||||
"--limit musí byť aspoň 1."
|
||||
)
|
||||
|
||||
if args.max_entities < 1:
|
||||
parser.error(
|
||||
"--max-entities musí byť aspoň 1."
|
||||
)
|
||||
|
||||
if (
|
||||
args.max_questions
|
||||
is not None
|
||||
and args.max_questions < 1
|
||||
):
|
||||
parser.error(
|
||||
"--max-questions musí byť aspoň 1."
|
||||
)
|
||||
|
||||
return args
|
||||
|
||||
|
||||
def save_json(
|
||||
path: Path,
|
||||
payload: dict[str, Any],
|
||||
) -> None:
|
||||
path.parent.mkdir(
|
||||
parents=True,
|
||||
exist_ok=True,
|
||||
)
|
||||
|
||||
path.write_text(
|
||||
json.dumps(
|
||||
payload,
|
||||
ensure_ascii=False,
|
||||
indent=2,
|
||||
)
|
||||
+ "\n",
|
||||
encoding="utf-8",
|
||||
)
|
||||
|
||||
|
||||
def save_csv(
|
||||
path: Path,
|
||||
rows: list[
|
||||
dict[str, Any]
|
||||
],
|
||||
) -> None:
|
||||
path.parent.mkdir(
|
||||
parents=True,
|
||||
exist_ok=True,
|
||||
)
|
||||
|
||||
fieldnames = [
|
||||
"complete",
|
||||
"answerability_ok",
|
||||
"bindings_ok",
|
||||
"binding_score",
|
||||
"paths_ok",
|
||||
"path_score",
|
||||
"count_ok",
|
||||
"expected_count",
|
||||
"actual_count",
|
||||
"id",
|
||||
"split",
|
||||
"category",
|
||||
"difficulty",
|
||||
"strict",
|
||||
"value_score",
|
||||
"entity_score",
|
||||
"relation_score",
|
||||
"property_score",
|
||||
"relation_choice_score",
|
||||
"document_recall",
|
||||
"source_recall",
|
||||
"entity_set_ok",
|
||||
"latency_seconds",
|
||||
"error",
|
||||
"question",
|
||||
"expected_values",
|
||||
"matched_values",
|
||||
"expected_relations",
|
||||
"actual_relations",
|
||||
"expected_documents",
|
||||
"actual_documents",
|
||||
"expected_source_urls",
|
||||
"actual_source_urls",
|
||||
"fact_types",
|
||||
"strategies",
|
||||
"binding_results",
|
||||
"path_results",
|
||||
]
|
||||
|
||||
with path.open(
|
||||
"w",
|
||||
encoding="utf-8",
|
||||
newline="",
|
||||
) as file:
|
||||
writer = csv.DictWriter(
|
||||
file,
|
||||
fieldnames=fieldnames,
|
||||
lineterminator='\n',
|
||||
)
|
||||
|
||||
writer.writeheader()
|
||||
|
||||
for row in rows:
|
||||
output = {}
|
||||
|
||||
for field in fieldnames:
|
||||
value = row.get(
|
||||
field
|
||||
)
|
||||
|
||||
if isinstance(
|
||||
value,
|
||||
(
|
||||
list,
|
||||
dict,
|
||||
),
|
||||
):
|
||||
value = json.dumps(
|
||||
value,
|
||||
ensure_ascii=False,
|
||||
)
|
||||
|
||||
output[
|
||||
field
|
||||
] = value
|
||||
|
||||
writer.writerow(
|
||||
output
|
||||
)
|
||||
|
||||
|
||||
def print_summary(
|
||||
summary: dict[str, Any],
|
||||
*,
|
||||
split: str,
|
||||
) -> None:
|
||||
print()
|
||||
print(
|
||||
"=" * 78
|
||||
)
|
||||
|
||||
print(
|
||||
"GRAPHRAG EVALUATION"
|
||||
)
|
||||
|
||||
print(
|
||||
"=" * 78
|
||||
)
|
||||
|
||||
print(
|
||||
f"Split: {split}"
|
||||
)
|
||||
|
||||
print(
|
||||
f"Questions: "
|
||||
f"{summary['questions']}"
|
||||
)
|
||||
|
||||
print(
|
||||
f"Strict: "
|
||||
f"{summary['strict_count']}/"
|
||||
f"{summary['questions']} "
|
||||
f"({summary['strict_accuracy']:.3%})"
|
||||
)
|
||||
|
||||
print(
|
||||
f"Errors: "
|
||||
f"{summary['error_count']}"
|
||||
)
|
||||
|
||||
print(
|
||||
f"Value score: "
|
||||
f"{summary['value_score']:.3f}"
|
||||
)
|
||||
|
||||
print(
|
||||
f"Entity score: "
|
||||
f"{summary['entity_score']:.3f}"
|
||||
)
|
||||
|
||||
print(
|
||||
f"Relation score: "
|
||||
f"{summary['relation_score']:.3f}"
|
||||
)
|
||||
|
||||
print(
|
||||
f"Property score: "
|
||||
f"{summary['property_score']:.3f}"
|
||||
)
|
||||
|
||||
print(
|
||||
f"Relation choices: "
|
||||
f"{summary['relation_choice_score']:.3f}"
|
||||
)
|
||||
|
||||
print(
|
||||
f"Document recall: "
|
||||
f"{summary['document_recall']:.3f}"
|
||||
)
|
||||
|
||||
print(
|
||||
f"Source recall: "
|
||||
f"{summary['source_recall']:.3f}"
|
||||
)
|
||||
|
||||
print(
|
||||
f"Latency mean: "
|
||||
f"{summary['latency_mean_seconds']:.4f} s"
|
||||
)
|
||||
|
||||
print(
|
||||
f"Latency median: "
|
||||
f"{summary['latency_median_seconds']:.4f} s"
|
||||
)
|
||||
|
||||
print(
|
||||
f"Latency p95: "
|
||||
f"{summary['latency_p95_seconds']:.4f} s"
|
||||
)
|
||||
|
||||
print(
|
||||
"=" * 78
|
||||
)
|
||||
|
||||
|
||||
def validate_output_destination(args: argparse.Namespace) -> None:
|
||||
suffix = args.split
|
||||
if args.ids:
|
||||
suffix += '_selected'
|
||||
elif args.max_questions:
|
||||
suffix += f'_first{args.max_questions}'
|
||||
if not args.overwrite:
|
||||
for extension in ('json', 'csv'):
|
||||
path = args.output_dir / f'graphrag_{suffix}.{extension}'
|
||||
if path.exists():
|
||||
raise RuntimeError(f'Results already exist; use a fresh output directory: {path}')
|
||||
elif (any(part.startswith(('final_', 'archive_')) for part in args.output_dir.parts)
|
||||
or any((args.output_dir / name).exists() for name in ('REPORT.md', 'summary.json', 'freeze.json'))):
|
||||
raise RuntimeError('Archived/final results are immutable; choose a fresh DEV directory.')
|
||||
|
||||
|
||||
def main() -> None:
|
||||
args = parse_args()
|
||||
validate_output_destination(args)
|
||||
metadata = run_metadata(args.questions)
|
||||
audit = json.loads(args.audit.read_text()) if args.audit else None
|
||||
if audit and (audit['dataset_sha256'] != metadata['fingerprints']['dataset_sha256']
|
||||
or audit['inputs'] != metadata['fingerprints']['inputs']):
|
||||
raise RuntimeError('Source audit does not match current benchmark and inputs.')
|
||||
if audit and audit.get('source_corpus') is not None and (
|
||||
audit['source_corpus'] != metadata['fingerprints']['source_corpus']):
|
||||
raise RuntimeError('Independent source audit does not match original Markdown.')
|
||||
|
||||
all_questions = load_questions(
|
||||
args.questions
|
||||
)
|
||||
source_oracle = load_source_oracle()
|
||||
|
||||
ids = {
|
||||
value.strip()
|
||||
for value in args.ids.split(
|
||||
","
|
||||
)
|
||||
if value.strip()
|
||||
}
|
||||
|
||||
questions = filter_questions(
|
||||
all_questions,
|
||||
split=args.split,
|
||||
ids=(
|
||||
ids
|
||||
if ids
|
||||
else None
|
||||
),
|
||||
max_questions=(
|
||||
args.max_questions
|
||||
),
|
||||
)
|
||||
|
||||
if not questions:
|
||||
raise RuntimeError(
|
||||
"Pre zadaný výber sa nenašli otázky."
|
||||
)
|
||||
|
||||
print()
|
||||
print(
|
||||
"GraphRAG dataset"
|
||||
)
|
||||
|
||||
print(
|
||||
"=" * 60
|
||||
)
|
||||
|
||||
print(
|
||||
f"File: {args.questions}"
|
||||
)
|
||||
|
||||
print(
|
||||
f"Total: {len(all_questions)}"
|
||||
)
|
||||
|
||||
print(
|
||||
f"Split: {args.split}"
|
||||
)
|
||||
|
||||
print(
|
||||
f"Selected: {len(questions)}"
|
||||
)
|
||||
|
||||
print(
|
||||
f"Limit: {args.limit}"
|
||||
)
|
||||
|
||||
print(
|
||||
f"Entities: {args.max_entities}"
|
||||
)
|
||||
|
||||
print(
|
||||
"=" * 60
|
||||
)
|
||||
|
||||
settings = (
|
||||
get_neo4j_settings()
|
||||
)
|
||||
|
||||
rows: list[
|
||||
dict[str, Any]
|
||||
] = []
|
||||
|
||||
with create_neo4j_driver(
|
||||
settings
|
||||
) as driver:
|
||||
driver.verify_connectivity()
|
||||
|
||||
with driver.session(
|
||||
database=settings.database
|
||||
) as session:
|
||||
metadata['graph'] = graph_fingerprint(session)
|
||||
if args.freeze_manifest:
|
||||
verify_freeze(json.loads(args.freeze_manifest.read_text()), metadata, metadata['graph'],
|
||||
limit=args.limit, max_entities=args.max_entities, audit=args.audit)
|
||||
total = len(
|
||||
questions
|
||||
)
|
||||
|
||||
for index, question in enumerate(
|
||||
questions,
|
||||
start=1,
|
||||
):
|
||||
question_id = str(
|
||||
question[
|
||||
"id"
|
||||
]
|
||||
)
|
||||
|
||||
print(
|
||||
f"[{index:04d}/{total:04d}] "
|
||||
f"{question_id}: "
|
||||
f"{question['question']}"
|
||||
)
|
||||
|
||||
started = (
|
||||
time.perf_counter()
|
||||
)
|
||||
|
||||
error = None
|
||||
|
||||
try:
|
||||
result = (
|
||||
search_graph_with_session(
|
||||
session,
|
||||
str(
|
||||
question[
|
||||
"question"
|
||||
]
|
||||
),
|
||||
limit=args.limit,
|
||||
max_entities=(
|
||||
args.max_entities
|
||||
),
|
||||
)
|
||||
)
|
||||
|
||||
except Exception as exc:
|
||||
result = {
|
||||
"strategies": [],
|
||||
"resolved_entities": [],
|
||||
"paths": [],
|
||||
"facts": [],
|
||||
"documents": [],
|
||||
}
|
||||
|
||||
error = (
|
||||
f"{type(exc).__name__}: "
|
||||
f"{exc}"
|
||||
)
|
||||
|
||||
latency = (
|
||||
time.perf_counter()
|
||||
- started
|
||||
)
|
||||
|
||||
row = evaluate_result(
|
||||
question,
|
||||
result,
|
||||
latency_seconds=(
|
||||
latency
|
||||
),
|
||||
error=error,
|
||||
source_oracle=source_oracle,
|
||||
)
|
||||
|
||||
rows.append(
|
||||
row
|
||||
)
|
||||
|
||||
state = (
|
||||
"OK"
|
||||
if row["strict"]
|
||||
else "FAIL"
|
||||
)
|
||||
|
||||
print(
|
||||
f" {state} | "
|
||||
f"value={row['value_score']:.2f} "
|
||||
f"entity={row['entity_score']:.2f} "
|
||||
f"rel={row['relation_score']:.2f} "
|
||||
f"doc={row['document_recall']:.2f} "
|
||||
f"{row['latency_seconds']:.4f}s"
|
||||
)
|
||||
|
||||
if graph_fingerprint(session) != metadata['graph']:
|
||||
raise RuntimeError('Graph changed during evaluation; results discarded.')
|
||||
|
||||
if run_metadata(args.questions)['fingerprints'] != metadata['fingerprints']:
|
||||
raise RuntimeError('Code or input data changed during evaluation; results discarded.')
|
||||
metadata['completed_at_utc'] = datetime.now(timezone.utc).isoformat()
|
||||
if args.freeze_manifest:
|
||||
metadata['freeze_sha256'] = sha256_file(args.freeze_manifest)
|
||||
if args.audit:
|
||||
metadata['audit_sha256'] = sha256_file(args.audit)
|
||||
|
||||
summary = aggregate_rows(
|
||||
rows
|
||||
)
|
||||
|
||||
by_category = aggregate_by_field(
|
||||
rows,
|
||||
"category",
|
||||
)
|
||||
|
||||
by_difficulty = (
|
||||
aggregate_by_field(
|
||||
rows,
|
||||
"difficulty",
|
||||
)
|
||||
)
|
||||
|
||||
payload = {
|
||||
'evaluation_schema_version': 4,
|
||||
'run_metadata': metadata,
|
||||
"configuration": {
|
||||
'evaluation_kind': (json.loads(args.freeze_manifest.read_text()).get('evaluation_kind', 'independent_holdout')
|
||||
if args.freeze_manifest else 'development_regression'),
|
||||
'published_only': True,
|
||||
"questions_file": str(
|
||||
args.questions
|
||||
),
|
||||
"split": args.split,
|
||||
"dataset_question_count": len(
|
||||
all_questions
|
||||
),
|
||||
"selected_question_count": len(
|
||||
questions
|
||||
),
|
||||
"limit": args.limit,
|
||||
"max_entities": (
|
||||
args.max_entities
|
||||
),
|
||||
"ids": sorted(
|
||||
ids
|
||||
),
|
||||
"max_questions": (
|
||||
args.max_questions
|
||||
),
|
||||
},
|
||||
"summary": summary,
|
||||
"by_category": by_category,
|
||||
"by_difficulty": (
|
||||
by_difficulty
|
||||
),
|
||||
"questions": rows,
|
||||
}
|
||||
if audit:
|
||||
consistent_ids = {row['id'] for row in audit['questions'] if row['source_consistent']}
|
||||
consistent = [row for row in rows if row['id'] in consistent_ids]
|
||||
payload['source_consistent_summary'] = aggregate_rows(consistent)
|
||||
payload['source_consistent_by_category'] = aggregate_by_field(consistent, 'category')
|
||||
payload['source_inconsistent_ids'] = [row['id'] for row in rows if row['id'] not in consistent_ids]
|
||||
|
||||
suffix = args.split
|
||||
|
||||
if ids:
|
||||
suffix += "_selected"
|
||||
|
||||
elif args.max_questions:
|
||||
suffix += (
|
||||
f"_first"
|
||||
f"{args.max_questions}"
|
||||
)
|
||||
|
||||
json_path = (
|
||||
args.output_dir
|
||||
/ f"graphrag_{suffix}.json"
|
||||
)
|
||||
|
||||
csv_path = (
|
||||
args.output_dir
|
||||
/ f"graphrag_{suffix}.csv"
|
||||
)
|
||||
|
||||
save_json(
|
||||
json_path,
|
||||
payload,
|
||||
)
|
||||
|
||||
save_csv(
|
||||
csv_path,
|
||||
rows,
|
||||
)
|
||||
|
||||
print_summary(
|
||||
summary,
|
||||
split=args.split,
|
||||
)
|
||||
if audit:
|
||||
print_summary(payload['source_consistent_summary'],
|
||||
split=f'{args.split} — source-consistent subset (supplementary)')
|
||||
print(f"Source-inconsistent annotations: {len(payload['source_inconsistent_ids'])}; "
|
||||
'included in the primary score above.')
|
||||
|
||||
print()
|
||||
print(
|
||||
f"JSON: {json_path}"
|
||||
)
|
||||
|
||||
print(
|
||||
f"CSV: {csv_path}"
|
||||
)
|
||||
|
||||
|
||||
if __name__ == "__main__":
|
||||
main()
|
||||
370
tools/graphrag/evaluation/evidence_contract.py
Normal file
370
tools/graphrag/evaluation/evidence_contract.py
Normal file
@ -0,0 +1,370 @@
|
||||
"""Connected, typed evidence checks shared by GraphRAG evaluation versions.
|
||||
|
||||
Facts are structured records emitted by fixed Cypher queries. They are expanded
|
||||
into the very paths those query contracts establish; query text, resolved aliases
|
||||
and context-only documents never create edges. Ordered paths must have compatible
|
||||
endpoint types. Bindings are satisfied by one connected witness, not a bag of
|
||||
independently occurring values.
|
||||
"""
|
||||
from __future__ import annotations
|
||||
|
||||
import itertools
|
||||
import re
|
||||
import unicodedata
|
||||
from collections import defaultdict
|
||||
from typing import Any
|
||||
|
||||
|
||||
RELATION_ENDPOINTS = {
|
||||
'AUTHORED': ('Person', 'Thesis'),
|
||||
'HAS_WORK': ('Person', 'Work'),
|
||||
'HAS_DOCUMENT': ('Person', 'Document'),
|
||||
'EVIDENCED_BY': ('Academic', 'Document'),
|
||||
'HAS_KEYWORD': ('Document', 'Keyword'),
|
||||
'IN_CATEGORY': ('Document', 'Category'),
|
||||
'AUTHORED_DOCUMENT': ('DocumentAuthor', 'Document'),
|
||||
'DESCRIBES': ('Document', 'Topic'),
|
||||
}
|
||||
|
||||
|
||||
def canonical(value: Any) -> str:
|
||||
raw = unicodedata.normalize('NFKD', str(value if value is not None else ''))
|
||||
return re.sub(r'\s+', ' ', re.sub(r'[^a-z0-9]+', ' ', ''.join(
|
||||
character for character in raw.casefold() if not unicodedata.combining(character)))).strip()
|
||||
|
||||
|
||||
def kind_matches(actual: str, expected: str) -> bool:
|
||||
return actual in {'Thesis', 'Work'} if expected in {'Academic', 'Thesis|Work'} else actual in expected.split('|')
|
||||
|
||||
|
||||
class EvidenceGraph:
|
||||
def __init__(self, result: dict[str, Any]):
|
||||
self.nodes: dict[tuple[str, str], dict] = {}
|
||||
self.conflicts: set[tuple[str, str]] = set()
|
||||
self.adjacency: dict[tuple[str, str], set[tuple[str, tuple[str, str]]]] = defaultdict(set)
|
||||
for path in result.get('paths', []):
|
||||
if not isinstance(path, dict):
|
||||
continue
|
||||
nodes, relationships = path.get('nodes', []), path.get('relationships', [])
|
||||
if not isinstance(nodes, list) or len(relationships) != max(0, len(nodes) - 1):
|
||||
continue
|
||||
keys = [self.node(row.get('kind', ''), row) for row in nodes if isinstance(row, dict)]
|
||||
if len(keys) != len(nodes):
|
||||
continue
|
||||
for left, relation, right in zip(keys, relationships, keys[1:]):
|
||||
self.edge(left, relation, right)
|
||||
for fact in result.get('facts', []):
|
||||
if isinstance(fact, dict):
|
||||
self.add_fact(fact)
|
||||
|
||||
def node(self, kind: str, properties: dict) -> tuple[str, str]:
|
||||
properties = {key: value for key, value in properties.items() if value is not None}
|
||||
if kind == 'Document':
|
||||
identity = properties.get('path') or properties.get('document_path')
|
||||
else:
|
||||
identity = properties.get('element_id') or properties.get('id')
|
||||
if not identity:
|
||||
if kind in {'Thesis', 'Work'}:
|
||||
identity = repr((properties.get('person'), properties.get('title'),
|
||||
properties.get('year'), properties.get('document_path')))
|
||||
else:
|
||||
identity = canonical(properties.get('name'))
|
||||
key = (kind, str(identity))
|
||||
current = self.nodes.setdefault(key, {'kind': kind})
|
||||
for field in {'name', 'title', 'year', 'start_year', 'thesis_type', 'work_type', 'path', 'source_url'}:
|
||||
if field in current and field in properties and canonical(current[field]) != canonical(properties[field]):
|
||||
self.conflicts.add(key)
|
||||
for field, value in properties.items():
|
||||
current.setdefault(field, value)
|
||||
return key
|
||||
|
||||
def edge(self, left: tuple[str, str], relation: str, right: tuple[str, str]) -> None:
|
||||
expected = RELATION_ENDPOINTS.get(relation)
|
||||
if expected is None:
|
||||
return
|
||||
if kind_matches(left[0], expected[0]) and kind_matches(right[0], expected[1]):
|
||||
pass
|
||||
elif kind_matches(right[0], expected[0]) and kind_matches(left[0], expected[1]):
|
||||
left, right = right, left
|
||||
else:
|
||||
return
|
||||
self.adjacency[left].add((relation, right))
|
||||
self.adjacency[right].add((relation, left))
|
||||
|
||||
def neighbors(self, key: tuple[str, str], relation: str, kind: str) -> list[tuple[str, str]]:
|
||||
return [target for edge, target in self.adjacency.get(key, ())
|
||||
if key not in self.conflicts and target not in self.conflicts
|
||||
and edge in relation.split('|') and kind_matches(target[0], kind)]
|
||||
|
||||
def add_fact(self, fact: dict) -> None:
|
||||
kind = fact.get('fact_type')
|
||||
if kind in {'shared_keyword', 'shared_category', 'shared_document_author'}:
|
||||
singular = {'shared_keyword': 'person_keyword', 'shared_category': 'person_category',
|
||||
'shared_document_author': 'person_document_author'}[kind]
|
||||
for side in ('left', 'right'):
|
||||
self.add_fact({**fact, 'fact_type': singular, 'person': fact.get(side + '_person'),
|
||||
'person_element_id': fact.get(side + '_person_element_id'),
|
||||
'document_path': fact.get(side + '_document_path'),
|
||||
'source_url': fact.get(side + '_source_url')})
|
||||
return
|
||||
if kind not in {'person_thesis', 'person_work', 'person_start_year', 'person_keyword',
|
||||
'person_category', 'person_document_author'} or not fact.get('person'):
|
||||
return
|
||||
person = self.node('Person', {'name': fact['person'], 'element_id': fact.get('person_element_id'),
|
||||
'start_year': fact.get('start_year') if kind == 'person_start_year' else None})
|
||||
path = fact.get('document_path')
|
||||
document = self.node('Document', {'path': path, 'source_url': fact.get('source_url')}) if path else None
|
||||
if kind in {'person_thesis', 'person_work'}:
|
||||
academic_kind = 'Thesis' if kind == 'person_thesis' else 'Work'
|
||||
prefix = 'thesis' if academic_kind == 'Thesis' else 'work'
|
||||
academic = self.node(academic_kind, {
|
||||
'element_id': fact.get(prefix + '_element_id'), 'id': fact.get(prefix + '_id'),
|
||||
'person': fact['person'], 'document_path': path, 'title': fact.get('title'),
|
||||
'year': fact.get('year'), prefix + '_type': fact.get(prefix + '_type')})
|
||||
self.edge(person, 'AUTHORED' if academic_kind == 'Thesis' else 'HAS_WORK', academic)
|
||||
if document:
|
||||
self.edge(academic, 'EVIDENCED_BY', document)
|
||||
elif document:
|
||||
self.edge(person, 'HAS_DOCUMENT', document)
|
||||
if kind == 'person_keyword' and fact.get('keyword'):
|
||||
target = self.node('Keyword', {'name': fact['keyword'], 'id': fact.get('keyword_id'),
|
||||
'element_id': fact.get('keyword_element_id')})
|
||||
self.edge(document, 'HAS_KEYWORD', target)
|
||||
elif kind == 'person_category' and fact.get('category'):
|
||||
target = self.node('Category', {'name': fact['category'],
|
||||
'element_id': fact.get('category_element_id')})
|
||||
self.edge(document, 'IN_CATEGORY', target)
|
||||
elif kind == 'person_document_author' and fact.get('document_author'):
|
||||
target = self.node('DocumentAuthor', {'name': fact['document_author'],
|
||||
'id': fact.get('document_author_id'), 'element_id': fact.get('document_author_element_id')})
|
||||
self.edge(target, 'AUTHORED_DOCUMENT', document)
|
||||
if fact.get('category'):
|
||||
category = self.node('Category', {'name': fact['category'],
|
||||
'element_id': fact.get('category_element_id')})
|
||||
self.edge(document, 'IN_CATEGORY', category)
|
||||
|
||||
def metadata_choices(self, person: tuple[str, str], binding: dict, field: str,
|
||||
relation: str, kind: str) -> list[tuple[Any, Any]]:
|
||||
if field not in binding:
|
||||
return [(None, None)]
|
||||
return [(document, node)
|
||||
for document in self.neighbors(person, 'HAS_DOCUMENT', 'Document')
|
||||
for node in self.neighbors(document, relation, kind)
|
||||
if canonical(self.nodes[node].get('name')) == canonical(binding[field])]
|
||||
|
||||
def witnesses(self, binding: dict, *, require_provenance: bool) -> list[dict]:
|
||||
people = [key for key, row in self.nodes.items() if key[0] == 'Person' and key not in self.conflicts
|
||||
and ('person' not in binding or canonical(row.get('name')) == canonical(binding['person']))]
|
||||
academic_required = any(field in binding for field in ['academic_kind', 'academic_type', 'title', 'year'])
|
||||
witnesses = []
|
||||
for person in people:
|
||||
if 'start_year' in binding and canonical(self.nodes[person].get('start_year')) != canonical(binding['start_year']):
|
||||
continue
|
||||
academics = []
|
||||
if academic_required:
|
||||
for relation, kind in [('AUTHORED', 'Thesis'), ('HAS_WORK', 'Work')]:
|
||||
for academic in self.neighbors(person, relation, kind):
|
||||
row = self.nodes[academic]
|
||||
if 'academic_kind' in binding and not kind_matches(kind, binding['academic_kind']):
|
||||
continue
|
||||
if any(canonical(row.get(field)) != canonical(binding[field])
|
||||
for field in ['title', 'year'] if field in binding):
|
||||
continue
|
||||
type_field = 'thesis_type' if kind == 'Thesis' else 'work_type'
|
||||
if 'academic_type' in binding and canonical(row.get(type_field)) != canonical(binding['academic_type']):
|
||||
continue
|
||||
docs = self.neighbors(academic, 'EVIDENCED_BY', 'Document')
|
||||
academics.extend((academic, doc) for doc in docs)
|
||||
if not docs and not require_provenance:
|
||||
academics.append((academic, None))
|
||||
else:
|
||||
academics = [(None, None)]
|
||||
choices = [self.metadata_choices(person, binding, *arguments) for arguments in [
|
||||
('keyword', 'HAS_KEYWORD', 'Keyword'), ('category', 'IN_CATEGORY', 'Category'),
|
||||
('document_author', 'AUTHORED_DOCUMENT', 'DocumentAuthor')]]
|
||||
person_docs = self.neighbors(person, 'HAS_DOCUMENT', 'Document') if (
|
||||
require_provenance and ('start_year' in binding or not academic_required
|
||||
and not any(field in binding for field in ['keyword', 'category', 'document_author']))
|
||||
) else [None]
|
||||
for (academic, academic_document), keyword, category, author, person_document in itertools.product(academics, *choices, person_docs):
|
||||
docs = [doc for doc in [academic_document, keyword[0], category[0], author[0], person_document] if doc]
|
||||
if binding.get('same_document') and len(set(docs)) > 1:
|
||||
continue
|
||||
if category[0] and author[0] and category[0] != author[0]:
|
||||
continue
|
||||
if 'document_path' in binding and any(
|
||||
self.nodes[doc].get('path') != binding['document_path'] for doc in docs
|
||||
):
|
||||
continue
|
||||
witnesses.append({'person': person, 'academic': academic, 'academic_document': academic_document,
|
||||
'person_document': person_document,
|
||||
'keyword': keyword[1], 'keyword_document': keyword[0],
|
||||
'category': category[1], 'category_document': category[0],
|
||||
'document_author': author[1], 'author_document': author[0]})
|
||||
return witnesses
|
||||
|
||||
def pattern_path(self, witness: dict, pattern: dict) -> list[dict] | None:
|
||||
kinds, relations = pattern.get('node_kinds', []), pattern.get('relationships', [])
|
||||
if not kinds or len(relations) != len(kinds) - 1 or not kind_matches('Person', kinds[0]):
|
||||
return None
|
||||
target_roles = {'Keyword': 'keyword', 'Category': 'category', 'DocumentAuthor': 'document_author',
|
||||
'Thesis': 'academic', 'Work': 'academic', 'Academic': 'academic', 'Thesis|Work': 'academic'}
|
||||
allowed = {key for key in witness.values() if key is not None}
|
||||
required_target = witness.get(target_roles.get(kinds[-1], ''))
|
||||
|
||||
def visit(key, index, path):
|
||||
if index == len(relations):
|
||||
return path if required_target is None or key == required_target else None
|
||||
for next_key in self.neighbors(key, relations[index], kinds[index + 1]):
|
||||
if next_key not in allowed:
|
||||
continue
|
||||
result = visit(next_key, index + 1, path + [next_key])
|
||||
if result:
|
||||
return result
|
||||
return None
|
||||
|
||||
found = visit(witness['person'], 0, [witness['person']])
|
||||
return [self.nodes[key] for key in found] if found else None
|
||||
|
||||
|
||||
def implicit_patterns(binding: dict, index: int) -> list[dict]:
|
||||
patterns = []
|
||||
if 'start_year' in binding or not any(field in binding for field in [
|
||||
'academic_kind', 'academic_type', 'title', 'year', 'keyword', 'category', 'document_author'
|
||||
]):
|
||||
patterns.append({'binding_index': index, 'node_kinds': ['Person', 'Document'],
|
||||
'relationships': ['HAS_DOCUMENT']})
|
||||
if any(field in binding for field in ['academic_kind', 'academic_type', 'title', 'year']):
|
||||
kind = binding.get('academic_kind', 'Academic')
|
||||
relationships = ['AUTHORED'] if kind == 'Thesis' else ['HAS_WORK'] if kind == 'Work' else ['AUTHORED|HAS_WORK']
|
||||
patterns.append({'binding_index': index, 'node_kinds': ['Person', kind, 'Document'],
|
||||
'relationships': relationships + ['EVIDENCED_BY']})
|
||||
for field, kind, relation in [('keyword', 'Keyword', 'HAS_KEYWORD'),
|
||||
('category', 'Category', 'IN_CATEGORY'),
|
||||
('document_author', 'DocumentAuthor', 'AUTHORED_DOCUMENT')]:
|
||||
if field in binding:
|
||||
patterns.append({'binding_index': index, 'node_kinds': ['Person', 'Document', kind],
|
||||
'relationships': ['HAS_DOCUMENT', relation]})
|
||||
return patterns
|
||||
|
||||
|
||||
def legacy_bindings(question: dict) -> list[dict]:
|
||||
"""Best-effort semantic conversion of schema2 annotations, never result data."""
|
||||
graph = question.get('graph', {})
|
||||
entities = defaultdict(list)
|
||||
for row in graph.get('expected_entities', []):
|
||||
entities[row.get('type')].append(row.get('value'))
|
||||
people = entities['person'] or [row['value'] for row in graph.get('start_entities', []) if row['type'] == 'person']
|
||||
people = people or [None]
|
||||
years = entities['year']
|
||||
properties = graph.get('expected_properties', [])
|
||||
start_year = any(prop == 'Person.start_year' for prop in properties)
|
||||
if not years and any('.year' in prop for prop in properties) and not start_year:
|
||||
years = re.findall(r'\b20\d{2}\b', question.get('question', ''))
|
||||
bindings = []
|
||||
for person in people:
|
||||
common = {'person': person} if person else {}
|
||||
if len(years) == 1:
|
||||
common['start_year' if start_year else 'year'] = years[0]
|
||||
for field, entity_type in [('keyword', 'keyword'), ('category', 'category'), ('document_author', 'document_author')]:
|
||||
if len(entities[entity_type]) == 1:
|
||||
common[field] = entities[entity_type][0]
|
||||
titles = [('Thesis', value) for value in entities['thesis_title']] + [('Work', value) for value in entities['work_title']]
|
||||
if titles:
|
||||
bindings.extend({**common, 'academic_kind': kind, 'title': title} for kind, title in titles)
|
||||
elif len(entities['category']) > 1:
|
||||
bindings.extend({**common, 'category': value} for value in entities['category'])
|
||||
elif any(key != 'person' for key in common):
|
||||
bindings.append(common)
|
||||
return bindings
|
||||
|
||||
|
||||
def positive_answer_facts(result: dict) -> list[dict]:
|
||||
facts = []
|
||||
for row in result.get('facts', []):
|
||||
if not isinstance(row, dict):
|
||||
facts.append(row)
|
||||
continue
|
||||
kind = row.get('fact_type', '')
|
||||
if kind == 'academic_year_comparison' and row.get('same_academic_year') is False and not row.get('shared_years'):
|
||||
continue
|
||||
if kind == 'start_year_comparison' and row.get('same_start_year') is False and row.get('shared_start_year') is None:
|
||||
continue
|
||||
facts.append(row)
|
||||
return facts
|
||||
|
||||
|
||||
def evaluate_contract(question: dict, result: dict) -> dict:
|
||||
graph = question.get('graph', {})
|
||||
schema = graph.get('schema_version', 2)
|
||||
negative = bool(graph.get('expected_no_answer') or question.get('should_answer') is False)
|
||||
expected_status = graph.get('expected_status')
|
||||
if negative:
|
||||
status = result.get('status')
|
||||
no_positive = not positive_answer_facts(result) and not result.get('paths')
|
||||
aggregation = result.get('aggregation') or {}
|
||||
if schema >= 3 and expected_status is None:
|
||||
expected_status = 'no_answer'
|
||||
status_ok = status == expected_status if expected_status else status in {'no_answer', 'ambiguous'}
|
||||
reason = result.get('reason')
|
||||
ok = bool(status_ok and isinstance(reason, str) and reason.strip()
|
||||
and no_positive and not aggregation.get('count'))
|
||||
return {'answerability_ok': ok, 'bindings_ok': True, 'binding_score': 1.0,
|
||||
'paths_ok': True, 'path_score': 1.0, 'binding_results': [], 'path_results': [],
|
||||
'expected_no_answer': True, 'actual_status': status}
|
||||
status_ok = (result.get('status') == 'ok' if schema >= 3
|
||||
else result.get('status') not in {'no_answer', 'ambiguous', 'error'})
|
||||
bindings = graph.get('expected_bindings')
|
||||
if bindings is None:
|
||||
bindings = legacy_bindings(question)
|
||||
empty_count_answer = (graph.get('expected_count') == 0 and graph.get('expected_entity_set') == []
|
||||
and (result.get('aggregation') or {}).get('count') == 0
|
||||
and (result.get('aggregation') or {}).get('complete') is True)
|
||||
if schema >= 3 and not bindings and not empty_count_answer:
|
||||
status_ok = False
|
||||
evidence = EvidenceGraph(result)
|
||||
explicit_patterns = graph.get('expected_path_patterns', [])
|
||||
source_choices = graph.get('expected_evidence_documents', [])
|
||||
binding_results, path_results = [], []
|
||||
for index, binding in enumerate(bindings):
|
||||
candidates = evidence.witnesses(binding, require_provenance=schema >= 3)
|
||||
patterns = [p for p in explicit_patterns if p.get('binding_index') == index]
|
||||
if not patterns and schema >= 3:
|
||||
patterns = implicit_patterns(binding, index)
|
||||
winner = None
|
||||
for candidate in candidates:
|
||||
checks = [evidence.pattern_path(candidate, pattern) for pattern in patterns]
|
||||
source_ok = True
|
||||
for choice in source_choices:
|
||||
if choice.get('binding_index') != index:
|
||||
continue
|
||||
document = evidence.nodes.get(candidate.get(choice.get('role')), {})
|
||||
if not any(document.get('path') == option.get('document_path')
|
||||
and document.get('source_url') == option.get('source_url')
|
||||
for option in choice.get('any_of', [])):
|
||||
source_ok = False
|
||||
break
|
||||
if source_ok and all(check is not None for check in checks):
|
||||
winner = checks
|
||||
break
|
||||
binding_results.append({'binding': binding, 'matched': bool(candidates) and winner is not None})
|
||||
for pattern_index, pattern in enumerate(patterns):
|
||||
path_results.append({'pattern': pattern, 'matched': winner is not None,
|
||||
'witness': winner[pattern_index] if winner is not None else []})
|
||||
bindings_ok = all(row['matched'] for row in binding_results)
|
||||
paths_ok = all(row['matched'] for row in path_results)
|
||||
# A malformed pattern referencing a nonexistent binding must not vanish.
|
||||
if any(not isinstance(p.get('binding_index'), int) or p['binding_index'] not in range(len(bindings))
|
||||
for p in explicit_patterns):
|
||||
paths_ok = False
|
||||
if any(not isinstance(p.get('binding_index'), int) or p['binding_index'] not in range(len(bindings))
|
||||
or p.get('role') not in {'academic_document', 'keyword_document', 'category_document',
|
||||
'author_document', 'person_document'} or not p.get('any_of')
|
||||
for p in source_choices):
|
||||
bindings_ok = False
|
||||
return {'answerability_ok': status_ok, 'bindings_ok': bindings_ok,
|
||||
'binding_score': sum(row['matched'] for row in binding_results) / len(binding_results) if binding_results else 1.0,
|
||||
'paths_ok': paths_ok,
|
||||
'path_score': sum(row['matched'] for row in path_results) / len(path_results) if path_results else float(paths_ok),
|
||||
'binding_results': binding_results, 'path_results': path_results,
|
||||
'expected_no_answer': False, 'actual_status': result.get('status', 'ok')}
|
||||
110
tools/graphrag/evaluation/freeze_graphrag.py
Normal file
110
tools/graphrag/evaluation/freeze_graphrag.py
Normal file
@ -0,0 +1,110 @@
|
||||
"""Freeze the exact code, data, graph and parameters after complete DEV evaluation."""
|
||||
from __future__ import annotations
|
||||
|
||||
import argparse
|
||||
import json
|
||||
from datetime import datetime, timezone
|
||||
from pathlib import Path
|
||||
|
||||
from .reproducibility import content_fingerprints, sha256_file
|
||||
|
||||
|
||||
def make_freeze(dev: dict, questions: list[dict], fingerprints: dict, audit: dict,
|
||||
*, purpose: str = 'independent_holdout') -> dict:
|
||||
if purpose not in {'independent_holdout','historical_regression'}:
|
||||
raise ValueError('Unknown evaluation purpose.')
|
||||
expected_ids = {q['id'] for q in questions if q['split'] == 'dev'}
|
||||
actual_ids = [row['id'] for row in dev['questions']]
|
||||
if dev['configuration']['split'] != 'dev' or set(actual_ids) != expected_ids or len(actual_ids) != len(expected_ids):
|
||||
raise RuntimeError('Freeze requires the complete DEV split, without duplicates.')
|
||||
if dev['summary']['error_count'] or any(row.get('error') for row in dev['questions']):
|
||||
raise RuntimeError('Freeze requires DEV without runtime errors.')
|
||||
if dev['run_metadata']['fingerprints'] != fingerprints:
|
||||
raise RuntimeError('Code or data changed after DEV; rerun DEV before freezing.')
|
||||
if fingerprints.get('retrieval_policy') and any(
|
||||
row.get('source_checked') is not True or row.get('all_facts_supported') is not True
|
||||
for row in dev['questions']):
|
||||
raise RuntimeError('Every DEV result must pass independent validation of all returned facts.')
|
||||
if audit['dataset_sha256'] != fingerprints['dataset_sha256'] or audit['inputs'] != fingerprints['inputs']:
|
||||
raise RuntimeError('Source audit does not match the benchmark and inputs.')
|
||||
if len(audit['questions']) != len(questions) or {r['id'] for r in audit['questions']} != {q['id'] for q in questions}:
|
||||
raise RuntimeError('Source audit must cover every question exactly once.')
|
||||
schema3 = any(question.get('graph', {}).get('schema_version') == 3 for question in questions)
|
||||
partition = None
|
||||
if schema3:
|
||||
if audit.get('source_corpus') != fingerprints.get('source_corpus'):
|
||||
raise RuntimeError('Independent audit does not match original Markdown sources.')
|
||||
if any(not row.get('source_consistent') for row in audit['questions']):
|
||||
raise RuntimeError('Resolve source-inconsistent annotations before freezing v2.')
|
||||
profiles = {split: {profile for question in questions if question['split'] == split
|
||||
for profile in question.get('graph', {}).get('source_profiles', [])}
|
||||
for split in ('dev', 'test')}
|
||||
policy = audit.get('partition_policy', {})
|
||||
if purpose == 'historical_regression':
|
||||
partition = {'method': 'Previously exposed questions; regression, not independent TEST',
|
||||
'dev_profile_count': len(profiles['dev']),
|
||||
'test_profile_count': len(profiles['test']),
|
||||
'source_profile_overlap': len(profiles['dev'] & profiles['test'])}
|
||||
elif policy.get('method') == 'disjoint logical query groups':
|
||||
# This mode explicitly reports known profiles. It must never be
|
||||
# presented as the stronger, historic unseen-profile experiment.
|
||||
from .benchmark_v4 import logical_group
|
||||
from .source_oracle import norm
|
||||
groups = {split: {logical_group(q) for q in questions if q['split'] == split}
|
||||
for split in ('dev', 'test')}
|
||||
if any(q['graph'].get('partition_group') != logical_group(q) for q in questions):
|
||||
raise RuntimeError('Declared logical group does not match the question constraints.')
|
||||
if not groups['dev'] or not groups['test'] or groups['dev'] & groups['test']:
|
||||
raise RuntimeError('DEV/TEST logical groups overlap or are missing.')
|
||||
exposed = set(policy.get('previously_exposed_groups', []))
|
||||
if not exposed or groups['test'] & exposed:
|
||||
raise RuntimeError('TEST contains previously exposed logical groups.')
|
||||
texts = {split: {norm(q['question']) for q in questions if q['split'] == split}
|
||||
for split in ('dev', 'test')}
|
||||
if texts['dev'] & texts['test']:
|
||||
raise RuntimeError('DEV/TEST question texts overlap.')
|
||||
partition = {'method': policy['method'], 'logical_group_overlap': 0,
|
||||
'previously_exposed_test_groups': 0,
|
||||
'dev_group_count': len(groups['dev']), 'test_group_count': len(groups['test']),
|
||||
'dev_profile_count': len(profiles['dev']), 'test_profile_count': len(profiles['test']),
|
||||
'source_profile_overlap': len(profiles['dev'] & profiles['test']),
|
||||
'limitations': policy['limitations']}
|
||||
elif profiles['dev'] & profiles['test']:
|
||||
raise RuntimeError('DEV/TEST source profiles overlap; independent holdout refused.')
|
||||
if not profiles['dev'] or not profiles['test']:
|
||||
raise RuntimeError('Primary v2 freeze requires declared DEV and TEST source profiles.')
|
||||
if partition is None:
|
||||
partition = {'method': 'disjoint source profiles',
|
||||
'dev_profile_count': len(profiles['dev']),
|
||||
'test_profile_count': len(profiles['test']), 'overlap': 0}
|
||||
return {'schema_version': 2 if schema3 else 1, 'evaluation_kind':purpose,
|
||||
'partition': partition, 'frozen_at_utc': datetime.now(timezone.utc).isoformat(),
|
||||
'fingerprints': fingerprints, 'graph': dev['run_metadata']['graph'],
|
||||
'parameters': {key: dev['configuration'][key] for key in ['limit', 'max_entities']},
|
||||
'dev_summary': dev['summary'], 'source_audit_summary': audit['by_split'],
|
||||
'policy': 'Report all questions including negatives. No exclusions or holdout tuning.'}
|
||||
|
||||
|
||||
def main() -> None:
|
||||
parser = argparse.ArgumentParser(description=__doc__)
|
||||
parser.add_argument('--dev-results', type=Path, required=True)
|
||||
parser.add_argument('--questions', type=Path, required=True)
|
||||
parser.add_argument('--audit', type=Path, required=True)
|
||||
parser.add_argument('--output', type=Path, required=True)
|
||||
parser.add_argument('--purpose', choices=['independent_holdout','historical_regression'],
|
||||
default='independent_holdout')
|
||||
args = parser.parse_args()
|
||||
if args.output.exists():
|
||||
parser.error('Freeze manifest already exists; choose a new version/output path.')
|
||||
manifest = make_freeze(json.loads(args.dev_results.read_text()), json.loads(args.questions.read_text()),
|
||||
content_fingerprints(args.questions), json.loads(args.audit.read_text()), purpose=args.purpose)
|
||||
manifest.update({'dev_results_sha256': sha256_file(args.dev_results),
|
||||
'audit_sha256': sha256_file(args.audit)})
|
||||
args.output.parent.mkdir(parents=True, exist_ok=True)
|
||||
with args.output.open('x', encoding='utf-8') as output:
|
||||
output.write(json.dumps(manifest, ensure_ascii=False, indent=2) + '\n')
|
||||
print(f'Frozen GraphRAG: {args.output}')
|
||||
|
||||
|
||||
if __name__ == '__main__':
|
||||
main()
|
||||
134
tools/graphrag/evaluation/frozen_release_v6.json
Normal file
134
tools/graphrag/evaluation/frozen_release_v6.json
Normal file
@ -0,0 +1,134 @@
|
||||
{
|
||||
"release": "graphrag-v6-frozen",
|
||||
"evaluation_kind": "historical_regression",
|
||||
"graph_freeze_sha256": "54946b476fd713f551414b00cf2b843627566f6a333e3b59ce3efbbdf2328629",
|
||||
"runtime_files": {
|
||||
"app/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"app/main.py": "ff1adeff8b770047139fe3f632ad837517c95ec04649849c4315d6f892f9eef3",
|
||||
"app/routes.py": "dfb82171fea33d33b6e48cb238d2c19a29254b47a9a87308f4864cdbac53fa7b",
|
||||
"app/security.py": "24f437aff6642477049f02fdccfb3429c15e610d044bbb66128903771510055f",
|
||||
"requirements.txt": "26a6d097727eba03c1b6c71cd02b06373ef01ce03e567dd2bc4357ae330e5a1a",
|
||||
"tools/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/answer_evaluation/__init__.py": "795be75bf60e4aa9209e5b820207e52e8420c41a4dc2e37d0b6018cd2934a51a",
|
||||
"tools/answer_evaluation/answer_format.py": "86a27b4aebc6a5077e13794b81957a1cf063a1f3e070c583120ba53c1788d2f8",
|
||||
"tools/answer_evaluation/check_context_scenarios.py": "cbb2edf8fdcba61b9e5cc50e28cb1a1dcc25b0e0ab990177b41f40031223ca63",
|
||||
"tools/answer_evaluation/check_deployment.py": "803c5a42ab61ff6529b830a4e1ab2f1401b59565b56086db65d449f0f9c1dfb5",
|
||||
"tools/answer_evaluation/check_rag_runtime.py": "1e1b8bd48ac4d668ec057fee162ef30d34ae20ae026361bc8cc296bc455d4067",
|
||||
"tools/answer_evaluation/checked_generation.py": "7e017471e6281db62b79f270210db3ab14c7e31a4623bbfa3d9a5fd8911b1c20",
|
||||
"tools/answer_evaluation/context_policy.py": "e7b7c511e5e9cafdef04969eb4007a6a61ac4b99bcc60e9e722945a15bec1f26",
|
||||
"tools/answer_evaluation/evaluate_graph_answers.py": "2553a0d17e164922b02046416fdf0d5df4496dc443466d8d9a1f4be86415b318",
|
||||
"tools/answer_evaluation/graph_answer_prompt.txt": "8c8274a22bf5b44364d8fc8226a8f659b31c232f5a2aba5916d693b559e9f341",
|
||||
"tools/answer_evaluation/rag_delivery.py": "b83f93d446f44fdd7d41c12eeeaae69c0b02908076624f4eb3f4f72b9b88dbc8",
|
||||
"tools/answer_evaluation/regrade_citations.py": "330f437aec12927fd8c99b0aa601373f6ab26cb111971a6fb06098931d1e4aab",
|
||||
"tools/graphrag/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/build_graphrag.py": "256292101d6d7d1946e926e2717ac45465b169f4091c51ecfed4f1a779dfd700",
|
||||
"tools/graphrag/evaluation/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/evaluation/audit_benchmark.py": "6619c818a52fc284e87ed6c48a503a54a3c9dd95447463ed78f075b7c58bad80",
|
||||
"tools/graphrag/evaluation/benchmark_v2.py": "129dd774faa414f06733e1ee6333e7b411b1c75b5601b895c405778df478a563",
|
||||
"tools/graphrag/evaluation/benchmark_v3.py": "30bae6c605ed26f4b49973acec799087c4e2b97a883ccedcafb965dd909c4c4d",
|
||||
"tools/graphrag/evaluation/benchmark_v4.py": "70a8b08f7c2b2cb3e2bdc77be9efedd23ea24ac564ec1c1eb224a9f6388b3a67",
|
||||
"tools/graphrag/evaluation/benchmark_v6.py": "f955e600d17358fafcb33bab772aef09d787452f6b33352e299fdd42669aaf34",
|
||||
"tools/graphrag/evaluation/check_openwebui.py": "e2a81b52f7431b27a5e2a7d2bd0801029a782ea3620c0b7a289c57bdebb994d7",
|
||||
"tools/graphrag/evaluation/evaluate_graphrag.py": "89c364d15b70c9cb55df39d5970b4d0d79b681ba70eed7530a4e3fe64167812e",
|
||||
"tools/graphrag/evaluation/evidence_contract.py": "78e24264c176e163e1782fef1634b6c45c7f31bd4692726d02a30ab45a06648e",
|
||||
"tools/graphrag/evaluation/freeze_graphrag.py": "793c6d04a13c3217347283c609f647cd0d69b020e44bbde458bdc7ebbab8ec7e",
|
||||
"tools/graphrag/evaluation/graphrag_evaluator.py": "7f99bf0f97974058650b619ea49a8ee32284cb4b324f1ffab9baf54f5c4495f4",
|
||||
"tools/graphrag/evaluation/reproducibility.py": "8db9a0e0f86236b56239f41da11803538dfaa6745bbf74dbd7618e0a73bda0ae",
|
||||
"tools/graphrag/evaluation/source_oracle.py": "f2265d0919a4019f10d2b4a986bd772684fe59c598d7ae2f5cd0daa41f81b87b",
|
||||
"tools/graphrag/evaluation/source_validation.py": "9671b8978623888dbed8b8b2d1b6b01c1ce73cb0a512b03919e48873990f15ed",
|
||||
"tools/graphrag/graph_db.py": "c4b1a2edb765856b807398e4c243a8d17753529a5d2dfdb51791e28bc8de17f7",
|
||||
"tools/graphrag/graph_search.py": "8cc3668b4ad7beabf849e6978ea1d5defc818b142ee8b157b19c319998fb7541",
|
||||
"tools/graphrag/graphrag.py": "a718efbd001301c4a809aa449a2f175ae7aca8f6f3248f539d6f0597faeb3187",
|
||||
"tools/graphrag/neo4j_smoke.py": "fb5244c72c29ef2acf96d1e7f54335ff168eed4119db1692025eb1b99194b7bb",
|
||||
"tools/graphrag/publication.py": "fba1fa0d0bed325fd87f8d3593baae9271de1766b772d7214c7f63fd3f1c37b6",
|
||||
"tools/graphrag/tests/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/tests/test_evaluation_pipeline_v2.py": "63d1b3e80ae3c7b563374fd7ab4aa5ffad3c614eafbd15142c577abd7f756bf9",
|
||||
"tools/graphrag/tests/test_evaluation_v5.py": "9387e9d1418ebab87530986b0e29dac31cf33d762777a29a31cff24cc72e552a",
|
||||
"tools/graphrag/tests/test_evaluation_wide.py": "1b28bb74fd6b9457c869186b88606f1f7863d573aa3ab5226162e878f236d99e",
|
||||
"tools/graphrag/tests/test_evaluator_connected_v2.py": "29d7c9838ed1ff37ea3276df6feb1b6142158c43a0525712f490b648181882de",
|
||||
"tools/graphrag/tests/test_graph_publication.py": "96e53c1ae28e36c7a4290e1e60c8b398bf095ceaf883e819e1a477e2672b11c0",
|
||||
"tools/graphrag/tests/test_graph_rebuild_atomic.py": "fe37d4fff0b1f0fb1d565f0a96152b9b4e336837bc78b5977cf3b4879d7fbaf3",
|
||||
"tools/graphrag/tests/test_graph_search.py": "eb58661aef9dafe6bf7188fcdc2d79cef6652d57c64d1b81ae81a52e8e0204d7",
|
||||
"tools/graphrag/tests/test_graph_search_entity_v2.py": "0ef1a8ebd513c5a4507eb38fcf5ae6137c69e9901b5a2975ba513be5902ac693",
|
||||
"tools/graphrag/tests/test_graph_search_neo4j.py": "fec2bf72de8f752f17c9164fee5754bdb2e153828855e47efbf0000dbe82cf3b",
|
||||
"tools/graphrag/tests/test_graph_search_regressions.py": "9db7779aeb8ed9e8c0f92c1657011a81080aff3c928649e811358e3009a18c48",
|
||||
"tools/graphrag/tests/test_graphrag.py": "9ee8629d6b528dd78c2ddfc25cee95e17613f45b454fc0a38d4c591862637a9f",
|
||||
"tools/graphrag/tests/test_graphrag_evaluator.py": "1c6d08aeec9ae56ac4123239a5aed12a0081d66cc3f34b2047d95764579d7298",
|
||||
"tools/graphrag/tests/test_graphrag_freeze.py": "c4b760baf4c7ebf13b16bd4cd3c51874f5512eef3b4c61470dc4d428b0303d9f",
|
||||
"tools/graphrag/tests/test_graphrag_research_v2.py": "711008a91ab8a58ae0854e7f90329bcd42e5189fde2e2001589e97b0c22c5198",
|
||||
"tools/graphrag/tests/test_graphrag_root_title.py": "085651fe6e6081521a5dde9554abfee93456250108cf15978df25378d886a46c",
|
||||
"tools/graphrag/tests/test_source_oracle_v2.py": "0afdbe235e185ffe9f38aa667f90f5a6c20504fe29e9ac572642b39a8eb7faca",
|
||||
"tools/graphrag/tests/test_title_labels.py": "2983ead68ad6e2e346d24af0fc96dc6771c163e9c2a351af426a1e0383998e6f",
|
||||
"tools/index_state.py": "c33920a63d04009f11ef23ca9e9eee9bf86453b7d0586d027bf3b39156afea0d",
|
||||
"tools/publication.py": "f99d445073390a733afc8d849b9fcd4b4b0890bb54d136db67d4015b78436e1a",
|
||||
"tools/rag/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/rag/build_chunks.py": "fe060e25b138abcb689a6eb1b1e993d7017a4b3c5dd63e7cd275e1279da6053b",
|
||||
"tools/rag/build_sqlite_index.py": "107c0987e9ec4086ff41f9e7ae30195a67be34616875635e705dc79236e79416",
|
||||
"tools/rag/common.py": "8497c46d5c6c27a7c76df1568360ad5e9d00d5e5a7ef186e758960cc79d81d1c",
|
||||
"tools/rag/embedding_utils.py": "a2ea0b5be1a1782efff1c85c0eabfedba043e0e8bf7eb8b6617eab60eb4559c3",
|
||||
"tools/rag/evaluation/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/rag/evaluation/evaluate_rag_answers.py": "945c2da655537fb37fe82a08e10dc3ed66a2d90980921f61f61efb171a4a26a2",
|
||||
"tools/rag/evaluation/evaluate_retrieval.py": "aba865751ab74d9c2b962548b1e476508dbe6cf7bf811bda79e25f853061cbd7",
|
||||
"tools/rag/evaluation/metrics.py": "40b7d16f7729599c1d2fa2370f7cb40dfa04a968cdadef3c4fae83a168202c28",
|
||||
"tools/rag/evaluation/rag_answer_data.py": "9a369e9ced254cf723a5d3006877959c6f144f4c770e382835af776f7f569762",
|
||||
"tools/rag/evaluation/rag_answer_state.py": "da4ab19f22378899d5c13e93e803a978518f8edcdd62e4990a06aae12d8eb469",
|
||||
"tools/rag/evaluation/rag_metrics.py": "3e95922df90dd1b757a550040a2d9bd4f857e17d179f60170d7cc881a08f94b6",
|
||||
"tools/rag/evaluation/rag_runner.py": "031abf7d5b1a026eb199aa2a579bfb8baaa01175279d0018a364bfe50b76c3c1",
|
||||
"tools/rag/evaluation/retrieval_runner.py": "fe3dd05459f825d72252b7a0841f28004fc81537096a7de487807e4d5f0c4c45",
|
||||
"tools/rag/rag_document_expansion.py": "d565b9794e30bc0f387c791a0557d5d03f2c1fa2fe5db53e49a9b19b1158f48e",
|
||||
"tools/rag/rag_query_evidence.py": "90fced0fecd8ef976a1537506d2e7e8e9d3ba22a6371131f978fb91df5cc0b19",
|
||||
"tools/rag/rag_supplemental_expansion.py": "a593579e543149633e3146c3886536a9196aff43f4df6f3d7ade94ca16dd243a",
|
||||
"tools/rag/rag_utils.py": "4f898cf0facc2ae9f2ea28a36f48d4ed37bd7fc716e097b319bcf4d36a4a4f03",
|
||||
"tools/rag/rebuild_index.py": "6a4d86a551d1141c403a0f6570c568896af37faeaa8c67cac170d2e6a393ca06",
|
||||
"tools/rag/scan_zpwiki.py": "ef770ce4edb6352ff0690af5783766c95062a0e56f638cca6e3d929973728273",
|
||||
"tools/rag/search_core.py": "624c8ddfe3edf78d06014579b747a59b2e33c0191a7cf90cdfd624b52ed5e96b",
|
||||
"tools/rag/search_db.py": "cc63aeaf2854e87b7448c3978959569b097074cdb16a9b2c16b2c37a4677fdbb",
|
||||
"tools/rag/search_utils.py": "69597bf5785f7852b1131a0648d9d2c65b6babba9ad279581f08b40d185ee646",
|
||||
"tools/rag/tests/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/rag/tests/conftest.py": "0c94402d5ca971233d9802ded81cdb39ae7dfddda5eb9126e2035f7599a8f1c7",
|
||||
"tools/rag/tests/test_chunking.py": "94904a20cfed0512d508017eaadbb43ef45ca74a5e96631241f6ca481222c498",
|
||||
"tools/rag/tests/test_common.py": "86f0aecb79b7a3764112c833ea3b732073c073a5d570ef8c99900fb2a3f04430",
|
||||
"tools/rag/tests/test_database.py": "31fc3553d76127c2d7e2c113b9053e537a72bb92f57a9c24cad6a579a1ffc589",
|
||||
"tools/rag/tests/test_e5_1_remaining.py": "a8a52d5204e7376f33bb1aef96aad20990126a0b92266596b7cf8dd0dcbea4bc",
|
||||
"tools/rag/tests/test_evaluate_rag_answers.py": "2143f3c9efbacf7b9119eeb9ae69e6cd7ea3f428ff5076d8e9973d0943675296",
|
||||
"tools/rag/tests/test_live_data.py": "3c5e04d4a29ec8360d89881be980dacacccf0e12594fe51a22ec23c32c98b3e3",
|
||||
"tools/rag/tests/test_rag.py": "13e97c88bf4afe45a8d633b269d110890f0f646887cee861bbf55ada0be7ad24",
|
||||
"tools/rag/tests/test_rag_document_expansion.py": "9adf39c7a9b683b1d40c36fce576272e71869b7c1236c371c1b077820874eb7e",
|
||||
"tools/rag/tests/test_rag_metrics_morphology.py": "070ee314d326e4c7218e7c19959a94076a2b241c4f19b9ecd9ca1fb3cc2639d4",
|
||||
"tools/rag/tests/test_rag_metrics_semantic.py": "3642394d2636edd7420589348fb75bf1d214b539983b7e620008d626deffabf0",
|
||||
"tools/rag/tests/test_rag_query_evidence.py": "c3fb5115306171010759b0cfd0cd05d1439d6a57de049efea02330ae7c553bfc",
|
||||
"tools/rag/tests/test_rag_query_evidence_topn.py": "ebf01ad57a52f030b908b7fb0312d8d32cf9f60ea2953c5a3fb8849c1f2dceaf",
|
||||
"tools/rag/tests/test_rag_runner.py": "1813086999d1e9826b42c2ac7978ea77d29e1c4b12f5e606f1fba572829e24ea",
|
||||
"tools/rag/tests/test_rag_runner_routing.py": "c9454e5dddfdb7afc013567811efec15545daf20733b7167f78f2dd9ff0380d6",
|
||||
"tools/rag/tests/test_rag_runner_tool_prompt.py": "073403907717d8d388c28ea92d1d1f9426edab2e8bd320c8f6329bcbff082e6c",
|
||||
"tools/rag/tests/test_rag_supplemental_expansion.py": "65449054e2d94396def0dc8d505a9573306adbf184820ddd6c9b5ea92e165f8b",
|
||||
"tools/rag/tests/test_rebuild_index.py": "aa0688b81e4b699ce99e97a4b8c1a6d4a49c5c153caa02301ebd5a5d8be764a4",
|
||||
"tools/rag/tests/test_scan_zpwiki.py": "324510ca504dff11ecf39b28aff26b44a358e14084b3b015c0c410690d8aa129",
|
||||
"tools/rag/tests/test_search.py": "82c96d35719d2233e4636b6f25d89b22f004848d8bae46a9705ee384d4abe9a8",
|
||||
"tools/retrieval_contract.py": "b8fa272c3babf924a3ce8b937fe7ae437cd959ba9f7667193ac67c18d2c5b58d",
|
||||
"tools/sync_indexes.py": "5b909b4394c24e5ce22848594b16d9aea45fb06418f5cd92bb6aa6381a0ccf10",
|
||||
"tools/tool_health.py": "8ad37345889ad58a737edac5960b5b6c5002af2397d60248f434e03fb4eddd89"
|
||||
},
|
||||
"deployment_configuration": {
|
||||
"Dockerfile": "fc7aefe4a99222daedc321acf8359773dc24eff82be04e688507e135956a92a6",
|
||||
"docker-compose.yml": "e33b65c58f155ac057b01be272bc323fab3ff7eb4f51c9e4ca1b53904cc17af4"
|
||||
},
|
||||
"measured_artifacts": {
|
||||
"tools/graphrag/evaluation/results/final_v6_2026-10-25/graphrag_dev.json": "d4ac47c21aed4be149a3f1aec1f7658c862da2ee24e41cc680128d013a071707",
|
||||
"tools/graphrag/evaluation/results/final_v6_2026-10-25/graphrag_test.json": "2d569267ada3eecb81cd793cc2c7e8f7715b3c9b931799d4ef0663ac3f11f1d5",
|
||||
"tools/graphrag/evaluation/graphrag_questions_v6.json": "a7bb38be01e03603cf2fa2c7137817094dff0a0cbb3f801263609e55b28e9edc",
|
||||
"tools/graphrag/evaluation/results/v6_preparation/source_audit.json": "d5922db25b6d40cb7e5dc7df7990e93a3caee263a6e747ae910ab340da340023",
|
||||
"tools/graphrag/evaluation/results/v6_preparation/protocol.json": "3f33834c78d35586d8bd8eb2cd48d7db184df5a1d683806d40f0d743aec6c21e",
|
||||
"tools/graphrag/evaluation/results/v6_preparation/source_review.csv": "ecf420330a6bb9a4a11fafa99ab617886d069d5c7e34f8045467794145f33cf9",
|
||||
"tools/graphrag/evaluation/results/v6_preparation/rag_delivery_replay.json": "3ecb0ba20b515f968df5cd070e2b470d58d69f3fb7bfb2546b1bd01e8e308a83",
|
||||
"tools/graphrag/evaluation/results/v6_preparation/citation_regrade.json": "238015f0f36010cb7f53570188a7e65e4a40e1ad778c9bab6bd37d2b4a697bc6",
|
||||
"tools/graphrag/evaluation/results/answers_v6_final_dev_2026-10-25/answers_dev.json": "f70834bf4ee1fe106c0849ab56e0758dd50e07dfa9bbc25b05ae4d4e811a4edd",
|
||||
"tools/graphrag/evaluation/results/answers_v6_regression_2026-10-25/answers_regression.json": "17a675405a79e3309602d0ac6f5b4ef447edde88a2c4c950aeb675d2de9aa4a4"
|
||||
},
|
||||
"policy": "Graph-generation files remained frozen during all 320 cases. RAG-only delivery notice verified separately and included in this full-runtime release freeze.",
|
||||
"secrets_excluded": [
|
||||
".env",
|
||||
"credentials",
|
||||
"private keys"
|
||||
]
|
||||
}
|
||||
137
tools/graphrag/evaluation/frozen_release_v7.json
Normal file
137
tools/graphrag/evaluation/frozen_release_v7.json
Normal file
@ -0,0 +1,137 @@
|
||||
{
|
||||
"release": "graphrag-v7-frozen",
|
||||
"evaluation_kind": "fresh_query_group_holdout_plus_historical_regression",
|
||||
"graph_freeze_sha256": "9e97794200520d0f2288e452c9e186c0291a54c63d2c1382f693a9753e4081cf",
|
||||
"runtime_files": {
|
||||
"app/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"app/main.py": "ff1adeff8b770047139fe3f632ad837517c95ec04649849c4315d6f892f9eef3",
|
||||
"app/routes.py": "dfb82171fea33d33b6e48cb238d2c19a29254b47a9a87308f4864cdbac53fa7b",
|
||||
"app/security.py": "24f437aff6642477049f02fdccfb3429c15e610d044bbb66128903771510055f",
|
||||
"requirements.txt": "26a6d097727eba03c1b6c71cd02b06373ef01ce03e567dd2bc4357ae330e5a1a",
|
||||
"tools/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/answer_evaluation/__init__.py": "795be75bf60e4aa9209e5b820207e52e8420c41a4dc2e37d0b6018cd2934a51a",
|
||||
"tools/answer_evaluation/answer_format.py": "86a27b4aebc6a5077e13794b81957a1cf063a1f3e070c583120ba53c1788d2f8",
|
||||
"tools/answer_evaluation/check_context_scenarios.py": "99dbae2747183622e0823cd8f6536f4ff38ef56d0e41dd7855096d47af3b1c37",
|
||||
"tools/answer_evaluation/check_deployment.py": "14618b102c0ade954dc73cbc5036a628166f0eb703d435b679d1a000d045ab5a",
|
||||
"tools/answer_evaluation/check_rag_runtime.py": "1e1b8bd48ac4d668ec057fee162ef30d34ae20ae026361bc8cc296bc455d4067",
|
||||
"tools/answer_evaluation/checked_generation.py": "cb821a65327424c19cbd996190b14e6aa30d9b909493f11716552f71249a0529",
|
||||
"tools/answer_evaluation/context_policy.py": "0dc2a056ca0d886d7cc8248ed4632c910c5e35bebd03ef94573df41802297f47",
|
||||
"tools/answer_evaluation/evaluate_graph_answers.py": "d81504e8fe51598c6bd1b0d482f61b9b6f51f87ba3f38b03ae1bc584675a3b76",
|
||||
"tools/answer_evaluation/graph_answer_prompt.txt": "fc9f2f8d52e70a8d67b9f4814b3f15e6be64bf88afe53ce4db4f037bde00e064",
|
||||
"tools/answer_evaluation/rag_delivery.py": "b83f93d446f44fdd7d41c12eeeaae69c0b02908076624f4eb3f4f72b9b88dbc8",
|
||||
"tools/answer_evaluation/regrade_citations.py": "330f437aec12927fd8c99b0aa601373f6ab26cb111971a6fb06098931d1e4aab",
|
||||
"tools/answer_evaluation/render_answer.py": "609c534a37899b3febcea32d983da4b806c287de8f2ddf9bc0675e3280859002",
|
||||
"tools/graphrag/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/build_graphrag.py": "256292101d6d7d1946e926e2717ac45465b169f4091c51ecfed4f1a779dfd700",
|
||||
"tools/graphrag/evaluation/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/evaluation/audit_benchmark.py": "6619c818a52fc284e87ed6c48a503a54a3c9dd95447463ed78f075b7c58bad80",
|
||||
"tools/graphrag/evaluation/benchmark_v2.py": "62a0b6af852d5ae8060c06db3f983ef4b797d74443f9df25a6b8bd77bf133330",
|
||||
"tools/graphrag/evaluation/benchmark_v3.py": "30bae6c605ed26f4b49973acec799087c4e2b97a883ccedcafb965dd909c4c4d",
|
||||
"tools/graphrag/evaluation/benchmark_v4.py": "7a731fe649d3d5170045b8bbcabf31ad527e5d26a934d434a4be3a4c94dc5c38",
|
||||
"tools/graphrag/evaluation/benchmark_v6.py": "f955e600d17358fafcb33bab772aef09d787452f6b33352e299fdd42669aaf34",
|
||||
"tools/graphrag/evaluation/benchmark_v7.py": "9477cd6e9a6dd0558837cf044535de75a8f101b17115e28e57a82d96d1aa01cb",
|
||||
"tools/graphrag/evaluation/check_openwebui.py": "863801048231d474ba82930cf6bf6853b4410f8295b3f97fd3d5934852431fbe",
|
||||
"tools/graphrag/evaluation/evaluate_graphrag.py": "22f48e9ac6dfae92d79ad648ca173547c6a37f98aa8199f7c37595f1b0b186f9",
|
||||
"tools/graphrag/evaluation/evidence_contract.py": "78e24264c176e163e1782fef1634b6c45c7f31bd4692726d02a30ab45a06648e",
|
||||
"tools/graphrag/evaluation/freeze_graphrag.py": "d8764d1aeb72208de55604785acff880002da1f818d8a8ad9477cf39e1f29efb",
|
||||
"tools/graphrag/evaluation/graphrag_evaluator.py": "7f99bf0f97974058650b619ea49a8ee32284cb4b324f1ffab9baf54f5c4495f4",
|
||||
"tools/graphrag/evaluation/reproducibility.py": "0e2dab6ffb17691f05f9d81dbec12ffc0f2e4e0b1a2114a75b66a5165cf7b4d2",
|
||||
"tools/graphrag/evaluation/source_oracle.py": "aed0309435fd21bc274fde7905a0720f68f359b3c30bb0b912e3371ebf0d8072",
|
||||
"tools/graphrag/evaluation/source_validation.py": "9671b8978623888dbed8b8b2d1b6b01c1ce73cb0a512b03919e48873990f15ed",
|
||||
"tools/graphrag/graph_db.py": "c4b1a2edb765856b807398e4c243a8d17753529a5d2dfdb51791e28bc8de17f7",
|
||||
"tools/graphrag/graph_search.py": "c41cbfbac0d5daa1d0b51f5f4b798a15688bbd2e0498d2cbe93c6584a99f6b7d",
|
||||
"tools/graphrag/graphrag.py": "dbc75403aa038e4021b5a70d1f17c62784b478252a94bac8db682bf38dcb39b3",
|
||||
"tools/graphrag/neo4j_smoke.py": "fb5244c72c29ef2acf96d1e7f54335ff168eed4119db1692025eb1b99194b7bb",
|
||||
"tools/graphrag/publication.py": "fba1fa0d0bed325fd87f8d3593baae9271de1766b772d7214c7f63fd3f1c37b6",
|
||||
"tools/graphrag/tests/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/tests/test_evaluation_pipeline_v2.py": "63d1b3e80ae3c7b563374fd7ab4aa5ffad3c614eafbd15142c577abd7f756bf9",
|
||||
"tools/graphrag/tests/test_evaluation_v5.py": "9387e9d1418ebab87530986b0e29dac31cf33d762777a29a31cff24cc72e552a",
|
||||
"tools/graphrag/tests/test_evaluation_wide.py": "1b28bb74fd6b9457c869186b88606f1f7863d573aa3ab5226162e878f236d99e",
|
||||
"tools/graphrag/tests/test_evaluator_connected_v2.py": "29d7c9838ed1ff37ea3276df6feb1b6142158c43a0525712f490b648181882de",
|
||||
"tools/graphrag/tests/test_graph_publication.py": "96e53c1ae28e36c7a4290e1e60c8b398bf095ceaf883e819e1a477e2672b11c0",
|
||||
"tools/graphrag/tests/test_graph_rebuild_atomic.py": "fe37d4fff0b1f0fb1d565f0a96152b9b4e336837bc78b5977cf3b4879d7fbaf3",
|
||||
"tools/graphrag/tests/test_graph_search.py": "eb58661aef9dafe6bf7188fcdc2d79cef6652d57c64d1b81ae81a52e8e0204d7",
|
||||
"tools/graphrag/tests/test_graph_search_entity_v2.py": "0ef1a8ebd513c5a4507eb38fcf5ae6137c69e9901b5a2975ba513be5902ac693",
|
||||
"tools/graphrag/tests/test_graph_search_neo4j.py": "fec2bf72de8f752f17c9164fee5754bdb2e153828855e47efbf0000dbe82cf3b",
|
||||
"tools/graphrag/tests/test_graph_search_regressions.py": "9db7779aeb8ed9e8c0f92c1657011a81080aff3c928649e811358e3009a18c48",
|
||||
"tools/graphrag/tests/test_graphrag.py": "9ee8629d6b528dd78c2ddfc25cee95e17613f45b454fc0a38d4c591862637a9f",
|
||||
"tools/graphrag/tests/test_graphrag_evaluator.py": "1c6d08aeec9ae56ac4123239a5aed12a0081d66cc3f34b2047d95764579d7298",
|
||||
"tools/graphrag/tests/test_graphrag_freeze.py": "c4b760baf4c7ebf13b16bd4cd3c51874f5512eef3b4c61470dc4d428b0303d9f",
|
||||
"tools/graphrag/tests/test_graphrag_research_v2.py": "711008a91ab8a58ae0854e7f90329bcd42e5189fde2e2001589e97b0c22c5198",
|
||||
"tools/graphrag/tests/test_graphrag_root_title.py": "085651fe6e6081521a5dde9554abfee93456250108cf15978df25378d886a46c",
|
||||
"tools/graphrag/tests/test_source_oracle_v2.py": "0afdbe235e185ffe9f38aa667f90f5a6c20504fe29e9ac572642b39a8eb7faca",
|
||||
"tools/graphrag/tests/test_title_labels.py": "2983ead68ad6e2e346d24af0fc96dc6771c163e9c2a351af426a1e0383998e6f",
|
||||
"tools/index_state.py": "c33920a63d04009f11ef23ca9e9eee9bf86453b7d0586d027bf3b39156afea0d",
|
||||
"tools/publication.py": "f99d445073390a733afc8d849b9fcd4b4b0890bb54d136db67d4015b78436e1a",
|
||||
"tools/rag/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/rag/build_chunks.py": "fe060e25b138abcb689a6eb1b1e993d7017a4b3c5dd63e7cd275e1279da6053b",
|
||||
"tools/rag/build_sqlite_index.py": "107c0987e9ec4086ff41f9e7ae30195a67be34616875635e705dc79236e79416",
|
||||
"tools/rag/common.py": "8497c46d5c6c27a7c76df1568360ad5e9d00d5e5a7ef186e758960cc79d81d1c",
|
||||
"tools/rag/embedding_utils.py": "a2ea0b5be1a1782efff1c85c0eabfedba043e0e8bf7eb8b6617eab60eb4559c3",
|
||||
"tools/rag/evaluation/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/rag/evaluation/evaluate_rag_answers.py": "945c2da655537fb37fe82a08e10dc3ed66a2d90980921f61f61efb171a4a26a2",
|
||||
"tools/rag/evaluation/evaluate_retrieval.py": "aba865751ab74d9c2b962548b1e476508dbe6cf7bf811bda79e25f853061cbd7",
|
||||
"tools/rag/evaluation/metrics.py": "40b7d16f7729599c1d2fa2370f7cb40dfa04a968cdadef3c4fae83a168202c28",
|
||||
"tools/rag/evaluation/rag_answer_data.py": "9a369e9ced254cf723a5d3006877959c6f144f4c770e382835af776f7f569762",
|
||||
"tools/rag/evaluation/rag_answer_state.py": "da4ab19f22378899d5c13e93e803a978518f8edcdd62e4990a06aae12d8eb469",
|
||||
"tools/rag/evaluation/rag_metrics.py": "3e95922df90dd1b757a550040a2d9bd4f857e17d179f60170d7cc881a08f94b6",
|
||||
"tools/rag/evaluation/rag_runner.py": "031abf7d5b1a026eb199aa2a579bfb8baaa01175279d0018a364bfe50b76c3c1",
|
||||
"tools/rag/evaluation/retrieval_runner.py": "fe3dd05459f825d72252b7a0841f28004fc81537096a7de487807e4d5f0c4c45",
|
||||
"tools/rag/rag_document_expansion.py": "d565b9794e30bc0f387c791a0557d5d03f2c1fa2fe5db53e49a9b19b1158f48e",
|
||||
"tools/rag/rag_query_evidence.py": "90fced0fecd8ef976a1537506d2e7e8e9d3ba22a6371131f978fb91df5cc0b19",
|
||||
"tools/rag/rag_supplemental_expansion.py": "a593579e543149633e3146c3886536a9196aff43f4df6f3d7ade94ca16dd243a",
|
||||
"tools/rag/rag_utils.py": "4f898cf0facc2ae9f2ea28a36f48d4ed37bd7fc716e097b319bcf4d36a4a4f03",
|
||||
"tools/rag/rebuild_index.py": "6a4d86a551d1141c403a0f6570c568896af37faeaa8c67cac170d2e6a393ca06",
|
||||
"tools/rag/scan_zpwiki.py": "ef770ce4edb6352ff0690af5783766c95062a0e56f638cca6e3d929973728273",
|
||||
"tools/rag/search_core.py": "624c8ddfe3edf78d06014579b747a59b2e33c0191a7cf90cdfd624b52ed5e96b",
|
||||
"tools/rag/search_db.py": "cc63aeaf2854e87b7448c3978959569b097074cdb16a9b2c16b2c37a4677fdbb",
|
||||
"tools/rag/search_utils.py": "69597bf5785f7852b1131a0648d9d2c65b6babba9ad279581f08b40d185ee646",
|
||||
"tools/rag/tests/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/rag/tests/conftest.py": "0c94402d5ca971233d9802ded81cdb39ae7dfddda5eb9126e2035f7599a8f1c7",
|
||||
"tools/rag/tests/test_chunking.py": "94904a20cfed0512d508017eaadbb43ef45ca74a5e96631241f6ca481222c498",
|
||||
"tools/rag/tests/test_common.py": "86f0aecb79b7a3764112c833ea3b732073c073a5d570ef8c99900fb2a3f04430",
|
||||
"tools/rag/tests/test_database.py": "31fc3553d76127c2d7e2c113b9053e537a72bb92f57a9c24cad6a579a1ffc589",
|
||||
"tools/rag/tests/test_e5_1_remaining.py": "a8a52d5204e7376f33bb1aef96aad20990126a0b92266596b7cf8dd0dcbea4bc",
|
||||
"tools/rag/tests/test_evaluate_rag_answers.py": "2143f3c9efbacf7b9119eeb9ae69e6cd7ea3f428ff5076d8e9973d0943675296",
|
||||
"tools/rag/tests/test_live_data.py": "3c5e04d4a29ec8360d89881be980dacacccf0e12594fe51a22ec23c32c98b3e3",
|
||||
"tools/rag/tests/test_rag.py": "13e97c88bf4afe45a8d633b269d110890f0f646887cee861bbf55ada0be7ad24",
|
||||
"tools/rag/tests/test_rag_document_expansion.py": "9adf39c7a9b683b1d40c36fce576272e71869b7c1236c371c1b077820874eb7e",
|
||||
"tools/rag/tests/test_rag_metrics_morphology.py": "070ee314d326e4c7218e7c19959a94076a2b241c4f19b9ecd9ca1fb3cc2639d4",
|
||||
"tools/rag/tests/test_rag_metrics_semantic.py": "3642394d2636edd7420589348fb75bf1d214b539983b7e620008d626deffabf0",
|
||||
"tools/rag/tests/test_rag_query_evidence.py": "c3fb5115306171010759b0cfd0cd05d1439d6a57de049efea02330ae7c553bfc",
|
||||
"tools/rag/tests/test_rag_query_evidence_topn.py": "ebf01ad57a52f030b908b7fb0312d8d32cf9f60ea2953c5a3fb8849c1f2dceaf",
|
||||
"tools/rag/tests/test_rag_runner.py": "1813086999d1e9826b42c2ac7978ea77d29e1c4b12f5e606f1fba572829e24ea",
|
||||
"tools/rag/tests/test_rag_runner_routing.py": "c9454e5dddfdb7afc013567811efec15545daf20733b7167f78f2dd9ff0380d6",
|
||||
"tools/rag/tests/test_rag_runner_tool_prompt.py": "073403907717d8d388c28ea92d1d1f9426edab2e8bd320c8f6329bcbff082e6c",
|
||||
"tools/rag/tests/test_rag_supplemental_expansion.py": "65449054e2d94396def0dc8d505a9573306adbf184820ddd6c9b5ea92e165f8b",
|
||||
"tools/rag/tests/test_rebuild_index.py": "aa0688b81e4b699ce99e97a4b8c1a6d4a49c5c153caa02301ebd5a5d8be764a4",
|
||||
"tools/rag/tests/test_scan_zpwiki.py": "324510ca504dff11ecf39b28aff26b44a358e14084b3b015c0c410690d8aa129",
|
||||
"tools/rag/tests/test_search.py": "82c96d35719d2233e4636b6f25d89b22f004848d8bae46a9705ee384d4abe9a8",
|
||||
"tools/retrieval_contract.py": "b8fa272c3babf924a3ce8b937fe7ae437cd959ba9f7667193ac67c18d2c5b58d",
|
||||
"tools/sync_indexes.py": "5b909b4394c24e5ce22848594b16d9aea45fb06418f5cd92bb6aa6381a0ccf10",
|
||||
"tools/tool_health.py": "8ad37345889ad58a737edac5960b5b6c5002af2397d60248f434e03fb4eddd89"
|
||||
},
|
||||
"deployment_configuration": {
|
||||
"Dockerfile": "fc7aefe4a99222daedc321acf8359773dc24eff82be04e688507e135956a92a6",
|
||||
"docker-compose.yml": "e33b65c58f155ac057b01be272bc323fab3ff7eb4f51c9e4ca1b53904cc17af4"
|
||||
},
|
||||
"measured_artifacts": {
|
||||
"tools/graphrag/evaluation/graphrag_questions_v7.json": "0f78e9749de369d752b6e1079f174cf3f6b390f4718a672119dfd43fa5d9dfac",
|
||||
"tools/graphrag/evaluation/results/final_v7_2026-10-26/graphrag_dev.json": "d1a5d7b6d5aff3c0002f36a60cebc07627a79ec6d57de119dd587e8ab70143b0",
|
||||
"tools/graphrag/evaluation/results/final_v7_2026-10-26/graphrag_test.json": "07d3d73c1b7ab0805549d2d3ebea0c02d1c00eacf3d6092911e34e9787cd9612",
|
||||
"tools/graphrag/evaluation/results/final_v7_2026-10-26/historical_graph_summary.json": "f0386fde85ed1779d1262264614d4d93faf90cca9a3671cd7591ff6b57759a9b",
|
||||
"tools/graphrag/evaluation/results/final_v7_2026-10-26/summary.json": "cdc7809eb1033bdf27569ea80deb53b3e82cc2beb0141e64d6251756737a396c",
|
||||
"tools/graphrag/evaluation/results/v7_preparation/source_audit.json": "7825d4f3e4e535eb5f49e975dfef363b9b813f1de5c97e2387e5c2f3e578e6a5",
|
||||
"tools/graphrag/evaluation/results/v7_preparation/protocol.json": "7ae343bba36fe25e8603f00325fe2dec1f5753616db9ef9c54f74ccffc1a7d83",
|
||||
"tools/graphrag/evaluation/results/v7_preparation/source_review.csv": "7ee21230e5dda7be9dc847b8ada6111d14d38f7b075a9c64d38f3ff69950b5c0",
|
||||
"tools/graphrag/evaluation/results/answers_v7_dev_2026-10-26/answers_dev.json": "4af9b52c250c837707c0690d892ec833347b3d3ee71d338ec631f6450eef8045",
|
||||
"tools/graphrag/evaluation/results/answers_v7_test_2026-10-26/answers_test.json": "19d5e6ef484495a0acc1402b2d8f6ba91b3b63b8229d1118cd75d763082c148a",
|
||||
"tools/graphrag/evaluation/results/answers_v7_regression_2026-10-26/answers_regression.json": "4bad6d54955b7645d861ea1ae2b412625b1ea032297caa57984f3b0cf21e3a25"
|
||||
},
|
||||
"policy": "Runtime code, prompt and gold remained unchanged throughout the final TEST and historical regression. All failures retained.",
|
||||
"secrets_excluded": [
|
||||
".env",
|
||||
"credentials",
|
||||
"private keys"
|
||||
]
|
||||
}
|
||||
82
tools/graphrag/evaluation/frozen_v1.json
Normal file
82
tools/graphrag/evaluation/frozen_v1.json
Normal file
@ -0,0 +1,82 @@
|
||||
{
|
||||
"schema_version": 1,
|
||||
"frozen_at_utc": "2026-10-24T19:03:18.603604+00:00",
|
||||
"fingerprints": {
|
||||
"implementation": {
|
||||
"tools/graphrag/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/build_graphrag.py": "81f6e9f5c9e71b588f8bed1968c1e900e29e484ba81d23b6a3a68e7220ad75a5",
|
||||
"tools/graphrag/evaluation/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/evaluation/audit_benchmark.py": "6619c818a52fc284e87ed6c48a503a54a3c9dd95447463ed78f075b7c58bad80",
|
||||
"tools/graphrag/evaluation/evaluate_graphrag.py": "6bdf68307b6bb90731fe09a89955e96eee76fec13bdf82281a96715dd168680e",
|
||||
"tools/graphrag/evaluation/freeze_graphrag.py": "32198eca7642f39a8ad33deefe0eea396d38fcc0f5bc5814cbb64ab6d3443b9e",
|
||||
"tools/graphrag/evaluation/graphrag_evaluator.py": "267d4e9942b7767a78a3689e8f7c9d6ed49f025389b043b69449b2d225651160",
|
||||
"tools/graphrag/evaluation/reproducibility.py": "5c28d8aa37ec6a973fa494f7e528c19af2f1326422ea7fd05912e01aa1af6725",
|
||||
"tools/graphrag/graph_db.py": "a6fce68000065d328139829c5ca894623f6ed5828c74a869663366c2ad7b5ea2",
|
||||
"tools/graphrag/graph_search.py": "20f466e8d9eef6a38e41860e9be9ebc719c93f38bcfa6f60aca0e1b56c7d6bca",
|
||||
"tools/graphrag/graphrag.py": "bee2eb1f86d8df8e978495a61107edf723df2dc2e0468e3ecf844719ec635e1d",
|
||||
"tools/graphrag/neo4j_smoke.py": "fb5244c72c29ef2acf96d1e7f54335ff168eed4119db1692025eb1b99194b7bb",
|
||||
"tools/graphrag/tests/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/tests/test_graph_search.py": "d5c95b5de2a0962857331929522764aa46a1222e550a3eb1aaca2148f9d58748",
|
||||
"tools/graphrag/tests/test_graph_search_neo4j.py": "fec2bf72de8f752f17c9164fee5754bdb2e153828855e47efbf0000dbe82cf3b",
|
||||
"tools/graphrag/tests/test_graph_search_regressions.py": "9db7779aeb8ed9e8c0f92c1657011a81080aff3c928649e811358e3009a18c48",
|
||||
"tools/graphrag/tests/test_graphrag.py": "6379335110f05668beca87ca7e486442071b2f666dbd651408d5f3a8d5723f0e",
|
||||
"tools/graphrag/tests/test_graphrag_evaluator.py": "1c6d08aeec9ae56ac4123239a5aed12a0081d66cc3f34b2047d95764579d7298",
|
||||
"tools/graphrag/tests/test_graphrag_freeze.py": "c4b760baf4c7ebf13b16bd4cd3c51874f5512eef3b4c61470dc4d428b0303d9f",
|
||||
"tools/graphrag/tests/test_graphrag_root_title.py": "085651fe6e6081521a5dde9554abfee93456250108cf15978df25378d886a46c",
|
||||
"requirements.txt": "26a6d097727eba03c1b6c71cd02b06373ef01ce03e567dd2bc4357ae330e5a1a"
|
||||
},
|
||||
"dataset_sha256": "b5c96e423fc9a5bcee0dcca38fdeac86b2f7cd1efebfcb0d7cd4cfb7fed0620e",
|
||||
"inputs": {
|
||||
"data/documents.json": "0542af2a373771cf7c4a95f93d14f4f687f6a0187846892c959aa6efc4bade52",
|
||||
"data/chunks.json": "437dde589be46e0c30842dd330de22d96a0173d2dbaff9c5f129568cb2bca4c9"
|
||||
}
|
||||
},
|
||||
"graph": {
|
||||
"sha256": "0637d9ebb106c65d9aaa73d0634b28db81135e6a6c7503ea6b06c4a922e7e1e3",
|
||||
"nodes": 422,
|
||||
"relationships": 829
|
||||
},
|
||||
"parameters": {
|
||||
"limit": 40,
|
||||
"max_entities": 8
|
||||
},
|
||||
"dev_summary": {
|
||||
"questions": 286,
|
||||
"strict_count": 209,
|
||||
"strict_accuracy": 0.730769,
|
||||
"error_count": 0,
|
||||
"value_score": 0.751748,
|
||||
"entity_score": 0.751748,
|
||||
"relation_score": 0.751748,
|
||||
"property_score": 0.835664,
|
||||
"relation_choice_score": 0.968531,
|
||||
"document_recall": 1.0,
|
||||
"source_recall": 1.0,
|
||||
"latency_mean_seconds": 0.032786,
|
||||
"latency_median_seconds": 0.03221,
|
||||
"latency_p95_seconds": 0.041831
|
||||
},
|
||||
"source_audit_summary": {
|
||||
"dev": {
|
||||
"questions": 286,
|
||||
"source_consistent": 209,
|
||||
"issues": {
|
||||
"keyword_not_in_frontmatter_catalog": 66,
|
||||
"keyword_not_linked_to_expected_person": 5,
|
||||
"exact_categories_omit_or_add_source_categories": 6
|
||||
}
|
||||
},
|
||||
"test": {
|
||||
"questions": 214,
|
||||
"source_consistent": 154,
|
||||
"issues": {
|
||||
"keyword_not_in_frontmatter_catalog": 46,
|
||||
"keyword_not_linked_to_expected_person": 11,
|
||||
"exact_categories_omit_or_add_source_categories": 3
|
||||
}
|
||||
}
|
||||
},
|
||||
"policy": "Report all questions. Source-consistent subset is supplementary. No holdout tuning.",
|
||||
"dev_results_sha256": "768d6795cf49b59a59a405276950afd4c48b22357cb682b9820f747d2a9e2be9",
|
||||
"audit_sha256": "4fbc8ea8090caaf275cac384e3c3c8ed7c3743b49523086bee3f0970e11d9276"
|
||||
}
|
||||
211
tools/graphrag/evaluation/frozen_v2.json
Normal file
211
tools/graphrag/evaluation/frozen_v2.json
Normal file
@ -0,0 +1,211 @@
|
||||
{
|
||||
"schema_version": 2,
|
||||
"partition": {
|
||||
"method": "disjoint source profiles",
|
||||
"dev_profile_count": 45,
|
||||
"test_profile_count": 24,
|
||||
"overlap": 0
|
||||
},
|
||||
"frozen_at_utc": "2026-10-25T01:03:09.186759+00:00",
|
||||
"fingerprints": {
|
||||
"implementation": {
|
||||
"tools/graphrag/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/build_graphrag.py": "81f6e9f5c9e71b588f8bed1968c1e900e29e484ba81d23b6a3a68e7220ad75a5",
|
||||
"tools/graphrag/evaluation/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/evaluation/audit_benchmark.py": "6619c818a52fc284e87ed6c48a503a54a3c9dd95447463ed78f075b7c58bad80",
|
||||
"tools/graphrag/evaluation/benchmark_v2.py": "3e66d8e20d049758ac6df393355c0b5038f09c6ba97c96acc2087d61cfb4ad26",
|
||||
"tools/graphrag/evaluation/evaluate_graphrag.py": "f9ef7e2fc681033cf1cb164581589f6f01acecf3d28e0cbfaba5c9ba72f24b23",
|
||||
"tools/graphrag/evaluation/evidence_contract.py": "78e24264c176e163e1782fef1634b6c45c7f31bd4692726d02a30ab45a06648e",
|
||||
"tools/graphrag/evaluation/freeze_graphrag.py": "0c330358beae2c5409e2dcd26be718c6b9534d5db9f2340f0390fe3be45cb60c",
|
||||
"tools/graphrag/evaluation/graphrag_evaluator.py": "3afe014e126b6ad90c8e408284d2c1979f54d6cf5dd19fd67f9249708fbed2d3",
|
||||
"tools/graphrag/evaluation/reproducibility.py": "b707d4c410cbf7d6769a6afdadfe79ef3bbd699a0323f0e0d2ab180ef7498680",
|
||||
"tools/graphrag/evaluation/source_oracle.py": "02a44584bf4fa0e8e9faa7e13b85873a1b00671e0abe556abec8a274621d666c",
|
||||
"tools/graphrag/graph_db.py": "a6fce68000065d328139829c5ca894623f6ed5828c74a869663366c2ad7b5ea2",
|
||||
"tools/graphrag/graph_search.py": "d08eaaa8c395e993cf6416f90226b16ea1fcefca4719304be4b64c61a174b98b",
|
||||
"tools/graphrag/graphrag.py": "71a13cb5aeef0e1b8247840d76f845af46b9c58b6bd9ba1b9ef210b468ad6805",
|
||||
"tools/graphrag/neo4j_smoke.py": "fb5244c72c29ef2acf96d1e7f54335ff168eed4119db1692025eb1b99194b7bb",
|
||||
"tools/graphrag/tests/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/tests/test_evaluation_pipeline_v2.py": "63d1b3e80ae3c7b563374fd7ab4aa5ffad3c614eafbd15142c577abd7f756bf9",
|
||||
"tools/graphrag/tests/test_evaluator_connected_v2.py": "29d7c9838ed1ff37ea3276df6feb1b6142158c43a0525712f490b648181882de",
|
||||
"tools/graphrag/tests/test_graph_search.py": "d5c95b5de2a0962857331929522764aa46a1222e550a3eb1aaca2148f9d58748",
|
||||
"tools/graphrag/tests/test_graph_search_entity_v2.py": "639d9ac307589de6788ef8145a4e7f73d97a1531445294424e0fc8ba83f99a1c",
|
||||
"tools/graphrag/tests/test_graph_search_neo4j.py": "fec2bf72de8f752f17c9164fee5754bdb2e153828855e47efbf0000dbe82cf3b",
|
||||
"tools/graphrag/tests/test_graph_search_regressions.py": "9db7779aeb8ed9e8c0f92c1657011a81080aff3c928649e811358e3009a18c48",
|
||||
"tools/graphrag/tests/test_graphrag.py": "6379335110f05668beca87ca7e486442071b2f666dbd651408d5f3a8d5723f0e",
|
||||
"tools/graphrag/tests/test_graphrag_evaluator.py": "1c6d08aeec9ae56ac4123239a5aed12a0081d66cc3f34b2047d95764579d7298",
|
||||
"tools/graphrag/tests/test_graphrag_freeze.py": "c4b760baf4c7ebf13b16bd4cd3c51874f5512eef3b4c61470dc4d428b0303d9f",
|
||||
"tools/graphrag/tests/test_graphrag_research_v2.py": "19ebf4a6fd622aaebc8f8b7e17c2aeda83ba17e7f04f155ee70817fa3c14fe03",
|
||||
"tools/graphrag/tests/test_graphrag_root_title.py": "085651fe6e6081521a5dde9554abfee93456250108cf15978df25378d886a46c",
|
||||
"tools/graphrag/tests/test_source_oracle_v2.py": "eea11c98f477764fd0826b0c26396d3617a21ffec76ef15809e74ed27e53ff3b",
|
||||
"requirements.txt": "26a6d097727eba03c1b6c71cd02b06373ef01ce03e567dd2bc4357ae330e5a1a"
|
||||
},
|
||||
"dataset_sha256": "fd9835adee93cacf2c45806dfe93463c2e9a58ccedb5f073876ad176039ad734",
|
||||
"inputs": {
|
||||
"data/documents.json": "0542af2a373771cf7c4a95f93d14f4f687f6a0187846892c959aa6efc4bade52",
|
||||
"data/chunks.json": "437dde589be46e0c30842dd330de22d96a0173d2dbaff9c5f129568cb2bca4c9"
|
||||
},
|
||||
"source_corpus": {
|
||||
"sha256": "440da12a7a991824e923f70cada7c616c3fb3b0f12767ec7d75039a6a3231b10",
|
||||
"document_count": 114,
|
||||
"documents": {
|
||||
"pages/interns/bogdan_paul_chis/README.md": "3b4b946eb3c10e9f9a4092e6cffa01c5080e7579aded2f6ed3120c41ed62b647",
|
||||
"pages/interns/cesar_gutierrez/README.md": "b0be60576eed28d4b1920e9acf198684519373dfc13171567247c853b3ed699e",
|
||||
"pages/interns/oliver_pejic/README.md": "0470f3c8465be8f02204b08e4c75ef47f68c7e4ad1038faa5641cdf1811f33d5",
|
||||
"pages/interns/sevval_bulburu/README.md": "ff2a9d66253802f1af0fdfd74832e40fae41b6df23c5e61dc266f6cd0cc16c4d",
|
||||
"pages/interns/yussef_ressaissi/README.md": "f997a65699da0db3222ef7a3c37652d05dfc3419ad4ec74683bafc2c897bb987",
|
||||
"pages/students/2016/darius_lindvai/README.md": "fcaa47bb9708a6439eec5c4b7f7b4ed6c7359e423e1d940e1aed9f44957e6d62",
|
||||
"pages/students/2016/darius_lindvai/dp2021/README.md": "be3d0fea2a6d592b225eecabd9b19445c2fce62b8289c07ab6af93835db12970",
|
||||
"pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md": "352162de1b1e192228fa5d26506c028ac47e567e90df53b1bbaa6ad736ec4766",
|
||||
"pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md": "b4a81ff457624b089d618e4479afb1e3d748f6724f72104ef5518e535ae02fe5",
|
||||
"pages/students/2016/dominik_nagy/README.md": "1c4037a158d84c45fa705a0c38e47142a9d46e226f0c138bc2d56d7c38f6d74d",
|
||||
"pages/students/2016/dominik_nagy/timovy_projekt/README.md": "b81a4dab7316f7b846dcf36515f6aa9d44035c86f46f0e07b7a43308bcd31458",
|
||||
"pages/students/2016/ediz_morochovic/README.md": "045e5eb9a3df2b84140808fbca0c3163266ad0efa144bc42d9d5c597881c6ac6",
|
||||
"pages/students/2016/jakub_maruniak/README.md": "6734c41a95b9d0c1e3d226b393ad109ee4a7b82ebfffa73df2d7e0a743fefa14",
|
||||
"pages/students/2016/jakub_maruniak/dp2021/README.md": "9cd884aec70705cdb2aaa0f514b513f16de263c37b749ced7f92916cd2f91c39",
|
||||
"pages/students/2016/jakub_maruniak/dp2021/annotation/README.md": "debae0c50aea1accef0840912b9b1f37b2138f856002bb50e91d7ea2dbbe7963",
|
||||
"pages/students/2016/jakub_maruniak/dp2021/train_experiments/README.md": "01dff38b37043414fa1db204394ddbe7aade00e14d02d495572b65c85d09b194",
|
||||
"pages/students/2016/jakub_maruniak/timovy_projekt/README.md": "04114b1f3d84664aad5bdba5a0b614c5a6f23392be3c31fd9123d63db1be0a35",
|
||||
"pages/students/2016/jan_holp/README.md": "80d6a8492766e5bfa61673a372e5f059d30c8e335de39842866c51485960e4d3",
|
||||
"pages/students/2016/jan_holp/dp2021/README.md": "a62acb74009376766c7e2f9856ee01d21f84593eb9b3ce85cf2e6032aa412476",
|
||||
"pages/students/2016/jan_holp/dp2021/zdrojove_subory/README.md": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"pages/students/2016/jan_holp/timovy_projekt/README.md": "79eebdfd3af7e8d5c279077e285a580731b1cf8cc9b4454f6596796e9915f70c",
|
||||
"pages/students/2016/lukas_pokryvka/README.md": "f279456c5c277ff1ee0dd89a3464ed9f9f67b44bc185a5da9811ef5cfb675002",
|
||||
"pages/students/2016/lukas_pokryvka/dp2021/README.md": "39b61376ce108e4a930f926ab2d6a997207457121bccfcf617129a3b210a15cf",
|
||||
"pages/students/2016/lukas_pokryvka/timovy_projekt/README.md": "4de4b6c8cfed17b6c60090f82df1d55a66be70a79d3013850689b2baebdd801b",
|
||||
"pages/students/2016/mark_feher/README.md": "bec37c0319fe0869a0377d771db23d090dbda93c27328f5697cdaeb3bbccfe9b",
|
||||
"pages/students/2016/maros_harahus/README.md": "0da150e91918632c9e8cd1443f04da403595a372517e254928ce9f76c9d5033d",
|
||||
"pages/students/2016/maros_harahus/timovy_projekt/README.md": "75af19f7c68f4b646fa1dbae75f3f3dfc52633a9f9da1400d21808bb20be0d83",
|
||||
"pages/students/2016/patrik_pavlisin/README.md": "dc1c648d7cd9b0f0e021c57f9b98189e37c100871439e7e304390715913f2763",
|
||||
"pages/students/2016/patrik_pavlisin/dp21/README.md": "ac1eb0fd0360ad34aa21b7c8da5bb010a6edf10be5721f28dedc3986cd1d8c54",
|
||||
"pages/students/2016/patrik_pavlisin/dp22/README.md": "f2a8c619a812b99abab618ae388eb672407950e1f33fb8d7da7a528c4de81d50",
|
||||
"pages/students/2016/patrik_pavlisin/tp20/README.md": "ae9c771f27e7e093bc29c6888c8d0b27ed61fb41519fd0d7e7f4f6cbb4626edc",
|
||||
"pages/students/2016/tomas_kucharik/README.md": "6a1a215433eb1857660177b4cb2ecec03c6a86743d3a04cd6d5c9d9682c9e63b",
|
||||
"pages/students/2017/dmytro_ushatenko/README.md": "65f4ac177d492162b08ca5da3d9eb048bd088a3c117a28a662113b7e4bc3a4ec",
|
||||
"pages/students/2017/martin_jancura/README.md": "6a0a18d5095dcfb12abfdd72c9cfd8025d714fb5e29a7858cd2b285e4cb986b9",
|
||||
"pages/students/2017/stanislav_matsunych/README.md": "90ffa11eff4a4360b0252dbc53a116c3a5777b3d5dd86ce5c89c02bdd2051c73",
|
||||
"pages/students/2017/than_trung_thanh/README.md": "2150519b8580e7337520db4de64d2d1c82d2634380537d019f41c506dbf2979d",
|
||||
"pages/students/2018/NaN1name_buday/README.md": "23c8c58090bdc954347e36f141bea91f43c8d5b1d777e346864a2ebe84c0bcce",
|
||||
"pages/students/2018/adrian_remias/README.md": "e5bfe1d5d4e626beaa636a02d34ec58cf2cff9b0e57833905af35b80bf1465a2",
|
||||
"pages/students/2018/david_ilas/README.md": "96c45ff9c5a821ddcb1a2fc86d487bd8f4729d1b76887914b0f5fbf99af45af0",
|
||||
"pages/students/2018/david_omasta/README.md": "4164051870e1e1cf8949ed18a74196e9ea789dfbe4fee24bdeb736ca42848327",
|
||||
"pages/students/2018/martin_wencel/README.md": "0e6a7a981689f22304f8baa5de97d4315c0695c94c9277de7851943eb012253b",
|
||||
"pages/students/2018/oleh_bilykh/README.md": "4072c62dd8ee753a0c8fa43fdfbbdf566e394c2df13e6a79d08a302e332710b1",
|
||||
"pages/students/2018/ondrej_megela/README.md": "969ff2e1a436b8f957e7168cf5eb678196b99aeda17701c502b016441f644065",
|
||||
"pages/students/2018/samuel_sirotnik/README.md": "cc230ede67b6e8632511c92a5ed6d1e9deb42e70819280222bdfd369ee77fc70",
|
||||
"pages/students/2019/alina_vitko/README.md": "9b071fe2aff470c275ae027be236fe836f741f774cabb9cbbb55304a8d5102cd",
|
||||
"pages/students/2019/artem_yatsenko/README.md": "328b101e46c51c959e792cf7ca226942f81d2ab8fe9648ad6d0ecd07016429e2",
|
||||
"pages/students/2019/david_stromp/README.md": "e46ca8691d5ec894128f6f6f2ed33e2c7bd141f80719bb0449b20f10f30cca09",
|
||||
"pages/students/2019/dmytro_mural/README.md": "e881a47d847c3ef8d680844113fdbfbb87553b28982bf9eef4936f6d30923e93",
|
||||
"pages/students/2019/filip_tomas/README.md": "75a1fe7b921e4bff0fdf9e2a957b4adad4b4a57aa7ebdffbb73dd82c02123f94",
|
||||
"pages/students/2019/kristian_sopkovic/README.md": "3286960fb30f584df35455f9b6dfae81ca4827a1d711d2bcd6e48c3f150c9279",
|
||||
"pages/students/2019/michal_stromko/README.md": "3ae1dd9b6638a6a249a94be3f3846286555666aefa225bb3a2c7288b35900ce7",
|
||||
"pages/students/2019/michal_stromko/vp2021/README.md": "feb2e093fdd6461239e79b1e1f96e65a1c8cd96e8a2b70535ae556a9c198046a",
|
||||
"pages/students/2019/michal_stromko/vp2021/tutorials/README.md": "40e3fa448c7329ef863e705435e23fe6b4788de440710f066fe0eed92d132bad",
|
||||
"pages/students/2019/michal_stromko/vp2021/tutorials/img/README.md": "e8d3ac160b17dfdee2c3e996bf6a03af7a6f16f9140bf5cf7ee343a82dd1865f",
|
||||
"pages/students/2019/patrik_pokrivcak/README.md": "3e3957ad0f7aca59d6eb64c38a3f5e21d8fd953200825d0d0e5cacabfbc35a7d",
|
||||
"pages/students/2019/samuel_horani/README.md": "86e6959ccc612b069687b57996fa3f61660075d6a0d65bfec64f423d39a0a999",
|
||||
"pages/students/2020/david_kostilnik/README.md": "2927524b75da59a64120fc364a0fc374986fa4d364d54e52c36800762c203264",
|
||||
"pages/students/2020/jakub_kristian_lukas/README.md": "f139d9b1ebf5a3f45612f3df5703ecdd935b90701763c27c7c529044c0b0455a",
|
||||
"pages/students/2020/kamil_tomcufcik/README.md": "9d865adf538bc6d7992ee4f4882713447da5c936fca17c43ca0f576072537048",
|
||||
"pages/students/2020/matej_kobylan/README.md": "3d7b289e17b8f25678a07e9ee0e6741688485a0ccb1e50940a6a6acc6312a547",
|
||||
"pages/students/2020/matus_suchanic/README.md": "770ca49538cca22df35f8e7ba736ee97483e4fe5788c221496553592b4e78dc6",
|
||||
"pages/students/2020/pavol_hudak/README.md": "33d06fccc6451e5f19b27b0cad001a34e81635b4ea294a01dec7771c823abc40",
|
||||
"pages/students/2020/vladyslav_krupko/README.md": "4c28e6d38651bb2cafcbf4a18e35210cd369aef2caff6c5b0aa52fac38f0fe7d",
|
||||
"pages/students/2021/artur_hyrenko/README.md": "0568261f4ade4de5472edcfeb1ffed9abae18dc67e4050f4ce2ad088839a2bb3",
|
||||
"pages/students/2021/eduard_matovka/README.md": "de2a7ae38ec87110e347956b37d0605a298ed2847f972961cc9b977da8221d43",
|
||||
"pages/students/2021/manohar_gowdru_shridharu/README.md": "c00ceb620ed7087ead5d9448d476bbb98d273d1d9e7bf1bc4355c367b26c7a6b",
|
||||
"pages/students/2021/martin_sarissky/README.md": "8e97b45a253745faa55f63c844e0b5dfe680aeaf6eb01fb8f9d06ac6e8ee8bcf",
|
||||
"pages/students/2021/matej_novotny/README.md": "b083a7cadde532e3428dc9a57bc61456fcc5905bda91e011b96033d42bf5d9cb",
|
||||
"pages/students/2021/matej_scislak/README.md": "b9a32cce8605e044a4f2828ff2d91a2995a62ef3a841e62f0a225c97221f0cc8",
|
||||
"pages/students/2021/nikita_bodnar/README.md": "2016c0dd923c0f8e561d5cea42ac81da3610fdcc54a4527f56d078e34e53ce90",
|
||||
"pages/students/2021/oleksandr_hryshchenko/README.md": "4b073992b715b6c75b79fd2c8f850a69f940966e3a61a82c625c32c945a93036",
|
||||
"pages/students/2021/vladimir_ferko/README.md": "68e7d311896eda2171e5eec1ec3a8da90d326ed91acaace8058f68664a50d271",
|
||||
"pages/students/2022/andrii_pervashov/README.md": "319dcaa1cc2e29dd7e3a710bab26cb3ac6944ab71b0b97e1de076b1199122334",
|
||||
"pages/students/2022/daniil_huzenko/README.md": "390782fbff6220a9462060ce1a62959f2a2b88f42d06e2c51d1f406b75d73f2c",
|
||||
"pages/students/2022/jakub_schwarc/README.md": "f541a8852c2b0f6f9d7182e01a34c4e3beee9bfa55427a06b331638b11eb8be6",
|
||||
"pages/students/2022/jan_malinovsky/README.md": "8af021bfb131fa005a7aec3e2f2f12fc17fa5dc14e2675311adbbfc445a4bcab",
|
||||
"pages/students/2022/jan_ptak/README.md": "131cf053764fd5423541ebe672c3b4f5da875cfb8e4b821f1335ddb967282282",
|
||||
"pages/students/2022/oleh_poiasnik/README.md": "c2f7dc3f61f8b4a5b43ded1e3ae4c7d3e7f874439ee6b17dd9c8d45dabc25bc8",
|
||||
"pages/students/2022/samuel_vasil/README.md": "67c807049147aacd04f3050f4ff0233a8b3f0a239ab173b430e13dfe113ad0a5",
|
||||
"pages/students/2022/serhii_yemets/README.md": "ffbeac893947acafe855d576322a8826f9d4f87ac344cb31f8ceeefa244b9133",
|
||||
"pages/students/2022/tetiana_mohorian/README.md": "c9efdc632bf1ca89a0bfde0dc00be7aaac8a85da3d92e2ce8506236c73e93cfb",
|
||||
"pages/students/2022/valerii_kutsenko/README.md": "dc764c609ad3c1df59cfea997d4db82a591b1b1e0764453e319d841115507e4f",
|
||||
"pages/students/2022/vladyslav_yanchenko/README.md": "4d1ce216e3b526ee437ddbc658e51d7bb83530087e43628c096a569a3854a47f",
|
||||
"pages/students/2022/yevhenii_leonov/README.md": "b90e41db0cec2451027020a9102d32a24d777e8a38b604ccca87b36cd6b3a292",
|
||||
"pages/students/2023/denis_le_thanh/README.md": "2cb83f942d86a02712b0c58778e46dc2211346d1a6eba606471dfa832245db61",
|
||||
"pages/students/2023/maksym_zatirka/README.md": "7a7d2cbe276c352dacfbc6ba6de5f15303d30ecf34845ff8da8d085f3d67c3dd",
|
||||
"pages/students/2023/oleksandr_dorybohov/README.md": "c24d6f941de0dafb4459cea8259cf147821cafc86ba65be5b528f419f734bc18",
|
||||
"pages/students/2023/ronald_zalacko/README.md": "724b0f8e6e641236dba9bddbd77f4546e09514076c7dfb151807aaf4b882c96f",
|
||||
"pages/students/2023/rostyslav_rodzhuk/README.md": "de356dd7427c8a0716c165a0f88ae47b691a86ee7a388f60e2d2e9306298415c",
|
||||
"pages/students/2023/samuel_dzurina/README.md": "4818191d044b91219c796a35010c95da5cf2093e050d494f30b219b91e13fa0e",
|
||||
"pages/students/2023/simona_bobrovcanova/README.md": "e473a1911dae10ab40e2cf6696a8be616a58c22aaf09af5953fbac475791a35e",
|
||||
"pages/students/2023/yevhenii_medushivskyi/README.md": "5710ebf91c893a12fe6d19f5372311938d1e7c7bbdf203f2dc8ed2fe7c4f5a24",
|
||||
"pages/topics/akopisat/README.md": "c7245e1fbfa4160618502c0baf8cc6bc47cd9a82b8a85bc1c645314829a7b76a",
|
||||
"pages/topics/bert/README.md": "35e507f7ec2ad1d3526e2a15f94ea085ee25f680a02daf6df62fd429bd9c25c9",
|
||||
"pages/topics/chatbot/README.md": "6f2f83ffb80109be47f9750cca9d3036ec3645abef9f2b590bd6825780c7c48a",
|
||||
"pages/topics/faq/README.md": "15cfbd9c2a1649c80a7a58922e2b66dadab5c86a5ef33ef16c82bebd4d2dbf06",
|
||||
"pages/topics/hatespeech/README.md": "364df94e70dd740c63544e2586ba7b957780f714fc0c941d1b04b02233e6cbc5",
|
||||
"pages/topics/legal/README.md": "003bb9bfe1e0ca21652091c2d11496312eb04e0689fe459e14c2d5a738e8eeea",
|
||||
"pages/topics/morphology/README.md": "e242cc5ff1a4cc98e227566c0ead999bbc95937b7c20be62cb2afb773d0d35c0",
|
||||
"pages/topics/named-entity/README.md": "66b2e25f70211d432d596e377d552b3b8f0c525b14c31e3bc9c956c3aeadca84",
|
||||
"pages/topics/named-entity/navod/README.md": "1ff87079a98411de0414754c60241e08d2214ddcd63ddf974e4340cce2ce5b02",
|
||||
"pages/topics/nlp/README.md": "6f90abf9dc3f0ff33475283c13b4a08561abf631425ec2daacb076155a9e02c2",
|
||||
"pages/topics/otvorene/README.md": "cd5544925553fe3840c0ea6f8ef60ab756e26ab6757bf810025c948d8d4f98fc",
|
||||
"pages/topics/prodigy/README.md": "5e4f691f2754c2ec4afbaab2f41e6db77feb5b322dd9344465eb40c35f116499",
|
||||
"pages/topics/python/README.md": "2ef073adba672142c39e9a59fa2e00a98ab52bda54233d46fbe6940ee23f9fcc",
|
||||
"pages/topics/question/README.md": "408078a2a67cea2699e12359e85ab641136231e6104c2afdf874a705879525df",
|
||||
"pages/topics/question/navod/README.md": "061e737c69184b2bd244316ca7ba841f7186fe01ee80ee993742a733dcad3ecd",
|
||||
"pages/topics/question/nezodpovedatelne/README.md": "b6703d9690f4599b973efb27595ce157773ae0fc0d55cf2c0a09d9f50e8e4c92",
|
||||
"pages/topics/question/validacie/README.md": "3216a7127abdfc6da50ed116f44ff2d6785e7da4af70d23aceda774e745ad562",
|
||||
"pages/topics/resources/README.md": "09405397387f00cbcc5680f7d655f2d861e4d92e5df792a62d9dfd04f3534f48",
|
||||
"pages/topics/seq2seq/README.md": "969d15c03a63a3f8d5edc9017fe5a0fb7311fdf4de4a3473a08266241f92c1e2",
|
||||
"pages/topics/spacy/README.md": "f504e5db77cb8694f08a57fb8636e522d59a0e669216f4bc8273bc3c5f375f87",
|
||||
"pages/topics/steel/README.md": "b4068cef2ed197711467ac47630d5b2064fdc8828f898f7af99664e94d833330",
|
||||
"pages/topics/translation/README.md": "a7d4289e72199b307dc5ad8fc69cda39c1a33c27a6c7447af70aa9c3cc6b8635"
|
||||
}
|
||||
}
|
||||
},
|
||||
"graph": {
|
||||
"sha256": "a7b95c647eb9a4eff6060f6e7e8be2b74a8246095f3c8c98d4611f4be545f51a",
|
||||
"nodes": 429,
|
||||
"relationships": 843
|
||||
},
|
||||
"parameters": {
|
||||
"limit": 40,
|
||||
"max_entities": 8
|
||||
},
|
||||
"dev_summary": {
|
||||
"questions": 509,
|
||||
"strict_count": 509,
|
||||
"strict_accuracy": 1.0,
|
||||
"error_count": 0,
|
||||
"value_score": 1.0,
|
||||
"entity_score": 1.0,
|
||||
"relation_score": 1.0,
|
||||
"property_score": 1.0,
|
||||
"relation_choice_score": 1.0,
|
||||
"document_recall": 1.0,
|
||||
"source_recall": 1.0,
|
||||
"binding_score": 1.0,
|
||||
"path_score": 1.0,
|
||||
"answerability_accuracy": 1.0,
|
||||
"latency_mean_seconds": 0.042799,
|
||||
"latency_median_seconds": 0.040359,
|
||||
"latency_p95_seconds": 0.061584
|
||||
},
|
||||
"source_audit_summary": {
|
||||
"dev": {
|
||||
"questions": 509,
|
||||
"source_consistent": 509,
|
||||
"issues": {}
|
||||
},
|
||||
"test": {
|
||||
"questions": 80,
|
||||
"source_consistent": 80,
|
||||
"issues": {}
|
||||
}
|
||||
},
|
||||
"policy": "Report all questions including negatives. No exclusions or holdout tuning.",
|
||||
"dev_results_sha256": "3bcb4bed1370975c47de2d34ea00f80c87d4832eee395cfde0d69130d5716be6",
|
||||
"audit_sha256": "6000c6a14cedaa31dd8c1b35b7f95c142a4233cd8508542f84235bceaf6c6cdf"
|
||||
}
|
||||
212
tools/graphrag/evaluation/frozen_v3.json
Normal file
212
tools/graphrag/evaluation/frozen_v3.json
Normal file
@ -0,0 +1,212 @@
|
||||
{
|
||||
"schema_version": 2,
|
||||
"partition": {
|
||||
"method": "disjoint source profiles",
|
||||
"dev_profile_count": 69,
|
||||
"test_profile_count": 2,
|
||||
"overlap": 0
|
||||
},
|
||||
"frozen_at_utc": "2026-10-25T01:13:16.783627+00:00",
|
||||
"fingerprints": {
|
||||
"implementation": {
|
||||
"tools/graphrag/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/build_graphrag.py": "81f6e9f5c9e71b588f8bed1968c1e900e29e484ba81d23b6a3a68e7220ad75a5",
|
||||
"tools/graphrag/evaluation/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/evaluation/audit_benchmark.py": "6619c818a52fc284e87ed6c48a503a54a3c9dd95447463ed78f075b7c58bad80",
|
||||
"tools/graphrag/evaluation/benchmark_v2.py": "3e66d8e20d049758ac6df393355c0b5038f09c6ba97c96acc2087d61cfb4ad26",
|
||||
"tools/graphrag/evaluation/benchmark_v3.py": "30bae6c605ed26f4b49973acec799087c4e2b97a883ccedcafb965dd909c4c4d",
|
||||
"tools/graphrag/evaluation/evaluate_graphrag.py": "313882233f5e62f700b512091e8166fc072f42add7a53e2a17af42f785d1fa6b",
|
||||
"tools/graphrag/evaluation/evidence_contract.py": "78e24264c176e163e1782fef1634b6c45c7f31bd4692726d02a30ab45a06648e",
|
||||
"tools/graphrag/evaluation/freeze_graphrag.py": "b850483db6e8dc94f2c8729d1e40b3e9363628a1181a47863f137a3390c69166",
|
||||
"tools/graphrag/evaluation/graphrag_evaluator.py": "3afe014e126b6ad90c8e408284d2c1979f54d6cf5dd19fd67f9249708fbed2d3",
|
||||
"tools/graphrag/evaluation/reproducibility.py": "b707d4c410cbf7d6769a6afdadfe79ef3bbd699a0323f0e0d2ab180ef7498680",
|
||||
"tools/graphrag/evaluation/source_oracle.py": "d9d1b5a2a5811b18fe579528c0bdacba46bddda8a196c4dfa000288033937094",
|
||||
"tools/graphrag/graph_db.py": "a6fce68000065d328139829c5ca894623f6ed5828c74a869663366c2ad7b5ea2",
|
||||
"tools/graphrag/graph_search.py": "296560e77a5c4cefe23430bb8197cc86b5680a7539508a6f63285ddd099a94ed",
|
||||
"tools/graphrag/graphrag.py": "61597bbc76d47dc6e4c3a4517eabb462f803aea450c85b42c1c823a34d4f1397",
|
||||
"tools/graphrag/neo4j_smoke.py": "fb5244c72c29ef2acf96d1e7f54335ff168eed4119db1692025eb1b99194b7bb",
|
||||
"tools/graphrag/tests/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/tests/test_evaluation_pipeline_v2.py": "63d1b3e80ae3c7b563374fd7ab4aa5ffad3c614eafbd15142c577abd7f756bf9",
|
||||
"tools/graphrag/tests/test_evaluator_connected_v2.py": "29d7c9838ed1ff37ea3276df6feb1b6142158c43a0525712f490b648181882de",
|
||||
"tools/graphrag/tests/test_graph_search.py": "d5c95b5de2a0962857331929522764aa46a1222e550a3eb1aaca2148f9d58748",
|
||||
"tools/graphrag/tests/test_graph_search_entity_v2.py": "0ef1a8ebd513c5a4507eb38fcf5ae6137c69e9901b5a2975ba513be5902ac693",
|
||||
"tools/graphrag/tests/test_graph_search_neo4j.py": "fec2bf72de8f752f17c9164fee5754bdb2e153828855e47efbf0000dbe82cf3b",
|
||||
"tools/graphrag/tests/test_graph_search_regressions.py": "9db7779aeb8ed9e8c0f92c1657011a81080aff3c928649e811358e3009a18c48",
|
||||
"tools/graphrag/tests/test_graphrag.py": "6379335110f05668beca87ca7e486442071b2f666dbd651408d5f3a8d5723f0e",
|
||||
"tools/graphrag/tests/test_graphrag_evaluator.py": "1c6d08aeec9ae56ac4123239a5aed12a0081d66cc3f34b2047d95764579d7298",
|
||||
"tools/graphrag/tests/test_graphrag_freeze.py": "c4b760baf4c7ebf13b16bd4cd3c51874f5512eef3b4c61470dc4d428b0303d9f",
|
||||
"tools/graphrag/tests/test_graphrag_research_v2.py": "711008a91ab8a58ae0854e7f90329bcd42e5189fde2e2001589e97b0c22c5198",
|
||||
"tools/graphrag/tests/test_graphrag_root_title.py": "085651fe6e6081521a5dde9554abfee93456250108cf15978df25378d886a46c",
|
||||
"tools/graphrag/tests/test_source_oracle_v2.py": "0afdbe235e185ffe9f38aa667f90f5a6c20504fe29e9ac572642b39a8eb7faca",
|
||||
"requirements.txt": "26a6d097727eba03c1b6c71cd02b06373ef01ce03e567dd2bc4357ae330e5a1a"
|
||||
},
|
||||
"dataset_sha256": "3094100b9b6cfe4bb04f7479bddce07f392812ce7bdad97703d74db54b6a54ad",
|
||||
"inputs": {
|
||||
"data/documents.json": "0542af2a373771cf7c4a95f93d14f4f687f6a0187846892c959aa6efc4bade52",
|
||||
"data/chunks.json": "437dde589be46e0c30842dd330de22d96a0173d2dbaff9c5f129568cb2bca4c9"
|
||||
},
|
||||
"source_corpus": {
|
||||
"sha256": "440da12a7a991824e923f70cada7c616c3fb3b0f12767ec7d75039a6a3231b10",
|
||||
"document_count": 114,
|
||||
"documents": {
|
||||
"pages/interns/bogdan_paul_chis/README.md": "3b4b946eb3c10e9f9a4092e6cffa01c5080e7579aded2f6ed3120c41ed62b647",
|
||||
"pages/interns/cesar_gutierrez/README.md": "b0be60576eed28d4b1920e9acf198684519373dfc13171567247c853b3ed699e",
|
||||
"pages/interns/oliver_pejic/README.md": "0470f3c8465be8f02204b08e4c75ef47f68c7e4ad1038faa5641cdf1811f33d5",
|
||||
"pages/interns/sevval_bulburu/README.md": "ff2a9d66253802f1af0fdfd74832e40fae41b6df23c5e61dc266f6cd0cc16c4d",
|
||||
"pages/interns/yussef_ressaissi/README.md": "f997a65699da0db3222ef7a3c37652d05dfc3419ad4ec74683bafc2c897bb987",
|
||||
"pages/students/2016/darius_lindvai/README.md": "fcaa47bb9708a6439eec5c4b7f7b4ed6c7359e423e1d940e1aed9f44957e6d62",
|
||||
"pages/students/2016/darius_lindvai/dp2021/README.md": "be3d0fea2a6d592b225eecabd9b19445c2fce62b8289c07ab6af93835db12970",
|
||||
"pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md": "352162de1b1e192228fa5d26506c028ac47e567e90df53b1bbaa6ad736ec4766",
|
||||
"pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md": "b4a81ff457624b089d618e4479afb1e3d748f6724f72104ef5518e535ae02fe5",
|
||||
"pages/students/2016/dominik_nagy/README.md": "1c4037a158d84c45fa705a0c38e47142a9d46e226f0c138bc2d56d7c38f6d74d",
|
||||
"pages/students/2016/dominik_nagy/timovy_projekt/README.md": "b81a4dab7316f7b846dcf36515f6aa9d44035c86f46f0e07b7a43308bcd31458",
|
||||
"pages/students/2016/ediz_morochovic/README.md": "045e5eb9a3df2b84140808fbca0c3163266ad0efa144bc42d9d5c597881c6ac6",
|
||||
"pages/students/2016/jakub_maruniak/README.md": "6734c41a95b9d0c1e3d226b393ad109ee4a7b82ebfffa73df2d7e0a743fefa14",
|
||||
"pages/students/2016/jakub_maruniak/dp2021/README.md": "9cd884aec70705cdb2aaa0f514b513f16de263c37b749ced7f92916cd2f91c39",
|
||||
"pages/students/2016/jakub_maruniak/dp2021/annotation/README.md": "debae0c50aea1accef0840912b9b1f37b2138f856002bb50e91d7ea2dbbe7963",
|
||||
"pages/students/2016/jakub_maruniak/dp2021/train_experiments/README.md": "01dff38b37043414fa1db204394ddbe7aade00e14d02d495572b65c85d09b194",
|
||||
"pages/students/2016/jakub_maruniak/timovy_projekt/README.md": "04114b1f3d84664aad5bdba5a0b614c5a6f23392be3c31fd9123d63db1be0a35",
|
||||
"pages/students/2016/jan_holp/README.md": "80d6a8492766e5bfa61673a372e5f059d30c8e335de39842866c51485960e4d3",
|
||||
"pages/students/2016/jan_holp/dp2021/README.md": "a62acb74009376766c7e2f9856ee01d21f84593eb9b3ce85cf2e6032aa412476",
|
||||
"pages/students/2016/jan_holp/dp2021/zdrojove_subory/README.md": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"pages/students/2016/jan_holp/timovy_projekt/README.md": "79eebdfd3af7e8d5c279077e285a580731b1cf8cc9b4454f6596796e9915f70c",
|
||||
"pages/students/2016/lukas_pokryvka/README.md": "f279456c5c277ff1ee0dd89a3464ed9f9f67b44bc185a5da9811ef5cfb675002",
|
||||
"pages/students/2016/lukas_pokryvka/dp2021/README.md": "39b61376ce108e4a930f926ab2d6a997207457121bccfcf617129a3b210a15cf",
|
||||
"pages/students/2016/lukas_pokryvka/timovy_projekt/README.md": "4de4b6c8cfed17b6c60090f82df1d55a66be70a79d3013850689b2baebdd801b",
|
||||
"pages/students/2016/mark_feher/README.md": "bec37c0319fe0869a0377d771db23d090dbda93c27328f5697cdaeb3bbccfe9b",
|
||||
"pages/students/2016/maros_harahus/README.md": "0da150e91918632c9e8cd1443f04da403595a372517e254928ce9f76c9d5033d",
|
||||
"pages/students/2016/maros_harahus/timovy_projekt/README.md": "75af19f7c68f4b646fa1dbae75f3f3dfc52633a9f9da1400d21808bb20be0d83",
|
||||
"pages/students/2016/patrik_pavlisin/README.md": "dc1c648d7cd9b0f0e021c57f9b98189e37c100871439e7e304390715913f2763",
|
||||
"pages/students/2016/patrik_pavlisin/dp21/README.md": "ac1eb0fd0360ad34aa21b7c8da5bb010a6edf10be5721f28dedc3986cd1d8c54",
|
||||
"pages/students/2016/patrik_pavlisin/dp22/README.md": "f2a8c619a812b99abab618ae388eb672407950e1f33fb8d7da7a528c4de81d50",
|
||||
"pages/students/2016/patrik_pavlisin/tp20/README.md": "ae9c771f27e7e093bc29c6888c8d0b27ed61fb41519fd0d7e7f4f6cbb4626edc",
|
||||
"pages/students/2016/tomas_kucharik/README.md": "6a1a215433eb1857660177b4cb2ecec03c6a86743d3a04cd6d5c9d9682c9e63b",
|
||||
"pages/students/2017/dmytro_ushatenko/README.md": "65f4ac177d492162b08ca5da3d9eb048bd088a3c117a28a662113b7e4bc3a4ec",
|
||||
"pages/students/2017/martin_jancura/README.md": "6a0a18d5095dcfb12abfdd72c9cfd8025d714fb5e29a7858cd2b285e4cb986b9",
|
||||
"pages/students/2017/stanislav_matsunych/README.md": "90ffa11eff4a4360b0252dbc53a116c3a5777b3d5dd86ce5c89c02bdd2051c73",
|
||||
"pages/students/2017/than_trung_thanh/README.md": "2150519b8580e7337520db4de64d2d1c82d2634380537d019f41c506dbf2979d",
|
||||
"pages/students/2018/NaN1name_buday/README.md": "23c8c58090bdc954347e36f141bea91f43c8d5b1d777e346864a2ebe84c0bcce",
|
||||
"pages/students/2018/adrian_remias/README.md": "e5bfe1d5d4e626beaa636a02d34ec58cf2cff9b0e57833905af35b80bf1465a2",
|
||||
"pages/students/2018/david_ilas/README.md": "96c45ff9c5a821ddcb1a2fc86d487bd8f4729d1b76887914b0f5fbf99af45af0",
|
||||
"pages/students/2018/david_omasta/README.md": "4164051870e1e1cf8949ed18a74196e9ea789dfbe4fee24bdeb736ca42848327",
|
||||
"pages/students/2018/martin_wencel/README.md": "0e6a7a981689f22304f8baa5de97d4315c0695c94c9277de7851943eb012253b",
|
||||
"pages/students/2018/oleh_bilykh/README.md": "4072c62dd8ee753a0c8fa43fdfbbdf566e394c2df13e6a79d08a302e332710b1",
|
||||
"pages/students/2018/ondrej_megela/README.md": "969ff2e1a436b8f957e7168cf5eb678196b99aeda17701c502b016441f644065",
|
||||
"pages/students/2018/samuel_sirotnik/README.md": "cc230ede67b6e8632511c92a5ed6d1e9deb42e70819280222bdfd369ee77fc70",
|
||||
"pages/students/2019/alina_vitko/README.md": "9b071fe2aff470c275ae027be236fe836f741f774cabb9cbbb55304a8d5102cd",
|
||||
"pages/students/2019/artem_yatsenko/README.md": "328b101e46c51c959e792cf7ca226942f81d2ab8fe9648ad6d0ecd07016429e2",
|
||||
"pages/students/2019/david_stromp/README.md": "e46ca8691d5ec894128f6f6f2ed33e2c7bd141f80719bb0449b20f10f30cca09",
|
||||
"pages/students/2019/dmytro_mural/README.md": "e881a47d847c3ef8d680844113fdbfbb87553b28982bf9eef4936f6d30923e93",
|
||||
"pages/students/2019/filip_tomas/README.md": "75a1fe7b921e4bff0fdf9e2a957b4adad4b4a57aa7ebdffbb73dd82c02123f94",
|
||||
"pages/students/2019/kristian_sopkovic/README.md": "3286960fb30f584df35455f9b6dfae81ca4827a1d711d2bcd6e48c3f150c9279",
|
||||
"pages/students/2019/michal_stromko/README.md": "3ae1dd9b6638a6a249a94be3f3846286555666aefa225bb3a2c7288b35900ce7",
|
||||
"pages/students/2019/michal_stromko/vp2021/README.md": "feb2e093fdd6461239e79b1e1f96e65a1c8cd96e8a2b70535ae556a9c198046a",
|
||||
"pages/students/2019/michal_stromko/vp2021/tutorials/README.md": "40e3fa448c7329ef863e705435e23fe6b4788de440710f066fe0eed92d132bad",
|
||||
"pages/students/2019/michal_stromko/vp2021/tutorials/img/README.md": "e8d3ac160b17dfdee2c3e996bf6a03af7a6f16f9140bf5cf7ee343a82dd1865f",
|
||||
"pages/students/2019/patrik_pokrivcak/README.md": "3e3957ad0f7aca59d6eb64c38a3f5e21d8fd953200825d0d0e5cacabfbc35a7d",
|
||||
"pages/students/2019/samuel_horani/README.md": "86e6959ccc612b069687b57996fa3f61660075d6a0d65bfec64f423d39a0a999",
|
||||
"pages/students/2020/david_kostilnik/README.md": "2927524b75da59a64120fc364a0fc374986fa4d364d54e52c36800762c203264",
|
||||
"pages/students/2020/jakub_kristian_lukas/README.md": "f139d9b1ebf5a3f45612f3df5703ecdd935b90701763c27c7c529044c0b0455a",
|
||||
"pages/students/2020/kamil_tomcufcik/README.md": "9d865adf538bc6d7992ee4f4882713447da5c936fca17c43ca0f576072537048",
|
||||
"pages/students/2020/matej_kobylan/README.md": "3d7b289e17b8f25678a07e9ee0e6741688485a0ccb1e50940a6a6acc6312a547",
|
||||
"pages/students/2020/matus_suchanic/README.md": "770ca49538cca22df35f8e7ba736ee97483e4fe5788c221496553592b4e78dc6",
|
||||
"pages/students/2020/pavol_hudak/README.md": "33d06fccc6451e5f19b27b0cad001a34e81635b4ea294a01dec7771c823abc40",
|
||||
"pages/students/2020/vladyslav_krupko/README.md": "4c28e6d38651bb2cafcbf4a18e35210cd369aef2caff6c5b0aa52fac38f0fe7d",
|
||||
"pages/students/2021/artur_hyrenko/README.md": "0568261f4ade4de5472edcfeb1ffed9abae18dc67e4050f4ce2ad088839a2bb3",
|
||||
"pages/students/2021/eduard_matovka/README.md": "de2a7ae38ec87110e347956b37d0605a298ed2847f972961cc9b977da8221d43",
|
||||
"pages/students/2021/manohar_gowdru_shridharu/README.md": "c00ceb620ed7087ead5d9448d476bbb98d273d1d9e7bf1bc4355c367b26c7a6b",
|
||||
"pages/students/2021/martin_sarissky/README.md": "8e97b45a253745faa55f63c844e0b5dfe680aeaf6eb01fb8f9d06ac6e8ee8bcf",
|
||||
"pages/students/2021/matej_novotny/README.md": "b083a7cadde532e3428dc9a57bc61456fcc5905bda91e011b96033d42bf5d9cb",
|
||||
"pages/students/2021/matej_scislak/README.md": "b9a32cce8605e044a4f2828ff2d91a2995a62ef3a841e62f0a225c97221f0cc8",
|
||||
"pages/students/2021/nikita_bodnar/README.md": "2016c0dd923c0f8e561d5cea42ac81da3610fdcc54a4527f56d078e34e53ce90",
|
||||
"pages/students/2021/oleksandr_hryshchenko/README.md": "4b073992b715b6c75b79fd2c8f850a69f940966e3a61a82c625c32c945a93036",
|
||||
"pages/students/2021/vladimir_ferko/README.md": "68e7d311896eda2171e5eec1ec3a8da90d326ed91acaace8058f68664a50d271",
|
||||
"pages/students/2022/andrii_pervashov/README.md": "319dcaa1cc2e29dd7e3a710bab26cb3ac6944ab71b0b97e1de076b1199122334",
|
||||
"pages/students/2022/daniil_huzenko/README.md": "390782fbff6220a9462060ce1a62959f2a2b88f42d06e2c51d1f406b75d73f2c",
|
||||
"pages/students/2022/jakub_schwarc/README.md": "f541a8852c2b0f6f9d7182e01a34c4e3beee9bfa55427a06b331638b11eb8be6",
|
||||
"pages/students/2022/jan_malinovsky/README.md": "8af021bfb131fa005a7aec3e2f2f12fc17fa5dc14e2675311adbbfc445a4bcab",
|
||||
"pages/students/2022/jan_ptak/README.md": "131cf053764fd5423541ebe672c3b4f5da875cfb8e4b821f1335ddb967282282",
|
||||
"pages/students/2022/oleh_poiasnik/README.md": "c2f7dc3f61f8b4a5b43ded1e3ae4c7d3e7f874439ee6b17dd9c8d45dabc25bc8",
|
||||
"pages/students/2022/samuel_vasil/README.md": "67c807049147aacd04f3050f4ff0233a8b3f0a239ab173b430e13dfe113ad0a5",
|
||||
"pages/students/2022/serhii_yemets/README.md": "ffbeac893947acafe855d576322a8826f9d4f87ac344cb31f8ceeefa244b9133",
|
||||
"pages/students/2022/tetiana_mohorian/README.md": "c9efdc632bf1ca89a0bfde0dc00be7aaac8a85da3d92e2ce8506236c73e93cfb",
|
||||
"pages/students/2022/valerii_kutsenko/README.md": "dc764c609ad3c1df59cfea997d4db82a591b1b1e0764453e319d841115507e4f",
|
||||
"pages/students/2022/vladyslav_yanchenko/README.md": "4d1ce216e3b526ee437ddbc658e51d7bb83530087e43628c096a569a3854a47f",
|
||||
"pages/students/2022/yevhenii_leonov/README.md": "b90e41db0cec2451027020a9102d32a24d777e8a38b604ccca87b36cd6b3a292",
|
||||
"pages/students/2023/denis_le_thanh/README.md": "2cb83f942d86a02712b0c58778e46dc2211346d1a6eba606471dfa832245db61",
|
||||
"pages/students/2023/maksym_zatirka/README.md": "7a7d2cbe276c352dacfbc6ba6de5f15303d30ecf34845ff8da8d085f3d67c3dd",
|
||||
"pages/students/2023/oleksandr_dorybohov/README.md": "c24d6f941de0dafb4459cea8259cf147821cafc86ba65be5b528f419f734bc18",
|
||||
"pages/students/2023/ronald_zalacko/README.md": "724b0f8e6e641236dba9bddbd77f4546e09514076c7dfb151807aaf4b882c96f",
|
||||
"pages/students/2023/rostyslav_rodzhuk/README.md": "de356dd7427c8a0716c165a0f88ae47b691a86ee7a388f60e2d2e9306298415c",
|
||||
"pages/students/2023/samuel_dzurina/README.md": "4818191d044b91219c796a35010c95da5cf2093e050d494f30b219b91e13fa0e",
|
||||
"pages/students/2023/simona_bobrovcanova/README.md": "e473a1911dae10ab40e2cf6696a8be616a58c22aaf09af5953fbac475791a35e",
|
||||
"pages/students/2023/yevhenii_medushivskyi/README.md": "5710ebf91c893a12fe6d19f5372311938d1e7c7bbdf203f2dc8ed2fe7c4f5a24",
|
||||
"pages/topics/akopisat/README.md": "c7245e1fbfa4160618502c0baf8cc6bc47cd9a82b8a85bc1c645314829a7b76a",
|
||||
"pages/topics/bert/README.md": "35e507f7ec2ad1d3526e2a15f94ea085ee25f680a02daf6df62fd429bd9c25c9",
|
||||
"pages/topics/chatbot/README.md": "6f2f83ffb80109be47f9750cca9d3036ec3645abef9f2b590bd6825780c7c48a",
|
||||
"pages/topics/faq/README.md": "15cfbd9c2a1649c80a7a58922e2b66dadab5c86a5ef33ef16c82bebd4d2dbf06",
|
||||
"pages/topics/hatespeech/README.md": "364df94e70dd740c63544e2586ba7b957780f714fc0c941d1b04b02233e6cbc5",
|
||||
"pages/topics/legal/README.md": "003bb9bfe1e0ca21652091c2d11496312eb04e0689fe459e14c2d5a738e8eeea",
|
||||
"pages/topics/morphology/README.md": "e242cc5ff1a4cc98e227566c0ead999bbc95937b7c20be62cb2afb773d0d35c0",
|
||||
"pages/topics/named-entity/README.md": "66b2e25f70211d432d596e377d552b3b8f0c525b14c31e3bc9c956c3aeadca84",
|
||||
"pages/topics/named-entity/navod/README.md": "1ff87079a98411de0414754c60241e08d2214ddcd63ddf974e4340cce2ce5b02",
|
||||
"pages/topics/nlp/README.md": "6f90abf9dc3f0ff33475283c13b4a08561abf631425ec2daacb076155a9e02c2",
|
||||
"pages/topics/otvorene/README.md": "cd5544925553fe3840c0ea6f8ef60ab756e26ab6757bf810025c948d8d4f98fc",
|
||||
"pages/topics/prodigy/README.md": "5e4f691f2754c2ec4afbaab2f41e6db77feb5b322dd9344465eb40c35f116499",
|
||||
"pages/topics/python/README.md": "2ef073adba672142c39e9a59fa2e00a98ab52bda54233d46fbe6940ee23f9fcc",
|
||||
"pages/topics/question/README.md": "408078a2a67cea2699e12359e85ab641136231e6104c2afdf874a705879525df",
|
||||
"pages/topics/question/navod/README.md": "061e737c69184b2bd244316ca7ba841f7186fe01ee80ee993742a733dcad3ecd",
|
||||
"pages/topics/question/nezodpovedatelne/README.md": "b6703d9690f4599b973efb27595ce157773ae0fc0d55cf2c0a09d9f50e8e4c92",
|
||||
"pages/topics/question/validacie/README.md": "3216a7127abdfc6da50ed116f44ff2d6785e7da4af70d23aceda774e745ad562",
|
||||
"pages/topics/resources/README.md": "09405397387f00cbcc5680f7d655f2d861e4d92e5df792a62d9dfd04f3534f48",
|
||||
"pages/topics/seq2seq/README.md": "969d15c03a63a3f8d5edc9017fe5a0fb7311fdf4de4a3473a08266241f92c1e2",
|
||||
"pages/topics/spacy/README.md": "f504e5db77cb8694f08a57fb8636e522d59a0e669216f4bc8273bc3c5f375f87",
|
||||
"pages/topics/steel/README.md": "b4068cef2ed197711467ac47630d5b2064fdc8828f898f7af99664e94d833330",
|
||||
"pages/topics/translation/README.md": "a7d4289e72199b307dc5ad8fc69cda39c1a33c27a6c7447af70aa9c3cc6b8635"
|
||||
}
|
||||
}
|
||||
},
|
||||
"graph": {
|
||||
"sha256": "3f799a1ff8cd86cca24515d742430a111734ad3c65425587b64ae4ffe891701f",
|
||||
"nodes": 447,
|
||||
"relationships": 879
|
||||
},
|
||||
"parameters": {
|
||||
"limit": 40,
|
||||
"max_entities": 8
|
||||
},
|
||||
"dev_summary": {
|
||||
"questions": 589,
|
||||
"strict_count": 589,
|
||||
"strict_accuracy": 1.0,
|
||||
"error_count": 0,
|
||||
"value_score": 1.0,
|
||||
"entity_score": 1.0,
|
||||
"relation_score": 1.0,
|
||||
"property_score": 1.0,
|
||||
"relation_choice_score": 1.0,
|
||||
"document_recall": 1.0,
|
||||
"source_recall": 1.0,
|
||||
"binding_score": 1.0,
|
||||
"path_score": 1.0,
|
||||
"answerability_accuracy": 1.0,
|
||||
"latency_mean_seconds": 0.041531,
|
||||
"latency_median_seconds": 0.040416,
|
||||
"latency_p95_seconds": 0.056271
|
||||
},
|
||||
"source_audit_summary": {
|
||||
"dev": {
|
||||
"questions": 589,
|
||||
"source_consistent": 589,
|
||||
"issues": {}
|
||||
},
|
||||
"test": {
|
||||
"questions": 13,
|
||||
"source_consistent": 13,
|
||||
"issues": {}
|
||||
}
|
||||
},
|
||||
"policy": "Report all questions including negatives. No exclusions or holdout tuning.",
|
||||
"dev_results_sha256": "9334783e76158987f538f103a3ea90691a4c4115c4f2e6cb6327b5d9eda9f478",
|
||||
"audit_sha256": "9b03a6c5914133bb5c1ce056ce0f570f3c43243968a6f8cbbfbbee584461e5ac"
|
||||
}
|
||||
223
tools/graphrag/evaluation/frozen_v4.json
Normal file
223
tools/graphrag/evaluation/frozen_v4.json
Normal file
@ -0,0 +1,223 @@
|
||||
{
|
||||
"schema_version": 2,
|
||||
"partition": {
|
||||
"method": "disjoint logical query groups",
|
||||
"logical_group_overlap": 0,
|
||||
"previously_exposed_test_groups": 0,
|
||||
"dev_group_count": 577,
|
||||
"test_group_count": 320,
|
||||
"dev_profile_count": 72,
|
||||
"test_profile_count": 72,
|
||||
"source_profile_overlap": 72,
|
||||
"limitations": [
|
||||
"Known source corpus, persons, vocabulary and template families.",
|
||||
"Fresh questions/fact combinations; not an unseen-person or LLM-answer benchmark."
|
||||
]
|
||||
},
|
||||
"frozen_at_utc": "2026-10-25T01:43:37.727824+00:00",
|
||||
"fingerprints": {
|
||||
"implementation": {
|
||||
"tools/graphrag/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/build_graphrag.py": "81f6e9f5c9e71b588f8bed1968c1e900e29e484ba81d23b6a3a68e7220ad75a5",
|
||||
"tools/graphrag/evaluation/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/evaluation/audit_benchmark.py": "6619c818a52fc284e87ed6c48a503a54a3c9dd95447463ed78f075b7c58bad80",
|
||||
"tools/graphrag/evaluation/benchmark_v2.py": "129dd774faa414f06733e1ee6333e7b411b1c75b5601b895c405778df478a563",
|
||||
"tools/graphrag/evaluation/benchmark_v3.py": "30bae6c605ed26f4b49973acec799087c4e2b97a883ccedcafb965dd909c4c4d",
|
||||
"tools/graphrag/evaluation/benchmark_v4.py": "70a8b08f7c2b2cb3e2bdc77be9efedd23ea24ac564ec1c1eb224a9f6388b3a67",
|
||||
"tools/graphrag/evaluation/check_openwebui.py": "585490c89b8d178d3e5723336f4ac02bd3f6c2a0bec51acf2b7483a742847f16",
|
||||
"tools/graphrag/evaluation/evaluate_graphrag.py": "2d336cf9bdd8072e6f4d4ad3e58fc51cbcd81124b6e6ef703e6d1fb282128fbc",
|
||||
"tools/graphrag/evaluation/evidence_contract.py": "78e24264c176e163e1782fef1634b6c45c7f31bd4692726d02a30ab45a06648e",
|
||||
"tools/graphrag/evaluation/freeze_graphrag.py": "9a11a3cae83b3660d53d8fb51eff8f83ca5cb45858e327f394b2efdc35d6189d",
|
||||
"tools/graphrag/evaluation/graphrag_evaluator.py": "3afe014e126b6ad90c8e408284d2c1979f54d6cf5dd19fd67f9249708fbed2d3",
|
||||
"tools/graphrag/evaluation/reproducibility.py": "b707d4c410cbf7d6769a6afdadfe79ef3bbd699a0323f0e0d2ab180ef7498680",
|
||||
"tools/graphrag/evaluation/source_oracle.py": "8bac1ef0fd2ebe826a1b0686012c9fea3108d1c827ced46d977c9518fe55d67c",
|
||||
"tools/graphrag/graph_db.py": "a6fce68000065d328139829c5ca894623f6ed5828c74a869663366c2ad7b5ea2",
|
||||
"tools/graphrag/graph_search.py": "5ee39051073caea09f2bdc446359404dbd3a79bce9b80002788bfe250ffc87a0",
|
||||
"tools/graphrag/graphrag.py": "31e0f87fa973abc16a8aff2735a99e8a4dd9c76d0b889674a7204210c90d8b1d",
|
||||
"tools/graphrag/neo4j_smoke.py": "fb5244c72c29ef2acf96d1e7f54335ff168eed4119db1692025eb1b99194b7bb",
|
||||
"tools/graphrag/tests/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/tests/test_evaluation_pipeline_v2.py": "63d1b3e80ae3c7b563374fd7ab4aa5ffad3c614eafbd15142c577abd7f756bf9",
|
||||
"tools/graphrag/tests/test_evaluation_wide.py": "1b28bb74fd6b9457c869186b88606f1f7863d573aa3ab5226162e878f236d99e",
|
||||
"tools/graphrag/tests/test_evaluator_connected_v2.py": "29d7c9838ed1ff37ea3276df6feb1b6142158c43a0525712f490b648181882de",
|
||||
"tools/graphrag/tests/test_graph_search.py": "d5c95b5de2a0962857331929522764aa46a1222e550a3eb1aaca2148f9d58748",
|
||||
"tools/graphrag/tests/test_graph_search_entity_v2.py": "0ef1a8ebd513c5a4507eb38fcf5ae6137c69e9901b5a2975ba513be5902ac693",
|
||||
"tools/graphrag/tests/test_graph_search_neo4j.py": "fec2bf72de8f752f17c9164fee5754bdb2e153828855e47efbf0000dbe82cf3b",
|
||||
"tools/graphrag/tests/test_graph_search_regressions.py": "9db7779aeb8ed9e8c0f92c1657011a81080aff3c928649e811358e3009a18c48",
|
||||
"tools/graphrag/tests/test_graphrag.py": "6379335110f05668beca87ca7e486442071b2f666dbd651408d5f3a8d5723f0e",
|
||||
"tools/graphrag/tests/test_graphrag_evaluator.py": "1c6d08aeec9ae56ac4123239a5aed12a0081d66cc3f34b2047d95764579d7298",
|
||||
"tools/graphrag/tests/test_graphrag_freeze.py": "c4b760baf4c7ebf13b16bd4cd3c51874f5512eef3b4c61470dc4d428b0303d9f",
|
||||
"tools/graphrag/tests/test_graphrag_research_v2.py": "711008a91ab8a58ae0854e7f90329bcd42e5189fde2e2001589e97b0c22c5198",
|
||||
"tools/graphrag/tests/test_graphrag_root_title.py": "085651fe6e6081521a5dde9554abfee93456250108cf15978df25378d886a46c",
|
||||
"tools/graphrag/tests/test_source_oracle_v2.py": "0afdbe235e185ffe9f38aa667f90f5a6c20504fe29e9ac572642b39a8eb7faca",
|
||||
"requirements.txt": "26a6d097727eba03c1b6c71cd02b06373ef01ce03e567dd2bc4357ae330e5a1a"
|
||||
},
|
||||
"dataset_sha256": "9a3b873882bbf29b905d79c9448c3c287fda30323f93a6533b88dbd59b19f558",
|
||||
"inputs": {
|
||||
"data/documents.json": "0542af2a373771cf7c4a95f93d14f4f687f6a0187846892c959aa6efc4bade52",
|
||||
"data/chunks.json": "437dde589be46e0c30842dd330de22d96a0173d2dbaff9c5f129568cb2bca4c9"
|
||||
},
|
||||
"source_corpus": {
|
||||
"sha256": "440da12a7a991824e923f70cada7c616c3fb3b0f12767ec7d75039a6a3231b10",
|
||||
"document_count": 114,
|
||||
"documents": {
|
||||
"pages/interns/bogdan_paul_chis/README.md": "3b4b946eb3c10e9f9a4092e6cffa01c5080e7579aded2f6ed3120c41ed62b647",
|
||||
"pages/interns/cesar_gutierrez/README.md": "b0be60576eed28d4b1920e9acf198684519373dfc13171567247c853b3ed699e",
|
||||
"pages/interns/oliver_pejic/README.md": "0470f3c8465be8f02204b08e4c75ef47f68c7e4ad1038faa5641cdf1811f33d5",
|
||||
"pages/interns/sevval_bulburu/README.md": "ff2a9d66253802f1af0fdfd74832e40fae41b6df23c5e61dc266f6cd0cc16c4d",
|
||||
"pages/interns/yussef_ressaissi/README.md": "f997a65699da0db3222ef7a3c37652d05dfc3419ad4ec74683bafc2c897bb987",
|
||||
"pages/students/2016/darius_lindvai/README.md": "fcaa47bb9708a6439eec5c4b7f7b4ed6c7359e423e1d940e1aed9f44957e6d62",
|
||||
"pages/students/2016/darius_lindvai/dp2021/README.md": "be3d0fea2a6d592b225eecabd9b19445c2fce62b8289c07ab6af93835db12970",
|
||||
"pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md": "352162de1b1e192228fa5d26506c028ac47e567e90df53b1bbaa6ad736ec4766",
|
||||
"pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md": "b4a81ff457624b089d618e4479afb1e3d748f6724f72104ef5518e535ae02fe5",
|
||||
"pages/students/2016/dominik_nagy/README.md": "1c4037a158d84c45fa705a0c38e47142a9d46e226f0c138bc2d56d7c38f6d74d",
|
||||
"pages/students/2016/dominik_nagy/timovy_projekt/README.md": "b81a4dab7316f7b846dcf36515f6aa9d44035c86f46f0e07b7a43308bcd31458",
|
||||
"pages/students/2016/ediz_morochovic/README.md": "045e5eb9a3df2b84140808fbca0c3163266ad0efa144bc42d9d5c597881c6ac6",
|
||||
"pages/students/2016/jakub_maruniak/README.md": "6734c41a95b9d0c1e3d226b393ad109ee4a7b82ebfffa73df2d7e0a743fefa14",
|
||||
"pages/students/2016/jakub_maruniak/dp2021/README.md": "9cd884aec70705cdb2aaa0f514b513f16de263c37b749ced7f92916cd2f91c39",
|
||||
"pages/students/2016/jakub_maruniak/dp2021/annotation/README.md": "debae0c50aea1accef0840912b9b1f37b2138f856002bb50e91d7ea2dbbe7963",
|
||||
"pages/students/2016/jakub_maruniak/dp2021/train_experiments/README.md": "01dff38b37043414fa1db204394ddbe7aade00e14d02d495572b65c85d09b194",
|
||||
"pages/students/2016/jakub_maruniak/timovy_projekt/README.md": "04114b1f3d84664aad5bdba5a0b614c5a6f23392be3c31fd9123d63db1be0a35",
|
||||
"pages/students/2016/jan_holp/README.md": "80d6a8492766e5bfa61673a372e5f059d30c8e335de39842866c51485960e4d3",
|
||||
"pages/students/2016/jan_holp/dp2021/README.md": "a62acb74009376766c7e2f9856ee01d21f84593eb9b3ce85cf2e6032aa412476",
|
||||
"pages/students/2016/jan_holp/dp2021/zdrojove_subory/README.md": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"pages/students/2016/jan_holp/timovy_projekt/README.md": "79eebdfd3af7e8d5c279077e285a580731b1cf8cc9b4454f6596796e9915f70c",
|
||||
"pages/students/2016/lukas_pokryvka/README.md": "f279456c5c277ff1ee0dd89a3464ed9f9f67b44bc185a5da9811ef5cfb675002",
|
||||
"pages/students/2016/lukas_pokryvka/dp2021/README.md": "39b61376ce108e4a930f926ab2d6a997207457121bccfcf617129a3b210a15cf",
|
||||
"pages/students/2016/lukas_pokryvka/timovy_projekt/README.md": "4de4b6c8cfed17b6c60090f82df1d55a66be70a79d3013850689b2baebdd801b",
|
||||
"pages/students/2016/mark_feher/README.md": "bec37c0319fe0869a0377d771db23d090dbda93c27328f5697cdaeb3bbccfe9b",
|
||||
"pages/students/2016/maros_harahus/README.md": "0da150e91918632c9e8cd1443f04da403595a372517e254928ce9f76c9d5033d",
|
||||
"pages/students/2016/maros_harahus/timovy_projekt/README.md": "75af19f7c68f4b646fa1dbae75f3f3dfc52633a9f9da1400d21808bb20be0d83",
|
||||
"pages/students/2016/patrik_pavlisin/README.md": "dc1c648d7cd9b0f0e021c57f9b98189e37c100871439e7e304390715913f2763",
|
||||
"pages/students/2016/patrik_pavlisin/dp21/README.md": "ac1eb0fd0360ad34aa21b7c8da5bb010a6edf10be5721f28dedc3986cd1d8c54",
|
||||
"pages/students/2016/patrik_pavlisin/dp22/README.md": "f2a8c619a812b99abab618ae388eb672407950e1f33fb8d7da7a528c4de81d50",
|
||||
"pages/students/2016/patrik_pavlisin/tp20/README.md": "ae9c771f27e7e093bc29c6888c8d0b27ed61fb41519fd0d7e7f4f6cbb4626edc",
|
||||
"pages/students/2016/tomas_kucharik/README.md": "6a1a215433eb1857660177b4cb2ecec03c6a86743d3a04cd6d5c9d9682c9e63b",
|
||||
"pages/students/2017/dmytro_ushatenko/README.md": "65f4ac177d492162b08ca5da3d9eb048bd088a3c117a28a662113b7e4bc3a4ec",
|
||||
"pages/students/2017/martin_jancura/README.md": "6a0a18d5095dcfb12abfdd72c9cfd8025d714fb5e29a7858cd2b285e4cb986b9",
|
||||
"pages/students/2017/stanislav_matsunych/README.md": "90ffa11eff4a4360b0252dbc53a116c3a5777b3d5dd86ce5c89c02bdd2051c73",
|
||||
"pages/students/2017/than_trung_thanh/README.md": "2150519b8580e7337520db4de64d2d1c82d2634380537d019f41c506dbf2979d",
|
||||
"pages/students/2018/NaN1name_buday/README.md": "23c8c58090bdc954347e36f141bea91f43c8d5b1d777e346864a2ebe84c0bcce",
|
||||
"pages/students/2018/adrian_remias/README.md": "e5bfe1d5d4e626beaa636a02d34ec58cf2cff9b0e57833905af35b80bf1465a2",
|
||||
"pages/students/2018/david_ilas/README.md": "96c45ff9c5a821ddcb1a2fc86d487bd8f4729d1b76887914b0f5fbf99af45af0",
|
||||
"pages/students/2018/david_omasta/README.md": "4164051870e1e1cf8949ed18a74196e9ea789dfbe4fee24bdeb736ca42848327",
|
||||
"pages/students/2018/martin_wencel/README.md": "0e6a7a981689f22304f8baa5de97d4315c0695c94c9277de7851943eb012253b",
|
||||
"pages/students/2018/oleh_bilykh/README.md": "4072c62dd8ee753a0c8fa43fdfbbdf566e394c2df13e6a79d08a302e332710b1",
|
||||
"pages/students/2018/ondrej_megela/README.md": "969ff2e1a436b8f957e7168cf5eb678196b99aeda17701c502b016441f644065",
|
||||
"pages/students/2018/samuel_sirotnik/README.md": "cc230ede67b6e8632511c92a5ed6d1e9deb42e70819280222bdfd369ee77fc70",
|
||||
"pages/students/2019/alina_vitko/README.md": "9b071fe2aff470c275ae027be236fe836f741f774cabb9cbbb55304a8d5102cd",
|
||||
"pages/students/2019/artem_yatsenko/README.md": "328b101e46c51c959e792cf7ca226942f81d2ab8fe9648ad6d0ecd07016429e2",
|
||||
"pages/students/2019/david_stromp/README.md": "e46ca8691d5ec894128f6f6f2ed33e2c7bd141f80719bb0449b20f10f30cca09",
|
||||
"pages/students/2019/dmytro_mural/README.md": "e881a47d847c3ef8d680844113fdbfbb87553b28982bf9eef4936f6d30923e93",
|
||||
"pages/students/2019/filip_tomas/README.md": "75a1fe7b921e4bff0fdf9e2a957b4adad4b4a57aa7ebdffbb73dd82c02123f94",
|
||||
"pages/students/2019/kristian_sopkovic/README.md": "3286960fb30f584df35455f9b6dfae81ca4827a1d711d2bcd6e48c3f150c9279",
|
||||
"pages/students/2019/michal_stromko/README.md": "3ae1dd9b6638a6a249a94be3f3846286555666aefa225bb3a2c7288b35900ce7",
|
||||
"pages/students/2019/michal_stromko/vp2021/README.md": "feb2e093fdd6461239e79b1e1f96e65a1c8cd96e8a2b70535ae556a9c198046a",
|
||||
"pages/students/2019/michal_stromko/vp2021/tutorials/README.md": "40e3fa448c7329ef863e705435e23fe6b4788de440710f066fe0eed92d132bad",
|
||||
"pages/students/2019/michal_stromko/vp2021/tutorials/img/README.md": "e8d3ac160b17dfdee2c3e996bf6a03af7a6f16f9140bf5cf7ee343a82dd1865f",
|
||||
"pages/students/2019/patrik_pokrivcak/README.md": "3e3957ad0f7aca59d6eb64c38a3f5e21d8fd953200825d0d0e5cacabfbc35a7d",
|
||||
"pages/students/2019/samuel_horani/README.md": "86e6959ccc612b069687b57996fa3f61660075d6a0d65bfec64f423d39a0a999",
|
||||
"pages/students/2020/david_kostilnik/README.md": "2927524b75da59a64120fc364a0fc374986fa4d364d54e52c36800762c203264",
|
||||
"pages/students/2020/jakub_kristian_lukas/README.md": "f139d9b1ebf5a3f45612f3df5703ecdd935b90701763c27c7c529044c0b0455a",
|
||||
"pages/students/2020/kamil_tomcufcik/README.md": "9d865adf538bc6d7992ee4f4882713447da5c936fca17c43ca0f576072537048",
|
||||
"pages/students/2020/matej_kobylan/README.md": "3d7b289e17b8f25678a07e9ee0e6741688485a0ccb1e50940a6a6acc6312a547",
|
||||
"pages/students/2020/matus_suchanic/README.md": "770ca49538cca22df35f8e7ba736ee97483e4fe5788c221496553592b4e78dc6",
|
||||
"pages/students/2020/pavol_hudak/README.md": "33d06fccc6451e5f19b27b0cad001a34e81635b4ea294a01dec7771c823abc40",
|
||||
"pages/students/2020/vladyslav_krupko/README.md": "4c28e6d38651bb2cafcbf4a18e35210cd369aef2caff6c5b0aa52fac38f0fe7d",
|
||||
"pages/students/2021/artur_hyrenko/README.md": "0568261f4ade4de5472edcfeb1ffed9abae18dc67e4050f4ce2ad088839a2bb3",
|
||||
"pages/students/2021/eduard_matovka/README.md": "de2a7ae38ec87110e347956b37d0605a298ed2847f972961cc9b977da8221d43",
|
||||
"pages/students/2021/manohar_gowdru_shridharu/README.md": "c00ceb620ed7087ead5d9448d476bbb98d273d1d9e7bf1bc4355c367b26c7a6b",
|
||||
"pages/students/2021/martin_sarissky/README.md": "8e97b45a253745faa55f63c844e0b5dfe680aeaf6eb01fb8f9d06ac6e8ee8bcf",
|
||||
"pages/students/2021/matej_novotny/README.md": "b083a7cadde532e3428dc9a57bc61456fcc5905bda91e011b96033d42bf5d9cb",
|
||||
"pages/students/2021/matej_scislak/README.md": "b9a32cce8605e044a4f2828ff2d91a2995a62ef3a841e62f0a225c97221f0cc8",
|
||||
"pages/students/2021/nikita_bodnar/README.md": "2016c0dd923c0f8e561d5cea42ac81da3610fdcc54a4527f56d078e34e53ce90",
|
||||
"pages/students/2021/oleksandr_hryshchenko/README.md": "4b073992b715b6c75b79fd2c8f850a69f940966e3a61a82c625c32c945a93036",
|
||||
"pages/students/2021/vladimir_ferko/README.md": "68e7d311896eda2171e5eec1ec3a8da90d326ed91acaace8058f68664a50d271",
|
||||
"pages/students/2022/andrii_pervashov/README.md": "319dcaa1cc2e29dd7e3a710bab26cb3ac6944ab71b0b97e1de076b1199122334",
|
||||
"pages/students/2022/daniil_huzenko/README.md": "390782fbff6220a9462060ce1a62959f2a2b88f42d06e2c51d1f406b75d73f2c",
|
||||
"pages/students/2022/jakub_schwarc/README.md": "f541a8852c2b0f6f9d7182e01a34c4e3beee9bfa55427a06b331638b11eb8be6",
|
||||
"pages/students/2022/jan_malinovsky/README.md": "8af021bfb131fa005a7aec3e2f2f12fc17fa5dc14e2675311adbbfc445a4bcab",
|
||||
"pages/students/2022/jan_ptak/README.md": "131cf053764fd5423541ebe672c3b4f5da875cfb8e4b821f1335ddb967282282",
|
||||
"pages/students/2022/oleh_poiasnik/README.md": "c2f7dc3f61f8b4a5b43ded1e3ae4c7d3e7f874439ee6b17dd9c8d45dabc25bc8",
|
||||
"pages/students/2022/samuel_vasil/README.md": "67c807049147aacd04f3050f4ff0233a8b3f0a239ab173b430e13dfe113ad0a5",
|
||||
"pages/students/2022/serhii_yemets/README.md": "ffbeac893947acafe855d576322a8826f9d4f87ac344cb31f8ceeefa244b9133",
|
||||
"pages/students/2022/tetiana_mohorian/README.md": "c9efdc632bf1ca89a0bfde0dc00be7aaac8a85da3d92e2ce8506236c73e93cfb",
|
||||
"pages/students/2022/valerii_kutsenko/README.md": "dc764c609ad3c1df59cfea997d4db82a591b1b1e0764453e319d841115507e4f",
|
||||
"pages/students/2022/vladyslav_yanchenko/README.md": "4d1ce216e3b526ee437ddbc658e51d7bb83530087e43628c096a569a3854a47f",
|
||||
"pages/students/2022/yevhenii_leonov/README.md": "b90e41db0cec2451027020a9102d32a24d777e8a38b604ccca87b36cd6b3a292",
|
||||
"pages/students/2023/denis_le_thanh/README.md": "2cb83f942d86a02712b0c58778e46dc2211346d1a6eba606471dfa832245db61",
|
||||
"pages/students/2023/maksym_zatirka/README.md": "7a7d2cbe276c352dacfbc6ba6de5f15303d30ecf34845ff8da8d085f3d67c3dd",
|
||||
"pages/students/2023/oleksandr_dorybohov/README.md": "c24d6f941de0dafb4459cea8259cf147821cafc86ba65be5b528f419f734bc18",
|
||||
"pages/students/2023/ronald_zalacko/README.md": "724b0f8e6e641236dba9bddbd77f4546e09514076c7dfb151807aaf4b882c96f",
|
||||
"pages/students/2023/rostyslav_rodzhuk/README.md": "de356dd7427c8a0716c165a0f88ae47b691a86ee7a388f60e2d2e9306298415c",
|
||||
"pages/students/2023/samuel_dzurina/README.md": "4818191d044b91219c796a35010c95da5cf2093e050d494f30b219b91e13fa0e",
|
||||
"pages/students/2023/simona_bobrovcanova/README.md": "e473a1911dae10ab40e2cf6696a8be616a58c22aaf09af5953fbac475791a35e",
|
||||
"pages/students/2023/yevhenii_medushivskyi/README.md": "5710ebf91c893a12fe6d19f5372311938d1e7c7bbdf203f2dc8ed2fe7c4f5a24",
|
||||
"pages/topics/akopisat/README.md": "c7245e1fbfa4160618502c0baf8cc6bc47cd9a82b8a85bc1c645314829a7b76a",
|
||||
"pages/topics/bert/README.md": "35e507f7ec2ad1d3526e2a15f94ea085ee25f680a02daf6df62fd429bd9c25c9",
|
||||
"pages/topics/chatbot/README.md": "6f2f83ffb80109be47f9750cca9d3036ec3645abef9f2b590bd6825780c7c48a",
|
||||
"pages/topics/faq/README.md": "15cfbd9c2a1649c80a7a58922e2b66dadab5c86a5ef33ef16c82bebd4d2dbf06",
|
||||
"pages/topics/hatespeech/README.md": "364df94e70dd740c63544e2586ba7b957780f714fc0c941d1b04b02233e6cbc5",
|
||||
"pages/topics/legal/README.md": "003bb9bfe1e0ca21652091c2d11496312eb04e0689fe459e14c2d5a738e8eeea",
|
||||
"pages/topics/morphology/README.md": "e242cc5ff1a4cc98e227566c0ead999bbc95937b7c20be62cb2afb773d0d35c0",
|
||||
"pages/topics/named-entity/README.md": "66b2e25f70211d432d596e377d552b3b8f0c525b14c31e3bc9c956c3aeadca84",
|
||||
"pages/topics/named-entity/navod/README.md": "1ff87079a98411de0414754c60241e08d2214ddcd63ddf974e4340cce2ce5b02",
|
||||
"pages/topics/nlp/README.md": "6f90abf9dc3f0ff33475283c13b4a08561abf631425ec2daacb076155a9e02c2",
|
||||
"pages/topics/otvorene/README.md": "cd5544925553fe3840c0ea6f8ef60ab756e26ab6757bf810025c948d8d4f98fc",
|
||||
"pages/topics/prodigy/README.md": "5e4f691f2754c2ec4afbaab2f41e6db77feb5b322dd9344465eb40c35f116499",
|
||||
"pages/topics/python/README.md": "2ef073adba672142c39e9a59fa2e00a98ab52bda54233d46fbe6940ee23f9fcc",
|
||||
"pages/topics/question/README.md": "408078a2a67cea2699e12359e85ab641136231e6104c2afdf874a705879525df",
|
||||
"pages/topics/question/navod/README.md": "061e737c69184b2bd244316ca7ba841f7186fe01ee80ee993742a733dcad3ecd",
|
||||
"pages/topics/question/nezodpovedatelne/README.md": "b6703d9690f4599b973efb27595ce157773ae0fc0d55cf2c0a09d9f50e8e4c92",
|
||||
"pages/topics/question/validacie/README.md": "3216a7127abdfc6da50ed116f44ff2d6785e7da4af70d23aceda774e745ad562",
|
||||
"pages/topics/resources/README.md": "09405397387f00cbcc5680f7d655f2d861e4d92e5df792a62d9dfd04f3534f48",
|
||||
"pages/topics/seq2seq/README.md": "969d15c03a63a3f8d5edc9017fe5a0fb7311fdf4de4a3473a08266241f92c1e2",
|
||||
"pages/topics/spacy/README.md": "f504e5db77cb8694f08a57fb8636e522d59a0e669216f4bc8273bc3c5f375f87",
|
||||
"pages/topics/steel/README.md": "b4068cef2ed197711467ac47630d5b2064fdc8828f898f7af99664e94d833330",
|
||||
"pages/topics/translation/README.md": "a7d4289e72199b307dc5ad8fc69cda39c1a33c27a6c7447af70aa9c3cc6b8635"
|
||||
}
|
||||
}
|
||||
},
|
||||
"graph": {
|
||||
"sha256": "2aede9d603e7f09b5fa0e52abbf0de29a8b24f814bb17119aa44e1673c47b206",
|
||||
"nodes": 447,
|
||||
"relationships": 879
|
||||
},
|
||||
"parameters": {
|
||||
"limit": 40,
|
||||
"max_entities": 8
|
||||
},
|
||||
"dev_summary": {
|
||||
"questions": 722,
|
||||
"strict_count": 722,
|
||||
"strict_accuracy": 1.0,
|
||||
"error_count": 0,
|
||||
"value_score": 1.0,
|
||||
"entity_score": 1.0,
|
||||
"relation_score": 1.0,
|
||||
"property_score": 1.0,
|
||||
"relation_choice_score": 1.0,
|
||||
"document_recall": 1.0,
|
||||
"source_recall": 1.0,
|
||||
"binding_score": 1.0,
|
||||
"path_score": 1.0,
|
||||
"answerability_accuracy": 1.0,
|
||||
"latency_mean_seconds": 0.042119,
|
||||
"latency_median_seconds": 0.040648,
|
||||
"latency_p95_seconds": 0.054136
|
||||
},
|
||||
"source_audit_summary": {
|
||||
"dev": {
|
||||
"questions": 722,
|
||||
"source_consistent": 722,
|
||||
"issues": {}
|
||||
},
|
||||
"test": {
|
||||
"questions": 320,
|
||||
"source_consistent": 320,
|
||||
"issues": {}
|
||||
}
|
||||
},
|
||||
"policy": "Report all questions including negatives. No exclusions or holdout tuning.",
|
||||
"dev_results_sha256": "d89a76998ce7360906ea0daa2e865853a92aa8796e0f5bb7030f16e6459b29e9",
|
||||
"audit_sha256": "220fd00ab08cceee6d5141ca5c1a02ec2877d1eee83b36ea707c6a076ba69e15"
|
||||
}
|
||||
233
tools/graphrag/evaluation/frozen_v5.json
Normal file
233
tools/graphrag/evaluation/frozen_v5.json
Normal file
@ -0,0 +1,233 @@
|
||||
{
|
||||
"schema_version": 2,
|
||||
"evaluation_kind": "historical_regression",
|
||||
"partition": {
|
||||
"method": "Previously exposed questions; regression, not independent TEST",
|
||||
"dev_profile_count": 72,
|
||||
"test_profile_count": 72,
|
||||
"source_profile_overlap": 72
|
||||
},
|
||||
"frozen_at_utc": "2026-10-25T16:08:00.798503+00:00",
|
||||
"fingerprints": {
|
||||
"implementation": {
|
||||
"tools/graphrag/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/build_graphrag.py": "256292101d6d7d1946e926e2717ac45465b169f4091c51ecfed4f1a779dfd700",
|
||||
"tools/graphrag/evaluation/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/evaluation/audit_benchmark.py": "6619c818a52fc284e87ed6c48a503a54a3c9dd95447463ed78f075b7c58bad80",
|
||||
"tools/graphrag/evaluation/benchmark_v2.py": "129dd774faa414f06733e1ee6333e7b411b1c75b5601b895c405778df478a563",
|
||||
"tools/graphrag/evaluation/benchmark_v3.py": "30bae6c605ed26f4b49973acec799087c4e2b97a883ccedcafb965dd909c4c4d",
|
||||
"tools/graphrag/evaluation/benchmark_v4.py": "70a8b08f7c2b2cb3e2bdc77be9efedd23ea24ac564ec1c1eb224a9f6388b3a67",
|
||||
"tools/graphrag/evaluation/check_openwebui.py": "d6b5d9947679aeabf4ec9599a7ad70b5ee917dd7c6ad747ddbf54579d8de475b",
|
||||
"tools/graphrag/evaluation/evaluate_graphrag.py": "89c364d15b70c9cb55df39d5970b4d0d79b681ba70eed7530a4e3fe64167812e",
|
||||
"tools/graphrag/evaluation/evidence_contract.py": "78e24264c176e163e1782fef1634b6c45c7f31bd4692726d02a30ab45a06648e",
|
||||
"tools/graphrag/evaluation/freeze_graphrag.py": "793c6d04a13c3217347283c609f647cd0d69b020e44bbde458bdc7ebbab8ec7e",
|
||||
"tools/graphrag/evaluation/graphrag_evaluator.py": "7f99bf0f97974058650b619ea49a8ee32284cb4b324f1ffab9baf54f5c4495f4",
|
||||
"tools/graphrag/evaluation/reproducibility.py": "f6dde1a2a6f68abd0e916dfb38d5eb756a7f8621a66b7c11e43e7580b347134a",
|
||||
"tools/graphrag/evaluation/source_oracle.py": "bfe8375556d64975433ff098e8d227aecbe59afd4e4fbe5745054524e913f3da",
|
||||
"tools/graphrag/evaluation/source_validation.py": "042a3f99b18c028d88d1ecb6bf2430b8979be3d7414c19ee506bd245082bff46",
|
||||
"tools/graphrag/graph_db.py": "c4b1a2edb765856b807398e4c243a8d17753529a5d2dfdb51791e28bc8de17f7",
|
||||
"tools/graphrag/graph_search.py": "8cc3668b4ad7beabf849e6978ea1d5defc818b142ee8b157b19c319998fb7541",
|
||||
"tools/graphrag/graphrag.py": "128f888a0c76d06457af8c1dd1cf56fc1955e25b976f367613f0829f7e990ee6",
|
||||
"tools/graphrag/neo4j_smoke.py": "fb5244c72c29ef2acf96d1e7f54335ff168eed4119db1692025eb1b99194b7bb",
|
||||
"tools/graphrag/publication.py": "fba1fa0d0bed325fd87f8d3593baae9271de1766b772d7214c7f63fd3f1c37b6",
|
||||
"tools/graphrag/tests/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/tests/test_evaluation_pipeline_v2.py": "63d1b3e80ae3c7b563374fd7ab4aa5ffad3c614eafbd15142c577abd7f756bf9",
|
||||
"tools/graphrag/tests/test_evaluation_v5.py": "0475ebd4dc28d3e940ab499a7bc4ef713dc4c679d25b650161b78d1886f3bc0b",
|
||||
"tools/graphrag/tests/test_evaluation_wide.py": "1b28bb74fd6b9457c869186b88606f1f7863d573aa3ab5226162e878f236d99e",
|
||||
"tools/graphrag/tests/test_evaluator_connected_v2.py": "29d7c9838ed1ff37ea3276df6feb1b6142158c43a0525712f490b648181882de",
|
||||
"tools/graphrag/tests/test_graph_publication.py": "96e53c1ae28e36c7a4290e1e60c8b398bf095ceaf883e819e1a477e2672b11c0",
|
||||
"tools/graphrag/tests/test_graph_rebuild_atomic.py": "fe37d4fff0b1f0fb1d565f0a96152b9b4e336837bc78b5977cf3b4879d7fbaf3",
|
||||
"tools/graphrag/tests/test_graph_search.py": "eb58661aef9dafe6bf7188fcdc2d79cef6652d57c64d1b81ae81a52e8e0204d7",
|
||||
"tools/graphrag/tests/test_graph_search_entity_v2.py": "0ef1a8ebd513c5a4507eb38fcf5ae6137c69e9901b5a2975ba513be5902ac693",
|
||||
"tools/graphrag/tests/test_graph_search_neo4j.py": "fec2bf72de8f752f17c9164fee5754bdb2e153828855e47efbf0000dbe82cf3b",
|
||||
"tools/graphrag/tests/test_graph_search_regressions.py": "9db7779aeb8ed9e8c0f92c1657011a81080aff3c928649e811358e3009a18c48",
|
||||
"tools/graphrag/tests/test_graphrag.py": "9ee8629d6b528dd78c2ddfc25cee95e17613f45b454fc0a38d4c591862637a9f",
|
||||
"tools/graphrag/tests/test_graphrag_evaluator.py": "1c6d08aeec9ae56ac4123239a5aed12a0081d66cc3f34b2047d95764579d7298",
|
||||
"tools/graphrag/tests/test_graphrag_freeze.py": "c4b760baf4c7ebf13b16bd4cd3c51874f5512eef3b4c61470dc4d428b0303d9f",
|
||||
"tools/graphrag/tests/test_graphrag_research_v2.py": "711008a91ab8a58ae0854e7f90329bcd42e5189fde2e2001589e97b0c22c5198",
|
||||
"tools/graphrag/tests/test_graphrag_root_title.py": "085651fe6e6081521a5dde9554abfee93456250108cf15978df25378d886a46c",
|
||||
"tools/graphrag/tests/test_source_oracle_v2.py": "0afdbe235e185ffe9f38aa667f90f5a6c20504fe29e9ac572642b39a8eb7faca",
|
||||
"requirements.txt": "26a6d097727eba03c1b6c71cd02b06373ef01ce03e567dd2bc4357ae330e5a1a",
|
||||
"tools/publication.py": "f99d445073390a733afc8d849b9fcd4b4b0890bb54d136db67d4015b78436e1a",
|
||||
"tools/retrieval_contract.py": "b8fa272c3babf924a3ce8b937fe7ae437cd959ba9f7667193ac67c18d2c5b58d",
|
||||
"tools/index_state.py": "c33920a63d04009f11ef23ca9e9eee9bf86453b7d0586d027bf3b39156afea0d",
|
||||
"tools/rag/common.py": "8497c46d5c6c27a7c76df1568360ad5e9d00d5e5a7ef186e758960cc79d81d1c",
|
||||
"tools/sync_indexes.py": "5b909b4394c24e5ce22848594b16d9aea45fb06418f5cd92bb6aa6381a0ccf10"
|
||||
},
|
||||
"dataset_sha256": "9a3b873882bbf29b905d79c9448c3c287fda30323f93a6533b88dbd59b19f558",
|
||||
"inputs": {
|
||||
"data/documents.json": "0542af2a373771cf7c4a95f93d14f4f687f6a0187846892c959aa6efc4bade52",
|
||||
"data/chunks.json": "437dde589be46e0c30842dd330de22d96a0173d2dbaff9c5f129568cb2bca4c9"
|
||||
},
|
||||
"source_corpus": {
|
||||
"sha256": "440da12a7a991824e923f70cada7c616c3fb3b0f12767ec7d75039a6a3231b10",
|
||||
"document_count": 114,
|
||||
"documents": {
|
||||
"pages/interns/bogdan_paul_chis/README.md": "3b4b946eb3c10e9f9a4092e6cffa01c5080e7579aded2f6ed3120c41ed62b647",
|
||||
"pages/interns/cesar_gutierrez/README.md": "b0be60576eed28d4b1920e9acf198684519373dfc13171567247c853b3ed699e",
|
||||
"pages/interns/oliver_pejic/README.md": "0470f3c8465be8f02204b08e4c75ef47f68c7e4ad1038faa5641cdf1811f33d5",
|
||||
"pages/interns/sevval_bulburu/README.md": "ff2a9d66253802f1af0fdfd74832e40fae41b6df23c5e61dc266f6cd0cc16c4d",
|
||||
"pages/interns/yussef_ressaissi/README.md": "f997a65699da0db3222ef7a3c37652d05dfc3419ad4ec74683bafc2c897bb987",
|
||||
"pages/students/2016/darius_lindvai/README.md": "fcaa47bb9708a6439eec5c4b7f7b4ed6c7359e423e1d940e1aed9f44957e6d62",
|
||||
"pages/students/2016/darius_lindvai/dp2021/README.md": "be3d0fea2a6d592b225eecabd9b19445c2fce62b8289c07ab6af93835db12970",
|
||||
"pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md": "352162de1b1e192228fa5d26506c028ac47e567e90df53b1bbaa6ad736ec4766",
|
||||
"pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md": "b4a81ff457624b089d618e4479afb1e3d748f6724f72104ef5518e535ae02fe5",
|
||||
"pages/students/2016/dominik_nagy/README.md": "1c4037a158d84c45fa705a0c38e47142a9d46e226f0c138bc2d56d7c38f6d74d",
|
||||
"pages/students/2016/dominik_nagy/timovy_projekt/README.md": "b81a4dab7316f7b846dcf36515f6aa9d44035c86f46f0e07b7a43308bcd31458",
|
||||
"pages/students/2016/ediz_morochovic/README.md": "045e5eb9a3df2b84140808fbca0c3163266ad0efa144bc42d9d5c597881c6ac6",
|
||||
"pages/students/2016/jakub_maruniak/README.md": "6734c41a95b9d0c1e3d226b393ad109ee4a7b82ebfffa73df2d7e0a743fefa14",
|
||||
"pages/students/2016/jakub_maruniak/dp2021/README.md": "9cd884aec70705cdb2aaa0f514b513f16de263c37b749ced7f92916cd2f91c39",
|
||||
"pages/students/2016/jakub_maruniak/dp2021/annotation/README.md": "debae0c50aea1accef0840912b9b1f37b2138f856002bb50e91d7ea2dbbe7963",
|
||||
"pages/students/2016/jakub_maruniak/dp2021/train_experiments/README.md": "01dff38b37043414fa1db204394ddbe7aade00e14d02d495572b65c85d09b194",
|
||||
"pages/students/2016/jakub_maruniak/timovy_projekt/README.md": "04114b1f3d84664aad5bdba5a0b614c5a6f23392be3c31fd9123d63db1be0a35",
|
||||
"pages/students/2016/jan_holp/README.md": "80d6a8492766e5bfa61673a372e5f059d30c8e335de39842866c51485960e4d3",
|
||||
"pages/students/2016/jan_holp/dp2021/README.md": "a62acb74009376766c7e2f9856ee01d21f84593eb9b3ce85cf2e6032aa412476",
|
||||
"pages/students/2016/jan_holp/dp2021/zdrojove_subory/README.md": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"pages/students/2016/jan_holp/timovy_projekt/README.md": "79eebdfd3af7e8d5c279077e285a580731b1cf8cc9b4454f6596796e9915f70c",
|
||||
"pages/students/2016/lukas_pokryvka/README.md": "f279456c5c277ff1ee0dd89a3464ed9f9f67b44bc185a5da9811ef5cfb675002",
|
||||
"pages/students/2016/lukas_pokryvka/dp2021/README.md": "39b61376ce108e4a930f926ab2d6a997207457121bccfcf617129a3b210a15cf",
|
||||
"pages/students/2016/lukas_pokryvka/timovy_projekt/README.md": "4de4b6c8cfed17b6c60090f82df1d55a66be70a79d3013850689b2baebdd801b",
|
||||
"pages/students/2016/mark_feher/README.md": "bec37c0319fe0869a0377d771db23d090dbda93c27328f5697cdaeb3bbccfe9b",
|
||||
"pages/students/2016/maros_harahus/README.md": "0da150e91918632c9e8cd1443f04da403595a372517e254928ce9f76c9d5033d",
|
||||
"pages/students/2016/maros_harahus/timovy_projekt/README.md": "75af19f7c68f4b646fa1dbae75f3f3dfc52633a9f9da1400d21808bb20be0d83",
|
||||
"pages/students/2016/patrik_pavlisin/README.md": "dc1c648d7cd9b0f0e021c57f9b98189e37c100871439e7e304390715913f2763",
|
||||
"pages/students/2016/patrik_pavlisin/dp21/README.md": "ac1eb0fd0360ad34aa21b7c8da5bb010a6edf10be5721f28dedc3986cd1d8c54",
|
||||
"pages/students/2016/patrik_pavlisin/dp22/README.md": "f2a8c619a812b99abab618ae388eb672407950e1f33fb8d7da7a528c4de81d50",
|
||||
"pages/students/2016/patrik_pavlisin/tp20/README.md": "ae9c771f27e7e093bc29c6888c8d0b27ed61fb41519fd0d7e7f4f6cbb4626edc",
|
||||
"pages/students/2016/tomas_kucharik/README.md": "6a1a215433eb1857660177b4cb2ecec03c6a86743d3a04cd6d5c9d9682c9e63b",
|
||||
"pages/students/2017/dmytro_ushatenko/README.md": "65f4ac177d492162b08ca5da3d9eb048bd088a3c117a28a662113b7e4bc3a4ec",
|
||||
"pages/students/2017/martin_jancura/README.md": "6a0a18d5095dcfb12abfdd72c9cfd8025d714fb5e29a7858cd2b285e4cb986b9",
|
||||
"pages/students/2017/stanislav_matsunych/README.md": "90ffa11eff4a4360b0252dbc53a116c3a5777b3d5dd86ce5c89c02bdd2051c73",
|
||||
"pages/students/2017/than_trung_thanh/README.md": "2150519b8580e7337520db4de64d2d1c82d2634380537d019f41c506dbf2979d",
|
||||
"pages/students/2018/NaN1name_buday/README.md": "23c8c58090bdc954347e36f141bea91f43c8d5b1d777e346864a2ebe84c0bcce",
|
||||
"pages/students/2018/adrian_remias/README.md": "e5bfe1d5d4e626beaa636a02d34ec58cf2cff9b0e57833905af35b80bf1465a2",
|
||||
"pages/students/2018/david_ilas/README.md": "96c45ff9c5a821ddcb1a2fc86d487bd8f4729d1b76887914b0f5fbf99af45af0",
|
||||
"pages/students/2018/david_omasta/README.md": "4164051870e1e1cf8949ed18a74196e9ea789dfbe4fee24bdeb736ca42848327",
|
||||
"pages/students/2018/martin_wencel/README.md": "0e6a7a981689f22304f8baa5de97d4315c0695c94c9277de7851943eb012253b",
|
||||
"pages/students/2018/oleh_bilykh/README.md": "4072c62dd8ee753a0c8fa43fdfbbdf566e394c2df13e6a79d08a302e332710b1",
|
||||
"pages/students/2018/ondrej_megela/README.md": "969ff2e1a436b8f957e7168cf5eb678196b99aeda17701c502b016441f644065",
|
||||
"pages/students/2018/samuel_sirotnik/README.md": "cc230ede67b6e8632511c92a5ed6d1e9deb42e70819280222bdfd369ee77fc70",
|
||||
"pages/students/2019/alina_vitko/README.md": "9b071fe2aff470c275ae027be236fe836f741f774cabb9cbbb55304a8d5102cd",
|
||||
"pages/students/2019/artem_yatsenko/README.md": "328b101e46c51c959e792cf7ca226942f81d2ab8fe9648ad6d0ecd07016429e2",
|
||||
"pages/students/2019/david_stromp/README.md": "e46ca8691d5ec894128f6f6f2ed33e2c7bd141f80719bb0449b20f10f30cca09",
|
||||
"pages/students/2019/dmytro_mural/README.md": "e881a47d847c3ef8d680844113fdbfbb87553b28982bf9eef4936f6d30923e93",
|
||||
"pages/students/2019/filip_tomas/README.md": "75a1fe7b921e4bff0fdf9e2a957b4adad4b4a57aa7ebdffbb73dd82c02123f94",
|
||||
"pages/students/2019/kristian_sopkovic/README.md": "3286960fb30f584df35455f9b6dfae81ca4827a1d711d2bcd6e48c3f150c9279",
|
||||
"pages/students/2019/michal_stromko/README.md": "3ae1dd9b6638a6a249a94be3f3846286555666aefa225bb3a2c7288b35900ce7",
|
||||
"pages/students/2019/michal_stromko/vp2021/README.md": "feb2e093fdd6461239e79b1e1f96e65a1c8cd96e8a2b70535ae556a9c198046a",
|
||||
"pages/students/2019/michal_stromko/vp2021/tutorials/README.md": "40e3fa448c7329ef863e705435e23fe6b4788de440710f066fe0eed92d132bad",
|
||||
"pages/students/2019/michal_stromko/vp2021/tutorials/img/README.md": "e8d3ac160b17dfdee2c3e996bf6a03af7a6f16f9140bf5cf7ee343a82dd1865f",
|
||||
"pages/students/2019/patrik_pokrivcak/README.md": "3e3957ad0f7aca59d6eb64c38a3f5e21d8fd953200825d0d0e5cacabfbc35a7d",
|
||||
"pages/students/2019/samuel_horani/README.md": "86e6959ccc612b069687b57996fa3f61660075d6a0d65bfec64f423d39a0a999",
|
||||
"pages/students/2020/david_kostilnik/README.md": "2927524b75da59a64120fc364a0fc374986fa4d364d54e52c36800762c203264",
|
||||
"pages/students/2020/jakub_kristian_lukas/README.md": "f139d9b1ebf5a3f45612f3df5703ecdd935b90701763c27c7c529044c0b0455a",
|
||||
"pages/students/2020/kamil_tomcufcik/README.md": "9d865adf538bc6d7992ee4f4882713447da5c936fca17c43ca0f576072537048",
|
||||
"pages/students/2020/matej_kobylan/README.md": "3d7b289e17b8f25678a07e9ee0e6741688485a0ccb1e50940a6a6acc6312a547",
|
||||
"pages/students/2020/matus_suchanic/README.md": "770ca49538cca22df35f8e7ba736ee97483e4fe5788c221496553592b4e78dc6",
|
||||
"pages/students/2020/pavol_hudak/README.md": "33d06fccc6451e5f19b27b0cad001a34e81635b4ea294a01dec7771c823abc40",
|
||||
"pages/students/2020/vladyslav_krupko/README.md": "4c28e6d38651bb2cafcbf4a18e35210cd369aef2caff6c5b0aa52fac38f0fe7d",
|
||||
"pages/students/2021/artur_hyrenko/README.md": "0568261f4ade4de5472edcfeb1ffed9abae18dc67e4050f4ce2ad088839a2bb3",
|
||||
"pages/students/2021/eduard_matovka/README.md": "de2a7ae38ec87110e347956b37d0605a298ed2847f972961cc9b977da8221d43",
|
||||
"pages/students/2021/manohar_gowdru_shridharu/README.md": "c00ceb620ed7087ead5d9448d476bbb98d273d1d9e7bf1bc4355c367b26c7a6b",
|
||||
"pages/students/2021/martin_sarissky/README.md": "8e97b45a253745faa55f63c844e0b5dfe680aeaf6eb01fb8f9d06ac6e8ee8bcf",
|
||||
"pages/students/2021/matej_novotny/README.md": "b083a7cadde532e3428dc9a57bc61456fcc5905bda91e011b96033d42bf5d9cb",
|
||||
"pages/students/2021/matej_scislak/README.md": "b9a32cce8605e044a4f2828ff2d91a2995a62ef3a841e62f0a225c97221f0cc8",
|
||||
"pages/students/2021/nikita_bodnar/README.md": "2016c0dd923c0f8e561d5cea42ac81da3610fdcc54a4527f56d078e34e53ce90",
|
||||
"pages/students/2021/oleksandr_hryshchenko/README.md": "4b073992b715b6c75b79fd2c8f850a69f940966e3a61a82c625c32c945a93036",
|
||||
"pages/students/2021/vladimir_ferko/README.md": "68e7d311896eda2171e5eec1ec3a8da90d326ed91acaace8058f68664a50d271",
|
||||
"pages/students/2022/andrii_pervashov/README.md": "319dcaa1cc2e29dd7e3a710bab26cb3ac6944ab71b0b97e1de076b1199122334",
|
||||
"pages/students/2022/daniil_huzenko/README.md": "390782fbff6220a9462060ce1a62959f2a2b88f42d06e2c51d1f406b75d73f2c",
|
||||
"pages/students/2022/jakub_schwarc/README.md": "f541a8852c2b0f6f9d7182e01a34c4e3beee9bfa55427a06b331638b11eb8be6",
|
||||
"pages/students/2022/jan_malinovsky/README.md": "8af021bfb131fa005a7aec3e2f2f12fc17fa5dc14e2675311adbbfc445a4bcab",
|
||||
"pages/students/2022/jan_ptak/README.md": "131cf053764fd5423541ebe672c3b4f5da875cfb8e4b821f1335ddb967282282",
|
||||
"pages/students/2022/oleh_poiasnik/README.md": "c2f7dc3f61f8b4a5b43ded1e3ae4c7d3e7f874439ee6b17dd9c8d45dabc25bc8",
|
||||
"pages/students/2022/samuel_vasil/README.md": "67c807049147aacd04f3050f4ff0233a8b3f0a239ab173b430e13dfe113ad0a5",
|
||||
"pages/students/2022/serhii_yemets/README.md": "ffbeac893947acafe855d576322a8826f9d4f87ac344cb31f8ceeefa244b9133",
|
||||
"pages/students/2022/tetiana_mohorian/README.md": "c9efdc632bf1ca89a0bfde0dc00be7aaac8a85da3d92e2ce8506236c73e93cfb",
|
||||
"pages/students/2022/valerii_kutsenko/README.md": "dc764c609ad3c1df59cfea997d4db82a591b1b1e0764453e319d841115507e4f",
|
||||
"pages/students/2022/vladyslav_yanchenko/README.md": "4d1ce216e3b526ee437ddbc658e51d7bb83530087e43628c096a569a3854a47f",
|
||||
"pages/students/2022/yevhenii_leonov/README.md": "b90e41db0cec2451027020a9102d32a24d777e8a38b604ccca87b36cd6b3a292",
|
||||
"pages/students/2023/denis_le_thanh/README.md": "2cb83f942d86a02712b0c58778e46dc2211346d1a6eba606471dfa832245db61",
|
||||
"pages/students/2023/maksym_zatirka/README.md": "7a7d2cbe276c352dacfbc6ba6de5f15303d30ecf34845ff8da8d085f3d67c3dd",
|
||||
"pages/students/2023/oleksandr_dorybohov/README.md": "c24d6f941de0dafb4459cea8259cf147821cafc86ba65be5b528f419f734bc18",
|
||||
"pages/students/2023/ronald_zalacko/README.md": "724b0f8e6e641236dba9bddbd77f4546e09514076c7dfb151807aaf4b882c96f",
|
||||
"pages/students/2023/rostyslav_rodzhuk/README.md": "de356dd7427c8a0716c165a0f88ae47b691a86ee7a388f60e2d2e9306298415c",
|
||||
"pages/students/2023/samuel_dzurina/README.md": "4818191d044b91219c796a35010c95da5cf2093e050d494f30b219b91e13fa0e",
|
||||
"pages/students/2023/simona_bobrovcanova/README.md": "e473a1911dae10ab40e2cf6696a8be616a58c22aaf09af5953fbac475791a35e",
|
||||
"pages/students/2023/yevhenii_medushivskyi/README.md": "5710ebf91c893a12fe6d19f5372311938d1e7c7bbdf203f2dc8ed2fe7c4f5a24",
|
||||
"pages/topics/akopisat/README.md": "c7245e1fbfa4160618502c0baf8cc6bc47cd9a82b8a85bc1c645314829a7b76a",
|
||||
"pages/topics/bert/README.md": "35e507f7ec2ad1d3526e2a15f94ea085ee25f680a02daf6df62fd429bd9c25c9",
|
||||
"pages/topics/chatbot/README.md": "6f2f83ffb80109be47f9750cca9d3036ec3645abef9f2b590bd6825780c7c48a",
|
||||
"pages/topics/faq/README.md": "15cfbd9c2a1649c80a7a58922e2b66dadab5c86a5ef33ef16c82bebd4d2dbf06",
|
||||
"pages/topics/hatespeech/README.md": "364df94e70dd740c63544e2586ba7b957780f714fc0c941d1b04b02233e6cbc5",
|
||||
"pages/topics/legal/README.md": "003bb9bfe1e0ca21652091c2d11496312eb04e0689fe459e14c2d5a738e8eeea",
|
||||
"pages/topics/morphology/README.md": "e242cc5ff1a4cc98e227566c0ead999bbc95937b7c20be62cb2afb773d0d35c0",
|
||||
"pages/topics/named-entity/README.md": "66b2e25f70211d432d596e377d552b3b8f0c525b14c31e3bc9c956c3aeadca84",
|
||||
"pages/topics/named-entity/navod/README.md": "1ff87079a98411de0414754c60241e08d2214ddcd63ddf974e4340cce2ce5b02",
|
||||
"pages/topics/nlp/README.md": "6f90abf9dc3f0ff33475283c13b4a08561abf631425ec2daacb076155a9e02c2",
|
||||
"pages/topics/otvorene/README.md": "cd5544925553fe3840c0ea6f8ef60ab756e26ab6757bf810025c948d8d4f98fc",
|
||||
"pages/topics/prodigy/README.md": "5e4f691f2754c2ec4afbaab2f41e6db77feb5b322dd9344465eb40c35f116499",
|
||||
"pages/topics/python/README.md": "2ef073adba672142c39e9a59fa2e00a98ab52bda54233d46fbe6940ee23f9fcc",
|
||||
"pages/topics/question/README.md": "408078a2a67cea2699e12359e85ab641136231e6104c2afdf874a705879525df",
|
||||
"pages/topics/question/navod/README.md": "061e737c69184b2bd244316ca7ba841f7186fe01ee80ee993742a733dcad3ecd",
|
||||
"pages/topics/question/nezodpovedatelne/README.md": "b6703d9690f4599b973efb27595ce157773ae0fc0d55cf2c0a09d9f50e8e4c92",
|
||||
"pages/topics/question/validacie/README.md": "3216a7127abdfc6da50ed116f44ff2d6785e7da4af70d23aceda774e745ad562",
|
||||
"pages/topics/resources/README.md": "09405397387f00cbcc5680f7d655f2d861e4d92e5df792a62d9dfd04f3534f48",
|
||||
"pages/topics/seq2seq/README.md": "969d15c03a63a3f8d5edc9017fe5a0fb7311fdf4de4a3473a08266241f92c1e2",
|
||||
"pages/topics/spacy/README.md": "f504e5db77cb8694f08a57fb8636e522d59a0e669216f4bc8273bc3c5f375f87",
|
||||
"pages/topics/steel/README.md": "b4068cef2ed197711467ac47630d5b2064fdc8828f898f7af99664e94d833330",
|
||||
"pages/topics/translation/README.md": "a7d4289e72199b307dc5ad8fc69cda39c1a33c27a6c7447af70aa9c3cc6b8635"
|
||||
}
|
||||
},
|
||||
"retrieval_policy": {
|
||||
"published_only": true,
|
||||
"publication_policy": "explicit-false-hidden-v1",
|
||||
"academic_preparation_is_work": false
|
||||
}
|
||||
},
|
||||
"graph": {
|
||||
"sha256": "f5f85ce72994baa1c4df62c0423fd6f3a349ef7de2174a65184a6dc4628e1cdb",
|
||||
"nodes": 446,
|
||||
"relationships": 877
|
||||
},
|
||||
"parameters": {
|
||||
"limit": 40,
|
||||
"max_entities": 8
|
||||
},
|
||||
"dev_summary": {
|
||||
"questions": 722,
|
||||
"source_checked_count": 722,
|
||||
"all_facts_supported_count": 722,
|
||||
"strict_count": 722,
|
||||
"strict_accuracy": 1.0,
|
||||
"error_count": 0,
|
||||
"value_score": 1.0,
|
||||
"entity_score": 1.0,
|
||||
"relation_score": 1.0,
|
||||
"property_score": 1.0,
|
||||
"relation_choice_score": 1.0,
|
||||
"document_recall": 1.0,
|
||||
"source_recall": 1.0,
|
||||
"binding_score": 1.0,
|
||||
"path_score": 1.0,
|
||||
"answerability_accuracy": 1.0,
|
||||
"latency_mean_seconds": 0.041665,
|
||||
"latency_median_seconds": 0.040584,
|
||||
"latency_p95_seconds": 0.050737
|
||||
},
|
||||
"source_audit_summary": {
|
||||
"dev": {
|
||||
"questions": 722,
|
||||
"source_consistent": 722,
|
||||
"issues": {}
|
||||
},
|
||||
"test": {
|
||||
"questions": 320,
|
||||
"source_consistent": 320,
|
||||
"issues": {}
|
||||
}
|
||||
},
|
||||
"policy": "Report all questions including negatives. No exclusions or holdout tuning.",
|
||||
"dev_results_sha256": "5a35b798860cac4376e6b323956eb4e1437469062deec99687c953b147d238f0",
|
||||
"audit_sha256": "091e2ee00a88e9e6a459e91fb54efabd23eec5eb4dd70570aa313c3e51e93410"
|
||||
}
|
||||
233
tools/graphrag/evaluation/frozen_v5_1.json
Normal file
233
tools/graphrag/evaluation/frozen_v5_1.json
Normal file
@ -0,0 +1,233 @@
|
||||
{
|
||||
"schema_version": 2,
|
||||
"evaluation_kind": "historical_regression",
|
||||
"partition": {
|
||||
"method": "Previously exposed questions; regression, not independent TEST",
|
||||
"dev_profile_count": 72,
|
||||
"test_profile_count": 72,
|
||||
"source_profile_overlap": 72
|
||||
},
|
||||
"frozen_at_utc": "2026-10-25T16:14:12.663856+00:00",
|
||||
"fingerprints": {
|
||||
"implementation": {
|
||||
"tools/graphrag/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/build_graphrag.py": "256292101d6d7d1946e926e2717ac45465b169f4091c51ecfed4f1a779dfd700",
|
||||
"tools/graphrag/evaluation/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/evaluation/audit_benchmark.py": "6619c818a52fc284e87ed6c48a503a54a3c9dd95447463ed78f075b7c58bad80",
|
||||
"tools/graphrag/evaluation/benchmark_v2.py": "129dd774faa414f06733e1ee6333e7b411b1c75b5601b895c405778df478a563",
|
||||
"tools/graphrag/evaluation/benchmark_v3.py": "30bae6c605ed26f4b49973acec799087c4e2b97a883ccedcafb965dd909c4c4d",
|
||||
"tools/graphrag/evaluation/benchmark_v4.py": "70a8b08f7c2b2cb3e2bdc77be9efedd23ea24ac564ec1c1eb224a9f6388b3a67",
|
||||
"tools/graphrag/evaluation/check_openwebui.py": "d6b5d9947679aeabf4ec9599a7ad70b5ee917dd7c6ad747ddbf54579d8de475b",
|
||||
"tools/graphrag/evaluation/evaluate_graphrag.py": "89c364d15b70c9cb55df39d5970b4d0d79b681ba70eed7530a4e3fe64167812e",
|
||||
"tools/graphrag/evaluation/evidence_contract.py": "78e24264c176e163e1782fef1634b6c45c7f31bd4692726d02a30ab45a06648e",
|
||||
"tools/graphrag/evaluation/freeze_graphrag.py": "793c6d04a13c3217347283c609f647cd0d69b020e44bbde458bdc7ebbab8ec7e",
|
||||
"tools/graphrag/evaluation/graphrag_evaluator.py": "7f99bf0f97974058650b619ea49a8ee32284cb4b324f1ffab9baf54f5c4495f4",
|
||||
"tools/graphrag/evaluation/reproducibility.py": "f6dde1a2a6f68abd0e916dfb38d5eb756a7f8621a66b7c11e43e7580b347134a",
|
||||
"tools/graphrag/evaluation/source_oracle.py": "25aba0ebd6af1c94ec42e4d5044bad55ae0964c89ed3f06aa63a0959ab2d7ddb",
|
||||
"tools/graphrag/evaluation/source_validation.py": "9671b8978623888dbed8b8b2d1b6b01c1ce73cb0a512b03919e48873990f15ed",
|
||||
"tools/graphrag/graph_db.py": "c4b1a2edb765856b807398e4c243a8d17753529a5d2dfdb51791e28bc8de17f7",
|
||||
"tools/graphrag/graph_search.py": "8cc3668b4ad7beabf849e6978ea1d5defc818b142ee8b157b19c319998fb7541",
|
||||
"tools/graphrag/graphrag.py": "3a5ae3bfd12ef171d650548cb26c5708b472424a11cd8cb9ed64e21c9ab5bbd2",
|
||||
"tools/graphrag/neo4j_smoke.py": "fb5244c72c29ef2acf96d1e7f54335ff168eed4119db1692025eb1b99194b7bb",
|
||||
"tools/graphrag/publication.py": "fba1fa0d0bed325fd87f8d3593baae9271de1766b772d7214c7f63fd3f1c37b6",
|
||||
"tools/graphrag/tests/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/tests/test_evaluation_pipeline_v2.py": "63d1b3e80ae3c7b563374fd7ab4aa5ffad3c614eafbd15142c577abd7f756bf9",
|
||||
"tools/graphrag/tests/test_evaluation_v5.py": "9387e9d1418ebab87530986b0e29dac31cf33d762777a29a31cff24cc72e552a",
|
||||
"tools/graphrag/tests/test_evaluation_wide.py": "1b28bb74fd6b9457c869186b88606f1f7863d573aa3ab5226162e878f236d99e",
|
||||
"tools/graphrag/tests/test_evaluator_connected_v2.py": "29d7c9838ed1ff37ea3276df6feb1b6142158c43a0525712f490b648181882de",
|
||||
"tools/graphrag/tests/test_graph_publication.py": "96e53c1ae28e36c7a4290e1e60c8b398bf095ceaf883e819e1a477e2672b11c0",
|
||||
"tools/graphrag/tests/test_graph_rebuild_atomic.py": "fe37d4fff0b1f0fb1d565f0a96152b9b4e336837bc78b5977cf3b4879d7fbaf3",
|
||||
"tools/graphrag/tests/test_graph_search.py": "eb58661aef9dafe6bf7188fcdc2d79cef6652d57c64d1b81ae81a52e8e0204d7",
|
||||
"tools/graphrag/tests/test_graph_search_entity_v2.py": "0ef1a8ebd513c5a4507eb38fcf5ae6137c69e9901b5a2975ba513be5902ac693",
|
||||
"tools/graphrag/tests/test_graph_search_neo4j.py": "fec2bf72de8f752f17c9164fee5754bdb2e153828855e47efbf0000dbe82cf3b",
|
||||
"tools/graphrag/tests/test_graph_search_regressions.py": "9db7779aeb8ed9e8c0f92c1657011a81080aff3c928649e811358e3009a18c48",
|
||||
"tools/graphrag/tests/test_graphrag.py": "9ee8629d6b528dd78c2ddfc25cee95e17613f45b454fc0a38d4c591862637a9f",
|
||||
"tools/graphrag/tests/test_graphrag_evaluator.py": "1c6d08aeec9ae56ac4123239a5aed12a0081d66cc3f34b2047d95764579d7298",
|
||||
"tools/graphrag/tests/test_graphrag_freeze.py": "c4b760baf4c7ebf13b16bd4cd3c51874f5512eef3b4c61470dc4d428b0303d9f",
|
||||
"tools/graphrag/tests/test_graphrag_research_v2.py": "711008a91ab8a58ae0854e7f90329bcd42e5189fde2e2001589e97b0c22c5198",
|
||||
"tools/graphrag/tests/test_graphrag_root_title.py": "085651fe6e6081521a5dde9554abfee93456250108cf15978df25378d886a46c",
|
||||
"tools/graphrag/tests/test_source_oracle_v2.py": "0afdbe235e185ffe9f38aa667f90f5a6c20504fe29e9ac572642b39a8eb7faca",
|
||||
"requirements.txt": "26a6d097727eba03c1b6c71cd02b06373ef01ce03e567dd2bc4357ae330e5a1a",
|
||||
"tools/publication.py": "f99d445073390a733afc8d849b9fcd4b4b0890bb54d136db67d4015b78436e1a",
|
||||
"tools/retrieval_contract.py": "b8fa272c3babf924a3ce8b937fe7ae437cd959ba9f7667193ac67c18d2c5b58d",
|
||||
"tools/index_state.py": "c33920a63d04009f11ef23ca9e9eee9bf86453b7d0586d027bf3b39156afea0d",
|
||||
"tools/rag/common.py": "8497c46d5c6c27a7c76df1568360ad5e9d00d5e5a7ef186e758960cc79d81d1c",
|
||||
"tools/sync_indexes.py": "5b909b4394c24e5ce22848594b16d9aea45fb06418f5cd92bb6aa6381a0ccf10"
|
||||
},
|
||||
"dataset_sha256": "9a3b873882bbf29b905d79c9448c3c287fda30323f93a6533b88dbd59b19f558",
|
||||
"inputs": {
|
||||
"data/documents.json": "0542af2a373771cf7c4a95f93d14f4f687f6a0187846892c959aa6efc4bade52",
|
||||
"data/chunks.json": "437dde589be46e0c30842dd330de22d96a0173d2dbaff9c5f129568cb2bca4c9"
|
||||
},
|
||||
"source_corpus": {
|
||||
"sha256": "440da12a7a991824e923f70cada7c616c3fb3b0f12767ec7d75039a6a3231b10",
|
||||
"document_count": 114,
|
||||
"documents": {
|
||||
"pages/interns/bogdan_paul_chis/README.md": "3b4b946eb3c10e9f9a4092e6cffa01c5080e7579aded2f6ed3120c41ed62b647",
|
||||
"pages/interns/cesar_gutierrez/README.md": "b0be60576eed28d4b1920e9acf198684519373dfc13171567247c853b3ed699e",
|
||||
"pages/interns/oliver_pejic/README.md": "0470f3c8465be8f02204b08e4c75ef47f68c7e4ad1038faa5641cdf1811f33d5",
|
||||
"pages/interns/sevval_bulburu/README.md": "ff2a9d66253802f1af0fdfd74832e40fae41b6df23c5e61dc266f6cd0cc16c4d",
|
||||
"pages/interns/yussef_ressaissi/README.md": "f997a65699da0db3222ef7a3c37652d05dfc3419ad4ec74683bafc2c897bb987",
|
||||
"pages/students/2016/darius_lindvai/README.md": "fcaa47bb9708a6439eec5c4b7f7b4ed6c7359e423e1d940e1aed9f44957e6d62",
|
||||
"pages/students/2016/darius_lindvai/dp2021/README.md": "be3d0fea2a6d592b225eecabd9b19445c2fce62b8289c07ab6af93835db12970",
|
||||
"pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md": "352162de1b1e192228fa5d26506c028ac47e567e90df53b1bbaa6ad736ec4766",
|
||||
"pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md": "b4a81ff457624b089d618e4479afb1e3d748f6724f72104ef5518e535ae02fe5",
|
||||
"pages/students/2016/dominik_nagy/README.md": "1c4037a158d84c45fa705a0c38e47142a9d46e226f0c138bc2d56d7c38f6d74d",
|
||||
"pages/students/2016/dominik_nagy/timovy_projekt/README.md": "b81a4dab7316f7b846dcf36515f6aa9d44035c86f46f0e07b7a43308bcd31458",
|
||||
"pages/students/2016/ediz_morochovic/README.md": "045e5eb9a3df2b84140808fbca0c3163266ad0efa144bc42d9d5c597881c6ac6",
|
||||
"pages/students/2016/jakub_maruniak/README.md": "6734c41a95b9d0c1e3d226b393ad109ee4a7b82ebfffa73df2d7e0a743fefa14",
|
||||
"pages/students/2016/jakub_maruniak/dp2021/README.md": "9cd884aec70705cdb2aaa0f514b513f16de263c37b749ced7f92916cd2f91c39",
|
||||
"pages/students/2016/jakub_maruniak/dp2021/annotation/README.md": "debae0c50aea1accef0840912b9b1f37b2138f856002bb50e91d7ea2dbbe7963",
|
||||
"pages/students/2016/jakub_maruniak/dp2021/train_experiments/README.md": "01dff38b37043414fa1db204394ddbe7aade00e14d02d495572b65c85d09b194",
|
||||
"pages/students/2016/jakub_maruniak/timovy_projekt/README.md": "04114b1f3d84664aad5bdba5a0b614c5a6f23392be3c31fd9123d63db1be0a35",
|
||||
"pages/students/2016/jan_holp/README.md": "80d6a8492766e5bfa61673a372e5f059d30c8e335de39842866c51485960e4d3",
|
||||
"pages/students/2016/jan_holp/dp2021/README.md": "a62acb74009376766c7e2f9856ee01d21f84593eb9b3ce85cf2e6032aa412476",
|
||||
"pages/students/2016/jan_holp/dp2021/zdrojove_subory/README.md": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"pages/students/2016/jan_holp/timovy_projekt/README.md": "79eebdfd3af7e8d5c279077e285a580731b1cf8cc9b4454f6596796e9915f70c",
|
||||
"pages/students/2016/lukas_pokryvka/README.md": "f279456c5c277ff1ee0dd89a3464ed9f9f67b44bc185a5da9811ef5cfb675002",
|
||||
"pages/students/2016/lukas_pokryvka/dp2021/README.md": "39b61376ce108e4a930f926ab2d6a997207457121bccfcf617129a3b210a15cf",
|
||||
"pages/students/2016/lukas_pokryvka/timovy_projekt/README.md": "4de4b6c8cfed17b6c60090f82df1d55a66be70a79d3013850689b2baebdd801b",
|
||||
"pages/students/2016/mark_feher/README.md": "bec37c0319fe0869a0377d771db23d090dbda93c27328f5697cdaeb3bbccfe9b",
|
||||
"pages/students/2016/maros_harahus/README.md": "0da150e91918632c9e8cd1443f04da403595a372517e254928ce9f76c9d5033d",
|
||||
"pages/students/2016/maros_harahus/timovy_projekt/README.md": "75af19f7c68f4b646fa1dbae75f3f3dfc52633a9f9da1400d21808bb20be0d83",
|
||||
"pages/students/2016/patrik_pavlisin/README.md": "dc1c648d7cd9b0f0e021c57f9b98189e37c100871439e7e304390715913f2763",
|
||||
"pages/students/2016/patrik_pavlisin/dp21/README.md": "ac1eb0fd0360ad34aa21b7c8da5bb010a6edf10be5721f28dedc3986cd1d8c54",
|
||||
"pages/students/2016/patrik_pavlisin/dp22/README.md": "f2a8c619a812b99abab618ae388eb672407950e1f33fb8d7da7a528c4de81d50",
|
||||
"pages/students/2016/patrik_pavlisin/tp20/README.md": "ae9c771f27e7e093bc29c6888c8d0b27ed61fb41519fd0d7e7f4f6cbb4626edc",
|
||||
"pages/students/2016/tomas_kucharik/README.md": "6a1a215433eb1857660177b4cb2ecec03c6a86743d3a04cd6d5c9d9682c9e63b",
|
||||
"pages/students/2017/dmytro_ushatenko/README.md": "65f4ac177d492162b08ca5da3d9eb048bd088a3c117a28a662113b7e4bc3a4ec",
|
||||
"pages/students/2017/martin_jancura/README.md": "6a0a18d5095dcfb12abfdd72c9cfd8025d714fb5e29a7858cd2b285e4cb986b9",
|
||||
"pages/students/2017/stanislav_matsunych/README.md": "90ffa11eff4a4360b0252dbc53a116c3a5777b3d5dd86ce5c89c02bdd2051c73",
|
||||
"pages/students/2017/than_trung_thanh/README.md": "2150519b8580e7337520db4de64d2d1c82d2634380537d019f41c506dbf2979d",
|
||||
"pages/students/2018/NaN1name_buday/README.md": "23c8c58090bdc954347e36f141bea91f43c8d5b1d777e346864a2ebe84c0bcce",
|
||||
"pages/students/2018/adrian_remias/README.md": "e5bfe1d5d4e626beaa636a02d34ec58cf2cff9b0e57833905af35b80bf1465a2",
|
||||
"pages/students/2018/david_ilas/README.md": "96c45ff9c5a821ddcb1a2fc86d487bd8f4729d1b76887914b0f5fbf99af45af0",
|
||||
"pages/students/2018/david_omasta/README.md": "4164051870e1e1cf8949ed18a74196e9ea789dfbe4fee24bdeb736ca42848327",
|
||||
"pages/students/2018/martin_wencel/README.md": "0e6a7a981689f22304f8baa5de97d4315c0695c94c9277de7851943eb012253b",
|
||||
"pages/students/2018/oleh_bilykh/README.md": "4072c62dd8ee753a0c8fa43fdfbbdf566e394c2df13e6a79d08a302e332710b1",
|
||||
"pages/students/2018/ondrej_megela/README.md": "969ff2e1a436b8f957e7168cf5eb678196b99aeda17701c502b016441f644065",
|
||||
"pages/students/2018/samuel_sirotnik/README.md": "cc230ede67b6e8632511c92a5ed6d1e9deb42e70819280222bdfd369ee77fc70",
|
||||
"pages/students/2019/alina_vitko/README.md": "9b071fe2aff470c275ae027be236fe836f741f774cabb9cbbb55304a8d5102cd",
|
||||
"pages/students/2019/artem_yatsenko/README.md": "328b101e46c51c959e792cf7ca226942f81d2ab8fe9648ad6d0ecd07016429e2",
|
||||
"pages/students/2019/david_stromp/README.md": "e46ca8691d5ec894128f6f6f2ed33e2c7bd141f80719bb0449b20f10f30cca09",
|
||||
"pages/students/2019/dmytro_mural/README.md": "e881a47d847c3ef8d680844113fdbfbb87553b28982bf9eef4936f6d30923e93",
|
||||
"pages/students/2019/filip_tomas/README.md": "75a1fe7b921e4bff0fdf9e2a957b4adad4b4a57aa7ebdffbb73dd82c02123f94",
|
||||
"pages/students/2019/kristian_sopkovic/README.md": "3286960fb30f584df35455f9b6dfae81ca4827a1d711d2bcd6e48c3f150c9279",
|
||||
"pages/students/2019/michal_stromko/README.md": "3ae1dd9b6638a6a249a94be3f3846286555666aefa225bb3a2c7288b35900ce7",
|
||||
"pages/students/2019/michal_stromko/vp2021/README.md": "feb2e093fdd6461239e79b1e1f96e65a1c8cd96e8a2b70535ae556a9c198046a",
|
||||
"pages/students/2019/michal_stromko/vp2021/tutorials/README.md": "40e3fa448c7329ef863e705435e23fe6b4788de440710f066fe0eed92d132bad",
|
||||
"pages/students/2019/michal_stromko/vp2021/tutorials/img/README.md": "e8d3ac160b17dfdee2c3e996bf6a03af7a6f16f9140bf5cf7ee343a82dd1865f",
|
||||
"pages/students/2019/patrik_pokrivcak/README.md": "3e3957ad0f7aca59d6eb64c38a3f5e21d8fd953200825d0d0e5cacabfbc35a7d",
|
||||
"pages/students/2019/samuel_horani/README.md": "86e6959ccc612b069687b57996fa3f61660075d6a0d65bfec64f423d39a0a999",
|
||||
"pages/students/2020/david_kostilnik/README.md": "2927524b75da59a64120fc364a0fc374986fa4d364d54e52c36800762c203264",
|
||||
"pages/students/2020/jakub_kristian_lukas/README.md": "f139d9b1ebf5a3f45612f3df5703ecdd935b90701763c27c7c529044c0b0455a",
|
||||
"pages/students/2020/kamil_tomcufcik/README.md": "9d865adf538bc6d7992ee4f4882713447da5c936fca17c43ca0f576072537048",
|
||||
"pages/students/2020/matej_kobylan/README.md": "3d7b289e17b8f25678a07e9ee0e6741688485a0ccb1e50940a6a6acc6312a547",
|
||||
"pages/students/2020/matus_suchanic/README.md": "770ca49538cca22df35f8e7ba736ee97483e4fe5788c221496553592b4e78dc6",
|
||||
"pages/students/2020/pavol_hudak/README.md": "33d06fccc6451e5f19b27b0cad001a34e81635b4ea294a01dec7771c823abc40",
|
||||
"pages/students/2020/vladyslav_krupko/README.md": "4c28e6d38651bb2cafcbf4a18e35210cd369aef2caff6c5b0aa52fac38f0fe7d",
|
||||
"pages/students/2021/artur_hyrenko/README.md": "0568261f4ade4de5472edcfeb1ffed9abae18dc67e4050f4ce2ad088839a2bb3",
|
||||
"pages/students/2021/eduard_matovka/README.md": "de2a7ae38ec87110e347956b37d0605a298ed2847f972961cc9b977da8221d43",
|
||||
"pages/students/2021/manohar_gowdru_shridharu/README.md": "c00ceb620ed7087ead5d9448d476bbb98d273d1d9e7bf1bc4355c367b26c7a6b",
|
||||
"pages/students/2021/martin_sarissky/README.md": "8e97b45a253745faa55f63c844e0b5dfe680aeaf6eb01fb8f9d06ac6e8ee8bcf",
|
||||
"pages/students/2021/matej_novotny/README.md": "b083a7cadde532e3428dc9a57bc61456fcc5905bda91e011b96033d42bf5d9cb",
|
||||
"pages/students/2021/matej_scislak/README.md": "b9a32cce8605e044a4f2828ff2d91a2995a62ef3a841e62f0a225c97221f0cc8",
|
||||
"pages/students/2021/nikita_bodnar/README.md": "2016c0dd923c0f8e561d5cea42ac81da3610fdcc54a4527f56d078e34e53ce90",
|
||||
"pages/students/2021/oleksandr_hryshchenko/README.md": "4b073992b715b6c75b79fd2c8f850a69f940966e3a61a82c625c32c945a93036",
|
||||
"pages/students/2021/vladimir_ferko/README.md": "68e7d311896eda2171e5eec1ec3a8da90d326ed91acaace8058f68664a50d271",
|
||||
"pages/students/2022/andrii_pervashov/README.md": "319dcaa1cc2e29dd7e3a710bab26cb3ac6944ab71b0b97e1de076b1199122334",
|
||||
"pages/students/2022/daniil_huzenko/README.md": "390782fbff6220a9462060ce1a62959f2a2b88f42d06e2c51d1f406b75d73f2c",
|
||||
"pages/students/2022/jakub_schwarc/README.md": "f541a8852c2b0f6f9d7182e01a34c4e3beee9bfa55427a06b331638b11eb8be6",
|
||||
"pages/students/2022/jan_malinovsky/README.md": "8af021bfb131fa005a7aec3e2f2f12fc17fa5dc14e2675311adbbfc445a4bcab",
|
||||
"pages/students/2022/jan_ptak/README.md": "131cf053764fd5423541ebe672c3b4f5da875cfb8e4b821f1335ddb967282282",
|
||||
"pages/students/2022/oleh_poiasnik/README.md": "c2f7dc3f61f8b4a5b43ded1e3ae4c7d3e7f874439ee6b17dd9c8d45dabc25bc8",
|
||||
"pages/students/2022/samuel_vasil/README.md": "67c807049147aacd04f3050f4ff0233a8b3f0a239ab173b430e13dfe113ad0a5",
|
||||
"pages/students/2022/serhii_yemets/README.md": "ffbeac893947acafe855d576322a8826f9d4f87ac344cb31f8ceeefa244b9133",
|
||||
"pages/students/2022/tetiana_mohorian/README.md": "c9efdc632bf1ca89a0bfde0dc00be7aaac8a85da3d92e2ce8506236c73e93cfb",
|
||||
"pages/students/2022/valerii_kutsenko/README.md": "dc764c609ad3c1df59cfea997d4db82a591b1b1e0764453e319d841115507e4f",
|
||||
"pages/students/2022/vladyslav_yanchenko/README.md": "4d1ce216e3b526ee437ddbc658e51d7bb83530087e43628c096a569a3854a47f",
|
||||
"pages/students/2022/yevhenii_leonov/README.md": "b90e41db0cec2451027020a9102d32a24d777e8a38b604ccca87b36cd6b3a292",
|
||||
"pages/students/2023/denis_le_thanh/README.md": "2cb83f942d86a02712b0c58778e46dc2211346d1a6eba606471dfa832245db61",
|
||||
"pages/students/2023/maksym_zatirka/README.md": "7a7d2cbe276c352dacfbc6ba6de5f15303d30ecf34845ff8da8d085f3d67c3dd",
|
||||
"pages/students/2023/oleksandr_dorybohov/README.md": "c24d6f941de0dafb4459cea8259cf147821cafc86ba65be5b528f419f734bc18",
|
||||
"pages/students/2023/ronald_zalacko/README.md": "724b0f8e6e641236dba9bddbd77f4546e09514076c7dfb151807aaf4b882c96f",
|
||||
"pages/students/2023/rostyslav_rodzhuk/README.md": "de356dd7427c8a0716c165a0f88ae47b691a86ee7a388f60e2d2e9306298415c",
|
||||
"pages/students/2023/samuel_dzurina/README.md": "4818191d044b91219c796a35010c95da5cf2093e050d494f30b219b91e13fa0e",
|
||||
"pages/students/2023/simona_bobrovcanova/README.md": "e473a1911dae10ab40e2cf6696a8be616a58c22aaf09af5953fbac475791a35e",
|
||||
"pages/students/2023/yevhenii_medushivskyi/README.md": "5710ebf91c893a12fe6d19f5372311938d1e7c7bbdf203f2dc8ed2fe7c4f5a24",
|
||||
"pages/topics/akopisat/README.md": "c7245e1fbfa4160618502c0baf8cc6bc47cd9a82b8a85bc1c645314829a7b76a",
|
||||
"pages/topics/bert/README.md": "35e507f7ec2ad1d3526e2a15f94ea085ee25f680a02daf6df62fd429bd9c25c9",
|
||||
"pages/topics/chatbot/README.md": "6f2f83ffb80109be47f9750cca9d3036ec3645abef9f2b590bd6825780c7c48a",
|
||||
"pages/topics/faq/README.md": "15cfbd9c2a1649c80a7a58922e2b66dadab5c86a5ef33ef16c82bebd4d2dbf06",
|
||||
"pages/topics/hatespeech/README.md": "364df94e70dd740c63544e2586ba7b957780f714fc0c941d1b04b02233e6cbc5",
|
||||
"pages/topics/legal/README.md": "003bb9bfe1e0ca21652091c2d11496312eb04e0689fe459e14c2d5a738e8eeea",
|
||||
"pages/topics/morphology/README.md": "e242cc5ff1a4cc98e227566c0ead999bbc95937b7c20be62cb2afb773d0d35c0",
|
||||
"pages/topics/named-entity/README.md": "66b2e25f70211d432d596e377d552b3b8f0c525b14c31e3bc9c956c3aeadca84",
|
||||
"pages/topics/named-entity/navod/README.md": "1ff87079a98411de0414754c60241e08d2214ddcd63ddf974e4340cce2ce5b02",
|
||||
"pages/topics/nlp/README.md": "6f90abf9dc3f0ff33475283c13b4a08561abf631425ec2daacb076155a9e02c2",
|
||||
"pages/topics/otvorene/README.md": "cd5544925553fe3840c0ea6f8ef60ab756e26ab6757bf810025c948d8d4f98fc",
|
||||
"pages/topics/prodigy/README.md": "5e4f691f2754c2ec4afbaab2f41e6db77feb5b322dd9344465eb40c35f116499",
|
||||
"pages/topics/python/README.md": "2ef073adba672142c39e9a59fa2e00a98ab52bda54233d46fbe6940ee23f9fcc",
|
||||
"pages/topics/question/README.md": "408078a2a67cea2699e12359e85ab641136231e6104c2afdf874a705879525df",
|
||||
"pages/topics/question/navod/README.md": "061e737c69184b2bd244316ca7ba841f7186fe01ee80ee993742a733dcad3ecd",
|
||||
"pages/topics/question/nezodpovedatelne/README.md": "b6703d9690f4599b973efb27595ce157773ae0fc0d55cf2c0a09d9f50e8e4c92",
|
||||
"pages/topics/question/validacie/README.md": "3216a7127abdfc6da50ed116f44ff2d6785e7da4af70d23aceda774e745ad562",
|
||||
"pages/topics/resources/README.md": "09405397387f00cbcc5680f7d655f2d861e4d92e5df792a62d9dfd04f3534f48",
|
||||
"pages/topics/seq2seq/README.md": "969d15c03a63a3f8d5edc9017fe5a0fb7311fdf4de4a3473a08266241f92c1e2",
|
||||
"pages/topics/spacy/README.md": "f504e5db77cb8694f08a57fb8636e522d59a0e669216f4bc8273bc3c5f375f87",
|
||||
"pages/topics/steel/README.md": "b4068cef2ed197711467ac47630d5b2064fdc8828f898f7af99664e94d833330",
|
||||
"pages/topics/translation/README.md": "a7d4289e72199b307dc5ad8fc69cda39c1a33c27a6c7447af70aa9c3cc6b8635"
|
||||
}
|
||||
},
|
||||
"retrieval_policy": {
|
||||
"published_only": true,
|
||||
"publication_policy": "explicit-false-hidden-v1",
|
||||
"academic_preparation_is_work": false
|
||||
}
|
||||
},
|
||||
"graph": {
|
||||
"sha256": "34d3ff672efe834d2b7d07e2f1cd1c043db011d0db37fb07cc7616bced0234a0",
|
||||
"nodes": 446,
|
||||
"relationships": 877
|
||||
},
|
||||
"parameters": {
|
||||
"limit": 40,
|
||||
"max_entities": 8
|
||||
},
|
||||
"dev_summary": {
|
||||
"questions": 722,
|
||||
"source_checked_count": 722,
|
||||
"all_facts_supported_count": 722,
|
||||
"strict_count": 722,
|
||||
"strict_accuracy": 1.0,
|
||||
"error_count": 0,
|
||||
"value_score": 1.0,
|
||||
"entity_score": 1.0,
|
||||
"relation_score": 1.0,
|
||||
"property_score": 1.0,
|
||||
"relation_choice_score": 1.0,
|
||||
"document_recall": 1.0,
|
||||
"source_recall": 1.0,
|
||||
"binding_score": 1.0,
|
||||
"path_score": 1.0,
|
||||
"answerability_accuracy": 1.0,
|
||||
"latency_mean_seconds": 0.042052,
|
||||
"latency_median_seconds": 0.040355,
|
||||
"latency_p95_seconds": 0.052196
|
||||
},
|
||||
"source_audit_summary": {
|
||||
"dev": {
|
||||
"questions": 722,
|
||||
"source_consistent": 722,
|
||||
"issues": {}
|
||||
},
|
||||
"test": {
|
||||
"questions": 320,
|
||||
"source_consistent": 320,
|
||||
"issues": {}
|
||||
}
|
||||
},
|
||||
"policy": "Report all questions including negatives. No exclusions or holdout tuning.",
|
||||
"dev_results_sha256": "b940a1a42a09d25fc008f34948ee3c8b274e9fab8fe0e692e04e1bfa472f2a25",
|
||||
"audit_sha256": "81708ca63f8772673cd836fe7a1a1938fbe0e713588efcb07ed3fd4280f27829"
|
||||
}
|
||||
241
tools/graphrag/evaluation/frozen_v6.json
Normal file
241
tools/graphrag/evaluation/frozen_v6.json
Normal file
@ -0,0 +1,241 @@
|
||||
{
|
||||
"schema_version": 2,
|
||||
"evaluation_kind": "historical_regression",
|
||||
"partition": {
|
||||
"method": "Previously exposed questions; regression, not independent TEST",
|
||||
"dev_profile_count": 72,
|
||||
"test_profile_count": 72,
|
||||
"source_profile_overlap": 72
|
||||
},
|
||||
"frozen_at_utc": "2026-10-25T21:18:46.238549+00:00",
|
||||
"fingerprints": {
|
||||
"implementation": {
|
||||
"tools/graphrag/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/build_graphrag.py": "256292101d6d7d1946e926e2717ac45465b169f4091c51ecfed4f1a779dfd700",
|
||||
"tools/graphrag/evaluation/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/evaluation/audit_benchmark.py": "6619c818a52fc284e87ed6c48a503a54a3c9dd95447463ed78f075b7c58bad80",
|
||||
"tools/graphrag/evaluation/benchmark_v2.py": "129dd774faa414f06733e1ee6333e7b411b1c75b5601b895c405778df478a563",
|
||||
"tools/graphrag/evaluation/benchmark_v3.py": "30bae6c605ed26f4b49973acec799087c4e2b97a883ccedcafb965dd909c4c4d",
|
||||
"tools/graphrag/evaluation/benchmark_v4.py": "70a8b08f7c2b2cb3e2bdc77be9efedd23ea24ac564ec1c1eb224a9f6388b3a67",
|
||||
"tools/graphrag/evaluation/benchmark_v6.py": "f955e600d17358fafcb33bab772aef09d787452f6b33352e299fdd42669aaf34",
|
||||
"tools/graphrag/evaluation/check_openwebui.py": "e2a81b52f7431b27a5e2a7d2bd0801029a782ea3620c0b7a289c57bdebb994d7",
|
||||
"tools/graphrag/evaluation/evaluate_graphrag.py": "89c364d15b70c9cb55df39d5970b4d0d79b681ba70eed7530a4e3fe64167812e",
|
||||
"tools/graphrag/evaluation/evidence_contract.py": "78e24264c176e163e1782fef1634b6c45c7f31bd4692726d02a30ab45a06648e",
|
||||
"tools/graphrag/evaluation/freeze_graphrag.py": "793c6d04a13c3217347283c609f647cd0d69b020e44bbde458bdc7ebbab8ec7e",
|
||||
"tools/graphrag/evaluation/graphrag_evaluator.py": "7f99bf0f97974058650b619ea49a8ee32284cb4b324f1ffab9baf54f5c4495f4",
|
||||
"tools/graphrag/evaluation/reproducibility.py": "8db9a0e0f86236b56239f41da11803538dfaa6745bbf74dbd7618e0a73bda0ae",
|
||||
"tools/graphrag/evaluation/source_oracle.py": "f2265d0919a4019f10d2b4a986bd772684fe59c598d7ae2f5cd0daa41f81b87b",
|
||||
"tools/graphrag/evaluation/source_validation.py": "9671b8978623888dbed8b8b2d1b6b01c1ce73cb0a512b03919e48873990f15ed",
|
||||
"tools/graphrag/graph_db.py": "c4b1a2edb765856b807398e4c243a8d17753529a5d2dfdb51791e28bc8de17f7",
|
||||
"tools/graphrag/graph_search.py": "8cc3668b4ad7beabf849e6978ea1d5defc818b142ee8b157b19c319998fb7541",
|
||||
"tools/graphrag/graphrag.py": "a718efbd001301c4a809aa449a2f175ae7aca8f6f3248f539d6f0597faeb3187",
|
||||
"tools/graphrag/neo4j_smoke.py": "fb5244c72c29ef2acf96d1e7f54335ff168eed4119db1692025eb1b99194b7bb",
|
||||
"tools/graphrag/publication.py": "fba1fa0d0bed325fd87f8d3593baae9271de1766b772d7214c7f63fd3f1c37b6",
|
||||
"tools/graphrag/tests/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/tests/test_evaluation_pipeline_v2.py": "63d1b3e80ae3c7b563374fd7ab4aa5ffad3c614eafbd15142c577abd7f756bf9",
|
||||
"tools/graphrag/tests/test_evaluation_v5.py": "9387e9d1418ebab87530986b0e29dac31cf33d762777a29a31cff24cc72e552a",
|
||||
"tools/graphrag/tests/test_evaluation_wide.py": "1b28bb74fd6b9457c869186b88606f1f7863d573aa3ab5226162e878f236d99e",
|
||||
"tools/graphrag/tests/test_evaluator_connected_v2.py": "29d7c9838ed1ff37ea3276df6feb1b6142158c43a0525712f490b648181882de",
|
||||
"tools/graphrag/tests/test_graph_publication.py": "96e53c1ae28e36c7a4290e1e60c8b398bf095ceaf883e819e1a477e2672b11c0",
|
||||
"tools/graphrag/tests/test_graph_rebuild_atomic.py": "fe37d4fff0b1f0fb1d565f0a96152b9b4e336837bc78b5977cf3b4879d7fbaf3",
|
||||
"tools/graphrag/tests/test_graph_search.py": "eb58661aef9dafe6bf7188fcdc2d79cef6652d57c64d1b81ae81a52e8e0204d7",
|
||||
"tools/graphrag/tests/test_graph_search_entity_v2.py": "0ef1a8ebd513c5a4507eb38fcf5ae6137c69e9901b5a2975ba513be5902ac693",
|
||||
"tools/graphrag/tests/test_graph_search_neo4j.py": "fec2bf72de8f752f17c9164fee5754bdb2e153828855e47efbf0000dbe82cf3b",
|
||||
"tools/graphrag/tests/test_graph_search_regressions.py": "9db7779aeb8ed9e8c0f92c1657011a81080aff3c928649e811358e3009a18c48",
|
||||
"tools/graphrag/tests/test_graphrag.py": "9ee8629d6b528dd78c2ddfc25cee95e17613f45b454fc0a38d4c591862637a9f",
|
||||
"tools/graphrag/tests/test_graphrag_evaluator.py": "1c6d08aeec9ae56ac4123239a5aed12a0081d66cc3f34b2047d95764579d7298",
|
||||
"tools/graphrag/tests/test_graphrag_freeze.py": "c4b760baf4c7ebf13b16bd4cd3c51874f5512eef3b4c61470dc4d428b0303d9f",
|
||||
"tools/graphrag/tests/test_graphrag_research_v2.py": "711008a91ab8a58ae0854e7f90329bcd42e5189fde2e2001589e97b0c22c5198",
|
||||
"tools/graphrag/tests/test_graphrag_root_title.py": "085651fe6e6081521a5dde9554abfee93456250108cf15978df25378d886a46c",
|
||||
"tools/graphrag/tests/test_source_oracle_v2.py": "0afdbe235e185ffe9f38aa667f90f5a6c20504fe29e9ac572642b39a8eb7faca",
|
||||
"tools/graphrag/tests/test_title_labels.py": "2983ead68ad6e2e346d24af0fc96dc6771c163e9c2a351af426a1e0383998e6f",
|
||||
"requirements.txt": "26a6d097727eba03c1b6c71cd02b06373ef01ce03e567dd2bc4357ae330e5a1a",
|
||||
"tools/publication.py": "f99d445073390a733afc8d849b9fcd4b4b0890bb54d136db67d4015b78436e1a",
|
||||
"tools/retrieval_contract.py": "b8fa272c3babf924a3ce8b937fe7ae437cd959ba9f7667193ac67c18d2c5b58d",
|
||||
"tools/index_state.py": "c33920a63d04009f11ef23ca9e9eee9bf86453b7d0586d027bf3b39156afea0d",
|
||||
"tools/rag/common.py": "8497c46d5c6c27a7c76df1568360ad5e9d00d5e5a7ef186e758960cc79d81d1c",
|
||||
"tools/sync_indexes.py": "5b909b4394c24e5ce22848594b16d9aea45fb06418f5cd92bb6aa6381a0ccf10",
|
||||
"tools/rag/rag_utils.py": "4f898cf0facc2ae9f2ea28a36f48d4ed37bd7fc716e097b319bcf4d36a4a4f03",
|
||||
"tools/answer_evaluation/context_policy.py": "e7b7c511e5e9cafdef04969eb4007a6a61ac4b99bcc60e9e722945a15bec1f26",
|
||||
"tools/answer_evaluation/checked_generation.py": "7e017471e6281db62b79f270210db3ab14c7e31a4623bbfa3d9a5fd8911b1c20",
|
||||
"tools/answer_evaluation/answer_format.py": "86a27b4aebc6a5077e13794b81957a1cf063a1f3e070c583120ba53c1788d2f8",
|
||||
"tools/rag/evaluation/rag_metrics.py": "3e95922df90dd1b757a550040a2d9bd4f857e17d179f60170d7cc881a08f94b6",
|
||||
"tools/rag/evaluation/rag_runner.py": "031abf7d5b1a026eb199aa2a579bfb8baaa01175279d0018a364bfe50b76c3c1"
|
||||
},
|
||||
"dataset_sha256": "a7bb38be01e03603cf2fa2c7137817094dff0a0cbb3f801263609e55b28e9edc",
|
||||
"inputs": {
|
||||
"data/documents.json": "0542af2a373771cf7c4a95f93d14f4f687f6a0187846892c959aa6efc4bade52",
|
||||
"data/chunks.json": "437dde589be46e0c30842dd330de22d96a0173d2dbaff9c5f129568cb2bca4c9"
|
||||
},
|
||||
"source_corpus": {
|
||||
"sha256": "440da12a7a991824e923f70cada7c616c3fb3b0f12767ec7d75039a6a3231b10",
|
||||
"document_count": 114,
|
||||
"documents": {
|
||||
"pages/interns/bogdan_paul_chis/README.md": "3b4b946eb3c10e9f9a4092e6cffa01c5080e7579aded2f6ed3120c41ed62b647",
|
||||
"pages/interns/cesar_gutierrez/README.md": "b0be60576eed28d4b1920e9acf198684519373dfc13171567247c853b3ed699e",
|
||||
"pages/interns/oliver_pejic/README.md": "0470f3c8465be8f02204b08e4c75ef47f68c7e4ad1038faa5641cdf1811f33d5",
|
||||
"pages/interns/sevval_bulburu/README.md": "ff2a9d66253802f1af0fdfd74832e40fae41b6df23c5e61dc266f6cd0cc16c4d",
|
||||
"pages/interns/yussef_ressaissi/README.md": "f997a65699da0db3222ef7a3c37652d05dfc3419ad4ec74683bafc2c897bb987",
|
||||
"pages/students/2016/darius_lindvai/README.md": "fcaa47bb9708a6439eec5c4b7f7b4ed6c7359e423e1d940e1aed9f44957e6d62",
|
||||
"pages/students/2016/darius_lindvai/dp2021/README.md": "be3d0fea2a6d592b225eecabd9b19445c2fce62b8289c07ab6af93835db12970",
|
||||
"pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md": "352162de1b1e192228fa5d26506c028ac47e567e90df53b1bbaa6ad736ec4766",
|
||||
"pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md": "b4a81ff457624b089d618e4479afb1e3d748f6724f72104ef5518e535ae02fe5",
|
||||
"pages/students/2016/dominik_nagy/README.md": "1c4037a158d84c45fa705a0c38e47142a9d46e226f0c138bc2d56d7c38f6d74d",
|
||||
"pages/students/2016/dominik_nagy/timovy_projekt/README.md": "b81a4dab7316f7b846dcf36515f6aa9d44035c86f46f0e07b7a43308bcd31458",
|
||||
"pages/students/2016/ediz_morochovic/README.md": "045e5eb9a3df2b84140808fbca0c3163266ad0efa144bc42d9d5c597881c6ac6",
|
||||
"pages/students/2016/jakub_maruniak/README.md": "6734c41a95b9d0c1e3d226b393ad109ee4a7b82ebfffa73df2d7e0a743fefa14",
|
||||
"pages/students/2016/jakub_maruniak/dp2021/README.md": "9cd884aec70705cdb2aaa0f514b513f16de263c37b749ced7f92916cd2f91c39",
|
||||
"pages/students/2016/jakub_maruniak/dp2021/annotation/README.md": "debae0c50aea1accef0840912b9b1f37b2138f856002bb50e91d7ea2dbbe7963",
|
||||
"pages/students/2016/jakub_maruniak/dp2021/train_experiments/README.md": "01dff38b37043414fa1db204394ddbe7aade00e14d02d495572b65c85d09b194",
|
||||
"pages/students/2016/jakub_maruniak/timovy_projekt/README.md": "04114b1f3d84664aad5bdba5a0b614c5a6f23392be3c31fd9123d63db1be0a35",
|
||||
"pages/students/2016/jan_holp/README.md": "80d6a8492766e5bfa61673a372e5f059d30c8e335de39842866c51485960e4d3",
|
||||
"pages/students/2016/jan_holp/dp2021/README.md": "a62acb74009376766c7e2f9856ee01d21f84593eb9b3ce85cf2e6032aa412476",
|
||||
"pages/students/2016/jan_holp/dp2021/zdrojove_subory/README.md": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"pages/students/2016/jan_holp/timovy_projekt/README.md": "79eebdfd3af7e8d5c279077e285a580731b1cf8cc9b4454f6596796e9915f70c",
|
||||
"pages/students/2016/lukas_pokryvka/README.md": "f279456c5c277ff1ee0dd89a3464ed9f9f67b44bc185a5da9811ef5cfb675002",
|
||||
"pages/students/2016/lukas_pokryvka/dp2021/README.md": "39b61376ce108e4a930f926ab2d6a997207457121bccfcf617129a3b210a15cf",
|
||||
"pages/students/2016/lukas_pokryvka/timovy_projekt/README.md": "4de4b6c8cfed17b6c60090f82df1d55a66be70a79d3013850689b2baebdd801b",
|
||||
"pages/students/2016/mark_feher/README.md": "bec37c0319fe0869a0377d771db23d090dbda93c27328f5697cdaeb3bbccfe9b",
|
||||
"pages/students/2016/maros_harahus/README.md": "0da150e91918632c9e8cd1443f04da403595a372517e254928ce9f76c9d5033d",
|
||||
"pages/students/2016/maros_harahus/timovy_projekt/README.md": "75af19f7c68f4b646fa1dbae75f3f3dfc52633a9f9da1400d21808bb20be0d83",
|
||||
"pages/students/2016/patrik_pavlisin/README.md": "dc1c648d7cd9b0f0e021c57f9b98189e37c100871439e7e304390715913f2763",
|
||||
"pages/students/2016/patrik_pavlisin/dp21/README.md": "ac1eb0fd0360ad34aa21b7c8da5bb010a6edf10be5721f28dedc3986cd1d8c54",
|
||||
"pages/students/2016/patrik_pavlisin/dp22/README.md": "f2a8c619a812b99abab618ae388eb672407950e1f33fb8d7da7a528c4de81d50",
|
||||
"pages/students/2016/patrik_pavlisin/tp20/README.md": "ae9c771f27e7e093bc29c6888c8d0b27ed61fb41519fd0d7e7f4f6cbb4626edc",
|
||||
"pages/students/2016/tomas_kucharik/README.md": "6a1a215433eb1857660177b4cb2ecec03c6a86743d3a04cd6d5c9d9682c9e63b",
|
||||
"pages/students/2017/dmytro_ushatenko/README.md": "65f4ac177d492162b08ca5da3d9eb048bd088a3c117a28a662113b7e4bc3a4ec",
|
||||
"pages/students/2017/martin_jancura/README.md": "6a0a18d5095dcfb12abfdd72c9cfd8025d714fb5e29a7858cd2b285e4cb986b9",
|
||||
"pages/students/2017/stanislav_matsunych/README.md": "90ffa11eff4a4360b0252dbc53a116c3a5777b3d5dd86ce5c89c02bdd2051c73",
|
||||
"pages/students/2017/than_trung_thanh/README.md": "2150519b8580e7337520db4de64d2d1c82d2634380537d019f41c506dbf2979d",
|
||||
"pages/students/2018/NaN1name_buday/README.md": "23c8c58090bdc954347e36f141bea91f43c8d5b1d777e346864a2ebe84c0bcce",
|
||||
"pages/students/2018/adrian_remias/README.md": "e5bfe1d5d4e626beaa636a02d34ec58cf2cff9b0e57833905af35b80bf1465a2",
|
||||
"pages/students/2018/david_ilas/README.md": "96c45ff9c5a821ddcb1a2fc86d487bd8f4729d1b76887914b0f5fbf99af45af0",
|
||||
"pages/students/2018/david_omasta/README.md": "4164051870e1e1cf8949ed18a74196e9ea789dfbe4fee24bdeb736ca42848327",
|
||||
"pages/students/2018/martin_wencel/README.md": "0e6a7a981689f22304f8baa5de97d4315c0695c94c9277de7851943eb012253b",
|
||||
"pages/students/2018/oleh_bilykh/README.md": "4072c62dd8ee753a0c8fa43fdfbbdf566e394c2df13e6a79d08a302e332710b1",
|
||||
"pages/students/2018/ondrej_megela/README.md": "969ff2e1a436b8f957e7168cf5eb678196b99aeda17701c502b016441f644065",
|
||||
"pages/students/2018/samuel_sirotnik/README.md": "cc230ede67b6e8632511c92a5ed6d1e9deb42e70819280222bdfd369ee77fc70",
|
||||
"pages/students/2019/alina_vitko/README.md": "9b071fe2aff470c275ae027be236fe836f741f774cabb9cbbb55304a8d5102cd",
|
||||
"pages/students/2019/artem_yatsenko/README.md": "328b101e46c51c959e792cf7ca226942f81d2ab8fe9648ad6d0ecd07016429e2",
|
||||
"pages/students/2019/david_stromp/README.md": "e46ca8691d5ec894128f6f6f2ed33e2c7bd141f80719bb0449b20f10f30cca09",
|
||||
"pages/students/2019/dmytro_mural/README.md": "e881a47d847c3ef8d680844113fdbfbb87553b28982bf9eef4936f6d30923e93",
|
||||
"pages/students/2019/filip_tomas/README.md": "75a1fe7b921e4bff0fdf9e2a957b4adad4b4a57aa7ebdffbb73dd82c02123f94",
|
||||
"pages/students/2019/kristian_sopkovic/README.md": "3286960fb30f584df35455f9b6dfae81ca4827a1d711d2bcd6e48c3f150c9279",
|
||||
"pages/students/2019/michal_stromko/README.md": "3ae1dd9b6638a6a249a94be3f3846286555666aefa225bb3a2c7288b35900ce7",
|
||||
"pages/students/2019/michal_stromko/vp2021/README.md": "feb2e093fdd6461239e79b1e1f96e65a1c8cd96e8a2b70535ae556a9c198046a",
|
||||
"pages/students/2019/michal_stromko/vp2021/tutorials/README.md": "40e3fa448c7329ef863e705435e23fe6b4788de440710f066fe0eed92d132bad",
|
||||
"pages/students/2019/michal_stromko/vp2021/tutorials/img/README.md": "e8d3ac160b17dfdee2c3e996bf6a03af7a6f16f9140bf5cf7ee343a82dd1865f",
|
||||
"pages/students/2019/patrik_pokrivcak/README.md": "3e3957ad0f7aca59d6eb64c38a3f5e21d8fd953200825d0d0e5cacabfbc35a7d",
|
||||
"pages/students/2019/samuel_horani/README.md": "86e6959ccc612b069687b57996fa3f61660075d6a0d65bfec64f423d39a0a999",
|
||||
"pages/students/2020/david_kostilnik/README.md": "2927524b75da59a64120fc364a0fc374986fa4d364d54e52c36800762c203264",
|
||||
"pages/students/2020/jakub_kristian_lukas/README.md": "f139d9b1ebf5a3f45612f3df5703ecdd935b90701763c27c7c529044c0b0455a",
|
||||
"pages/students/2020/kamil_tomcufcik/README.md": "9d865adf538bc6d7992ee4f4882713447da5c936fca17c43ca0f576072537048",
|
||||
"pages/students/2020/matej_kobylan/README.md": "3d7b289e17b8f25678a07e9ee0e6741688485a0ccb1e50940a6a6acc6312a547",
|
||||
"pages/students/2020/matus_suchanic/README.md": "770ca49538cca22df35f8e7ba736ee97483e4fe5788c221496553592b4e78dc6",
|
||||
"pages/students/2020/pavol_hudak/README.md": "33d06fccc6451e5f19b27b0cad001a34e81635b4ea294a01dec7771c823abc40",
|
||||
"pages/students/2020/vladyslav_krupko/README.md": "4c28e6d38651bb2cafcbf4a18e35210cd369aef2caff6c5b0aa52fac38f0fe7d",
|
||||
"pages/students/2021/artur_hyrenko/README.md": "0568261f4ade4de5472edcfeb1ffed9abae18dc67e4050f4ce2ad088839a2bb3",
|
||||
"pages/students/2021/eduard_matovka/README.md": "de2a7ae38ec87110e347956b37d0605a298ed2847f972961cc9b977da8221d43",
|
||||
"pages/students/2021/manohar_gowdru_shridharu/README.md": "c00ceb620ed7087ead5d9448d476bbb98d273d1d9e7bf1bc4355c367b26c7a6b",
|
||||
"pages/students/2021/martin_sarissky/README.md": "8e97b45a253745faa55f63c844e0b5dfe680aeaf6eb01fb8f9d06ac6e8ee8bcf",
|
||||
"pages/students/2021/matej_novotny/README.md": "b083a7cadde532e3428dc9a57bc61456fcc5905bda91e011b96033d42bf5d9cb",
|
||||
"pages/students/2021/matej_scislak/README.md": "b9a32cce8605e044a4f2828ff2d91a2995a62ef3a841e62f0a225c97221f0cc8",
|
||||
"pages/students/2021/nikita_bodnar/README.md": "2016c0dd923c0f8e561d5cea42ac81da3610fdcc54a4527f56d078e34e53ce90",
|
||||
"pages/students/2021/oleksandr_hryshchenko/README.md": "4b073992b715b6c75b79fd2c8f850a69f940966e3a61a82c625c32c945a93036",
|
||||
"pages/students/2021/vladimir_ferko/README.md": "68e7d311896eda2171e5eec1ec3a8da90d326ed91acaace8058f68664a50d271",
|
||||
"pages/students/2022/andrii_pervashov/README.md": "319dcaa1cc2e29dd7e3a710bab26cb3ac6944ab71b0b97e1de076b1199122334",
|
||||
"pages/students/2022/daniil_huzenko/README.md": "390782fbff6220a9462060ce1a62959f2a2b88f42d06e2c51d1f406b75d73f2c",
|
||||
"pages/students/2022/jakub_schwarc/README.md": "f541a8852c2b0f6f9d7182e01a34c4e3beee9bfa55427a06b331638b11eb8be6",
|
||||
"pages/students/2022/jan_malinovsky/README.md": "8af021bfb131fa005a7aec3e2f2f12fc17fa5dc14e2675311adbbfc445a4bcab",
|
||||
"pages/students/2022/jan_ptak/README.md": "131cf053764fd5423541ebe672c3b4f5da875cfb8e4b821f1335ddb967282282",
|
||||
"pages/students/2022/oleh_poiasnik/README.md": "c2f7dc3f61f8b4a5b43ded1e3ae4c7d3e7f874439ee6b17dd9c8d45dabc25bc8",
|
||||
"pages/students/2022/samuel_vasil/README.md": "67c807049147aacd04f3050f4ff0233a8b3f0a239ab173b430e13dfe113ad0a5",
|
||||
"pages/students/2022/serhii_yemets/README.md": "ffbeac893947acafe855d576322a8826f9d4f87ac344cb31f8ceeefa244b9133",
|
||||
"pages/students/2022/tetiana_mohorian/README.md": "c9efdc632bf1ca89a0bfde0dc00be7aaac8a85da3d92e2ce8506236c73e93cfb",
|
||||
"pages/students/2022/valerii_kutsenko/README.md": "dc764c609ad3c1df59cfea997d4db82a591b1b1e0764453e319d841115507e4f",
|
||||
"pages/students/2022/vladyslav_yanchenko/README.md": "4d1ce216e3b526ee437ddbc658e51d7bb83530087e43628c096a569a3854a47f",
|
||||
"pages/students/2022/yevhenii_leonov/README.md": "b90e41db0cec2451027020a9102d32a24d777e8a38b604ccca87b36cd6b3a292",
|
||||
"pages/students/2023/denis_le_thanh/README.md": "2cb83f942d86a02712b0c58778e46dc2211346d1a6eba606471dfa832245db61",
|
||||
"pages/students/2023/maksym_zatirka/README.md": "7a7d2cbe276c352dacfbc6ba6de5f15303d30ecf34845ff8da8d085f3d67c3dd",
|
||||
"pages/students/2023/oleksandr_dorybohov/README.md": "c24d6f941de0dafb4459cea8259cf147821cafc86ba65be5b528f419f734bc18",
|
||||
"pages/students/2023/ronald_zalacko/README.md": "724b0f8e6e641236dba9bddbd77f4546e09514076c7dfb151807aaf4b882c96f",
|
||||
"pages/students/2023/rostyslav_rodzhuk/README.md": "de356dd7427c8a0716c165a0f88ae47b691a86ee7a388f60e2d2e9306298415c",
|
||||
"pages/students/2023/samuel_dzurina/README.md": "4818191d044b91219c796a35010c95da5cf2093e050d494f30b219b91e13fa0e",
|
||||
"pages/students/2023/simona_bobrovcanova/README.md": "e473a1911dae10ab40e2cf6696a8be616a58c22aaf09af5953fbac475791a35e",
|
||||
"pages/students/2023/yevhenii_medushivskyi/README.md": "5710ebf91c893a12fe6d19f5372311938d1e7c7bbdf203f2dc8ed2fe7c4f5a24",
|
||||
"pages/topics/akopisat/README.md": "c7245e1fbfa4160618502c0baf8cc6bc47cd9a82b8a85bc1c645314829a7b76a",
|
||||
"pages/topics/bert/README.md": "35e507f7ec2ad1d3526e2a15f94ea085ee25f680a02daf6df62fd429bd9c25c9",
|
||||
"pages/topics/chatbot/README.md": "6f2f83ffb80109be47f9750cca9d3036ec3645abef9f2b590bd6825780c7c48a",
|
||||
"pages/topics/faq/README.md": "15cfbd9c2a1649c80a7a58922e2b66dadab5c86a5ef33ef16c82bebd4d2dbf06",
|
||||
"pages/topics/hatespeech/README.md": "364df94e70dd740c63544e2586ba7b957780f714fc0c941d1b04b02233e6cbc5",
|
||||
"pages/topics/legal/README.md": "003bb9bfe1e0ca21652091c2d11496312eb04e0689fe459e14c2d5a738e8eeea",
|
||||
"pages/topics/morphology/README.md": "e242cc5ff1a4cc98e227566c0ead999bbc95937b7c20be62cb2afb773d0d35c0",
|
||||
"pages/topics/named-entity/README.md": "66b2e25f70211d432d596e377d552b3b8f0c525b14c31e3bc9c956c3aeadca84",
|
||||
"pages/topics/named-entity/navod/README.md": "1ff87079a98411de0414754c60241e08d2214ddcd63ddf974e4340cce2ce5b02",
|
||||
"pages/topics/nlp/README.md": "6f90abf9dc3f0ff33475283c13b4a08561abf631425ec2daacb076155a9e02c2",
|
||||
"pages/topics/otvorene/README.md": "cd5544925553fe3840c0ea6f8ef60ab756e26ab6757bf810025c948d8d4f98fc",
|
||||
"pages/topics/prodigy/README.md": "5e4f691f2754c2ec4afbaab2f41e6db77feb5b322dd9344465eb40c35f116499",
|
||||
"pages/topics/python/README.md": "2ef073adba672142c39e9a59fa2e00a98ab52bda54233d46fbe6940ee23f9fcc",
|
||||
"pages/topics/question/README.md": "408078a2a67cea2699e12359e85ab641136231e6104c2afdf874a705879525df",
|
||||
"pages/topics/question/navod/README.md": "061e737c69184b2bd244316ca7ba841f7186fe01ee80ee993742a733dcad3ecd",
|
||||
"pages/topics/question/nezodpovedatelne/README.md": "b6703d9690f4599b973efb27595ce157773ae0fc0d55cf2c0a09d9f50e8e4c92",
|
||||
"pages/topics/question/validacie/README.md": "3216a7127abdfc6da50ed116f44ff2d6785e7da4af70d23aceda774e745ad562",
|
||||
"pages/topics/resources/README.md": "09405397387f00cbcc5680f7d655f2d861e4d92e5df792a62d9dfd04f3534f48",
|
||||
"pages/topics/seq2seq/README.md": "969d15c03a63a3f8d5edc9017fe5a0fb7311fdf4de4a3473a08266241f92c1e2",
|
||||
"pages/topics/spacy/README.md": "f504e5db77cb8694f08a57fb8636e522d59a0e669216f4bc8273bc3c5f375f87",
|
||||
"pages/topics/steel/README.md": "b4068cef2ed197711467ac47630d5b2064fdc8828f898f7af99664e94d833330",
|
||||
"pages/topics/translation/README.md": "a7d4289e72199b307dc5ad8fc69cda39c1a33c27a6c7447af70aa9c3cc6b8635"
|
||||
}
|
||||
},
|
||||
"retrieval_policy": {
|
||||
"published_only": true,
|
||||
"publication_policy": "explicit-false-hidden-v1",
|
||||
"academic_preparation_is_work": false
|
||||
}
|
||||
},
|
||||
"graph": {
|
||||
"sha256": "6fd45dc58382641072d991a088fcdfcd1c0e81ce912befbae6fca700d630fe01",
|
||||
"nodes": 446,
|
||||
"relationships": 877
|
||||
},
|
||||
"parameters": {
|
||||
"limit": 40,
|
||||
"max_entities": 8
|
||||
},
|
||||
"dev_summary": {
|
||||
"questions": 722,
|
||||
"source_checked_count": 722,
|
||||
"all_facts_supported_count": 722,
|
||||
"strict_count": 722,
|
||||
"strict_accuracy": 1.0,
|
||||
"error_count": 0,
|
||||
"value_score": 1.0,
|
||||
"entity_score": 1.0,
|
||||
"relation_score": 1.0,
|
||||
"property_score": 1.0,
|
||||
"relation_choice_score": 1.0,
|
||||
"document_recall": 1.0,
|
||||
"source_recall": 1.0,
|
||||
"binding_score": 1.0,
|
||||
"path_score": 1.0,
|
||||
"answerability_accuracy": 1.0,
|
||||
"latency_mean_seconds": 0.051461,
|
||||
"latency_median_seconds": 0.04753,
|
||||
"latency_p95_seconds": 0.079209
|
||||
},
|
||||
"source_audit_summary": {
|
||||
"dev": {
|
||||
"questions": 722,
|
||||
"source_consistent": 722,
|
||||
"issues": {}
|
||||
},
|
||||
"test": {
|
||||
"questions": 320,
|
||||
"source_consistent": 320,
|
||||
"issues": {}
|
||||
}
|
||||
},
|
||||
"policy": "Report all questions including negatives. No exclusions or holdout tuning.",
|
||||
"dev_results_sha256": "d4ac47c21aed4be149a3f1aec1f7658c862da2ee24e41cc680128d013a071707",
|
||||
"audit_sha256": "d5922db25b6d40cb7e5dc7df7990e93a3caee263a6e747ae910ab340da340023"
|
||||
}
|
||||
252
tools/graphrag/evaluation/frozen_v7.json
Normal file
252
tools/graphrag/evaluation/frozen_v7.json
Normal file
@ -0,0 +1,252 @@
|
||||
{
|
||||
"schema_version": 2,
|
||||
"evaluation_kind": "independent_holdout",
|
||||
"partition": {
|
||||
"method": "disjoint logical query groups",
|
||||
"logical_group_overlap": 0,
|
||||
"previously_exposed_test_groups": 0,
|
||||
"dev_group_count": 901,
|
||||
"test_group_count": 80,
|
||||
"dev_profile_count": 72,
|
||||
"test_profile_count": 55,
|
||||
"source_profile_overlap": 55,
|
||||
"limitations": [
|
||||
"Known corpus, persons and template families; only the query/fact combinations are fresh.",
|
||||
"Two remaining document-author/category groups and seven category-list groups constrain category coverage.",
|
||||
"AI source annotation, not human annotation. No tuning on this TEST."
|
||||
]
|
||||
},
|
||||
"frozen_at_utc": "2026-10-26T00:14:20.132176+00:00",
|
||||
"fingerprints": {
|
||||
"implementation": {
|
||||
"tools/graphrag/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/build_graphrag.py": "256292101d6d7d1946e926e2717ac45465b169f4091c51ecfed4f1a779dfd700",
|
||||
"tools/graphrag/evaluation/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/evaluation/audit_benchmark.py": "6619c818a52fc284e87ed6c48a503a54a3c9dd95447463ed78f075b7c58bad80",
|
||||
"tools/graphrag/evaluation/benchmark_v2.py": "62a0b6af852d5ae8060c06db3f983ef4b797d74443f9df25a6b8bd77bf133330",
|
||||
"tools/graphrag/evaluation/benchmark_v3.py": "30bae6c605ed26f4b49973acec799087c4e2b97a883ccedcafb965dd909c4c4d",
|
||||
"tools/graphrag/evaluation/benchmark_v4.py": "7a731fe649d3d5170045b8bbcabf31ad527e5d26a934d434a4be3a4c94dc5c38",
|
||||
"tools/graphrag/evaluation/benchmark_v6.py": "f955e600d17358fafcb33bab772aef09d787452f6b33352e299fdd42669aaf34",
|
||||
"tools/graphrag/evaluation/benchmark_v7.py": "9477cd6e9a6dd0558837cf044535de75a8f101b17115e28e57a82d96d1aa01cb",
|
||||
"tools/graphrag/evaluation/check_openwebui.py": "863801048231d474ba82930cf6bf6853b4410f8295b3f97fd3d5934852431fbe",
|
||||
"tools/graphrag/evaluation/evaluate_graphrag.py": "22f48e9ac6dfae92d79ad648ca173547c6a37f98aa8199f7c37595f1b0b186f9",
|
||||
"tools/graphrag/evaluation/evidence_contract.py": "78e24264c176e163e1782fef1634b6c45c7f31bd4692726d02a30ab45a06648e",
|
||||
"tools/graphrag/evaluation/freeze_graphrag.py": "d8764d1aeb72208de55604785acff880002da1f818d8a8ad9477cf39e1f29efb",
|
||||
"tools/graphrag/evaluation/graphrag_evaluator.py": "7f99bf0f97974058650b619ea49a8ee32284cb4b324f1ffab9baf54f5c4495f4",
|
||||
"tools/graphrag/evaluation/reproducibility.py": "0e2dab6ffb17691f05f9d81dbec12ffc0f2e4e0b1a2114a75b66a5165cf7b4d2",
|
||||
"tools/graphrag/evaluation/source_oracle.py": "aed0309435fd21bc274fde7905a0720f68f359b3c30bb0b912e3371ebf0d8072",
|
||||
"tools/graphrag/evaluation/source_validation.py": "9671b8978623888dbed8b8b2d1b6b01c1ce73cb0a512b03919e48873990f15ed",
|
||||
"tools/graphrag/graph_db.py": "c4b1a2edb765856b807398e4c243a8d17753529a5d2dfdb51791e28bc8de17f7",
|
||||
"tools/graphrag/graph_search.py": "c41cbfbac0d5daa1d0b51f5f4b798a15688bbd2e0498d2cbe93c6584a99f6b7d",
|
||||
"tools/graphrag/graphrag.py": "dbc75403aa038e4021b5a70d1f17c62784b478252a94bac8db682bf38dcb39b3",
|
||||
"tools/graphrag/neo4j_smoke.py": "fb5244c72c29ef2acf96d1e7f54335ff168eed4119db1692025eb1b99194b7bb",
|
||||
"tools/graphrag/publication.py": "fba1fa0d0bed325fd87f8d3593baae9271de1766b772d7214c7f63fd3f1c37b6",
|
||||
"tools/graphrag/tests/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"tools/graphrag/tests/test_evaluation_pipeline_v2.py": "63d1b3e80ae3c7b563374fd7ab4aa5ffad3c614eafbd15142c577abd7f756bf9",
|
||||
"tools/graphrag/tests/test_evaluation_v5.py": "9387e9d1418ebab87530986b0e29dac31cf33d762777a29a31cff24cc72e552a",
|
||||
"tools/graphrag/tests/test_evaluation_wide.py": "1b28bb74fd6b9457c869186b88606f1f7863d573aa3ab5226162e878f236d99e",
|
||||
"tools/graphrag/tests/test_evaluator_connected_v2.py": "29d7c9838ed1ff37ea3276df6feb1b6142158c43a0525712f490b648181882de",
|
||||
"tools/graphrag/tests/test_graph_publication.py": "96e53c1ae28e36c7a4290e1e60c8b398bf095ceaf883e819e1a477e2672b11c0",
|
||||
"tools/graphrag/tests/test_graph_rebuild_atomic.py": "fe37d4fff0b1f0fb1d565f0a96152b9b4e336837bc78b5977cf3b4879d7fbaf3",
|
||||
"tools/graphrag/tests/test_graph_search.py": "eb58661aef9dafe6bf7188fcdc2d79cef6652d57c64d1b81ae81a52e8e0204d7",
|
||||
"tools/graphrag/tests/test_graph_search_entity_v2.py": "0ef1a8ebd513c5a4507eb38fcf5ae6137c69e9901b5a2975ba513be5902ac693",
|
||||
"tools/graphrag/tests/test_graph_search_neo4j.py": "fec2bf72de8f752f17c9164fee5754bdb2e153828855e47efbf0000dbe82cf3b",
|
||||
"tools/graphrag/tests/test_graph_search_regressions.py": "9db7779aeb8ed9e8c0f92c1657011a81080aff3c928649e811358e3009a18c48",
|
||||
"tools/graphrag/tests/test_graphrag.py": "9ee8629d6b528dd78c2ddfc25cee95e17613f45b454fc0a38d4c591862637a9f",
|
||||
"tools/graphrag/tests/test_graphrag_evaluator.py": "1c6d08aeec9ae56ac4123239a5aed12a0081d66cc3f34b2047d95764579d7298",
|
||||
"tools/graphrag/tests/test_graphrag_freeze.py": "c4b760baf4c7ebf13b16bd4cd3c51874f5512eef3b4c61470dc4d428b0303d9f",
|
||||
"tools/graphrag/tests/test_graphrag_research_v2.py": "711008a91ab8a58ae0854e7f90329bcd42e5189fde2e2001589e97b0c22c5198",
|
||||
"tools/graphrag/tests/test_graphrag_root_title.py": "085651fe6e6081521a5dde9554abfee93456250108cf15978df25378d886a46c",
|
||||
"tools/graphrag/tests/test_source_oracle_v2.py": "0afdbe235e185ffe9f38aa667f90f5a6c20504fe29e9ac572642b39a8eb7faca",
|
||||
"tools/graphrag/tests/test_title_labels.py": "2983ead68ad6e2e346d24af0fc96dc6771c163e9c2a351af426a1e0383998e6f",
|
||||
"requirements.txt": "26a6d097727eba03c1b6c71cd02b06373ef01ce03e567dd2bc4357ae330e5a1a",
|
||||
"tools/publication.py": "f99d445073390a733afc8d849b9fcd4b4b0890bb54d136db67d4015b78436e1a",
|
||||
"tools/retrieval_contract.py": "b8fa272c3babf924a3ce8b937fe7ae437cd959ba9f7667193ac67c18d2c5b58d",
|
||||
"tools/index_state.py": "c33920a63d04009f11ef23ca9e9eee9bf86453b7d0586d027bf3b39156afea0d",
|
||||
"tools/rag/common.py": "8497c46d5c6c27a7c76df1568360ad5e9d00d5e5a7ef186e758960cc79d81d1c",
|
||||
"tools/sync_indexes.py": "5b909b4394c24e5ce22848594b16d9aea45fb06418f5cd92bb6aa6381a0ccf10",
|
||||
"tools/rag/rag_utils.py": "4f898cf0facc2ae9f2ea28a36f48d4ed37bd7fc716e097b319bcf4d36a4a4f03",
|
||||
"tools/answer_evaluation/context_policy.py": "0dc2a056ca0d886d7cc8248ed4632c910c5e35bebd03ef94573df41802297f47",
|
||||
"tools/answer_evaluation/checked_generation.py": "cb821a65327424c19cbd996190b14e6aa30d9b909493f11716552f71249a0529",
|
||||
"tools/answer_evaluation/answer_format.py": "86a27b4aebc6a5077e13794b81957a1cf063a1f3e070c583120ba53c1788d2f8",
|
||||
"tools/answer_evaluation/render_answer.py": "609c534a37899b3febcea32d983da4b806c287de8f2ddf9bc0675e3280859002",
|
||||
"tools/rag/evaluation/rag_metrics.py": "3e95922df90dd1b757a550040a2d9bd4f857e17d179f60170d7cc881a08f94b6",
|
||||
"tools/rag/evaluation/rag_runner.py": "031abf7d5b1a026eb199aa2a579bfb8baaa01175279d0018a364bfe50b76c3c1"
|
||||
},
|
||||
"dataset_sha256": "0f78e9749de369d752b6e1079f174cf3f6b390f4718a672119dfd43fa5d9dfac",
|
||||
"inputs": {
|
||||
"data/documents.json": "0542af2a373771cf7c4a95f93d14f4f687f6a0187846892c959aa6efc4bade52",
|
||||
"data/chunks.json": "437dde589be46e0c30842dd330de22d96a0173d2dbaff9c5f129568cb2bca4c9"
|
||||
},
|
||||
"source_corpus": {
|
||||
"sha256": "440da12a7a991824e923f70cada7c616c3fb3b0f12767ec7d75039a6a3231b10",
|
||||
"document_count": 114,
|
||||
"documents": {
|
||||
"pages/interns/bogdan_paul_chis/README.md": "3b4b946eb3c10e9f9a4092e6cffa01c5080e7579aded2f6ed3120c41ed62b647",
|
||||
"pages/interns/cesar_gutierrez/README.md": "b0be60576eed28d4b1920e9acf198684519373dfc13171567247c853b3ed699e",
|
||||
"pages/interns/oliver_pejic/README.md": "0470f3c8465be8f02204b08e4c75ef47f68c7e4ad1038faa5641cdf1811f33d5",
|
||||
"pages/interns/sevval_bulburu/README.md": "ff2a9d66253802f1af0fdfd74832e40fae41b6df23c5e61dc266f6cd0cc16c4d",
|
||||
"pages/interns/yussef_ressaissi/README.md": "f997a65699da0db3222ef7a3c37652d05dfc3419ad4ec74683bafc2c897bb987",
|
||||
"pages/students/2016/darius_lindvai/README.md": "fcaa47bb9708a6439eec5c4b7f7b4ed6c7359e423e1d940e1aed9f44957e6d62",
|
||||
"pages/students/2016/darius_lindvai/dp2021/README.md": "be3d0fea2a6d592b225eecabd9b19445c2fce62b8289c07ab6af93835db12970",
|
||||
"pages/students/2016/darius_lindvai/timovy_projekt/resers/README.md": "352162de1b1e192228fa5d26506c028ac47e567e90df53b1bbaa6ad736ec4766",
|
||||
"pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md": "b4a81ff457624b089d618e4479afb1e3d748f6724f72104ef5518e535ae02fe5",
|
||||
"pages/students/2016/dominik_nagy/README.md": "1c4037a158d84c45fa705a0c38e47142a9d46e226f0c138bc2d56d7c38f6d74d",
|
||||
"pages/students/2016/dominik_nagy/timovy_projekt/README.md": "b81a4dab7316f7b846dcf36515f6aa9d44035c86f46f0e07b7a43308bcd31458",
|
||||
"pages/students/2016/ediz_morochovic/README.md": "045e5eb9a3df2b84140808fbca0c3163266ad0efa144bc42d9d5c597881c6ac6",
|
||||
"pages/students/2016/jakub_maruniak/README.md": "6734c41a95b9d0c1e3d226b393ad109ee4a7b82ebfffa73df2d7e0a743fefa14",
|
||||
"pages/students/2016/jakub_maruniak/dp2021/README.md": "9cd884aec70705cdb2aaa0f514b513f16de263c37b749ced7f92916cd2f91c39",
|
||||
"pages/students/2016/jakub_maruniak/dp2021/annotation/README.md": "debae0c50aea1accef0840912b9b1f37b2138f856002bb50e91d7ea2dbbe7963",
|
||||
"pages/students/2016/jakub_maruniak/dp2021/train_experiments/README.md": "01dff38b37043414fa1db204394ddbe7aade00e14d02d495572b65c85d09b194",
|
||||
"pages/students/2016/jakub_maruniak/timovy_projekt/README.md": "04114b1f3d84664aad5bdba5a0b614c5a6f23392be3c31fd9123d63db1be0a35",
|
||||
"pages/students/2016/jan_holp/README.md": "80d6a8492766e5bfa61673a372e5f059d30c8e335de39842866c51485960e4d3",
|
||||
"pages/students/2016/jan_holp/dp2021/README.md": "a62acb74009376766c7e2f9856ee01d21f84593eb9b3ce85cf2e6032aa412476",
|
||||
"pages/students/2016/jan_holp/dp2021/zdrojove_subory/README.md": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"pages/students/2016/jan_holp/timovy_projekt/README.md": "79eebdfd3af7e8d5c279077e285a580731b1cf8cc9b4454f6596796e9915f70c",
|
||||
"pages/students/2016/lukas_pokryvka/README.md": "f279456c5c277ff1ee0dd89a3464ed9f9f67b44bc185a5da9811ef5cfb675002",
|
||||
"pages/students/2016/lukas_pokryvka/dp2021/README.md": "39b61376ce108e4a930f926ab2d6a997207457121bccfcf617129a3b210a15cf",
|
||||
"pages/students/2016/lukas_pokryvka/timovy_projekt/README.md": "4de4b6c8cfed17b6c60090f82df1d55a66be70a79d3013850689b2baebdd801b",
|
||||
"pages/students/2016/mark_feher/README.md": "bec37c0319fe0869a0377d771db23d090dbda93c27328f5697cdaeb3bbccfe9b",
|
||||
"pages/students/2016/maros_harahus/README.md": "0da150e91918632c9e8cd1443f04da403595a372517e254928ce9f76c9d5033d",
|
||||
"pages/students/2016/maros_harahus/timovy_projekt/README.md": "75af19f7c68f4b646fa1dbae75f3f3dfc52633a9f9da1400d21808bb20be0d83",
|
||||
"pages/students/2016/patrik_pavlisin/README.md": "dc1c648d7cd9b0f0e021c57f9b98189e37c100871439e7e304390715913f2763",
|
||||
"pages/students/2016/patrik_pavlisin/dp21/README.md": "ac1eb0fd0360ad34aa21b7c8da5bb010a6edf10be5721f28dedc3986cd1d8c54",
|
||||
"pages/students/2016/patrik_pavlisin/dp22/README.md": "f2a8c619a812b99abab618ae388eb672407950e1f33fb8d7da7a528c4de81d50",
|
||||
"pages/students/2016/patrik_pavlisin/tp20/README.md": "ae9c771f27e7e093bc29c6888c8d0b27ed61fb41519fd0d7e7f4f6cbb4626edc",
|
||||
"pages/students/2016/tomas_kucharik/README.md": "6a1a215433eb1857660177b4cb2ecec03c6a86743d3a04cd6d5c9d9682c9e63b",
|
||||
"pages/students/2017/dmytro_ushatenko/README.md": "65f4ac177d492162b08ca5da3d9eb048bd088a3c117a28a662113b7e4bc3a4ec",
|
||||
"pages/students/2017/martin_jancura/README.md": "6a0a18d5095dcfb12abfdd72c9cfd8025d714fb5e29a7858cd2b285e4cb986b9",
|
||||
"pages/students/2017/stanislav_matsunych/README.md": "90ffa11eff4a4360b0252dbc53a116c3a5777b3d5dd86ce5c89c02bdd2051c73",
|
||||
"pages/students/2017/than_trung_thanh/README.md": "2150519b8580e7337520db4de64d2d1c82d2634380537d019f41c506dbf2979d",
|
||||
"pages/students/2018/NaN1name_buday/README.md": "23c8c58090bdc954347e36f141bea91f43c8d5b1d777e346864a2ebe84c0bcce",
|
||||
"pages/students/2018/adrian_remias/README.md": "e5bfe1d5d4e626beaa636a02d34ec58cf2cff9b0e57833905af35b80bf1465a2",
|
||||
"pages/students/2018/david_ilas/README.md": "96c45ff9c5a821ddcb1a2fc86d487bd8f4729d1b76887914b0f5fbf99af45af0",
|
||||
"pages/students/2018/david_omasta/README.md": "4164051870e1e1cf8949ed18a74196e9ea789dfbe4fee24bdeb736ca42848327",
|
||||
"pages/students/2018/martin_wencel/README.md": "0e6a7a981689f22304f8baa5de97d4315c0695c94c9277de7851943eb012253b",
|
||||
"pages/students/2018/oleh_bilykh/README.md": "4072c62dd8ee753a0c8fa43fdfbbdf566e394c2df13e6a79d08a302e332710b1",
|
||||
"pages/students/2018/ondrej_megela/README.md": "969ff2e1a436b8f957e7168cf5eb678196b99aeda17701c502b016441f644065",
|
||||
"pages/students/2018/samuel_sirotnik/README.md": "cc230ede67b6e8632511c92a5ed6d1e9deb42e70819280222bdfd369ee77fc70",
|
||||
"pages/students/2019/alina_vitko/README.md": "9b071fe2aff470c275ae027be236fe836f741f774cabb9cbbb55304a8d5102cd",
|
||||
"pages/students/2019/artem_yatsenko/README.md": "328b101e46c51c959e792cf7ca226942f81d2ab8fe9648ad6d0ecd07016429e2",
|
||||
"pages/students/2019/david_stromp/README.md": "e46ca8691d5ec894128f6f6f2ed33e2c7bd141f80719bb0449b20f10f30cca09",
|
||||
"pages/students/2019/dmytro_mural/README.md": "e881a47d847c3ef8d680844113fdbfbb87553b28982bf9eef4936f6d30923e93",
|
||||
"pages/students/2019/filip_tomas/README.md": "75a1fe7b921e4bff0fdf9e2a957b4adad4b4a57aa7ebdffbb73dd82c02123f94",
|
||||
"pages/students/2019/kristian_sopkovic/README.md": "3286960fb30f584df35455f9b6dfae81ca4827a1d711d2bcd6e48c3f150c9279",
|
||||
"pages/students/2019/michal_stromko/README.md": "3ae1dd9b6638a6a249a94be3f3846286555666aefa225bb3a2c7288b35900ce7",
|
||||
"pages/students/2019/michal_stromko/vp2021/README.md": "feb2e093fdd6461239e79b1e1f96e65a1c8cd96e8a2b70535ae556a9c198046a",
|
||||
"pages/students/2019/michal_stromko/vp2021/tutorials/README.md": "40e3fa448c7329ef863e705435e23fe6b4788de440710f066fe0eed92d132bad",
|
||||
"pages/students/2019/michal_stromko/vp2021/tutorials/img/README.md": "e8d3ac160b17dfdee2c3e996bf6a03af7a6f16f9140bf5cf7ee343a82dd1865f",
|
||||
"pages/students/2019/patrik_pokrivcak/README.md": "3e3957ad0f7aca59d6eb64c38a3f5e21d8fd953200825d0d0e5cacabfbc35a7d",
|
||||
"pages/students/2019/samuel_horani/README.md": "86e6959ccc612b069687b57996fa3f61660075d6a0d65bfec64f423d39a0a999",
|
||||
"pages/students/2020/david_kostilnik/README.md": "2927524b75da59a64120fc364a0fc374986fa4d364d54e52c36800762c203264",
|
||||
"pages/students/2020/jakub_kristian_lukas/README.md": "f139d9b1ebf5a3f45612f3df5703ecdd935b90701763c27c7c529044c0b0455a",
|
||||
"pages/students/2020/kamil_tomcufcik/README.md": "9d865adf538bc6d7992ee4f4882713447da5c936fca17c43ca0f576072537048",
|
||||
"pages/students/2020/matej_kobylan/README.md": "3d7b289e17b8f25678a07e9ee0e6741688485a0ccb1e50940a6a6acc6312a547",
|
||||
"pages/students/2020/matus_suchanic/README.md": "770ca49538cca22df35f8e7ba736ee97483e4fe5788c221496553592b4e78dc6",
|
||||
"pages/students/2020/pavol_hudak/README.md": "33d06fccc6451e5f19b27b0cad001a34e81635b4ea294a01dec7771c823abc40",
|
||||
"pages/students/2020/vladyslav_krupko/README.md": "4c28e6d38651bb2cafcbf4a18e35210cd369aef2caff6c5b0aa52fac38f0fe7d",
|
||||
"pages/students/2021/artur_hyrenko/README.md": "0568261f4ade4de5472edcfeb1ffed9abae18dc67e4050f4ce2ad088839a2bb3",
|
||||
"pages/students/2021/eduard_matovka/README.md": "de2a7ae38ec87110e347956b37d0605a298ed2847f972961cc9b977da8221d43",
|
||||
"pages/students/2021/manohar_gowdru_shridharu/README.md": "c00ceb620ed7087ead5d9448d476bbb98d273d1d9e7bf1bc4355c367b26c7a6b",
|
||||
"pages/students/2021/martin_sarissky/README.md": "8e97b45a253745faa55f63c844e0b5dfe680aeaf6eb01fb8f9d06ac6e8ee8bcf",
|
||||
"pages/students/2021/matej_novotny/README.md": "b083a7cadde532e3428dc9a57bc61456fcc5905bda91e011b96033d42bf5d9cb",
|
||||
"pages/students/2021/matej_scislak/README.md": "b9a32cce8605e044a4f2828ff2d91a2995a62ef3a841e62f0a225c97221f0cc8",
|
||||
"pages/students/2021/nikita_bodnar/README.md": "2016c0dd923c0f8e561d5cea42ac81da3610fdcc54a4527f56d078e34e53ce90",
|
||||
"pages/students/2021/oleksandr_hryshchenko/README.md": "4b073992b715b6c75b79fd2c8f850a69f940966e3a61a82c625c32c945a93036",
|
||||
"pages/students/2021/vladimir_ferko/README.md": "68e7d311896eda2171e5eec1ec3a8da90d326ed91acaace8058f68664a50d271",
|
||||
"pages/students/2022/andrii_pervashov/README.md": "319dcaa1cc2e29dd7e3a710bab26cb3ac6944ab71b0b97e1de076b1199122334",
|
||||
"pages/students/2022/daniil_huzenko/README.md": "390782fbff6220a9462060ce1a62959f2a2b88f42d06e2c51d1f406b75d73f2c",
|
||||
"pages/students/2022/jakub_schwarc/README.md": "f541a8852c2b0f6f9d7182e01a34c4e3beee9bfa55427a06b331638b11eb8be6",
|
||||
"pages/students/2022/jan_malinovsky/README.md": "8af021bfb131fa005a7aec3e2f2f12fc17fa5dc14e2675311adbbfc445a4bcab",
|
||||
"pages/students/2022/jan_ptak/README.md": "131cf053764fd5423541ebe672c3b4f5da875cfb8e4b821f1335ddb967282282",
|
||||
"pages/students/2022/oleh_poiasnik/README.md": "c2f7dc3f61f8b4a5b43ded1e3ae4c7d3e7f874439ee6b17dd9c8d45dabc25bc8",
|
||||
"pages/students/2022/samuel_vasil/README.md": "67c807049147aacd04f3050f4ff0233a8b3f0a239ab173b430e13dfe113ad0a5",
|
||||
"pages/students/2022/serhii_yemets/README.md": "ffbeac893947acafe855d576322a8826f9d4f87ac344cb31f8ceeefa244b9133",
|
||||
"pages/students/2022/tetiana_mohorian/README.md": "c9efdc632bf1ca89a0bfde0dc00be7aaac8a85da3d92e2ce8506236c73e93cfb",
|
||||
"pages/students/2022/valerii_kutsenko/README.md": "dc764c609ad3c1df59cfea997d4db82a591b1b1e0764453e319d841115507e4f",
|
||||
"pages/students/2022/vladyslav_yanchenko/README.md": "4d1ce216e3b526ee437ddbc658e51d7bb83530087e43628c096a569a3854a47f",
|
||||
"pages/students/2022/yevhenii_leonov/README.md": "b90e41db0cec2451027020a9102d32a24d777e8a38b604ccca87b36cd6b3a292",
|
||||
"pages/students/2023/denis_le_thanh/README.md": "2cb83f942d86a02712b0c58778e46dc2211346d1a6eba606471dfa832245db61",
|
||||
"pages/students/2023/maksym_zatirka/README.md": "7a7d2cbe276c352dacfbc6ba6de5f15303d30ecf34845ff8da8d085f3d67c3dd",
|
||||
"pages/students/2023/oleksandr_dorybohov/README.md": "c24d6f941de0dafb4459cea8259cf147821cafc86ba65be5b528f419f734bc18",
|
||||
"pages/students/2023/ronald_zalacko/README.md": "724b0f8e6e641236dba9bddbd77f4546e09514076c7dfb151807aaf4b882c96f",
|
||||
"pages/students/2023/rostyslav_rodzhuk/README.md": "de356dd7427c8a0716c165a0f88ae47b691a86ee7a388f60e2d2e9306298415c",
|
||||
"pages/students/2023/samuel_dzurina/README.md": "4818191d044b91219c796a35010c95da5cf2093e050d494f30b219b91e13fa0e",
|
||||
"pages/students/2023/simona_bobrovcanova/README.md": "e473a1911dae10ab40e2cf6696a8be616a58c22aaf09af5953fbac475791a35e",
|
||||
"pages/students/2023/yevhenii_medushivskyi/README.md": "5710ebf91c893a12fe6d19f5372311938d1e7c7bbdf203f2dc8ed2fe7c4f5a24",
|
||||
"pages/topics/akopisat/README.md": "c7245e1fbfa4160618502c0baf8cc6bc47cd9a82b8a85bc1c645314829a7b76a",
|
||||
"pages/topics/bert/README.md": "35e507f7ec2ad1d3526e2a15f94ea085ee25f680a02daf6df62fd429bd9c25c9",
|
||||
"pages/topics/chatbot/README.md": "6f2f83ffb80109be47f9750cca9d3036ec3645abef9f2b590bd6825780c7c48a",
|
||||
"pages/topics/faq/README.md": "15cfbd9c2a1649c80a7a58922e2b66dadab5c86a5ef33ef16c82bebd4d2dbf06",
|
||||
"pages/topics/hatespeech/README.md": "364df94e70dd740c63544e2586ba7b957780f714fc0c941d1b04b02233e6cbc5",
|
||||
"pages/topics/legal/README.md": "003bb9bfe1e0ca21652091c2d11496312eb04e0689fe459e14c2d5a738e8eeea",
|
||||
"pages/topics/morphology/README.md": "e242cc5ff1a4cc98e227566c0ead999bbc95937b7c20be62cb2afb773d0d35c0",
|
||||
"pages/topics/named-entity/README.md": "66b2e25f70211d432d596e377d552b3b8f0c525b14c31e3bc9c956c3aeadca84",
|
||||
"pages/topics/named-entity/navod/README.md": "1ff87079a98411de0414754c60241e08d2214ddcd63ddf974e4340cce2ce5b02",
|
||||
"pages/topics/nlp/README.md": "6f90abf9dc3f0ff33475283c13b4a08561abf631425ec2daacb076155a9e02c2",
|
||||
"pages/topics/otvorene/README.md": "cd5544925553fe3840c0ea6f8ef60ab756e26ab6757bf810025c948d8d4f98fc",
|
||||
"pages/topics/prodigy/README.md": "5e4f691f2754c2ec4afbaab2f41e6db77feb5b322dd9344465eb40c35f116499",
|
||||
"pages/topics/python/README.md": "2ef073adba672142c39e9a59fa2e00a98ab52bda54233d46fbe6940ee23f9fcc",
|
||||
"pages/topics/question/README.md": "408078a2a67cea2699e12359e85ab641136231e6104c2afdf874a705879525df",
|
||||
"pages/topics/question/navod/README.md": "061e737c69184b2bd244316ca7ba841f7186fe01ee80ee993742a733dcad3ecd",
|
||||
"pages/topics/question/nezodpovedatelne/README.md": "b6703d9690f4599b973efb27595ce157773ae0fc0d55cf2c0a09d9f50e8e4c92",
|
||||
"pages/topics/question/validacie/README.md": "3216a7127abdfc6da50ed116f44ff2d6785e7da4af70d23aceda774e745ad562",
|
||||
"pages/topics/resources/README.md": "09405397387f00cbcc5680f7d655f2d861e4d92e5df792a62d9dfd04f3534f48",
|
||||
"pages/topics/seq2seq/README.md": "969d15c03a63a3f8d5edc9017fe5a0fb7311fdf4de4a3473a08266241f92c1e2",
|
||||
"pages/topics/spacy/README.md": "f504e5db77cb8694f08a57fb8636e522d59a0e669216f4bc8273bc3c5f375f87",
|
||||
"pages/topics/steel/README.md": "b4068cef2ed197711467ac47630d5b2064fdc8828f898f7af99664e94d833330",
|
||||
"pages/topics/translation/README.md": "a7d4289e72199b307dc5ad8fc69cda39c1a33c27a6c7447af70aa9c3cc6b8635"
|
||||
}
|
||||
},
|
||||
"retrieval_policy": {
|
||||
"published_only": true,
|
||||
"publication_policy": "explicit-false-hidden-v1",
|
||||
"academic_preparation_is_work": false
|
||||
}
|
||||
},
|
||||
"graph": {
|
||||
"sha256": "566817ce7ddebb2638585192c148c41421071bdf719674fc6ddddb1c99a0e36f",
|
||||
"nodes": 446,
|
||||
"relationships": 877
|
||||
},
|
||||
"parameters": {
|
||||
"limit": 40,
|
||||
"max_entities": 8
|
||||
},
|
||||
"dev_summary": {
|
||||
"questions": 1046,
|
||||
"source_checked_count": 1046,
|
||||
"all_facts_supported_count": 1046,
|
||||
"strict_count": 1046,
|
||||
"strict_accuracy": 1.0,
|
||||
"error_count": 0,
|
||||
"value_score": 1.0,
|
||||
"entity_score": 1.0,
|
||||
"relation_score": 1.0,
|
||||
"property_score": 1.0,
|
||||
"relation_choice_score": 1.0,
|
||||
"document_recall": 1.0,
|
||||
"source_recall": 1.0,
|
||||
"binding_score": 1.0,
|
||||
"path_score": 1.0,
|
||||
"answerability_accuracy": 1.0,
|
||||
"latency_mean_seconds": 0.081848,
|
||||
"latency_median_seconds": 0.071172,
|
||||
"latency_p95_seconds": 0.113998
|
||||
},
|
||||
"source_audit_summary": {
|
||||
"dev": {
|
||||
"questions": 1046,
|
||||
"source_consistent": 1046,
|
||||
"issues": {}
|
||||
},
|
||||
"test": {
|
||||
"questions": 80,
|
||||
"source_consistent": 80,
|
||||
"issues": {}
|
||||
}
|
||||
},
|
||||
"policy": "Report all questions including negatives. No exclusions or holdout tuning.",
|
||||
"dev_results_sha256": "d1a5d7b6d5aff3c0002f36a60cebc07627a79ec6d57de119dd587e8ab70143b0",
|
||||
"audit_sha256": "7825d4f3e4e535eb5f49e975dfef363b9b813f1de5c97e2387e5c2f3e578e6a5"
|
||||
}
|
||||
1471
tools/graphrag/evaluation/graphrag_evaluator.py
Normal file
1471
tools/graphrag/evaluation/graphrag_evaluator.py
Normal file
File diff suppressed because it is too large
Load Diff
File diff suppressed because it is too large
Load Diff
71956
tools/graphrag/evaluation/graphrag_questions_v2.json
Normal file
71956
tools/graphrag/evaluation/graphrag_questions_v2.json
Normal file
File diff suppressed because it is too large
Load Diff
74495
tools/graphrag/evaluation/graphrag_questions_v3.json
Normal file
74495
tools/graphrag/evaluation/graphrag_questions_v3.json
Normal file
File diff suppressed because it is too large
Load Diff
133691
tools/graphrag/evaluation/graphrag_questions_v4.json
Normal file
133691
tools/graphrag/evaluation/graphrag_questions_v4.json
Normal file
File diff suppressed because it is too large
Load Diff
132933
tools/graphrag/evaluation/graphrag_questions_v6.json
Normal file
132933
tools/graphrag/evaluation/graphrag_questions_v6.json
Normal file
File diff suppressed because it is too large
Load Diff
143614
tools/graphrag/evaluation/graphrag_questions_v7.json
Normal file
143614
tools/graphrag/evaluation/graphrag_questions_v7.json
Normal file
File diff suppressed because it is too large
Load Diff
93
tools/graphrag/evaluation/reproducibility.py
Normal file
93
tools/graphrag/evaluation/reproducibility.py
Normal file
@ -0,0 +1,93 @@
|
||||
"""Content fingerprints used to freeze retrieval before holdout evaluation."""
|
||||
from __future__ import annotations
|
||||
|
||||
import hashlib
|
||||
import json
|
||||
import os
|
||||
import platform
|
||||
import subprocess
|
||||
from datetime import datetime, timezone
|
||||
from pathlib import Path
|
||||
from typing import Any
|
||||
from tools.publication import DEFAULT_PUBLISHED_ONLY, PUBLICATION_POLICY_VERSION
|
||||
|
||||
ROOT = Path(__file__).resolve().parents[3]
|
||||
|
||||
|
||||
def sha256_file(path: Path) -> str:
|
||||
return hashlib.sha256(path.read_bytes()).hexdigest()
|
||||
|
||||
|
||||
def source_corpus_fingerprint(root: Path = ROOT) -> dict[str, Any]:
|
||||
"""Bind independent expectations to the original Markdown, not graph output."""
|
||||
wiki = Path(os.getenv('ZPWIKI_ROOT', str(root.parent / 'zpwiki')))
|
||||
pages = wiki / 'pages'
|
||||
if not pages.is_dir():
|
||||
raise RuntimeError(f'Original ZP Wiki Markdown directory is missing: {pages}')
|
||||
documents = {str(path.relative_to(wiki)): sha256_file(path)
|
||||
for path in sorted(pages.rglob('README.md')) if path.is_file()}
|
||||
serialized = json.dumps(documents, sort_keys=True, separators=(',', ':')).encode()
|
||||
return {'sha256': hashlib.sha256(serialized).hexdigest(),
|
||||
'document_count': len(documents), 'documents': documents}
|
||||
|
||||
|
||||
def content_fingerprints(questions: Path, root: Path = ROOT) -> dict[str, Any]:
|
||||
files = sorted((root / 'tools/graphrag').rglob('*.py'))
|
||||
# requirements.txt and tools/ are present both in the checkout and image.
|
||||
files.extend(root / name for name in [
|
||||
'requirements.txt', 'tools/publication.py', 'tools/retrieval_contract.py',
|
||||
'tools/index_state.py', 'tools/rag/common.py', 'tools/sync_indexes.py',
|
||||
'tools/rag/rag_utils.py', 'tools/answer_evaluation/context_policy.py',
|
||||
'tools/answer_evaluation/checked_generation.py', 'tools/answer_evaluation/answer_format.py',
|
||||
'tools/answer_evaluation/render_answer.py',
|
||||
'tools/rag/evaluation/rag_metrics.py', 'tools/rag/evaluation/rag_runner.py'])
|
||||
return {
|
||||
'implementation': {str(path.relative_to(root)): sha256_file(path) for path in files},
|
||||
'dataset_sha256': sha256_file(questions),
|
||||
'inputs': {name: sha256_file(root / name) for name in ['data/documents.json', 'data/chunks.json']},
|
||||
'source_corpus': source_corpus_fingerprint(root),
|
||||
'retrieval_policy': {'published_only': DEFAULT_PUBLISHED_ONLY,
|
||||
'publication_policy': PUBLICATION_POLICY_VERSION,
|
||||
'academic_preparation_is_work': False},
|
||||
}
|
||||
|
||||
|
||||
def graph_fingerprint(session: Any) -> dict[str, Any]:
|
||||
nodes = session.run(
|
||||
'MATCH (n) WHERE n.graph_scope = $scope '
|
||||
'RETURN labels(n) AS labels, properties(n) AS properties', scope='zpwiki'
|
||||
).data()
|
||||
edges = session.run(
|
||||
'MATCH (a)-[r]->(b) WHERE a.graph_scope = $scope AND b.graph_scope = $scope '
|
||||
'RETURN labels(a) AS source_labels, coalesce(a.id, a.path, a.name) AS source, '
|
||||
'type(r) AS type, properties(r) AS properties, labels(b) AS target_labels, '
|
||||
'coalesce(b.id, b.path, b.name) AS target', scope='zpwiki'
|
||||
).data()
|
||||
# elementId and row order are deliberately excluded: they change on rebuild.
|
||||
canonical = lambda rows: sorted(json.dumps(row, sort_keys=True, ensure_ascii=False, default=str) for row in rows)
|
||||
content = json.dumps({'nodes': canonical(nodes), 'relationships': canonical(edges)}, ensure_ascii=False)
|
||||
return {'sha256': hashlib.sha256(content.encode()).hexdigest(),
|
||||
'nodes': len(nodes), 'relationships': len(edges)}
|
||||
|
||||
|
||||
def run_metadata(questions: Path) -> dict[str, Any]:
|
||||
def revision(path: Path) -> str | None:
|
||||
result = subprocess.run(['git', '-C', str(path), 'rev-parse', 'HEAD'],
|
||||
text=True, capture_output=True, check=False)
|
||||
return result.stdout.strip() if result.returncode == 0 else None
|
||||
return {'started_at_utc': datetime.now(timezone.utc).isoformat(),
|
||||
'python': platform.python_version(), 'git_head': revision(ROOT),
|
||||
'wiki_git_head': revision(Path(os.getenv('ZPWIKI_ROOT', str(ROOT.parent / 'zpwiki')))),
|
||||
'fingerprints': content_fingerprints(questions)}
|
||||
|
||||
|
||||
def verify_freeze(manifest: dict, metadata: dict, graph: dict, *, limit: int, max_entities: int,
|
||||
audit: Path | None) -> None:
|
||||
if manifest['fingerprints'] != metadata['fingerprints']:
|
||||
raise RuntimeError('Frozen implementation, benchmark or inputs changed. TEST refused.')
|
||||
if manifest['graph'] != graph:
|
||||
raise RuntimeError('Neo4j graph changed since DEV freeze. TEST refused.')
|
||||
if manifest['parameters'] != {'limit': limit, 'max_entities': max_entities}:
|
||||
raise RuntimeError('Retrieval parameters differ from DEV freeze. TEST refused.')
|
||||
if audit is None or sha256_file(audit) != manifest['audit_sha256']:
|
||||
raise RuntimeError('Source audit differs from DEV freeze. TEST refused.')
|
||||
File diff suppressed because it is too large
Load Diff
@ -0,0 +1,381 @@
|
||||
{
|
||||
"method": "Fresh LLM-generation holdout over previously measured, frozen graph queries.",
|
||||
"graph_freeze_sha256": "07867eb5300498b5862b1e4a607d9f5b050b9fdeab19b1fb6129810e28313a62",
|
||||
"audit_sha256": "220fd00ab08cceee6d5141ca5c1a02ec2877d1eee83b36ea707c6a076ba69e15",
|
||||
"generation_files": {
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/evaluate_graph_answers.py": "d34f324c0c490a02111eed31c45864c068b2b856040bea0201f731ab4ac527f5",
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/graph_answer_prompt.txt": "1900178f4ae805e258726a2df853ab2d0766033cf2ed956d28ea8e0caa7c653f",
|
||||
"tools/rag/evaluation/rag_runner.py": "a011b29e2b6aa47df9350e74fc358f05780a355170a819dbb1cfd16d2971493b"
|
||||
},
|
||||
"model": "model120-fast",
|
||||
"temperature": 0,
|
||||
"workers": 3,
|
||||
"dev_ids": [
|
||||
"wide-001",
|
||||
"wide-002",
|
||||
"wide-041",
|
||||
"wide-042",
|
||||
"wide-081",
|
||||
"wide-082",
|
||||
"wide-113",
|
||||
"wide-114",
|
||||
"wide-137",
|
||||
"wide-138",
|
||||
"wide-169",
|
||||
"wide-170",
|
||||
"wide-193",
|
||||
"wide-194",
|
||||
"wide-217",
|
||||
"wide-218",
|
||||
"wide-249",
|
||||
"wide-250",
|
||||
"wide-289",
|
||||
"wide-290"
|
||||
],
|
||||
"test_ids": [
|
||||
"wide-003",
|
||||
"wide-004",
|
||||
"wide-005",
|
||||
"wide-006",
|
||||
"wide-007",
|
||||
"wide-008",
|
||||
"wide-009",
|
||||
"wide-010",
|
||||
"wide-011",
|
||||
"wide-012",
|
||||
"wide-013",
|
||||
"wide-014",
|
||||
"wide-015",
|
||||
"wide-016",
|
||||
"wide-017",
|
||||
"wide-018",
|
||||
"wide-019",
|
||||
"wide-020",
|
||||
"wide-021",
|
||||
"wide-022",
|
||||
"wide-023",
|
||||
"wide-024",
|
||||
"wide-025",
|
||||
"wide-026",
|
||||
"wide-027",
|
||||
"wide-028",
|
||||
"wide-029",
|
||||
"wide-030",
|
||||
"wide-031",
|
||||
"wide-032",
|
||||
"wide-033",
|
||||
"wide-034",
|
||||
"wide-035",
|
||||
"wide-036",
|
||||
"wide-037",
|
||||
"wide-038",
|
||||
"wide-039",
|
||||
"wide-040",
|
||||
"wide-043",
|
||||
"wide-044",
|
||||
"wide-045",
|
||||
"wide-046",
|
||||
"wide-047",
|
||||
"wide-048",
|
||||
"wide-049",
|
||||
"wide-050",
|
||||
"wide-051",
|
||||
"wide-052",
|
||||
"wide-053",
|
||||
"wide-054",
|
||||
"wide-055",
|
||||
"wide-056",
|
||||
"wide-057",
|
||||
"wide-058",
|
||||
"wide-059",
|
||||
"wide-060",
|
||||
"wide-061",
|
||||
"wide-062",
|
||||
"wide-063",
|
||||
"wide-064",
|
||||
"wide-065",
|
||||
"wide-066",
|
||||
"wide-067",
|
||||
"wide-068",
|
||||
"wide-069",
|
||||
"wide-070",
|
||||
"wide-071",
|
||||
"wide-072",
|
||||
"wide-073",
|
||||
"wide-074",
|
||||
"wide-075",
|
||||
"wide-076",
|
||||
"wide-077",
|
||||
"wide-078",
|
||||
"wide-079",
|
||||
"wide-080",
|
||||
"wide-083",
|
||||
"wide-084",
|
||||
"wide-085",
|
||||
"wide-086",
|
||||
"wide-087",
|
||||
"wide-088",
|
||||
"wide-089",
|
||||
"wide-090",
|
||||
"wide-091",
|
||||
"wide-092",
|
||||
"wide-093",
|
||||
"wide-094",
|
||||
"wide-095",
|
||||
"wide-096",
|
||||
"wide-097",
|
||||
"wide-098",
|
||||
"wide-099",
|
||||
"wide-100",
|
||||
"wide-101",
|
||||
"wide-102",
|
||||
"wide-103",
|
||||
"wide-104",
|
||||
"wide-105",
|
||||
"wide-106",
|
||||
"wide-107",
|
||||
"wide-108",
|
||||
"wide-109",
|
||||
"wide-110",
|
||||
"wide-111",
|
||||
"wide-112",
|
||||
"wide-115",
|
||||
"wide-116",
|
||||
"wide-117",
|
||||
"wide-118",
|
||||
"wide-119",
|
||||
"wide-120",
|
||||
"wide-121",
|
||||
"wide-122",
|
||||
"wide-123",
|
||||
"wide-124",
|
||||
"wide-125",
|
||||
"wide-126",
|
||||
"wide-127",
|
||||
"wide-128",
|
||||
"wide-129",
|
||||
"wide-130",
|
||||
"wide-131",
|
||||
"wide-132",
|
||||
"wide-133",
|
||||
"wide-134",
|
||||
"wide-135",
|
||||
"wide-136",
|
||||
"wide-139",
|
||||
"wide-140",
|
||||
"wide-141",
|
||||
"wide-142",
|
||||
"wide-143",
|
||||
"wide-144",
|
||||
"wide-145",
|
||||
"wide-146",
|
||||
"wide-147",
|
||||
"wide-148",
|
||||
"wide-149",
|
||||
"wide-150",
|
||||
"wide-151",
|
||||
"wide-152",
|
||||
"wide-153",
|
||||
"wide-154",
|
||||
"wide-155",
|
||||
"wide-156",
|
||||
"wide-157",
|
||||
"wide-158",
|
||||
"wide-159",
|
||||
"wide-160",
|
||||
"wide-161",
|
||||
"wide-162",
|
||||
"wide-163",
|
||||
"wide-164",
|
||||
"wide-165",
|
||||
"wide-166",
|
||||
"wide-167",
|
||||
"wide-168",
|
||||
"wide-171",
|
||||
"wide-172",
|
||||
"wide-173",
|
||||
"wide-174",
|
||||
"wide-175",
|
||||
"wide-176",
|
||||
"wide-177",
|
||||
"wide-178",
|
||||
"wide-179",
|
||||
"wide-180",
|
||||
"wide-181",
|
||||
"wide-182",
|
||||
"wide-183",
|
||||
"wide-184",
|
||||
"wide-185",
|
||||
"wide-186",
|
||||
"wide-187",
|
||||
"wide-188",
|
||||
"wide-189",
|
||||
"wide-190",
|
||||
"wide-191",
|
||||
"wide-192",
|
||||
"wide-195",
|
||||
"wide-196",
|
||||
"wide-197",
|
||||
"wide-198",
|
||||
"wide-199",
|
||||
"wide-200",
|
||||
"wide-201",
|
||||
"wide-202",
|
||||
"wide-203",
|
||||
"wide-204",
|
||||
"wide-205",
|
||||
"wide-206",
|
||||
"wide-207",
|
||||
"wide-208",
|
||||
"wide-209",
|
||||
"wide-210",
|
||||
"wide-211",
|
||||
"wide-212",
|
||||
"wide-213",
|
||||
"wide-214",
|
||||
"wide-215",
|
||||
"wide-216",
|
||||
"wide-219",
|
||||
"wide-220",
|
||||
"wide-221",
|
||||
"wide-222",
|
||||
"wide-223",
|
||||
"wide-224",
|
||||
"wide-225",
|
||||
"wide-226",
|
||||
"wide-227",
|
||||
"wide-228",
|
||||
"wide-229",
|
||||
"wide-230",
|
||||
"wide-231",
|
||||
"wide-232",
|
||||
"wide-233",
|
||||
"wide-234",
|
||||
"wide-235",
|
||||
"wide-236",
|
||||
"wide-237",
|
||||
"wide-238",
|
||||
"wide-239",
|
||||
"wide-240",
|
||||
"wide-241",
|
||||
"wide-242",
|
||||
"wide-243",
|
||||
"wide-244",
|
||||
"wide-245",
|
||||
"wide-246",
|
||||
"wide-247",
|
||||
"wide-248",
|
||||
"wide-251",
|
||||
"wide-252",
|
||||
"wide-253",
|
||||
"wide-254",
|
||||
"wide-255",
|
||||
"wide-256",
|
||||
"wide-257",
|
||||
"wide-258",
|
||||
"wide-259",
|
||||
"wide-260",
|
||||
"wide-261",
|
||||
"wide-262",
|
||||
"wide-263",
|
||||
"wide-264",
|
||||
"wide-265",
|
||||
"wide-266",
|
||||
"wide-267",
|
||||
"wide-268",
|
||||
"wide-269",
|
||||
"wide-270",
|
||||
"wide-271",
|
||||
"wide-272",
|
||||
"wide-273",
|
||||
"wide-274",
|
||||
"wide-275",
|
||||
"wide-276",
|
||||
"wide-277",
|
||||
"wide-278",
|
||||
"wide-279",
|
||||
"wide-280",
|
||||
"wide-281",
|
||||
"wide-282",
|
||||
"wide-283",
|
||||
"wide-284",
|
||||
"wide-285",
|
||||
"wide-286",
|
||||
"wide-287",
|
||||
"wide-288",
|
||||
"wide-291",
|
||||
"wide-292",
|
||||
"wide-293",
|
||||
"wide-294",
|
||||
"wide-295",
|
||||
"wide-296",
|
||||
"wide-297",
|
||||
"wide-298",
|
||||
"wide-299",
|
||||
"wide-300",
|
||||
"wide-301",
|
||||
"wide-302",
|
||||
"wide-303",
|
||||
"wide-304",
|
||||
"wide-305",
|
||||
"wide-306",
|
||||
"wide-307",
|
||||
"wide-308",
|
||||
"wide-309",
|
||||
"wide-310",
|
||||
"wide-311",
|
||||
"wide-312",
|
||||
"wide-313",
|
||||
"wide-314",
|
||||
"wide-315",
|
||||
"wide-316",
|
||||
"wide-317",
|
||||
"wide-318",
|
||||
"wide-319",
|
||||
"wide-320"
|
||||
],
|
||||
"dev_count": 20,
|
||||
"test_count": 300,
|
||||
"target_accuracy": 0.92,
|
||||
"selected_split": "dev",
|
||||
"selected_ids": [
|
||||
"wide-001",
|
||||
"wide-002",
|
||||
"wide-041",
|
||||
"wide-042",
|
||||
"wide-081",
|
||||
"wide-082",
|
||||
"wide-113",
|
||||
"wide-114",
|
||||
"wide-137",
|
||||
"wide-138",
|
||||
"wide-169",
|
||||
"wide-170",
|
||||
"wide-193",
|
||||
"wide-194",
|
||||
"wide-217",
|
||||
"wide-218",
|
||||
"wide-249",
|
||||
"wide-250",
|
||||
"wide-289",
|
||||
"wide-290"
|
||||
],
|
||||
"policy": "Evaluate all 300; retain every failure; do not tune on this TEST.",
|
||||
"test_categories": {
|
||||
"shared_keyword_pair": 38,
|
||||
"same_academic_year_pair": 38,
|
||||
"same_start_year_pair": 30,
|
||||
"person_title_year": 22,
|
||||
"person_keyword_title": 30,
|
||||
"document_author_category_multi_hop": 22,
|
||||
"person_multiple_categories": 22,
|
||||
"candidate_set_aggregation": 30,
|
||||
"conjunctive_disambiguation": 38,
|
||||
"negative_lookup": 30
|
||||
},
|
||||
"limitations": [
|
||||
"Known corpus/profiles and templates; model outputs for these 300 questions were not previously observed.",
|
||||
"Harness supplies graph context; native OpenWebUI tool choice and browser UI are outside this experiment.",
|
||||
"Checks structured factual claims, their source support/citations and required prose values; not a general semantic judge of arbitrary prose."
|
||||
]
|
||||
}
|
||||
@ -0,0 +1,301 @@
|
||||
id,category,strict,error,latency_seconds,bindings_ok,sources_ok,status_ok,count_ok,set_ok,text_values_ok,question,answer
|
||||
wide-003,shared_keyword_pair,True,,6.699744368997926,True,True,True,True,True,True,Pre osoby Manohar Gowdru Shridhara a Nikita Bodnar over rovnaké kľúčové slovo nlp.,"{""answer"": ""Áno, obe osoby Manohar Gowdru Shridhara a Nikita Bodnar majú ako kľúčové slovo NLP. Zdroje: https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu, https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""status"": ""ok"", ""claims"": [{""person"": ""Manohar Gowdru Shridhara"", ""keyword"": ""NLP""}, {""person"": ""Nikita Bodnar"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar""], ""count"": 2}"
|
||||
wide-004,shared_keyword_pair,True,,5.666554606999853,True,True,True,True,True,True,Over spoločné kľúčové slovo nlp pri osobách Jakub Maruniak a Nikita Bodnar.,"{""answer"": ""Spoločné kľúčové slovo NLP majú Jakub Maruniak a Nikita Bodnar. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak, https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""status"": ""ok"", ""claims"": [{""person"": ""Jakub Maruniak"", ""keyword"": ""NLP""}, {""person"": ""Nikita Bodnar"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar""], ""count"": 2}"
|
||||
wide-005,shared_keyword_pair,True,,11.765499916000408,True,True,True,True,True,True,Majú osoby Denis Le Thanh a Samuel Vasiľ spoločné kľúčové slovo nlp?,"{""answer"": ""Áno, osoby Denis Le Thanh a Samuel Vasiľ majú spoločné kľúčové slovo NLP. Samuel Vasiľ má kľúčové slovo NLP podľa zdroja https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil a Denis Le Thanh má kľúčové slovo NLP podľa zdroja https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh."", ""status"": ""ok"", ""claims"": [{""person"": ""Samuel Vasiľ"", ""keyword"": ""NLP""}, {""person"": ""Denis Le Thanh"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""], ""count"": 2}"
|
||||
wide-006,shared_keyword_pair,True,,9.003742946995771,True,True,True,True,True,True,Pre osoby Lukáš Pokrývka a Stanislav Matsunych over rovnaké kľúčové slovo nlp.,"{""answer"": ""Áno, obe osoby Lukáš Pokrývka a Stanislav Matsunych majú kľúčové slovo NLP. Lukáš Pokrývka má toto kľúčové slovo v dokumente pages/students/2016/lukas_pokryvka/timovy_projekt/README.md (zdroj: https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt). Stanislav Matsunych má kľúčové slovo NLP v dokumente pages/students/2017/stanislav_matsunych/README.md (zdroj: https://zp.kemt.fei.tuke.sk/students/2017/stanislav_matsunych)."", ""status"": ""ok"", ""claims"": [{""person"": ""Lukáš Pokrývka"", ""keyword"": ""NLP""}, {""person"": ""Stanislav Matsunych"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2017/stanislav_matsunych""], ""count"": 2}"
|
||||
wide-007,shared_keyword_pair,True,,10.538517578002939,True,True,True,True,True,True,Over spoločné kľúčové slovo nlp pri osobách Oleksandr Dorybohov a Youssef Ressaissi.,"{""answer"": ""Spoločné kľúčové slovo NLP majú Oleksandr Dorybohov a Youssef Ressaissi. Zdroje: https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov, https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi"", ""status"": ""ok"", ""claims"": [{""person"": ""Youssef Ressaissi"", ""keyword"": ""NLP""}, {""person"": ""Oleksandr Dorybohov"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""], ""count"": 2}"
|
||||
wide-008,shared_keyword_pair,True,,8.536271106997447,True,True,True,True,True,True,Majú osoby Denis Le Thanh a Tomáš Kuchárik spoločné kľúčové slovo nlp?,"{""answer"": ""Áno, obe osoby, Denis Le Thanh a Tomáš Kuchárik, majú spoločné kľúčové slovo NLP. Tieto údaje sú potvrdené v ich profiloch na stránkach https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh a https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik."", ""status"": ""ok"", ""claims"": [{""person"": ""Tomáš Kuchárik"", ""keyword"": ""NLP""}, {""person"": ""Denis Le Thanh"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""], ""count"": 2}"
|
||||
wide-009,shared_keyword_pair,True,,9.359552573005203,True,True,True,True,True,True,Pre osoby Dávid Iľaš a Maroš Harahus over rovnaké kľúčové slovo nlp.,"{""answer"": ""Áno, obe osoby Dávid Iľaš a Maroš Harahus majú rovnaké kľúčové slovo NLP. Dávid Iľaš má kľúčové slovo NLP podľa zdroja https://zp.kemt.fei.tuke.sk/students/2018/david_ilas a Maroš Harahus má kľúčové slovo NLP podľa zdroja https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus."", ""status"": ""ok"", ""claims"": [{""person"": ""Dávid Iľaš"", ""keyword"": ""NLP""}, {""person"": ""Maroš Harahus"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/david_ilas"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""], ""count"": 2}"
|
||||
wide-010,shared_keyword_pair,True,,9.009257842997613,True,True,True,True,True,True,Over spoločné kľúčové slovo nlp pri osobách Nikita Bodnar a Oleksandr Dorybohov.,"{""answer"": ""Spoločným kľúčovým slovom pre Nikitu Bodnara a Oleksandra Dorybohova je NLP. Tieto údaje sú potvrdené v zdrojoch: https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar a https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov."", ""status"": ""ok"", ""claims"": [{""person"": ""Nikita Bodnar"", ""keyword"": ""NLP""}, {""person"": ""Oleksandr Dorybohov"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""], ""count"": 2}"
|
||||
wide-011,shared_keyword_pair,True,,10.274840045000019,True,True,True,True,True,True,Majú osoby Lukáš Pokrývka a Martin NaN1 spoločné kľúčové slovo nlp?,"{""answer"": ""Áno, obe osoby Lukáš Pokrývka a Martin NaN1 majú spoločné kľúčové slovo NLP. Lukáš Pokrývka má toto kľúčové slovo v dokumente na stránke https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt a Martin NaN1 v dokumente na stránke https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday."", ""status"": ""ok"", ""claims"": [{""person"": ""Lukáš Pokrývka"", ""keyword"": ""NLP""}, {""person"": ""Martin NaN1"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday""], ""count"": 2}"
|
||||
wide-012,shared_keyword_pair,True,,8.777758887998061,True,True,True,True,True,True,Pre osoby Martin Šarišský a Yevhenii Leonov over rovnaké kľúčové slovo nlp.,"{""answer"": ""Osoba Martin Šarišský má kľúčové slovo NLP (zdroj: https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky). Osoba Yevhenii Leonov má kľúčové slovo NLP (zdroj: https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov)."", ""status"": ""ok"", ""claims"": [{""person"": ""Martin Šarišský"", ""keyword"": ""NLP""}, {""person"": ""Yevhenii Leonov"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov""], ""count"": 2}"
|
||||
wide-013,shared_keyword_pair,True,,13.491731257003266,True,True,True,True,True,True,Over spoločné kľúčové slovo nlp pri osobách Maksym Zatirka a Patrik Pavlišin.,"{""answer"": ""Spoločné kľúčové slovo NLP majú osoby Patrik Pavlišin a Maksym Zatirka. Patrik Pavlišin má kľúčové slovo NLP v dokumente pages/students/2016/patrik_pavlisin/README.md (zdroj: https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin). Maksym Zatirka má kľúčové slovo NLP v dokumente pages/students/2023/maksym_zatirka/README.md (zdroj: https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka)."", ""status"": ""ok"", ""claims"": [{""person"": ""Patrik Pavlišin"", ""keyword"": ""NLP""}, {""person"": ""Maksym Zatirka"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""], ""count"": 2}"
|
||||
wide-014,shared_keyword_pair,True,,8.736353909996978,True,True,True,True,True,True,Majú osoby Artem Yatsenko a Matej Novotný spoločné kľúčové slovo nlp?,"{""answer"": ""Áno, obe osoby Artem Yatsenko a Matej Novotný majú spoločné kľúčové slovo NLP. Artem Yatsenko má toto kľúčové slovo uvedené v dokumente pages/students/2019/artem_yatsenko/README.md (zdroj: https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko) a Matej Novotný v dokumente pages/students/2021/matej_novotny/README.md (zdroj: https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny)."", ""status"": ""ok"", ""claims"": [{""person"": ""Artem Yatsenko"", ""keyword"": ""NLP""}, {""person"": ""Matej Novotný"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny""], ""count"": 2}"
|
||||
wide-015,shared_keyword_pair,True,,15.575955378000799,True,True,True,True,True,True,Pre osoby Kristián Sopkovič a Yevhenii Medushivskyi over rovnaké kľúčové slovo nlp.,"{""answer"": ""Áno, obe osoby, Kristián Sopkovič a Yevhenii Medushivskyi, majú rovnaké kľúčové slovo NLP. Kristián Sopkovič má toto kľúčové slovo v dokumente z roku 2019 (https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic) a Yevhenii Medushivskyi v dokumente z roku 2023 (https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi)."", ""status"": ""ok"", ""claims"": [{""person"": ""Kristián Sopkovič"", ""keyword"": ""NLP""}, {""person"": ""Yevhenii Medushivskyi"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi""], ""count"": 2}"
|
||||
wide-016,shared_keyword_pair,True,,7.991483903999324,True,True,True,True,True,True,Over spoločné kľúčové slovo nlp pri osobách Alina Vitko a Manohar Gowdru Shridhara.,"{""answer"": ""Spoločné kľúčové slovo NLP majú Alina Vitko a Manohar Gowdru Shridhara. Alina Vitko má kľúčové slovo NLP v dokumente na stránke https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko. Manohar Gowdru Shridhara má kľúčové slovo NLP v dokumente na stránke https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu."", ""status"": ""ok"", ""claims"": [{""person"": ""Alina Vitko"", ""keyword"": ""NLP""}, {""person"": ""Manohar Gowdru Shridhara"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu""], ""count"": 2}"
|
||||
wide-017,shared_keyword_pair,True,,15.949837186002696,True,True,True,True,True,True,Majú osoby Andrii Pervashov a Valerii Kutsenko spoločné kľúčové slovo nlp?,"{""answer"": ""Áno, osoby Andrii Pervashov a Valerii Kutsenko majú spoločné kľúčové slovo NLP. Andrii Pervashov má kľúčové slovo NLP podľa zdroja https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov a Valerii Kutsenko má kľúčové slovo NLP podľa zdroja https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko."", ""status"": ""ok"", ""claims"": [{""person"": ""Andrii Pervashov"", ""keyword"": ""NLP""}, {""person"": ""Valerii Kutsenko"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""], ""count"": 2}"
|
||||
wide-018,shared_keyword_pair,True,,6.7982784530031495,True,True,True,True,True,True,Pre osoby Jakub Maruniak a Yevhenii Medushivskyi over rovnaké kľúčové slovo nlp.,"{""answer"": ""Obe osoby, Yevhenii Medushivskyi a Jakub Maruniak, majú ako kľúčové slovo NLP. Yevhenii Medushivskyi je uvedený v zdroji https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi a Jakub Maruniak v zdroji https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak."", ""status"": ""ok"", ""claims"": [{""person"": ""Yevhenii Medushivskyi"", ""keyword"": ""NLP""}, {""person"": ""Jakub Maruniak"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2023/yevhenii_medushivskyi"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""], ""count"": 2}"
|
||||
wide-019,shared_keyword_pair,True,,12.657017598998209,True,True,True,True,True,True,Over spoločné kľúčové slovo nlp pri osobách Adrián Remiáš a Bogdan Paul Chiș.,"{""answer"": ""Spoločné kľúčové slovo NLP majú Adrián Remiáš a Bogdan Paul Chiș. Adrián Remiáš má kľúčové slovo NLP v dokumente pages/students/2018/adrian_remias/README.md (https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias). Bogdan Paul Chiș má kľúčové slovo NLP v dokumente pages/interns/bogdan_paul_chis/README.md (https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis)."", ""status"": ""ok"", ""claims"": [{""person"": ""Adrián Remiáš"", ""keyword"": ""NLP""}, {""person"": ""Bogdan Paul Chiș"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis""], ""count"": 2}"
|
||||
wide-020,shared_keyword_pair,True,,6.938394573000551,True,True,True,True,True,True,Majú osoby Oleh Bilykh a Ondrej Megela spoločné kľúčové slovo question-answer?,"{""answer"": ""Áno, osoby Oleh Bilykh a Ondrej Megela majú spoločné kľúčové slovo question-answer. Tento fakt je potvrdený pre Olega Bilykha na stránke https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh a pre Ondreja Megelu na stránke https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela."", ""status"": ""ok"", ""claims"": [{""person"": ""Oleh Bilykh"", ""keyword"": ""question-answer""}, {""person"": ""Ondrej Megela"", ""keyword"": ""question-answer""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""], ""count"": 2}"
|
||||
wide-021,shared_keyword_pair,True,,10.601334623002913,True,True,True,True,True,True,Pre osoby Bogdan Paul Chiș a Samuel Džurina over rovnaké kľúčové slovo nlp.,"{""answer"": ""Áno, obe osoby, Bogdan Paul Chiș a Samuel Džurina, majú rovnaké kľúčové slovo NLP. Zdroje: https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis, https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""status"": ""ok"", ""claims"": [{""person"": ""Bogdan Paul Chiș"", ""keyword"": ""NLP""}, {""person"": ""Samuel Džurina"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""], ""count"": 2}"
|
||||
wide-022,shared_keyword_pair,True,,10.63887820099626,True,True,True,True,True,True,Over spoločné kľúčové slovo nlp pri osobách Dárius Lindvai a Dominik Nagy.,"{""answer"": ""Spoločné kľúčové slovo NLP majú Dárius Lindvai a Dominik Nagy. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai, https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""status"": ""ok"", ""claims"": [{""person"": ""Dárius Lindvai"", ""keyword"": ""NLP""}, {""person"": ""Dominik Nagy"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy""], ""count"": 2}"
|
||||
wide-023,shared_keyword_pair,True,,7.379739687996334,True,True,True,True,True,True,Majú osoby Artem Yatsenko a Maksym Zatirka spoločné kľúčové slovo nlp?,"{""answer"": ""Áno, obe osoby Artem Yatsenko a Maksym Zatirka majú spoločné kľúčové slovo NLP. Artem Yatsenko má toto kľúčové slovo uvedené v dokumente pages/students/2019/artem_yatsenko/README.md (zdroj: https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko) a Maksym Zatirka v dokumente pages/students/2023/maksym_zatirka/README.md (zdroj: https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka)."", ""status"": ""ok"", ""claims"": [{""person"": ""Artem Yatsenko"", ""keyword"": ""NLP""}, {""person"": ""Maksym Zatirka"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""], ""count"": 2}"
|
||||
wide-024,shared_keyword_pair,True,,8.829382572002942,True,True,True,True,True,True,Pre osoby Denis Le Thanh a Oleksandr Dorybohov over rovnaké kľúčové slovo lm.,"{""answer"": ""Áno, obe osoby Denis Le Thanh a Oleksandr Dorybohov majú rovnaké kľúčové slovo LM. Tieto údaje sú potvrdené v zdrojoch: https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh a https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov."", ""status"": ""ok"", ""claims"": [{""person"": ""Denis Le Thanh"", ""keyword"": ""LM""}, {""person"": ""Oleksandr Dorybohov"", ""keyword"": ""LM""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""], ""count"": 2}"
|
||||
wide-025,shared_keyword_pair,True,,9.64496994500223,True,True,True,True,True,True,Over spoločné kľúčové slovo nlp pri osobách Artur Hyrenko a Than Trung Thanh.,"{""answer"": ""Spoločné kľúčové slovo NLP majú Artur Hyrenko a Than Trung Thanh. Zdroje: https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh, https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko."", ""status"": ""ok"", ""claims"": [{""person"": ""Than Trung Thanh"", ""keyword"": ""NLP""}, {""person"": ""Artur Hyrenko"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko""], ""count"": 2}"
|
||||
wide-026,shared_keyword_pair,True,,10.304747886999394,True,True,True,True,True,True,Majú osoby Lukáš Pokrývka a Than Trung Thanh spoločné kľúčové slovo nlp?,"{""answer"": ""Áno, obe osoby Lukáš Pokrývka a Than Trung Thanh majú spoločné kľúčové slovo NLP. Lukáš Pokrývka má toto kľúčové slovo uvedené v dokumente týkajúcom sa tímového projektu (https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt) a Than Trung Thanh ho má v hlavnom dokumente svojho profilu (https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh)."", ""status"": ""ok"", ""claims"": [{""person"": ""Lukáš Pokrývka"", ""keyword"": ""NLP""}, {""person"": ""Than Trung Thanh"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh""], ""count"": 2}"
|
||||
wide-027,shared_keyword_pair,True,,9.40718223300064,True,True,True,True,True,True,Pre osoby Artur Hyrenko a Rostyslav Rodzhuk over rovnaké kľúčové slovo nlp.,"{""answer"": ""Áno, obe osoby Artur Hyrenko a Rostyslav Rodzhuk majú ako kľúčové slovo NLP. Zdroje: https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko a https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk."", ""status"": ""ok"", ""claims"": [{""person"": ""Artur Hyrenko"", ""keyword"": ""NLP""}, {""person"": ""Rostyslav Rodzhuk"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""], ""count"": 2}"
|
||||
wide-028,shared_keyword_pair,True,,10.532162452000193,True,True,True,True,True,True,Over spoločné kľúčové slovo nlp pri osobách Denis Le Thanh a Ján Holp.,"{""answer"": ""Spoločné kľúčové slovo NLP majú Denis Le Thanh a Ján Holp. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/jan_holp, https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""status"": ""ok"", ""claims"": [{""person"": ""Ján Holp"", ""keyword"": ""NLP""}, {""person"": ""Denis Le Thanh"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""], ""count"": 2}"
|
||||
wide-029,shared_keyword_pair,True,,9.789691318001132,True,True,True,True,True,True,Majú osoby Dávid Stromp a Ediz Morochovič spoločné kľúčové slovo nlp?,"{""answer"": ""Áno, obe osoby Dávid Stromp a Ediz Morochovič majú spoločné kľúčové slovo NLP. Dávid Stromp má toto kľúčové slovo uvedené v dokumente pages/students/2019/david_stromp/README.md (zdroj: https://zp.kemt.fei.tuke.sk/students/2019/david_stromp) a Ediz Morochovič v dokumente pages/students/2016/ediz_morochovic/README.md (zdroj: https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic)."", ""status"": ""ok"", ""claims"": [{""person"": ""Dávid Stromp"", ""keyword"": ""NLP""}, {""person"": ""Ediz Morochovič"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic""], ""count"": 2}"
|
||||
wide-030,shared_keyword_pair,True,,11.241516061993025,True,True,True,True,True,True,Pre osoby Kristián Sopkovič a Martin Wencel over rovnaké kľúčové slovo spacy.,"{""answer"": ""Áno, obe osoby, Martin Wencel a Kristián Sopkovič, majú v grafoch uvedené kľúčové slovo Spacy. Martin Wencel je uvedený na stránke https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel a Kristián Sopkovič na stránke https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic."", ""status"": ""ok"", ""claims"": [{""person"": ""Martin Wencel"", ""keyword"": ""Spacy""}, {""person"": ""Kristián Sopkovič"", ""keyword"": ""Spacy""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""], ""count"": 2}"
|
||||
wide-031,shared_keyword_pair,True,,10.634745764997206,True,True,True,True,True,True,Over spoločné kľúčové slovo nlp pri osobách Jakub Schwarc a Ján Holp.,"{""answer"": ""Spoločné kľúčové slovo NLP majú Jakub Schwarc a Ján Holp. Ján Holp má toto kľúčové slovo v dokumente z roku 2016 (https://zp.kemt.fei.tuke.sk/students/2016/jan_holp) a Jakub Schwarc v dokumente z roku 2022 (https://zp.kemt.fei.tuke.sk/students/2022/jakub_schwarc)."", ""status"": ""ok"", ""claims"": [{""person"": ""Ján Holp"", ""keyword"": ""NLP""}, {""person"": ""Jakub Schwarc"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2022/jakub_schwarc""], ""count"": 2}"
|
||||
wide-032,shared_keyword_pair,True,,11.027207719998842,True,True,True,True,True,True,Majú osoby Dávid Stromp a Márk Fehér spoločné kľúčové slovo nlp?,"{""answer"": ""Áno, obe osoby Dávid Stromp a Márk Fehér majú spoločné kľúčové slovo NLP. Dávid Stromp má toto kľúčové slovo v dokumente pages/students/2019/david_stromp/README.md (zdroj: https://zp.kemt.fei.tuke.sk/students/2019/david_stromp) a Márk Fehér v dokumente pages/students/2016/mark_feher/README.md (zdroj: https://zp.kemt.fei.tuke.sk/students/2016/mark_feher)."", ""status"": ""ok"", ""claims"": [{""person"": ""Dávid Stromp"", ""keyword"": ""NLP""}, {""person"": ""Márk Fehér"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher""], ""count"": 2}"
|
||||
wide-033,shared_keyword_pair,True,,9.521409880995634,True,True,True,True,True,True,Pre osoby Stanislav Matsunych a Youssef Ressaissi over rovnaké kľúčové slovo nlp.,"{""answer"": ""Áno, obe osoby Stanislav Matsunych a Youssef Ressaissi majú rovnaké kľúčové slovo NLP. Zdroje: https://zp.kemt.fei.tuke.sk/students/2017/stanislav_matsunych, https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi"", ""status"": ""ok"", ""claims"": [{""person"": ""Stanislav Matsunych"", ""keyword"": ""NLP""}, {""person"": ""Youssef Ressaissi"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2017/stanislav_matsunych"", ""https://zp.kemt.fei.tuke.sk/interns/yussef_ressaissi""], ""count"": 2}"
|
||||
wide-034,shared_keyword_pair,True,,10.085962933000701,True,True,True,True,True,True,Over spoločné kľúčové slovo nlp pri osobách Ján Malinovský a Lukáš Pokrývka.,"{""answer"": ""Spoločné kľúčové slovo NLP majú Ján Malinovský a Lukáš Pokrývka. Lukáš Pokrývka má toto kľúčové slovo v dokumente na stránke https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt a Ján Malinovský na stránke https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky."", ""status"": ""ok"", ""claims"": [{""person"": ""Lukáš Pokrývka"", ""keyword"": ""NLP""}, {""person"": ""Ján Malinovský"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""], ""count"": 2}"
|
||||
wide-035,shared_keyword_pair,True,,9.319875779998256,True,True,True,True,True,True,Majú osoby Ján Holp a Sevval Bulburu spoločné kľúčové slovo nlp?,"{""answer"": ""Áno, obe osoby Ján Holp a Sevval Bulburu majú spoločné kľúčové slovo NLP. Ján Holp má toto kľúčové slovo uvedené v dokumente pages/students/2016/jan_holp/README.md (zdroj: https://zp.kemt.fei.tuke.sk/students/2016/jan_holp) a Sevval Bulburu v dokumente pages/interns/sevval_bulburu/README.md (zdroj: https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu)."", ""status"": ""ok"", ""claims"": [{""person"": ""Ján Holp"", ""keyword"": ""NLP""}, {""person"": ""Sevval Bulburu"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/interns/sevval_bulburu""], ""count"": 2}"
|
||||
wide-036,shared_keyword_pair,True,,9.90310135600157,True,True,True,True,True,True,Pre osoby Oleh Bilykh a Ondrej Megela over rovnaké kľúčové slovo qa.,"{""answer"": ""Áno, obe osoby, Oleh Bilykh a Ondrej Megela, majú rovnaké kľúčové slovo QA. Zdroje: https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh, https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""status"": ""ok"", ""claims"": [{""person"": ""Oleh Bilykh"", ""keyword"": ""QA""}, {""person"": ""Ondrej Megela"", ""keyword"": ""QA""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""], ""count"": 2}"
|
||||
wide-037,shared_keyword_pair,True,,9.461803379999765,True,True,True,True,True,True,Over spoločné kľúčové slovo nlp pri osobách Andrii Pervashov a Oleh Bilykh.,"{""answer"": ""Spoločné kľúčové slovo NLP majú osoby Oleh Bilykh a Andrii Pervashov. Zdroje: https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh, https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov."", ""status"": ""ok"", ""claims"": [{""person"": ""Oleh Bilykh"", ""keyword"": ""NLP""}, {""person"": ""Andrii Pervashov"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""], ""count"": 2}"
|
||||
wide-038,shared_keyword_pair,True,,8.896227124998404,True,True,True,True,True,True,Majú osoby Tetiana Mohorian a Valerii Kutsenko spoločné kľúčové slovo rag?,"{""answer"": ""Áno, osoby Tetiana Mohorian a Valerii Kutsenko majú spoločné kľúčové slovo RAG. Toto je potvrdené v ich profiloch na stránkach https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian a https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko."", ""status"": ""ok"", ""claims"": [{""person"": ""Tetiana Mohorian"", ""keyword"": ""RAG""}, {""person"": ""Valerii Kutsenko"", ""keyword"": ""RAG""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""], ""count"": 2}"
|
||||
wide-039,shared_keyword_pair,True,,9.704090511993854,True,True,True,True,True,True,Pre osoby Alina Vitko a Matej Kobyľan over rovnaké kľúčové slovo ir.,"{""answer"": ""Áno, obe osoby, Alina Vitko a Matej Kobyľan, majú priradené kľúčové slovo \""ir\"". Alina Vitko je uvedená na stránke https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko a Matej Kobyľan na stránke https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan."", ""status"": ""ok"", ""claims"": [{""person"": ""Alina Vitko"", ""keyword"": ""ir""}, {""person"": ""Matej Kobyľan"", ""keyword"": ""ir""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""], ""count"": 2}"
|
||||
wide-040,shared_keyword_pair,True,,8.09319808800501,True,True,True,True,True,True,Over spoločné kľúčové slovo nlp pri osobách Oleksandr Hryshchenko a Serhii Yemets.,"{""answer"": ""Spoločné kľúčové slovo NLP majú Oleksandr Hryshchenko a Serhii Yemets. Zdroje: https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko, https://zp.kemt.fei.tuke.sk/students/2022/serhii_yemets"", ""status"": ""ok"", ""claims"": [{""person"": ""Oleksandr Hryshchenko"", ""keyword"": ""NLP""}, {""person"": ""Serhii Yemets"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/serhii_yemets""], ""count"": 2}"
|
||||
wide-043,same_academic_year_pair,True,,12.992187249998096,True,True,True,True,True,True,Porovnaj rovnaké roky práce pri osobách Alina Vitko a Artem Yatsenko.,"{""answer"": ""Alina Vitko a Artem Yatsenko majú spoločné roky práce 2021 a 2022. Obe osoby pracovali v roku 2021 a 2022, čo je potvrdené zdrojmi: https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko a https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko."", ""status"": ""ok"", ""claims"": [{""person"": ""Alina Vitko"", ""year"": 2021}, {""person"": ""Alina Vitko"", ""year"": 2022}, {""person"": ""Artem Yatsenko"", ""year"": 2021}, {""person"": ""Artem Yatsenko"", ""year"": 2022}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""], ""count"": 2}"
|
||||
wide-044,same_academic_year_pair,True,,7.993425487999048,True,True,True,True,True,True,Aké spoločné roky práce spájajú osoby Patrik Pavlišin a Samuel Širotník?,"{""answer"": ""Spoločným rokom práce pre Patrika Pavlišina a Samuela Širotníka je 2020. Patrik Pavlišin pracoval v roku 2020 (zdroj: https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin) a Samuel Širotník tiež v roku 2020 (zdroj: https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik)."", ""status"": ""ok"", ""claims"": [{""person"": ""Patrik Pavlišin"", ""year"": 2020}, {""person"": ""Samuel Širotník"", ""year"": 2020}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik""], ""count"": 1}"
|
||||
wide-045,same_academic_year_pair,True,,11.783585913006391,True,True,True,True,True,True,Ktoré spoločné roky prác majú osoby Lukáš Pokrývka a Márk Fehér?,"{""answer"": ""Lukáš Pokrývka a Márk Fehér majú spoločný rok prác 2021. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka, https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""status"": ""ok"", ""claims"": [{""person"": ""Lukáš Pokrývka"", ""year"": 2021}, {""person"": ""Márk Fehér"", ""year"": 2021}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher""], ""count"": 1}"
|
||||
wide-046,same_academic_year_pair,True,,8.095852152000589,True,True,True,True,True,True,Porovnaj rovnaké roky práce pri osobách Kristián Sopkovič a Ondrej Megela.,"{""answer"": ""Kristián Sopkovič a Ondrej Megela majú rovnaký rok práce 2022. Zdroje: https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic, https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""status"": ""ok"", ""claims"": [{""person"": ""Kristián Sopkovič"", ""year"": 2022}, {""person"": ""Ondrej Megela"", ""year"": 2022}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""], ""count"": 2}"
|
||||
wide-047,same_academic_year_pair,True,,14.414462206004828,True,True,True,True,True,True,Aké spoločné roky práce spájajú osoby Martin Šarišský a Matej Ščišľak?,"{""answer"": ""Martin Šarišský a Matej Ščišľak majú spoločné roky práce 2024, 2025 a 2026. Tieto údaje sú potvrdené v zdrojoch: https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky a https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak."", ""status"": ""ok"", ""claims"": [{""person"": ""Martin Šarišský"", ""year"": 2024}, {""person"": ""Martin Šarišský"", ""year"": 2025}, {""person"": ""Martin Šarišský"", ""year"": 2026}, {""person"": ""Matej Ščišľak"", ""year"": 2024}, {""person"": ""Matej Ščišľak"", ""year"": 2025}, {""person"": ""Matej Ščišľak"", ""year"": 2026}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""], ""count"": 3}"
|
||||
wide-048,same_academic_year_pair,True,,7.2015859890016145,True,True,True,True,True,True,Ktoré spoločné roky prác majú osoby Márk Fehér a Ondrej Megela?,"{""answer"": ""Márk Fehér a Ondrej Megela majú spoločný rok prác 2022. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/mark_feher, https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""status"": ""ok"", ""claims"": [{""person"": ""Márk Fehér"", ""year"": 2022}, {""person"": ""Ondrej Megela"", ""year"": 2022}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""], ""count"": 1}"
|
||||
wide-049,same_academic_year_pair,True,,11.857852802997513,True,True,True,True,True,True,Porovnaj rovnaké roky práce pri osobách Daniil Huzenko a Vladyslav Yanchenko.,"{""answer"": ""Daniil Huzenko a Vladyslav Yanchenko majú rovnaký rok práce 2025. Zdroje: https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko, https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko."", ""status"": ""ok"", ""claims"": [{""person"": ""Daniil Huzenko"", ""year"": 2025}, {""person"": ""Vladyslav Yanchenko"", ""year"": 2025}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""], ""count"": 2}"
|
||||
wide-050,same_academic_year_pair,True,,9.958301602004212,True,True,True,True,True,True,Aké spoločné roky práce spájajú osoby Matúš Suchanič a Ondrej Megela?,"{""answer"": ""Matúš Suchanič a Ondrej Megela majú spoločné roky práce 2022 a 2023. Tieto údaje sú potvrdené zdrojmi: https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic a https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela."", ""status"": ""ok"", ""claims"": [{""person"": ""Matúš Suchanič"", ""year"": 2022}, {""person"": ""Matúš Suchanič"", ""year"": 2023}, {""person"": ""Ondrej Megela"", ""year"": 2022}, {""person"": ""Ondrej Megela"", ""year"": 2023}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""], ""count"": 2}"
|
||||
wide-051,same_academic_year_pair,True,,10.470878234002157,True,True,True,True,True,True,Ktoré spoločné roky prác majú osoby Artur Hyrenko a Maksym Zatirka?,"{""answer"": ""Osoby Artur Hyrenko a Maksym Zatirka majú spoločný rok práce 2026. Zdroje: https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko, https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""status"": ""ok"", ""claims"": [{""person"": ""Artur Hyrenko"", ""year"": 2026}, {""person"": ""Maksym Zatirka"", ""year"": 2026}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""], ""count"": 1}"
|
||||
wide-052,same_academic_year_pair,True,,8.66265292999742,True,True,True,True,True,True,Porovnaj rovnaké roky práce pri osobách Matúš Suchanič a Vladyslav Krupko.,"{""answer"": ""Matúš Suchanič a Vladyslav Krupko majú rovnaký rok práce 2023. Zdroje: https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic, https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""status"": ""ok"", ""claims"": [{""person"": ""Matúš Suchanič"", ""year"": 2023}, {""person"": ""Vladyslav Krupko"", ""year"": 2023}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""], ""count"": 2}"
|
||||
wide-053,same_academic_year_pair,True,,8.393673475999094,True,True,True,True,True,True,Aké spoločné roky práce spájajú osoby Jakub Maruniak a Samuel Širotník?,"{""answer"": ""Spoločným rokom práce pre Jakuba Maruniaka a Samuela Širotníka je 2020. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak, https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""status"": ""ok"", ""claims"": [{""person"": ""Jakub Maruniak"", ""year"": 2020}, {""person"": ""Samuel Širotník"", ""year"": 2020}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik""], ""count"": 1}"
|
||||
wide-054,same_academic_year_pair,True,,8.700021895005193,True,True,True,True,True,True,Ktoré spoločné roky prác majú osoby Dmytro Ushatenko a Maroš Harahus?,"{""answer"": ""Osoby Dmytro Ushatenko a Maroš Harahus majú spoločný rok práce 2020. Dmytro Ushatenko pracoval v roku 2020 (zdroj: https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko) a Maroš Harahus tiež v roku 2020 (zdroj: https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus)."", ""status"": ""ok"", ""claims"": [{""person"": ""Dmytro Ushatenko"", ""year"": 2020}, {""person"": ""Maroš Harahus"", ""year"": 2020}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""], ""count"": 1}"
|
||||
wide-055,same_academic_year_pair,True,,9.511775334001868,True,True,True,True,True,True,Porovnaj rovnaké roky práce pri osobách Jakub Schwarc a Martin Šarišský.,"{""answer"": ""Jakub Schwarc a Martin Šarišský majú rovnaký rok práce 2026. Zdroje: https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky, https://zp.kemt.fei.tuke.sk/students/2022/jakub_schwarc."", ""status"": ""ok"", ""claims"": [{""person"": ""Martin Šarišský"", ""year"": 2026}, {""person"": ""Jakub Schwarc"", ""year"": 2026}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/jakub_schwarc""], ""count"": 2}"
|
||||
wide-056,same_academic_year_pair,True,,10.811054402998707,True,True,True,True,True,True,Aké spoločné roky práce spájajú osoby Márk Fehér a Patrik Pavlišin?,"{""answer"": ""Spoločné roky práce pre Márka Fehéra a Patrika Pavlišina sú 2021 a 2022. Tieto údaje sú potvrdené zdrojmi: https://zp.kemt.fei.tuke.sk/students/2016/mark_feher a https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin."", ""status"": ""ok"", ""claims"": [{""person"": ""Márk Fehér"", ""year"": 2021}, {""person"": ""Márk Fehér"", ""year"": 2022}, {""person"": ""Patrik Pavlišin"", ""year"": 2021}, {""person"": ""Patrik Pavlišin"", ""year"": 2022}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""], ""count"": 2}"
|
||||
wide-057,same_academic_year_pair,True,,9.067882338000345,True,True,True,True,True,True,Ktoré spoločné roky prác majú osoby Denis Le Thanh a Ján Pták?,"{""answer"": ""Osoby Denis Le Thanh a Ján Pták majú spoločný rok práce 2026. Zdroje: https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh, https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak"", ""status"": ""ok"", ""claims"": [{""person"": ""Denis Le Thanh"", ""year"": 2026}, {""person"": ""Ján Pták"", ""year"": 2026}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""], ""count"": 1}"
|
||||
wide-058,same_academic_year_pair,True,,9.767850545002148,True,True,True,True,True,True,Porovnaj rovnaké roky práce pri osobách Artur Hyrenko a Rostyslav Rodzhuk.,"{""answer"": ""Artur Hyrenko a Rostyslav Rodzhuk majú rovnaký rok práce 2026. Zdroje: https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko, https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""status"": ""ok"", ""claims"": [{""person"": ""Artur Hyrenko"", ""year"": 2026}, {""person"": ""Rostyslav Rodzhuk"", ""year"": 2026}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""], ""count"": 2}"
|
||||
wide-059,same_academic_year_pair,True,,8.003912930995284,True,True,True,True,True,True,Aké spoločné roky práce spájajú osoby Dávid Kostilník a Vladyslav Yanchenko?,"{""answer"": ""Osoby Dávid Kostilník a Vladyslav Yanchenko majú spoločný rok práce 2025. Dávid Kostilník je uvedený v roku 2025 (zdroj: https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik) a Vladyslav Yanchenko je tiež uvedený v roku 2025 (zdroj: https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko)."", ""status"": ""ok"", ""claims"": [{""person"": ""Dávid Kostilník"", ""year"": 2025}, {""person"": ""Vladyslav Yanchenko"", ""year"": 2025}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik"", ""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""], ""count"": 1}"
|
||||
wide-060,same_academic_year_pair,True,,10.589566226000898,True,True,True,True,True,True,Ktoré spoločné roky prác majú osoby Alina Vitko a Jakub Maruniak?,"{""answer"": ""Osoby Alina Vitko a Jakub Maruniak majú spoločný rok prác 2021. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak, https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""status"": ""ok"", ""claims"": [{""person"": ""Jakub Maruniak"", ""year"": 2021}, {""person"": ""Alina Vitko"", ""year"": 2021}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""], ""count"": 1}"
|
||||
wide-061,same_academic_year_pair,True,,8.728929495002376,True,True,True,True,True,True,Porovnaj rovnaké roky práce pri osobách Dávid Stromp a Matúš Suchanič.,"{""answer"": ""Dávid Stromp a Matúš Suchanič majú rovnaký rok práce 2022. Zdroje: https://zp.kemt.fei.tuke.sk/students/2019/david_stromp, https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""status"": ""ok"", ""claims"": [{""person"": ""Dávid Stromp"", ""year"": 2022}, {""person"": ""Matúš Suchanič"", ""year"": 2022}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""], ""count"": 2}"
|
||||
wide-062,same_academic_year_pair,True,,9.624930268000753,True,True,True,True,True,True,Aké spoločné roky práce spájajú osoby Filip Tomáš a Valerii Kutsenko?,"{""answer"": ""Osoby Filip Tomáš a Valerii Kutsenko majú spoločný rok práce 2025. Zdroje: https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas, https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""status"": ""ok"", ""claims"": [{""person"": ""Filip Tomáš"", ""year"": 2025}, {""person"": ""Valerii Kutsenko"", ""year"": 2025}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""], ""count"": 1}"
|
||||
wide-063,same_academic_year_pair,True,,7.708646625003894,True,True,True,True,True,True,Ktoré spoločné roky prác majú osoby Jakub Maruniak a Tomáš Kuchárik?,"{""answer"": ""Osoby Jakub Maruniak a Tomáš Kuchárik majú spoločný rok prác 2021. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak, https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""status"": ""ok"", ""claims"": [{""person"": ""Jakub Maruniak"", ""year"": 2021}, {""person"": ""Tomáš Kuchárik"", ""year"": 2021}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""], ""count"": 1}"
|
||||
wide-064,same_academic_year_pair,True,,9.076152639994689,True,True,True,True,True,True,Porovnaj rovnaké roky práce pri osobách Oleh Bilykh a Samuel Horáni.,"{""answer"": ""Oleh Bilykh a Samuel Horáni majú rovnaký rok práce 2021. Zdroje: https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh, https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""status"": ""ok"", ""claims"": [{""person"": ""Oleh Bilykh"", ""year"": 2021}, {""person"": ""Samuel Horáni"", ""year"": 2021}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani""], ""count"": 2}"
|
||||
wide-065,same_academic_year_pair,True,,8.600696289999178,True,True,True,True,True,True,Aké spoločné roky práce spájajú osoby Dmytro Ushatenko a Patrik Pavlišin?,"{""answer"": ""Spoločným rokom práce pre Dmytra Ushatenka a Patrika Pavlišina je 2020. Dmytro Ushatenko pracoval v roku 2020 (zdroj: https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko) a Patrik Pavlišin pracoval v roku 2020 (zdroj: https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin)."", ""status"": ""ok"", ""claims"": [{""person"": ""Dmytro Ushatenko"", ""year"": 2020}, {""person"": ""Patrik Pavlišin"", ""year"": 2020}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko"", ""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""], ""count"": 1}"
|
||||
wide-066,same_academic_year_pair,True,,9.30446918799862,True,True,True,True,True,True,Ktoré spoločné roky prác majú osoby Jakub Maruniak a Ondrej Megela?,"{""answer"": ""Osoby Jakub Maruniak a Ondrej Megela majú spoločný rok práce 2020. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak, https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""status"": ""ok"", ""claims"": [{""person"": ""Ondrej Megela"", ""year"": 2020}, {""person"": ""Jakub Maruniak"", ""year"": 2020}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""], ""count"": 1}"
|
||||
wide-067,same_academic_year_pair,True,,10.539549341003294,True,True,True,True,True,True,Porovnaj rovnaké roky práce pri osobách Alina Vitko a Dmytro Mural.,"{""answer"": ""Alina Vitko a Dmytro Mural majú rovnaké roky práce 2021 a 2022. Zdroje: https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko, https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural."", ""status"": ""ok"", ""claims"": [{""person"": ""Alina Vitko"", ""year"": 2021}, {""person"": ""Alina Vitko"", ""year"": 2022}, {""person"": ""Dmytro Mural"", ""year"": 2021}, {""person"": ""Dmytro Mural"", ""year"": 2022}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural""], ""count"": 2}"
|
||||
wide-068,same_academic_year_pair,True,,8.96055851499841,True,True,True,True,True,True,Aké spoločné roky práce spájajú osoby Tetiana Mohorian a Yevhenii Leonov?,"{""answer"": ""Spoločným rokom práce, ktorý spája Tetiana Mohorian a Yevhenii Leonov, je rok 2025. Tieto údaje sú potvrdené v zdrojoch: https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian a https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov."", ""status"": ""ok"", ""claims"": [{""person"": ""Tetiana Mohorian"", ""year"": 2025}, {""person"": ""Yevhenii Leonov"", ""year"": 2025}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian"", ""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov""], ""count"": 1}"
|
||||
wide-069,same_academic_year_pair,True,,10.708338853000896,True,True,True,True,True,True,Ktoré spoločné roky prác majú osoby Oleksandr Hryshchenko a Ronald Zalacko?,"{""answer"": ""Oleksandr Hryshchenko a Ronald Zalacko majú spoločný rok práce 2026. Zdroje: https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko, https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""status"": ""ok"", ""claims"": [{""person"": ""Oleksandr Hryshchenko"", ""year"": 2026}, {""person"": ""Ronald Zalacko"", ""year"": 2026}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko""], ""count"": 1}"
|
||||
wide-070,same_academic_year_pair,True,,7.392514177001431,True,True,True,True,True,True,Porovnaj rovnaké roky práce pri osobách Adrián Remiáš a Pavol Hudák.,"{""answer"": ""Adrián Remiáš a Pavol Hudák majú rovnaký rok práce 2024. Zdroje: https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias, https://zp.kemt.fei.tuke.sk/students/2020/pavol_hudak."", ""status"": ""ok"", ""claims"": [{""person"": ""Adrián Remiáš"", ""year"": 2024}, {""person"": ""Pavol Hudák"", ""year"": 2024}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2020/pavol_hudak""], ""count"": 2}"
|
||||
wide-071,same_academic_year_pair,True,,13.657042221995653,True,True,True,True,True,True,Aké spoločné roky práce spájajú osoby Nikita Bodnar a Patrik Pokrivčák?,"{""answer"": ""Spoločnými rokmi práce osôb Nikita Bodnar a Patrik Pokrivčák sú roky 2024 a 2025. Obe osoby majú zaznamenané roky 2024 a 2025 v zdrojoch: https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar a https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak."", ""status"": ""ok"", ""claims"": [{""person"": ""Nikita Bodnar"", ""year"": 2024}, {""person"": ""Nikita Bodnar"", ""year"": 2025}, {""person"": ""Patrik Pokrivčák"", ""year"": 2024}, {""person"": ""Patrik Pokrivčák"", ""year"": 2025}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak""], ""count"": 2}"
|
||||
wide-072,same_academic_year_pair,True,,6.338669182994636,True,True,True,True,True,True,Ktoré spoločné roky prác majú osoby Ján Malinovský a Simona Bobrovčanová?,"{""answer"": ""Osoby Ján Malinovský a Simona Bobrovčanová majú spoločný rok práce 2026. Zdroje: https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky, https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""status"": ""ok"", ""claims"": [{""person"": ""Ján Malinovský"", ""year"": 2026}, {""person"": ""Simona Bobrovčanová"", ""year"": 2026}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""], ""count"": 1}"
|
||||
wide-073,same_academic_year_pair,True,,11.086802947000251,True,True,True,True,True,True,Porovnaj rovnaké roky práce pri osobách Jakub Maruniak a Márk Fehér.,"{""answer"": ""Jakub Maruniak a Márk Fehér majú rovnaký rok práce 2021. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak, https://zp.kemt.fei.tuke.sk/students/2016/mark_feher."", ""status"": ""ok"", ""claims"": [{""person"": ""Jakub Maruniak"", ""year"": 2021}, {""person"": ""Márk Fehér"", ""year"": 2021}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher""], ""count"": 2}"
|
||||
wide-074,same_academic_year_pair,True,,8.229125010002463,True,True,True,True,True,True,Aké spoločné roky práce spájajú osoby Kamil Tomčufčík a Valerii Kutsenko?,"{""answer"": ""Osoby Kamil Tomčufčík a Valerii Kutsenko majú spoločný rok práce 2025. Zdroje: https://zp.kemt.fei.tuke.sk/students/2020/kamil_tomcufcik, https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""status"": ""ok"", ""claims"": [{""person"": ""Kamil Tomčufčík"", ""year"": 2025}, {""person"": ""Valerii Kutsenko"", ""year"": 2025}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2020/kamil_tomcufcik"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""], ""count"": 1}"
|
||||
wide-075,same_academic_year_pair,True,,9.072914823002066,True,True,True,True,True,True,Ktoré spoločné roky prác majú osoby Serhii Yemets a Tetiana Mohorian?,"{""answer"": ""Osoby Serhii Yemets a Tetiana Mohorian majú spoločný rok prác 2025. Zdroje: https://zp.kemt.fei.tuke.sk/students/2022/serhii_yemets, https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian"", ""status"": ""ok"", ""claims"": [{""person"": ""Serhii Yemets"", ""year"": 2025}, {""person"": ""Tetiana Mohorian"", ""year"": 2025}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/serhii_yemets"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""], ""count"": 1}"
|
||||
wide-076,same_academic_year_pair,True,,7.277860586000315,True,True,True,True,True,True,Porovnaj rovnaké roky práce pri osobách Martin Šarišský a Serhii Yemets.,"{""answer"": ""Martin Šarišský a Serhii Yemets majú rovnaký rok práce 2025. Zdroje: https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky, https://zp.kemt.fei.tuke.sk/students/2022/serhii_yemets"", ""status"": ""ok"", ""claims"": [{""person"": ""Martin Šarišský"", ""year"": 2025}, {""person"": ""Serhii Yemets"", ""year"": 2025}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2022/serhii_yemets""], ""count"": 2}"
|
||||
wide-077,same_academic_year_pair,True,,8.747992983000586,True,True,True,True,True,True,Aké spoločné roky práce spájajú osoby Matej Kobyľan a Nikita Bodnar?,"{""answer"": ""Spoločným rokom práce pre Mateja Kobyľana a Nikitu Bodnara je 2024. Zdroje: https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan, https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""status"": ""ok"", ""claims"": [{""person"": ""Matej Kobyľan"", ""year"": 2024}, {""person"": ""Nikita Bodnar"", ""year"": 2024}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar""], ""count"": 1}"
|
||||
wide-078,same_academic_year_pair,True,,7.9442629190016305,True,True,True,True,True,True,Ktoré spoločné roky prác majú osoby Dárius Lindvai a Martin NaN1?,"{""answer"": ""Osoby Dárius Lindvai a Martin NaN1 majú spoločný rok práce 2020. Dárius Lindvai má prácu z roku 2020 (zdroj: https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai) a Martin NaN1 má prácu z roku 2020 (zdroj: https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday)."", ""status"": ""ok"", ""claims"": [{""person"": ""Dárius Lindvai"", ""year"": 2020}, {""person"": ""Martin NaN1"", ""year"": 2020}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday""], ""count"": 1}"
|
||||
wide-079,same_academic_year_pair,True,,8.828723204998823,True,True,True,True,True,True,Porovnaj rovnaké roky práce pri osobách Artur Hyrenko a Samuel Džurina.,"{""answer"": ""Artur Hyrenko a Samuel Džurina majú rovnaký rok práce 2026. Zdroje: https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko, https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""status"": ""ok"", ""claims"": [{""person"": ""Artur Hyrenko"", ""year"": 2026}, {""person"": ""Samuel Džurina"", ""year"": 2026}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""], ""count"": 2}"
|
||||
wide-080,same_academic_year_pair,False,,10.36691496399726,True,True,True,True,True,True,Aké spoločné roky práce spájajú osoby Dávid Stromp a Dominik Nagy?,"{""answer"": ""Spoločné roky práce pre Dávida Strompa a Dominika Nagya sú 2021 a 2022. Tieto údaje sú potvrdené zdrojmi: https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy a https://zp.kemt.fei.tuke.sk/students/2019/david_stromp."", ""status"": ""ok"", ""claims"": [{""person"": ""Dominik Nagy"", ""year"": 2021}, {""person"": ""Dominik Nagy"", ""year"": 2022}, {""person"": ""Dávid Stromp"", ""year"": 2021}, {""person"": ""Dávid Stromp"", ""year"": 2022}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp""], ""count"": 2}"
|
||||
wide-083,same_start_year_pair,True,,8.719621158001246,True,True,True,True,True,True,Aký spoločný rok začiatku štúdia majú osoby Lukáš Pokrývka a Maroš Harahus?,"{""answer"": ""Lukáš Pokrývka a Maroš Harahus majú spoločný rok začiatku štúdia 2016. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka, https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""status"": ""ok"", ""claims"": [{""person"": ""Lukáš Pokrývka"", ""start_year"": 2016}, {""person"": ""Maroš Harahus"", ""start_year"": 2016}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""], ""count"": 2}"
|
||||
wide-084,same_start_year_pair,True,,12.174287679998088,True,True,True,True,True,True,Porovnaj rovnaký rok začiatku štúdia osôb Dávid Kostilník a Jakub Kristián Lukas.,"{""answer"": ""Dávid Kostilník a Jakub Kristián Lukas začali štúdium v rovnakom roku 2020. Zdroje: https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik, https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas"", ""status"": ""ok"", ""claims"": [{""person"": ""Dávid Kostilník"", ""start_year"": 2020}, {""person"": ""Jakub Kristián Lukas"", ""start_year"": 2020}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik"", ""https://zp.kemt.fei.tuke.sk/students/2020/jakub_kristian_lukas""], ""count"": 2}"
|
||||
wide-085,same_start_year_pair,True,,5.55311806199461,True,True,True,True,True,True,Aký spoločný rok začiatku štúdia majú osoby Dominik Nagy a Jakub Maruniak?,"{""answer"": ""Dominik Nagy a Jakub Maruniak majú spoločný rok začiatku štúdia 2016. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy, https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""status"": ""ok"", ""claims"": [{""person"": ""Dominik Nagy"", ""start_year"": 2016}, {""person"": ""Jakub Maruniak"", ""start_year"": 2016}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""], ""count"": 2}"
|
||||
wide-086,same_start_year_pair,True,,10.080774428999575,True,True,True,True,True,True,Aký spoločný rok začiatku štúdia majú osoby Artem Yatsenko a Samuel Horáni?,"{""answer"": ""Artem Yatsenko a Samuel Horáni majú spoločný rok začiatku štúdia 2019. Zdroje: https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko, https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""status"": ""ok"", ""claims"": [{""person"": ""Artem Yatsenko"", ""start_year"": 2019}, {""person"": ""Samuel Horáni"", ""start_year"": 2019}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani""], ""count"": 2}"
|
||||
wide-087,same_start_year_pair,True,,7.166185222995409,True,True,True,True,True,True,Porovnaj rovnaký rok začiatku štúdia osôb Dmytro Mural a Samuel Horáni.,"{""answer"": ""Dmytro Mural a Samuel Horáni začali štúdium v rovnakom roku 2019. Zdroje: https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural, https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""status"": ""ok"", ""claims"": [{""person"": ""Dmytro Mural"", ""start_year"": 2019}, {""person"": ""Samuel Horáni"", ""start_year"": 2019}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani""], ""count"": 2}"
|
||||
wide-088,same_start_year_pair,True,,9.089845142996637,True,True,True,True,True,True,Aký spoločný rok začiatku štúdia majú osoby Ján Holp a Maroš Harahus?,"{""answer"": ""Osoby Ján Holp a Maroš Harahus majú spoločný rok začiatku štúdia 2016. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/jan_holp, https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""status"": ""ok"", ""claims"": [{""person"": ""Ján Holp"", ""start_year"": 2016}, {""person"": ""Maroš Harahus"", ""start_year"": 2016}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""], ""count"": 2}"
|
||||
wide-089,same_start_year_pair,True,,7.242540999999619,True,True,True,True,True,True,Aký spoločný rok začiatku štúdia majú osoby Dávid Kostilník a Vladyslav Krupko?,"{""answer"": ""Dávid Kostilník a Vladyslav Krupko majú spoločný rok začiatku štúdia 2020. Zdroje: https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik, https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko"", ""status"": ""ok"", ""claims"": [{""person"": ""Dávid Kostilník"", ""start_year"": 2020}, {""person"": ""Vladyslav Krupko"", ""start_year"": 2020}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik"", ""https://zp.kemt.fei.tuke.sk/students/2020/vladyslav_krupko""], ""count"": 2}"
|
||||
wide-090,same_start_year_pair,True,,9.571305277997453,True,True,True,True,True,True,Porovnaj rovnaký rok začiatku štúdia osôb Martin Jancura a Stanislav Matsunych.,"{""answer"": ""Martin Jancura a Stanislav Matsunych začali štúdium v rovnakom roku 2017. Zdroje: https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura, https://zp.kemt.fei.tuke.sk/students/2017/stanislav_matsunych"", ""status"": ""ok"", ""claims"": [{""person"": ""Martin Jancura"", ""start_year"": 2017}, {""person"": ""Stanislav Matsunych"", ""start_year"": 2017}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""https://zp.kemt.fei.tuke.sk/students/2017/stanislav_matsunych""], ""count"": 2}"
|
||||
wide-091,same_start_year_pair,True,,7.682041077001486,True,True,True,True,True,True,Aký spoločný rok začiatku štúdia majú osoby Matej Novotný a Nikita Bodnar?,"{""answer"": ""Matej Novotný a Nikita Bodnar majú spoločný rok začiatku štúdia 2021. Zdroje: https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny, https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""status"": ""ok"", ""claims"": [{""person"": ""Matej Novotný"", ""start_year"": 2021}, {""person"": ""Nikita Bodnar"", ""start_year"": 2021}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/matej_novotny"", ""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar""], ""count"": 2}"
|
||||
wide-092,same_start_year_pair,True,,9.652925777001656,True,True,True,True,True,True,Aký spoločný rok začiatku štúdia majú osoby Dávid Omasta a Martin Wencel?,"{""answer"": ""Dávid Omasta a Martin Wencel majú spoločný rok začiatku štúdia 2018. Zdroje: https://zp.kemt.fei.tuke.sk/students/2018/david_omasta, https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""status"": ""ok"", ""claims"": [{""person"": ""Dávid Omasta"", ""start_year"": 2018}, {""person"": ""Martin Wencel"", ""start_year"": 2018}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""], ""count"": 2}"
|
||||
wide-093,same_start_year_pair,True,,7.145516338998277,True,True,True,True,True,True,Porovnaj rovnaký rok začiatku štúdia osôb Samuel Vasiľ a Valerii Kutsenko.,"{""answer"": ""Samuel Vasiľ a Valerii Kutsenko začali štúdium v rovnakom roku 2022. Zdroje: https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil, https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""status"": ""ok"", ""claims"": [{""person"": ""Samuel Vasiľ"", ""start_year"": 2022}, {""person"": ""Valerii Kutsenko"", ""start_year"": 2022}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""], ""count"": 2}"
|
||||
wide-094,same_start_year_pair,True,,9.363720138004282,True,True,True,True,True,True,Aký spoločný rok začiatku štúdia majú osoby Dmytro Mural a Kristián Sopkovič?,"{""answer"": ""Dmytro Mural a Kristián Sopkovič majú spoločný rok začiatku štúdia 2019. Zdroje: https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural, https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""status"": ""ok"", ""claims"": [{""person"": ""Dmytro Mural"", ""start_year"": 2019}, {""person"": ""Kristián Sopkovič"", ""start_year"": 2019}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""], ""count"": 2}"
|
||||
wide-095,same_start_year_pair,True,,7.0345262230039225,True,True,True,True,True,True,Aký spoločný rok začiatku štúdia majú osoby Oleksandr Dorybohov a Samuel Džurina?,"{""answer"": ""Oleksandr Dorybohov a Samuel Džurina majú spoločný rok začiatku štúdia 2023. Zdroje: https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov, https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina"", ""status"": ""ok"", ""claims"": [{""person"": ""Oleksandr Dorybohov"", ""start_year"": 2023}, {""person"": ""Samuel Džurina"", ""start_year"": 2023}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""], ""count"": 2}"
|
||||
wide-096,same_start_year_pair,True,,9.334781532001216,True,True,True,True,True,True,Porovnaj rovnaký rok začiatku štúdia osôb Michal Stromko a Patrik Pokrivčák.,"{""answer"": ""Michal Stromko a Patrik Pokrivčák začali štúdium v rovnakom roku 2019. Zdroje: https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko, https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak"", ""status"": ""ok"", ""claims"": [{""person"": ""Michal Stromko"", ""start_year"": 2019}, {""person"": ""Patrik Pokrivčák"", ""start_year"": 2019}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak""], ""count"": 2}"
|
||||
wide-097,same_start_year_pair,True,,7.029824302000634,True,True,True,True,True,True,Aký spoločný rok začiatku štúdia majú osoby Martin Šarišský a Matej Ščišľak?,"{""answer"": ""Martin Šarišský a Matej Ščišľak majú spoločný rok začiatku štúdia 2021. Zdroje: https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky, https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""status"": ""ok"", ""claims"": [{""person"": ""Martin Šarišský"", ""start_year"": 2021}, {""person"": ""Matej Ščišľak"", ""start_year"": 2021}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""], ""count"": 2}"
|
||||
wide-098,same_start_year_pair,True,,9.2781991909942,True,True,True,True,True,True,Aký spoločný rok začiatku štúdia majú osoby Matej Kobyľan a Pavol Hudák?,"{""answer"": ""Spoločný rok začiatku štúdia pre Mateja Kobyľana a Pavola Hudáka je 2020. Zdroje: https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan, https://zp.kemt.fei.tuke.sk/students/2020/pavol_hudak"", ""status"": ""ok"", ""claims"": [{""person"": ""Matej Kobyľan"", ""start_year"": 2020}, {""person"": ""Pavol Hudák"", ""start_year"": 2020}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""https://zp.kemt.fei.tuke.sk/students/2020/pavol_hudak""], ""count"": 2}"
|
||||
wide-099,same_start_year_pair,True,,6.882240877996082,True,True,True,True,True,True,Porovnaj rovnaký rok začiatku štúdia osôb Alina Vitko a Dávid Stromp.,"{""answer"": ""Alina Vitko a Dávid Stromp začali štúdium v rovnakom roku 2019. Zdroje: https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko, https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""status"": ""ok"", ""claims"": [{""person"": ""Alina Vitko"", ""start_year"": 2019}, {""person"": ""Dávid Stromp"", ""start_year"": 2019}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp""], ""count"": 2}"
|
||||
wide-100,same_start_year_pair,True,,9.426582434993179,True,True,True,True,True,True,Aký spoločný rok začiatku štúdia majú osoby Ronald Zalacko a Simona Bobrovčanová?,"{""answer"": ""Ronald Zalacko a Simona Bobrovčanová majú spoločný rok začiatku štúdia 2023. Zdroje: https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko, https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""status"": ""ok"", ""claims"": [{""person"": ""Ronald Zalacko"", ""start_year"": 2023}, {""person"": ""Simona Bobrovčanová"", ""start_year"": 2023}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2023/ronald_zalacko"", ""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""], ""count"": 2}"
|
||||
wide-101,same_start_year_pair,True,,6.825582851000945,True,True,True,True,True,True,Aký spoločný rok začiatku štúdia majú osoby Jakub Schwarc a Valerii Kutsenko?,"{""answer"": ""Osoby Jakub Schwarc a Valerii Kutsenko majú spoločný rok začiatku štúdia 2022. Zdroje: https://zp.kemt.fei.tuke.sk/students/2022/jakub_schwarc, https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""status"": ""ok"", ""claims"": [{""person"": ""Jakub Schwarc"", ""start_year"": 2022}, {""person"": ""Valerii Kutsenko"", ""start_year"": 2022}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/jakub_schwarc"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""], ""count"": 2}"
|
||||
wide-102,same_start_year_pair,True,,9.520078122004634,True,True,True,True,True,True,Porovnaj rovnaký rok začiatku štúdia osôb Ján Malinovský a Tetiana Mohorian.,"{""answer"": ""Ján Malinovský a Tetiana Mohorian začali štúdium v rovnakom roku 2022. Zdroje: https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky, https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian"", ""status"": ""ok"", ""claims"": [{""person"": ""Ján Malinovský"", ""start_year"": 2022}, {""person"": ""Tetiana Mohorian"", ""start_year"": 2022}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""https://zp.kemt.fei.tuke.sk/students/2022/tetiana_mohorian""], ""count"": 2}"
|
||||
wide-103,same_start_year_pair,True,,6.680194066000695,True,True,True,True,True,True,Aký spoločný rok začiatku štúdia majú osoby Martin Šarišský a Vladimír Ferko?,"{""answer"": ""Martin Šarišský a Vladimír Ferko majú spoločný rok začiatku štúdia 2021. Zdroje: https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky, https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko"", ""status"": ""ok"", ""claims"": [{""person"": ""Martin Šarišský"", ""start_year"": 2021}, {""person"": ""Vladimír Ferko"", ""start_year"": 2021}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""], ""count"": 2}"
|
||||
wide-104,same_start_year_pair,False,,9.48697051199997,True,True,True,True,True,False,Aký spoločný rok začiatku štúdia majú osoby Adrián Remiáš a Martin NaN1?,"{""answer"": ""Spoločný rok začiatku štúdia pre Adriána Remiáša a Martina NaN1 je 2018. Zdroje: https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias, https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday"", ""status"": ""ok"", ""claims"": [{""person"": ""Adrián Remiáš"", ""start_year"": 2018}, {""person"": ""Martin NaN1"", ""start_year"": 2018}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday""], ""count"": 1}"
|
||||
wide-105,same_start_year_pair,True,,6.5554323559990735,True,True,True,True,True,True,Porovnaj rovnaký rok začiatku štúdia osôb Dominik Nagy a Maroš Harahus.,"{""answer"": ""Dominik Nagy a Maroš Harahus začali štúdium v rovnakom roku 2016. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy, https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""status"": ""ok"", ""claims"": [{""person"": ""Dominik Nagy"", ""start_year"": 2016}, {""person"": ""Maroš Harahus"", ""start_year"": 2016}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""], ""count"": 2}"
|
||||
wide-106,same_start_year_pair,True,,9.503550268003892,True,True,True,True,True,True,Aký spoločný rok začiatku štúdia majú osoby Kamil Tomčufčík a Matúš Suchanič?,"{""answer"": ""Spoločný rok začiatku štúdia pre Kamil Tomčufčík a Matúš Suchanič je 2020. Zdroje: https://zp.kemt.fei.tuke.sk/students/2020/kamil_tomcufcik, https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""status"": ""ok"", ""claims"": [{""person"": ""Kamil Tomčufčík"", ""start_year"": 2020}, {""person"": ""Matúš Suchanič"", ""start_year"": 2020}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2020/kamil_tomcufcik"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""], ""count"": 2}"
|
||||
wide-107,same_start_year_pair,True,,6.221047974002431,True,True,True,True,True,True,Aký spoločný rok začiatku štúdia majú osoby Dominik Nagy a Márk Fehér?,"{""answer"": ""Dominik Nagy a Márk Fehér majú spoločný rok začiatku štúdia 2016. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy, https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""status"": ""ok"", ""claims"": [{""person"": ""Dominik Nagy"", ""start_year"": 2016}, {""person"": ""Márk Fehér"", ""start_year"": 2016}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher""], ""count"": 2}"
|
||||
wide-108,same_start_year_pair,True,,11.524189818002924,True,True,True,True,True,True,Porovnaj rovnaký rok začiatku štúdia osôb Artur Hyrenko a Manohar Gowdru Shridhara.,"{""answer"": ""Artur Hyrenko a Manohar Gowdru Shridhara začali štúdium v rovnakom roku 2021. Zdroje: https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko, https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu"", ""status"": ""ok"", ""claims"": [{""person"": ""Artur Hyrenko"", ""start_year"": 2021}, {""person"": ""Manohar Gowdru Shridhara"", ""start_year"": 2021}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/manohar_gowdru_shridharu""], ""count"": 2}"
|
||||
wide-109,same_start_year_pair,True,,5.475857990000804,True,True,True,True,True,True,Aký spoločný rok začiatku štúdia majú osoby Adrián Remiáš a Dávid Iľaš?,"{""answer"": ""Adrián Remiáš a Dávid Iľaš majú spoločný rok začiatku štúdia 2018. Zdroje: https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias, https://zp.kemt.fei.tuke.sk/students/2018/david_ilas"", ""status"": ""ok"", ""claims"": [{""person"": ""Adrián Remiáš"", ""start_year"": 2018}, {""person"": ""Dávid Iľaš"", ""start_year"": 2018}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_ilas""], ""count"": 2}"
|
||||
wide-110,same_start_year_pair,True,,10.211346320000303,True,True,True,True,True,True,Aký spoločný rok začiatku štúdia majú osoby Filip Tomáš a Samuel Horáni?,"{""answer"": ""Osoby Filip Tomáš a Samuel Horáni majú spoločný rok začiatku štúdia 2019. Zdroje: https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas, https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""status"": ""ok"", ""claims"": [{""person"": ""Filip Tomáš"", ""start_year"": 2019}, {""person"": ""Samuel Horáni"", ""start_year"": 2019}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani""], ""count"": 2}"
|
||||
wide-111,same_start_year_pair,True,,8.28008010499616,True,True,True,True,True,True,Porovnaj rovnaký rok začiatku štúdia osôb Dominik Nagy a Tomáš Kuchárik.,"{""answer"": ""Dominik Nagy a Tomáš Kuchárik začali štúdium v rovnakom roku 2016 (zdroje: https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy, https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik)."", ""status"": ""ok"", ""claims"": [{""person"": ""Dominik Nagy"", ""start_year"": 2016}, {""person"": ""Tomáš Kuchárik"", ""start_year"": 2016}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""], ""count"": 2}"
|
||||
wide-112,same_start_year_pair,True,,9.384743433998665,True,True,True,True,True,True,Aký spoločný rok začiatku štúdia majú osoby Jakub Maruniak a Tomáš Kuchárik?,"{""answer"": ""Jakub Maruniak a Tomáš Kuchárik majú spoločný rok začiatku štúdia 2016. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak, https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik"", ""status"": ""ok"", ""claims"": [{""person"": ""Jakub Maruniak"", ""start_year"": 2016}, {""person"": ""Tomáš Kuchárik"", ""start_year"": 2016}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""], ""count"": 1}"
|
||||
wide-115,person_title_year,True,,7.64530175300024,True,True,True,True,True,True,Uveď názov práce osoby Dárius Lindvai a rok práce pre rok 2021.,"{""answer"": ""Osoba Dárius Lindvai má v roku 2021 prácu s názvom \""Obnovenie interpunkcie pomocou hlbokých neurónových sietí\"". Zdroj: https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""status"": ""ok"", ""claims"": [{""person"": ""Dárius Lindvai"", ""title"": ""Obnovenie interpunkcie pomocou hlbokých neurónových sietí"", ""year"": 2021}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai""], ""count"": 1}"
|
||||
wide-116,person_title_year,True,,6.991201303004345,True,True,True,True,True,True,Aký názov práce a rok práce sú pri osobe Jakub Maruniak uvedené pre rok 2019?,"{""answer"": ""Pre rok 2019 je pri osobe Jakub Maruniak uvedený názov práce \""Rešerš\"" a rok 2019. Zdroj: https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""status"": ""ok"", ""claims"": [{""person"": ""Jakub Maruniak"", ""title"": ""Rešerš"", ""year"": 2019}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""], ""count"": 1}"
|
||||
wide-117,person_title_year,True,,7.595171244000085,True,True,True,True,True,True,Uveď názov práce osoby Andrii Pervashov a rok práce pre rok 2027.,"{""answer"": ""Osoba Andrii Pervashov má v roku 2027 prácu s názvom \""Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu\"" (zdroj: https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov)."", ""status"": ""ok"", ""claims"": [{""person"": ""Andrii Pervashov"", ""title"": ""Prepis reči pre tvorbu štruktúrovaného zdravotného záznamu"", ""year"": 2027}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""], ""count"": 1}"
|
||||
wide-118,person_title_year,True,,6.700285118997272,True,True,True,True,True,True,Uveď názov práce osoby Andrii Pervashov a rok práce pre rok 2025.,"{""answer"": ""Osoba Andrii Pervashov má v roku 2025 prácu s názvom \""Korekcia textu pomocou neurónových sietí\"". Zdroj: https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""status"": ""ok"", ""claims"": [{""person"": ""Andrii Pervashov"", ""title"": ""Korekcia textu pomocou neurónových sietí"", ""year"": 2025}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""], ""count"": 1}"
|
||||
wide-119,person_title_year,False,"JSONDecodeError: Expecting ',' delimiter: line 1 column 135 (char 134)",7.856277612998383,,,,,,,Aký názov diplomového projektu a rok práce sú pri osobe Ján Malinovský uvedené pre rok 2026?,null
|
||||
wide-120,person_title_year,True,,5.406756443000631,True,True,True,True,True,True,Uveď názov práce osoby Dávid Kostilník a rok práce pre rok 2025.,"{""answer"": ""Dávid Kostilník má v roku 2025 prácu s názvom \""Sémantické vyhľadávanie pomocou veľkých modelov\"". Zdroj: https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik"", ""status"": ""ok"", ""claims"": [{""person"": ""Dávid Kostilník"", ""title"": ""Sémantické vyhľadávanie pomocou veľkých modelov"", ""year"": 2025}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik""], ""count"": 1}"
|
||||
wide-121,person_title_year,True,,7.843929166003363,True,True,True,True,True,True,Uveď názov práce osoby Martin NaN1 a rok práce pre rok 2020.,"{""answer"": ""Osoba Martin NaN1 má v roku 2020 prácu s názvom \""Využitie najnovších nástrojov v rámci prirodzeného spracovania reči\"" (zdroj: https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday)."", ""status"": ""ok"", ""claims"": [{""person"": ""Martin NaN1"", ""title"": ""Využitie najnovších nástrojov v rámci prirodzeného spracovania reči"", ""year"": 2020}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday""], ""count"": 1}"
|
||||
wide-122,person_title_year,True,,5.50400585099851,True,True,True,True,True,True,Aký názov práce a rok práce sú pri osobe Oleksandr Dorybohov uvedené pre rok 2026?,"{""answer"": ""Pre osobu Oleksandr Dorybohov je v roku 2026 uvedená práca s názvom \""Automatické odpovede na otázky v právnej oblasti\"". Zdroj: https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""status"": ""ok"", ""claims"": [{""person"": ""Oleksandr Dorybohov"", ""title"": ""Automatické odpovede na otázky v právnej oblasti"", ""year"": 2026}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""], ""count"": 1}"
|
||||
wide-123,person_title_year,True,,7.8118334250029875,True,True,True,True,True,True,Uveď názov práce osoby Martin Šarišský a rok práce pre rok 2026.,"{""answer"": ""Martin Šarišský má v roku 2026 prácu s názvom \""Agentové systémy pomocou veľkého jazykového modelu\"" (zdroj: https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky)."", ""status"": ""ok"", ""claims"": [{""person"": ""Martin Šarišský"", ""title"": ""Agentové systémy pomocou veľkého jazykového modelu"", ""year"": 2026}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""], ""count"": 1}"
|
||||
wide-124,person_title_year,True,,5.611420686000201,True,True,True,True,True,True,Uveď názov práce osoby Daniil Huzenko a rok práce pre rok 2025.,"{""answer"": ""Daniil Huzenko má v roku 2025 prácu s názvom \""Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia\"". Zdroj: https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""status"": ""ok"", ""claims"": [{""person"": ""Daniil Huzenko"", ""title"": ""Testovanie hybridného klaudu s využiťím kombinácie verejného a privátneho riešenia"", ""year"": 2025}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""], ""count"": 1}"
|
||||
wide-125,person_title_year,True,,7.626659750996623,True,True,True,True,True,True,Aký názov práce a rok práce sú pri osobe Márk Fehér uvedené pre rok 2022?,"{""answer"": ""Pre osobu Márk Fehér je v roku 2022 uvedená práca s názvom \""Klasifikácia textu metódami strojového učenia\"" (zdroj: https://zp.kemt.fei.tuke.sk/students/2016/mark_feher)."", ""status"": ""ok"", ""claims"": [{""person"": ""Márk Fehér"", ""title"": ""Klasifikácia textu metódami strojového učenia"", ""year"": 2022}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher""], ""count"": 1}"
|
||||
wide-126,person_title_year,True,,5.4480505640021875,True,True,True,True,True,True,Uveď názov práce osoby Michal Stromko a rok práce pre rok 2022.,"{""answer"": ""Michal Stromko v roku 2022 vydal prácu s názvom \""Indexovanie slovenského textu pomocou Elasticsearch\"". Zdroj: https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""status"": ""ok"", ""claims"": [{""person"": ""Michal Stromko"", ""title"": ""Indexovanie slovenského textu pomocou Elasticsearch"", ""year"": 2022}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""], ""count"": 1}"
|
||||
wide-127,person_title_year,True,,7.319815613998799,True,True,True,True,True,True,Uveď názov práce osoby Samuel Džurina a rok práce pre rok 2026.,"{""answer"": ""Samuel Džurina má v roku 2026 prácu s názvom \""Dialógový systém pre podporu firemných procesov\"" (zdroj: https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina)."", ""status"": ""ok"", ""claims"": [{""person"": ""Samuel Džurina"", ""title"": ""Dialógový systém pre podporu firemných procesov"", ""year"": 2026}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""], ""count"": 1}"
|
||||
wide-128,person_title_year,True,,5.924834024001029,True,True,True,True,True,True,Aký názov práce a rok práce sú pri osobe Kristián Sopkovič uvedené pre rok 2022?,"{""answer"": ""Pre rok 2022 je pri osobe Kristián Sopkovič uvedená práca s názvom \""Model Spacy pre spracovanie prirodzeného jazyka v slovenčine\"". Zdroj: https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""status"": ""ok"", ""claims"": [{""person"": ""Kristián Sopkovič"", ""title"": ""Model Spacy pre spracovanie prirodzeného jazyka v slovenčine"", ""year"": 2022}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""], ""count"": 1}"
|
||||
wide-129,person_title_year,True,,8.256344303001242,True,True,True,True,True,True,Uveď názov diplomového projektu osoby Maroš Harahus a rok práce pre rok 2020.,"{""answer"": ""Maroš Harahus v roku 2020 vypracoval diplomový projekt s názvom „Doplnenie podpory morfologického značkovania slovenského jazyka do nlp frameworku (spacy alebo flair)\"". Zdroj: https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"", ""status"": ""ok"", ""claims"": [{""person"": ""Maroš Harahus"", ""title"": ""Doplnenie podpory morfologického značkovania slovenského jazyka do nlp frameworku (spacy alebo flair)"", ""year"": 2020}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus""], ""count"": 1}"
|
||||
wide-130,person_title_year,True,,5.6732517479977105,True,True,True,True,True,True,Uveď názov práce osoby Matej Kobyľan a rok práce pre rok 2023.,"{""answer"": ""Matej Kobyľan v roku 2023 vydal prácu s názvom \""Systém pre monitoring médií\"" (zdroj: https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan)."", ""status"": ""ok"", ""claims"": [{""person"": ""Matej Kobyľan"", ""title"": ""Systém pre monitoring médií"", ""year"": 2023}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""], ""count"": 1}"
|
||||
wide-131,person_title_year,True,,8.2095386889996,True,True,True,True,True,True,Aký názov práce a rok práce sú pri osobe Eduard Matovka uvedené pre rok 2024?,"{""answer"": ""Pre Eduarda Matovku je v roku 2024 uvedená práca s názvom \""Slovenská konverzačná umelá inteligencia\"" (zdroj: https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka)."", ""status"": ""ok"", ""claims"": [{""person"": ""Eduard Matovka"", ""title"": ""Slovenská konverzačná umelá inteligencia"", ""year"": 2024}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka""], ""count"": 1}"
|
||||
wide-132,person_title_year,True,,4.313341328997922,True,True,True,True,True,True,Uveď názov práce osoby Patrik Pavlišin a rok práce pre rok 2022.,"{""answer"": ""Patrik Pavlišin v roku 2022 vydal prácu s názvom „Neurónový strojový preklad“ (zdroj: https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin)."", ""status"": ""ok"", ""claims"": [{""person"": ""Patrik Pavlišin"", ""title"": ""Neurónový strojový preklad"", ""year"": 2022}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""], ""count"": 1}"
|
||||
wide-133,person_title_year,True,,8.382512608994148,True,True,True,True,True,True,Uveď názov práce osoby Matej Ščišľak a rok práce pre rok 2024.,"{""answer"": ""Matej Ščišľak v roku 2024 vypracoval prácu s názvom \""Dialógový systém pre potreby samosprávy\"". Zdroj: https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""status"": ""ok"", ""claims"": [{""person"": ""Matej Ščišľak"", ""title"": ""Dialógový systém pre potreby samosprávy"", ""year"": 2024}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""], ""count"": 1}"
|
||||
wide-134,person_title_year,True,,4.108209114005149,True,True,True,True,True,True,Aký názov práce a rok práce sú pri osobe Matúš Suchanič uvedené pre rok 2023?,"{""answer"": ""Pre rok 2023 je pri osobe Matúš Suchanič uvedená práca s názvom \""Automatická kategorizácia slovenského textu\"" (zdroj: https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic)."", ""status"": ""ok"", ""claims"": [{""person"": ""Matúš Suchanič"", ""title"": ""Automatická kategorizácia slovenského textu"", ""year"": 2023}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""], ""count"": 1}"
|
||||
wide-135,person_title_year,True,,7.9910924850046285,True,True,True,True,True,True,Uveď názov práce osoby Alina Vitko a rok práce pre rok 2021.,"{""answer"": ""Osoba Alina Vitko má v roku 2021 prácu s názvom \""Vytovrenie prehľadu existujúcich systémov QA.\"" (zdroj: https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko)."", ""status"": ""ok"", ""claims"": [{""person"": ""Alina Vitko"", ""title"": ""Vytovrenie prehľadu existujúcich systémov QA."", ""year"": 2021}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""], ""count"": 1}"
|
||||
wide-136,person_title_year,True,,5.380558614997426,True,True,True,True,True,True,Uveď názov diplomového projektu osoby Lukáš Pokrývka a rok práce pre rok 2020.,"{""answer"": ""Lukáš Pokrývka v roku 2020 vypracoval diplomový projekt s názvom \""Paralelné trénovanie neurónových sietí pomocou knižnice Pytorch.\"" (zdroj: https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka)"", ""status"": ""ok"", ""claims"": [{""person"": ""Lukáš Pokrývka"", ""title"": ""Paralelné trénovanie neurónových sietí pomocou knižnice Pytorch."", ""year"": 2020}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""], ""count"": 1}"
|
||||
wide-139,person_keyword_title,False,JSONDecodeError: Expecting property name enclosed in double quotes: line 1 column 119 (char 118),8.51874773700547,,,,,,,Uveď názov práce osoby Dominik Nagy v roku 2022 s kľúčovým slovom nlp.,null
|
||||
wide-140,person_keyword_title,True,,5.7996268090064405,True,True,True,True,True,True,Aký názov práce osoby Michal Stromko v roku 2022 súvisí s kľúčovým slovom nlp?,"{""answer"": ""Michal Stromko v roku 2022 vypracoval prácu s názvom \""Indexovanie slovenského textu pomocou Elasticsearch\"", ktorá súvisí s kľúčovým slovom NLP. Zdroj: https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""status"": ""ok"", ""claims"": [{""person"": ""Michal Stromko"", ""title"": ""Indexovanie slovenského textu pomocou Elasticsearch"", ""year"": 2022, ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""], ""count"": 1}"
|
||||
wide-141,person_keyword_title,False,JSONDecodeError: Expecting property name enclosed in double quotes: line 1 column 113 (char 112),8.499829861000762,,,,,,,Uveď názov práce osoby Martin Šarišský v roku 2026 s kľúčovým slovom rasa.,null
|
||||
wide-142,person_keyword_title,False,,8.239055701000325,False,True,False,True,True,True,Uveď názov práce osoby Dárius Lindvai v roku 2019 s kľúčovým slovom lstm.,"{""answer"": ""Na základe dodaných grafových faktov nie je možné určiť názov práce osoby Dárius Lindvai z roku 2019 s kľúčovým slovom lstm, pretože v grafe chýba záznam, ktorý by spájal rok 2019, kľúčové slovo lstm a názov práce tej istej osoby. Zdroj https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai uvádza pre rok 2019 prácu s názvom 'rešerš', ale neobsahuje kľúčové slovo lstm. Zdroj https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial uvádza kľúčové slovo lstm, ale neuvádza rok 2019 ani názov práce."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial""], ""count"": 0}"
|
||||
wide-143,person_keyword_title,False,,9.427794609000557,False,True,True,True,True,True,Aký názov práce osoby Dominik Nagy v roku 2022 súvisí s kľúčovým slovom seq2seq?,"{""answer"": ""V roku 2022 má Dominik Nagy prácu s názvom „Neurónový strojový preklad pomocou knižnice Fairseq“ [1], ktorá súvisí s kľúčovým slovom „seq2seq“ [2]."", ""status"": ""ok"", ""claims"": [{""person"": ""Dominik Nagy"", ""title"": ""Neurónový strojový preklad pomocou knižnice Fairseq"", ""year"": 2022}, {""person"": ""Dominik Nagy"", ""keyword"": ""seq2seq""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy/timovy_projekt""], ""count"": 1}"
|
||||
wide-144,person_keyword_title,True,,9.193312716000946,True,True,True,True,True,True,Uveď názov práce osoby Dárius Lindvai v roku 2021 s kľúčovým slovom interpunction.,"{""answer"": ""Dárius Lindvai v roku 2021 vypracoval prácu s názvom „Obnovenie interpunkcie pomocou hlbokých neurónových sietí“, ktorá má kľúčové slovo interpunction. Zdroj: https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""status"": ""ok"", ""claims"": [{""person"": ""Dárius Lindvai"", ""title"": ""Obnovenie interpunkcie pomocou hlbokých neurónových sietí"", ""year"": 2021, ""keyword"": ""interpunction""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai""], ""count"": 1}"
|
||||
wide-145,person_keyword_title,False,,10.574943351995898,False,True,False,True,True,True,Uveď názov práce osoby Dárius Lindvai v roku 2019 s kľúčovým slovom python.,"{""answer"": ""Na základe dodaných grafových faktov neexistuje práca osoby Dárius Lindvai z roku 2019, ktorá by mala kľúčové slovo python. Osoba Dárius Lindvai má v roku 2019 prácu s názvom \""rešerš\"" (zdroj: https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai), ale táto práca nemá priradené kľúčové slovo python. Kľúčové slovo python je priradené k dokumentu v ceste pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md (zdroj: https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial), ale pre tento dokument nie je v grafe uvedený rok 2019 ani názov práce."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial""], ""count"": 0}"
|
||||
wide-146,person_keyword_title,True,,7.7894158019989845,True,True,True,True,True,True,Aký názov práce osoby Simona Bobrovčanová v roku 2026 súvisí s kľúčovým slovom lm?,"{""answer"": ""Názov práce osoby Simona Bobrovčanová v roku 2026 súvisiacej s kľúčovým slovom LM je \""Automatická sumarizácia slovenského textu\"". Zdroj: https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""status"": ""ok"", ""claims"": [{""person"": ""Simona Bobrovčanová"", ""title"": ""Automatická sumarizácia slovenského textu"", ""year"": 2026, ""keyword"": ""LM""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""], ""count"": 1}"
|
||||
wide-147,person_keyword_title,True,,10.804093170001579,True,True,True,True,True,True,Uveď názov práce osoby Martin NaN1 v roku 2020 s kľúčovým slovom gpt.,"{""answer"": ""Martin NaN1 v roku 2020 vydal prácu s názvom \""Využitie najnovších nástrojov v rámci prirodzeného spracovania reči\"", ktorá obsahuje kľúčové slovo gpt. Zdroj: https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday"", ""status"": ""ok"", ""claims"": [{""person"": ""Martin NaN1"", ""title"": ""Využitie najnovších nástrojov v rámci prirodzeného spracovania reči"", ""year"": 2020, ""keyword"": ""gpt""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday""], ""count"": 1}"
|
||||
wide-148,person_keyword_title,True,,4.910634503998153,True,True,True,True,True,True,Uveď názov práce osoby Patrik Pavlišin v roku 2020 s kľúčovým slovom translation.,"{""answer"": ""Patrik Pavlišin v roku 2020 vydal prácu s názvom \""Metódy automatického prekladu\"", ktorá má kľúčové slovo translation. Zdroj: https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""status"": ""ok"", ""claims"": [{""person"": ""Patrik Pavlišin"", ""title"": ""Metódy automatického prekladu"", ""year"": 2020, ""keyword"": ""translation""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""], ""count"": 1}"
|
||||
wide-149,person_keyword_title,True,,8.948702435998712,True,True,True,True,True,True,Aký názov práce osoby Michal Stromko v roku 2022 súvisí s kľúčovým slovom ir?,"{""answer"": ""Michal Stromko v roku 2022 vypracoval prácu s názvom \""Indexovanie slovenského textu pomocou Elasticsearch\"", ktorá súvisí s kľúčovým slovom ir. Zdroj: https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""status"": ""ok"", ""claims"": [{""person"": ""Michal Stromko"", ""title"": ""Indexovanie slovenského textu pomocou Elasticsearch"", ""year"": 2022, ""keyword"": ""ir""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""], ""count"": 1}"
|
||||
wide-150,person_keyword_title,True,,6.8871356439995,True,True,True,True,True,True,Uveď názov práce osoby Samuel Vasiľ v roku 2026 s kľúčovým slovom nlp.,"{""answer"": ""Samuel Vasiľ má v roku 2026 prácu s názvom \""Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI\"" s kľúčovým slovom NLP. Zdroj: https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil"", ""status"": ""ok"", ""claims"": [{""person"": ""Samuel Vasiľ"", ""title"": ""Orchestrácia veľkých jazykových modelov pomocou model context protokolu s využitím OpenWebUI"", ""year"": 2026, ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/samuel_vasil""], ""count"": 1}"
|
||||
wide-151,person_keyword_title,True,,7.582760322999093,True,True,True,True,True,True,Uveď názov práce osoby Michal Stromko v roku 2022 s kľúčovým slovom demo.,"{""answer"": ""Michal Stromko v roku 2022 vypracoval prácu s názvom \""Indexovanie slovenského textu pomocou Elasticsearch\"", ktorá obsahuje kľúčové slovo demo. Zdroj: https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""status"": ""ok"", ""claims"": [{""person"": ""Michal Stromko"", ""title"": ""Indexovanie slovenského textu pomocou Elasticsearch"", ""year"": 2022, ""keyword"": ""demo""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""], ""count"": 1}"
|
||||
wide-152,person_keyword_title,True,,7.1138568820024375,True,True,True,True,True,True,Aký názov práce osoby Dávid Iľaš v roku 2023 súvisí s kľúčovým slovom nlp?,"{""answer"": ""Osoba Dávid Iľaš má v roku 2023 prácu s názvom \""Rozpoznávanie emócií z textu.\"", ktorá súvisí s kľúčovým slovom NLP. Zdroj: https://zp.kemt.fei.tuke.sk/students/2018/david_ilas"", ""status"": ""ok"", ""claims"": [{""person"": ""Dávid Iľaš"", ""title"": ""Rozpoznávanie emócií z textu."", ""year"": 2023, ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/david_ilas""], ""count"": 1}"
|
||||
wide-153,person_keyword_title,True,,7.93297110900312,True,True,True,True,True,True,Uveď názov práce osoby Michal Stromko v roku 2024 s kľúčovým slovom cloud.,"{""answer"": ""Michal Stromko v roku 2024 vypracoval prácu s názvom \""Sémantické vyhľadávanie v slovenskom texte\"", ktorá obsahuje kľúčové slovo cloud. Zdroj: https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""status"": ""ok"", ""claims"": [{""person"": ""Michal Stromko"", ""title"": ""Sémantické vyhľadávanie v slovenskom texte"", ""year"": 2024, ""keyword"": ""cloud""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""], ""count"": 1}"
|
||||
wide-154,person_keyword_title,True,,7.315907237993088,True,True,True,True,True,True,Uveď názov práce osoby Lukáš Pokrývka v roku 2019 s kľúčovým slovom cloud.,"{""answer"": ""Názov práce Lukáša Pokrývku z roku 2019 s kľúčovým slovom cloud je Paralelné spracovanie prirodzeného jazyka. Zdroj: https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""status"": ""ok"", ""claims"": [{""person"": ""Lukáš Pokrývka"", ""title"": ""Paralelné spracovanie prirodzeného jazyka"", ""year"": 2019, ""keyword"": ""cloud""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""], ""count"": 1}"
|
||||
wide-155,person_keyword_title,False,,8.323158056002285,True,True,True,True,True,False,Aký názov práce osoby Matej Ščišľak v roku 2026 súvisí s kľúčovým slovom chatbot?,"{""answer"": ""Osoba Matej Ščišľak má v roku 2026 prácu s názvom \""Znalostné grafy pre zlepšenie vyhľadávania právnych informáci.\"", ktorá súvisí s kľúčovým slovom chatbot. Zdroj: https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""status"": ""ok"", ""claims"": [{""person"": ""Matej Ščišľak"", ""title"": ""Znalostné grafy pre zlepšenie vyhľadávania právnych informácií."", ""year"": 2026, ""keyword"": ""chatbot""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""], ""count"": 1}"
|
||||
wide-156,person_keyword_title,True,,6.521070124996186,True,True,True,True,True,True,Uveď názov práce osoby Oleh Poiasnik v roku 2027 s kľúčovým slovom rag.,"{""answer"": ""Oleh Poiasnik má v roku 2027 prácu s názvom „Expertný agentový systém na podporu rozhodovania v lekárni“ s kľúčovým slovom RAG. Zdroj: https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik"", ""status"": ""ok"", ""claims"": [{""person"": ""Oleh Poiasnik"", ""title"": ""Expertný agentový systém na podporu rozhodovania v lekárni"", ""year"": 2027, ""keyword"": ""RAG""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""], ""count"": 1}"
|
||||
wide-157,person_keyword_title,True,,8.291034098998352,True,True,True,True,True,True,Uveď názov práce osoby Ondrej Megela v roku 2023 s kľúčovým slovom lm.,"{""answer"": ""Ondrej Megela v roku 2023 vypracoval prácu s názvom \""Automatické generovanie otázok v slovenskom jazyku\"", ktorá obsahuje kľúčové slovo LM. Zdroj: https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""status"": ""ok"", ""claims"": [{""person"": ""Ondrej Megela"", ""title"": ""Automatické generovanie otázok v slovenskom jazyku"", ""year"": 2023, ""keyword"": ""LM""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""], ""count"": 1}"
|
||||
wide-158,person_keyword_title,True,,6.099724388004688,True,True,True,True,True,True,Aký názov práce osoby Ján Malinovský v roku 2026 súvisí s kľúčovým slovom nlp?,"{""answer"": ""Názov práce Ján Malinovský z roku 2026 súvisiaci s kľúčovým slovom NLP je „Grafové vyhľadávanie pre podporu vzdelávania“ (zdroj: https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky)."", ""status"": ""ok"", ""claims"": [{""person"": ""Ján Malinovský"", ""title"": ""Grafové vyhľadávanie pre podporu vzdelávania"", ""year"": 2026, ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""], ""count"": 1}"
|
||||
wide-159,person_keyword_title,False,,9.068388027997571,False,True,True,True,True,True,Uveď názov práce osoby Than Trung Thanh v roku 2020 s kľúčovým slovom anotation.,"{""answer"": ""Osoba Than Trung Thanh v roku 2020 vypracovala prácu s názvom \""Rozpoznávanie pomenovaných entít v slovenskom jazyku pomocou nástrojov Spacy a Prodigy\"", ktorá obsahuje kľúčové slovo anotation. Zdroj: https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""status"": ""ok"", ""claims"": [{""person"": ""Than Trung Thanh"", ""title"": ""Rozpoznávanie pomenovaných entít v slovenskom jazyku pomocou nástrojov Spacy a Prodigy"", ""year"": 2020}, {""person"": ""Than Trung Thanh"", ""keyword"": ""anotation""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh""], ""count"": 1}"
|
||||
wide-160,person_keyword_title,True,,6.224928866002301,True,True,True,True,True,True,Uveď názov práce osoby Andrii Pervashov v roku 2025 s kľúčovým slovom nlp.,"{""answer"": ""Andrii Pervashov má v roku 2025 prácu s názvom \""Korekcia textu pomocou neurónových sietí\"" a kľúčovým slovom NLP. Zdroj: https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""status"": ""ok"", ""claims"": [{""person"": ""Andrii Pervashov"", ""title"": ""Korekcia textu pomocou neurónových sietí"", ""year"": 2025, ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""], ""count"": 1}"
|
||||
wide-161,person_keyword_title,False,,9.423955840997223,True,True,True,True,True,False,Aký názov práce osoby Kristián Sopkovič v roku 2024 súvisí s kľúčovým slovom spacy?,"{""answer"": ""Kristián Sopkovič v roku 2024 vypracoval prácu s názvom „Neurónové vyhľadávanie na základe sémantickej podobnosti vektorov."", ""status"": ""ok"", ""claims"": [{""person"": ""Kristián Sopkovič"", ""title"": ""Neurónové vyhľadávanie na základe sémantickej podobnosti vektorov."", ""year"": 2024, ""keyword"": ""Spacy""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""], ""count"": 1}"
|
||||
wide-162,person_keyword_title,True,,6.191365853002935,True,True,True,True,True,True,Uveď názov práce osoby Simona Bobrovčanová v roku 2026 s kľúčovým slovom nlp.,"{""answer"": ""Osoba Simona Bobrovčanová má v roku 2026 prácu s názvom \""Automatická sumarizácia slovenského textu\"" a kľúčovým slovom NLP. Zdroj: https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova"", ""status"": ""ok"", ""claims"": [{""person"": ""Simona Bobrovčanová"", ""title"": ""Automatická sumarizácia slovenského textu"", ""year"": 2026, ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2023/simona_bobrovcanova""], ""count"": 1}"
|
||||
wide-163,person_keyword_title,False,,10.652335631006281,False,True,True,True,True,True,Uveď názov práce osoby Rostyslav Rodzhuk v roku 2025 s kľúčovým slovom nlp.,"{""answer"": ""Osoba Rostyslav Rodzhuk má v roku 2025 prácu s názvom \""Veľký jazykový model ako inteligentný agent\"" a kľúčovým slovom NLP. Zdroj: https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk"", ""status"": ""ok"", ""claims"": [{""person"": ""Rostyslav Rodzhuk"", ""title"": ""Veľký jazykový model ako inteligentný agent"", ""year"": 2025}, {""person"": ""Rostyslav Rodzhuk"", ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2023/rostyslav_rodzhuk""], ""count"": 1}"
|
||||
wide-164,person_keyword_title,True,,6.74385710900242,True,True,True,True,True,True,Aký názov práce osoby Patrik Pokrivčák v roku 2025 súvisí s kľúčovým slovom hate?,"{""answer"": ""Osoba Patrik Pokrivčák má v roku 2025 prácu s názvom \""Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov\"", ktorá súvisí s kľúčovým slovom hate. Zdroj: https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak"", ""status"": ""ok"", ""claims"": [{""person"": ""Patrik Pokrivčák"", ""title"": ""Rozpoznávanie nenávistnej reči pomocou veľkých jazykových modelov"", ""year"": 2025, ""keyword"": ""hate""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak""], ""count"": 1}"
|
||||
wide-165,person_keyword_title,True,,9.475837231002515,True,True,True,True,True,True,Uveď názov práce osoby Dárius Lindvai v roku 2019 s kľúčovým slovom nn.,"{""answer"": ""Osoba Dárius Lindvai má v roku 2019 prácu s názvom \""rešerš\"" a kľúčovým slovom \""nn\"". Zdroj: https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""status"": ""ok"", ""claims"": [{""person"": ""Dárius Lindvai"", ""title"": ""rešerš"", ""year"": 2019, ""keyword"": ""nn""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai""], ""count"": 1}"
|
||||
wide-166,person_keyword_title,True,,5.933394573999976,True,True,True,True,True,True,Uveď názov práce osoby Oleksandr Dorybohov v roku 2026 s kľúčovým slovom nlp.,"{""answer"": ""Oleksandr Dorybohov má v roku 2026 prácu s názvom \""Automatické odpovede na otázky v právnej oblasti\"" s kľúčovým slovom NLP. Zdroj: https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""status"": ""ok"", ""claims"": [{""person"": ""Oleksandr Dorybohov"", ""title"": ""Automatické odpovede na otázky v právnej oblasti"", ""year"": 2026, ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""], ""count"": 1}"
|
||||
wide-167,person_keyword_title,True,,8.969329906001803,True,True,True,True,True,True,Aký názov práce osoby Lukáš Pokrývka v roku 2020 súvisí s kľúčovým slovom gpu?,"{""answer"": ""Názov práce Lukáša Pokrývku z roku 2020 súvisiacej s kľúčovým slovom GPU je \""Paralelné trénovanie neurónových sietí pomocou knižnice Pytorch.\"" (zdroj: https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka)"", ""status"": ""ok"", ""claims"": [{""person"": ""Lukáš Pokrývka"", ""title"": ""Paralelné trénovanie neurónových sietí pomocou knižnice Pytorch."", ""year"": 2020, ""keyword"": ""GPU""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""], ""count"": 1}"
|
||||
wide-168,person_keyword_title,True,,6.5191473989980295,True,True,True,True,True,True,Uveď názov práce osoby Matej Ščišľak v roku 2024 s kľúčovým slovom nlp.,"{""answer"": ""Matej Ščišľak v roku 2024 vytvoril prácu s názvom \""Dialógový systém pre potreby samosprávy\"", ktorá má kľúčové slovo NLP. Zdroj: https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""status"": ""ok"", ""claims"": [{""person"": ""Matej Ščišľak"", ""title"": ""Dialógový systém pre potreby samosprávy"", ""year"": 2024, ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""], ""count"": 1}"
|
||||
wide-171,document_author_category_multi_hop,True,,7.691536218000692,True,True,True,True,True,True,Ktorý autor dokumentu je pri osobe Dávid Omasta spojený s kategóriou dp2023?,"{""answer"": ""Pri osobe Dávid Omasta a kategórii dp2023 je ako autor dokumentu uvedený Daniel Hladek. Zdroj: https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""status"": ""ok"", ""claims"": [{""person"": ""Dávid Omasta"", ""category"": ""dp2023"", ""document_author"": ""Daniel Hladek""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""], ""count"": 1}"
|
||||
wide-172,document_author_category_multi_hop,True,,5.241324082999199,True,True,True,True,True,True,"Kto je autor dokumentu osoby Matúš Suchanič, ktorý patrí do kategórie vp2022?","{""answer"": ""Autorom dokumentu osoby Matúš Suchanič v kategórii vp2022 je Daniel Hladek. Zdroj: https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""status"": ""ok"", ""claims"": [{""person"": ""Matúš Suchanič"", ""document_author"": ""Daniel Hladek"", ""category"": ""vp2022""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""], ""count"": 1}"
|
||||
wide-173,document_author_category_multi_hop,True,,6.954509536997648,True,True,True,True,True,True,Ktorý autor dokumentu je pri osobe Kamil Tomčufčík spojený s kategóriou dp2025?,"{""answer"": ""Autorom dokumentu spojeným s osobou Kamil Tomčufčík a kategóriou dp2025 je Daniel Hladek. Zdroj: https://zp.kemt.fei.tuke.sk/students/2020/kamil_tomcufcik"", ""status"": ""ok"", ""claims"": [{""person"": ""Kamil Tomčufčík"", ""category"": ""dp2025"", ""document_author"": ""Daniel Hladek""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2020/kamil_tomcufcik""], ""count"": 1}"
|
||||
wide-174,document_author_category_multi_hop,True,,5.2895403880029335,True,True,True,True,True,True,Ktorý autor dokumentu je pri osobe Artur Hyrenko spojený s kategóriou dp2026?,"{""answer"": ""Autorom dokumentu spojeným s osobou Artur Hyrenko a kategóriou dp2026 je Daniel Hladek. Zdroj: https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""status"": ""ok"", ""claims"": [{""person"": ""Artur Hyrenko"", ""category"": ""dp2026"", ""document_author"": ""Daniel Hladek""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko""], ""count"": 1}"
|
||||
wide-175,document_author_category_multi_hop,True,,7.420917933995952,True,True,True,True,True,True,"Kto je autor dokumentu osoby Serhii Yemets, ktorý patrí do kategórie bp2025?","{""answer"": ""Autorom dokumentu osoby Serhii Yemets v kategórii bp2025 je Daniel Hladek. Zdroj: https://zp.kemt.fei.tuke.sk/students/2022/serhii_yemets"", ""status"": ""ok"", ""claims"": [{""person"": ""Serhii Yemets"", ""document_author"": ""Daniel Hladek"", ""category"": ""bp2025""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/serhii_yemets""], ""count"": 1}"
|
||||
wide-176,document_author_category_multi_hop,True,,7.267075166004361,True,True,True,True,True,True,Ktorý autor dokumentu je pri osobe Dárius Lindvai spojený s kategóriou tp2020?,"{""answer"": ""Pri osobe Dárius Lindvai spojená s kategóriou tp2020 je dokumentový autor Dárius Lindvai, čo je potvrdené v zdrojoch: https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers a https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial."", ""status"": ""ok"", ""claims"": [{""person"": ""Dárius Lindvai"", ""category"": ""tp2020"", ""document_author"": ""Dárius Lindvai""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/resers"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial""], ""count"": 1}"
|
||||
wide-177,document_author_category_multi_hop,True,,7.992678946000524,True,True,True,True,True,True,Ktorý autor dokumentu je pri osobe Maroš Harahus spojený s kategóriou tp2020?,"{""answer"": ""Autorom dokumentu spojeným s osobou Maroš Harahus a kategóriou tp2020 je Maroš Harahus. Zdroj: https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt"", ""status"": ""ok"", ""claims"": [{""person"": ""Maroš Harahus"", ""document_author"": ""Maroš Harahus"", ""category"": ""tp2020""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus/timovy_projekt""], ""count"": 1}"
|
||||
wide-178,document_author_category_multi_hop,False,,7.213448406997486,False,True,True,True,True,True,"Kto je autor dokumentu osoby Patrik Pokrivčák, ktorý patrí do kategórie dp2025?","{""answer"": ""Autorom dokumentu osoby Patrik Pokrivčák v kategórii dp2025 je Daniel Hladek. Zdroj: https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak"", ""status"": ""ok"", ""claims"": [{""person"": ""Daniel Hladek"", ""document_author"": ""Daniel Hladek"", ""category"": ""dp2025""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak""], ""count"": 1}"
|
||||
wide-179,document_author_category_multi_hop,True,,5.843621088999498,True,True,True,True,True,True,Ktorý autor dokumentu je pri osobe Dávid Stromp spojený s kategóriou bp2022?,"{""answer"": ""Autorom dokumentu spojeným s osobou Dávid Stromp a kategóriou bp2022 je Maroš Harahus. Zdroj: https://zp.kemt.fei.tuke.sk/students/2019/david_stromp"", ""status"": ""ok"", ""claims"": [{""person"": ""Dávid Stromp"", ""category"": ""bp2022"", ""document_author"": ""Maroš Harahus""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/david_stromp""], ""count"": 1}"
|
||||
wide-180,document_author_category_multi_hop,True,,6.530649876003736,True,True,True,True,True,True,Ktorý autor dokumentu je pri osobe Dávid Iľaš spojený s kategóriou dp2023?,"{""answer"": ""Pri osobe Dávid Iľaš je s kategóriou dp2023 spojený dokumentový autor Daniel Hladek. Zdroj: https://zp.kemt.fei.tuke.sk/students/2018/david_ilas"", ""status"": ""ok"", ""claims"": [{""person"": ""Dávid Iľaš"", ""document_author"": ""Daniel Hladek"", ""category"": ""dp2023""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/david_ilas""], ""count"": 1}"
|
||||
wide-181,document_author_category_multi_hop,False,,5.399389828002313,False,True,True,True,True,True,"Kto je autor dokumentu osoby Jakub Maruniak, ktorý patrí do kategórie dp2021?","{""answer"": ""Autorom dokumentu osoby Jakub Maruniak v kategórii dp2021 je Daniel Hladek. Zdroj: https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""status"": ""ok"", ""claims"": [{""person"": ""Daniel Hladek"", ""document_author"": ""Daniel Hladek"", ""category"": ""dp2021""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""], ""count"": 1}"
|
||||
wide-182,document_author_category_multi_hop,True,,6.547648766005295,True,True,True,True,True,True,Ktorý autor dokumentu je pri osobe Valerii Kutsenko spojený s kategóriou dp2027?,"{""answer"": ""Autorom dokumentu spojeným s osobou Valerii Kutsenko a kategóriou dp2027 je Daniel Hladek. Zdroj: https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""status"": ""ok"", ""claims"": [{""person"": ""Valerii Kutsenko"", ""document_author"": ""Daniel Hladek"", ""category"": ""dp2027""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""], ""count"": 1}"
|
||||
wide-183,document_author_category_multi_hop,True,,5.38755500499974,True,True,True,True,True,True,Ktorý autor dokumentu je pri osobe Martin Jancura spojený s kategóriou bp2021?,"{""answer"": ""Autorom dokumentu spojeným s osobou Martin Jancura a kategóriou bp2021 je Daniel Hladek. Zdroj: https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""status"": ""ok"", ""claims"": [{""person"": ""Martin Jancura"", ""document_author"": ""Daniel Hladek"", ""category"": ""bp2021""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""], ""count"": 1}"
|
||||
wide-184,document_author_category_multi_hop,True,,6.554086822005047,True,True,True,True,True,True,"Kto je autor dokumentu osoby Nikita Bodnar, ktorý patrí do kategórie vp2023?","{""answer"": ""Autorom dokumentu osoby Nikita Bodnar v kategórii vp2023 je Daniel Hladek. Zdroj: https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar"", ""status"": ""ok"", ""claims"": [{""person"": ""Nikita Bodnar"", ""document_author"": ""Daniel Hladek"", ""category"": ""vp2023""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/nikita_bodnar""], ""count"": 1}"
|
||||
wide-185,document_author_category_multi_hop,True,,5.499499361001654,True,True,True,True,True,True,Ktorý autor dokumentu je pri osobe Matej Ščišľak spojený s kategóriou dp2026?,"{""answer"": ""Pri osobe Matej Ščišľak je s kategóriou dp2026 spojený dokumentový autor Daniel Hladek. Zdroj: https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""status"": ""ok"", ""claims"": [{""person"": ""Matej Ščišľak"", ""category"": ""dp2026"", ""document_author"": ""Daniel Hladek""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""], ""count"": 1}"
|
||||
wide-186,document_author_category_multi_hop,True,,7.084702929998457,True,True,True,True,True,True,Ktorý autor dokumentu je pri osobe Lukáš Pokrývka spojený s kategóriou tp2020?,"{""answer"": ""Autorom dokumentu spojeným s osobou Lukáš Pokrývka a kategóriou tp2020 je Lukáš Pokrývka (zdroj: https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt)."", ""status"": ""ok"", ""claims"": [{""person"": ""Lukáš Pokrývka"", ""document_author"": ""Lukáš Pokrývka"", ""category"": ""tp2020""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka/timovy_projekt""], ""count"": 1}"
|
||||
wide-187,document_author_category_multi_hop,True,,5.604316528995696,True,True,True,True,True,True,"Kto je autor dokumentu osoby Andrii Pervashov, ktorý patrí do kategórie dp2027?","{""answer"": ""Autorom dokumentu osoby Andrii Pervashov v kategórii dp2027 je Daniel Hladek. Zdroj: https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""status"": ""ok"", ""claims"": [{""person"": ""Andrii Pervashov"", ""document_author"": ""Daniel Hladek"", ""category"": ""dp2027""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov""], ""count"": 1}"
|
||||
wide-188,document_author_category_multi_hop,True,,6.835225114999048,True,True,True,True,True,True,Ktorý autor dokumentu je pri osobe Samuel Horáni spojený s kategóriou vp2021?,"{""answer"": ""Autorom dokumentu spojeným s osobou Samuel Horáni a kategóriou vp2021 je Daniel Hladek. Zdroj: https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani"", ""status"": ""ok"", ""claims"": [{""person"": ""Samuel Horáni"", ""document_author"": ""Daniel Hladek"", ""category"": ""vp2021""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/samuel_horani""], ""count"": 1}"
|
||||
wide-189,document_author_category_multi_hop,True,,5.236019719995966,True,True,True,True,True,True,Ktorý autor dokumentu je pri osobe Yevhenii Leonov spojený s kategóriou vp2024?,"{""answer"": ""Autorom dokumentu spojeným s osobou Yevhenii Leonov a kategóriou vp2024 je Daniel Hladek. Zdroj: https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov"", ""status"": ""ok"", ""claims"": [{""person"": ""Yevhenii Leonov"", ""category"": ""vp2024"", ""document_author"": ""Daniel Hladek""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/yevhenii_leonov""], ""count"": 1}"
|
||||
wide-190,document_author_category_multi_hop,True,,6.673279062000802,True,True,True,True,True,True,"Kto je autor dokumentu osoby Oleh Bilykh, ktorý patrí do kategórie bp2021?","{""answer"": ""Autorom dokumentu osoby Oleh Bilykh v kategórii bp2021 je Daniel Hladek. Zdroj: https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""status"": ""ok"", ""claims"": [{""person"": ""Oleh Bilykh"", ""document_author"": ""Daniel Hladek"", ""category"": ""bp2021""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""], ""count"": 1}"
|
||||
wide-191,document_author_category_multi_hop,True,,4.902594167993811,True,True,True,True,True,True,Ktorý autor dokumentu je pri osobe Ján Holp spojený s kategóriou tp2020?,"{""answer"": ""Autorom dokumentu spojeným s osobou Ján Holp a kategóriou tp2020 je Ján Holp [1]."", ""status"": ""ok"", ""claims"": [{""person"": ""Ján Holp"", ""document_author"": ""Ján Holp"", ""category"": ""tp2020""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp/timovy_projekt""], ""count"": 1}"
|
||||
wide-192,document_author_category_multi_hop,True,,7.23534662900056,True,True,True,True,True,True,Ktorý autor dokumentu je pri osobe Oleksandr Hryshchenko spojený s kategóriou dp2026?,"{""answer"": ""Autorom dokumentu spojeným s osobou Oleksandr Hryshchenko a kategóriou dp2026 je Daniel Hladek. Zdroj: https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko"", ""status"": ""ok"", ""claims"": [{""person"": ""Oleksandr Hryshchenko"", ""category"": ""dp2026"", ""document_author"": ""Daniel Hladek""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko""], ""count"": 1}"
|
||||
wide-195,person_multiple_categories,True,,4.123462159004703,True,True,True,True,True,True,Aké všetky kategórie majú dokumenty osoby Samuel Džurina?,"{""answer"": ""Samuel Džurina má dokumenty v kategórii bp2026 (zdroj: https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina)."", ""status"": ""ok"", ""claims"": [{""person"": ""Samuel Džurina"", ""category"": ""bp2026""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2023/samuel_dzurina""], ""count"": 1}"
|
||||
wide-196,person_multiple_categories,True,,6.55695073500101,True,True,True,True,True,True,Vypíš všetky kategórie dokumentov osoby Daniil Huzenko.,"{""answer"": ""Osoba Daniil Huzenko má dokument v kategórii bp2025 (zdroj: https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko)."", ""status"": ""ok"", ""claims"": [{""person"": ""Daniil Huzenko"", ""category"": ""bp2025""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""], ""count"": 1}"
|
||||
wide-197,person_multiple_categories,True,,3.839980998003739,True,True,True,True,True,True,Aké všetky kategórie majú dokumenty osoby Than Trung Thanh?,"{""answer"": ""Osoba Than Trung Thanh má dokumenty v kategórii bp2021. Zdroj: https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""status"": ""ok"", ""claims"": [{""person"": ""Than Trung Thanh"", ""category"": ""bp2021""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh""], ""count"": 1}"
|
||||
wide-198,person_multiple_categories,True,,5.812021667996305,True,True,True,True,True,True,Aké všetky kategórie majú dokumenty osoby Vladimír Ferko?,"{""answer"": ""Vladimír Ferko má dokumenty v kategórii bp2024 [1]."", ""status"": ""ok"", ""claims"": [{""person"": ""Vladimír Ferko"", ""category"": ""bp2024""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""], ""count"": 1}"
|
||||
wide-199,person_multiple_categories,True,,4.070570078998571,True,True,True,True,True,True,Vypíš všetky kategórie dokumentov osoby Dmytro Ushatenko.,"{""answer"": ""Osoba Dmytro Ushatenko má dokument v kategórii bp2020 (zdroj: https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko)."", ""status"": ""ok"", ""claims"": [{""person"": ""Dmytro Ushatenko"", ""category"": ""bp2020""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko""], ""count"": 1}"
|
||||
wide-200,person_multiple_categories,True,,5.895577477996994,True,True,True,True,True,True,Aké všetky kategórie majú dokumenty osoby Martin Wencel?,"{""answer"": ""Martin Wencel má dokumenty v kategórii bp2021 (zdroj: https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel)."", ""status"": ""ok"", ""claims"": [{""person"": ""Martin Wencel"", ""category"": ""bp2021""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""], ""count"": 1}"
|
||||
wide-201,person_multiple_categories,True,,4.787276399998518,True,True,True,True,True,True,Aké všetky kategórie majú dokumenty osoby Serhii Yemets?,"{""answer"": ""Osoba Serhii Yemets má dokumenty v kategórii bp2025 (zdroj: https://zp.kemt.fei.tuke.sk/students/2022/serhii_yemets)."", ""status"": ""ok"", ""claims"": [{""person"": ""Serhii Yemets"", ""category"": ""bp2025""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/serhii_yemets""], ""count"": 1}"
|
||||
wide-202,person_multiple_categories,True,,4.874617752000631,True,True,True,True,True,True,Vypíš všetky kategórie dokumentov osoby Oliver Pejic.,"{""answer"": ""Osoba Oliver Pejic má dokumenty v kategórii iaeste [1]."", ""status"": ""ok"", ""claims"": [{""person"": ""Oliver Pejic"", ""category"": ""iaeste""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/interns/oliver_pejic""], ""count"": 1}"
|
||||
wide-203,person_multiple_categories,True,,4.45105388200318,True,True,True,True,True,True,Aké všetky kategórie majú dokumenty osoby Maksym Zatirka?,"{""answer"": ""Osoba Maksym Zatirka má dokumenty v kategórii bp2026 [1]."", ""status"": ""ok"", ""claims"": [{""person"": ""Maksym Zatirka"", ""category"": ""bp2026""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""], ""count"": 1}"
|
||||
wide-204,person_multiple_categories,True,,4.655141262002871,True,True,True,True,True,True,Aké všetky kategórie majú dokumenty osoby Martin Jancura?,"{""answer"": ""Martin Jancura má dokumenty v kategóriách bp2021 a dp2023 [1]."", ""status"": ""ok"", ""claims"": [{""person"": ""Martin Jancura"", ""category"": ""bp2021""}, {""person"": ""Martin Jancura"", ""category"": ""dp2023""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""], ""count"": 2}"
|
||||
wide-205,person_multiple_categories,True,,5.410459575999994,True,True,True,True,True,True,Vypíš všetky kategórie dokumentov osoby Oleksandr Hryshchenko.,"{""answer"": ""Oleksandr Hryshchenko má dokument v kategórii dp2026 (zdroj: https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko)."", ""status"": ""ok"", ""claims"": [{""person"": ""Oleksandr Hryshchenko"", ""category"": ""dp2026""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/oleksandr_hryshchenko""], ""count"": 1}"
|
||||
wide-206,person_multiple_categories,True,,4.934618246996251,True,True,True,True,True,True,Aké všetky kategórie majú dokumenty osoby Márk Fehér?,"{""answer"": ""Osoba Márk Fehér má dokumenty v kategórii dp2022 (zdroj: https://zp.kemt.fei.tuke.sk/students/2016/mark_feher)."", ""status"": ""ok"", ""claims"": [{""person"": ""Márk Fehér"", ""category"": ""dp2022""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher""], ""count"": 1}"
|
||||
wide-207,person_multiple_categories,True,,5.351602836002712,True,True,True,True,True,True,Aké všetky kategórie majú dokumenty osoby Oleh Bilykh?,"{""answer"": ""Oleh Bilykh má dokumenty v kategórii bp2021 (zdroj: https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh)."", ""status"": ""ok"", ""claims"": [{""person"": ""Oleh Bilykh"", ""category"": ""bp2021""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""], ""count"": 1}"
|
||||
wide-208,person_multiple_categories,True,,4.647810752998339,True,True,True,True,True,True,Vypíš všetky kategórie dokumentov osoby Ján Pták.,"{""answer"": ""Osoba Ján Pták má dokument v kategórii dp2027 (zdroj: https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak)."", ""status"": ""ok"", ""claims"": [{""person"": ""Ján Pták"", ""category"": ""dp2027""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""], ""count"": 1}"
|
||||
wide-209,person_multiple_categories,False,JSONDecodeError: Expecting value: line 1 column 1 (char 0),8.321756921002816,,,,,,,Aké všetky kategórie majú dokumenty osoby Yevhenii Medushivskyi?,null
|
||||
wide-210,person_multiple_categories,True,,4.485325813999225,True,True,True,True,True,True,Aké všetky kategórie majú dokumenty osoby Ediz Morochovič?,"{""answer"": ""Osoba Ediz Morochovič má dokumenty v kategórii bp2019 (zdroj: https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic)."", ""status"": ""ok"", ""claims"": [{""person"": ""Ediz Morochovič"", ""category"": ""bp2019""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic""], ""count"": 1}"
|
||||
wide-211,person_multiple_categories,True,,6.549260562998825,True,True,True,True,True,True,Vypíš všetky kategórie dokumentov osoby Alina Vitko.,"{""answer"": ""Osoba Alina Vitko má dokument v kategórii bp2022 (zdroj: https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko)."", ""status"": ""ok"", ""claims"": [{""person"": ""Alina Vitko"", ""category"": ""bp2022""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko""], ""count"": 1}"
|
||||
wide-212,person_multiple_categories,True,,4.947871591997682,True,True,True,True,True,True,Aké všetky kategórie majú dokumenty osoby Cesar Abascal Gutierrez?,"{""answer"": ""Osoba Cesar Abascal Gutierrez má dokumenty v kategórii iaeste. Zdroj: https://zp.kemt.fei.tuke.sk/interns/cesar_gutierrez"", ""status"": ""ok"", ""claims"": [{""person"": ""Cesar Abascal Gutierrez"", ""category"": ""iaeste""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/interns/cesar_gutierrez""], ""count"": 1}"
|
||||
wide-213,person_multiple_categories,True,,4.7744402950047515,True,True,True,True,True,True,Aké všetky kategórie majú dokumenty osoby Bogdan Paul Chiș?,"{""answer"": ""Osoba Bogdan Paul Chiș má dokumenty v kategórii erasmus. Zdroj: https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis"", ""status"": ""ok"", ""claims"": [{""person"": ""Bogdan Paul Chiș"", ""category"": ""erasmus""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/interns/bogdan_paul_chis""], ""count"": 1}"
|
||||
wide-214,person_multiple_categories,True,,5.108398393000243,True,True,True,True,True,True,Vypíš všetky kategórie dokumentov osoby Matej Kobyľan.,"{""answer"": ""Osoba Matej Kobyľan má dokument v kategórii bp2023 (zdroj: https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan)."", ""status"": ""ok"", ""claims"": [{""person"": ""Matej Kobyľan"", ""category"": ""bp2023""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""], ""count"": 1}"
|
||||
wide-215,person_multiple_categories,True,,5.243163012994046,True,True,True,True,True,True,Aké všetky kategórie majú dokumenty osoby Oleksandr Dorybohov?,"{""answer"": ""Oleksandr Dorybohov má dokumenty v kategórii bp2026 (zdroj: https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov)."", ""status"": ""ok"", ""claims"": [{""person"": ""Oleksandr Dorybohov"", ""category"": ""bp2026""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""], ""count"": 1}"
|
||||
wide-216,person_multiple_categories,True,,5.386864268002682,True,True,True,True,True,True,Aké všetky kategórie majú dokumenty osoby Denis Le Thanh?,"{""answer"": ""Osoba Denis Le Thanh má dokumenty v kategórii bp2026. Zdroj: https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""status"": ""ok"", ""claims"": [{""person"": ""Denis Le Thanh"", ""category"": ""bp2026""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""], ""count"": 1}"
|
||||
wide-219,candidate_set_aggregation,True,,7.7192733800038695,True,True,True,True,True,True,"Z kandidátov Artur Hyrenko, Matej Ščišľak, Adrián Remiáš vyber osoby s prácou v roku 2026. Aký je ich počet?","{""answer"": ""Počet osôb s prácou v roku 2026 je 2. Sú to Artur Hyrenko a Matej Ščišľak. Adrián Remiáš nemá prácu v roku 2026. Zdroje: https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko, https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""status"": ""ok"", ""claims"": [{""person"": ""Artur Hyrenko"", ""year"": 2026}, {""person"": ""Matej Ščišľak"", ""year"": 2026}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""], ""count"": 2}"
|
||||
wide-220,candidate_set_aggregation,True,,7.372822696001094,True,True,True,True,True,True,"Z kandidátov Alina Vitko, Márk Fehér, Adrián Remiáš vyber osoby s prácou v roku 2021. Koľko ich je?","{""answer"": ""Dvaja kandidáti, Alina Vitko a Márk Fehér, majú prácu v roku 2021. Zdroje: https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko, https://zp.kemt.fei.tuke.sk/students/2016/mark_feher"", ""status"": ""ok"", ""claims"": [{""person"": ""Alina Vitko"", ""year"": 2021}, {""person"": ""Márk Fehér"", ""year"": 2021}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2016/mark_feher""], ""count"": 2}"
|
||||
wide-221,candidate_set_aggregation,True,,10.551185654003348,True,True,True,True,True,True,"Z kandidátov Andrii Pervashov, Daniil Huzenko, Adrián Remiáš vyber osoby s prácou v roku 2025. Aký je ich počet?","{""answer"": ""Počet kandidátov s prácou v roku 2025 je 2, a to Andrii Pervashov a Daniil Huzenko. Zdroje: https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov, https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko"", ""status"": ""ok"", ""claims"": [{""person"": ""Andrii Pervashov"", ""year"": 2025}, {""person"": ""Daniil Huzenko"", ""year"": 2025}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""], ""count"": 2}"
|
||||
wide-222,candidate_set_aggregation,True,,7.566261407999264,True,True,True,True,True,True,"Z kandidátov Andrii Pervashov, Valerii Kutsenko, Adrián Remiáš vyber osoby s prácou v roku 2027. Aký je ich počet?","{""answer"": ""Počet osôb s prácou v roku 2027 je 2. Sú nimi Andrii Pervashov a Valerii Kutsenko. Zdroje: https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov, https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""status"": ""ok"", ""claims"": [{""person"": ""Andrii Pervashov"", ""year"": 2027}, {""person"": ""Valerii Kutsenko"", ""year"": 2027}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""], ""count"": 2}"
|
||||
wide-223,candidate_set_aggregation,True,,10.795403767995595,True,True,True,True,True,True,"Z kandidátov Alina Vitko, Artem Yatsenko, Adrián Remiáš vyber osoby s prácou v roku 2022. Koľko ich je?","{""answer"": ""Dvaja kandidáti, Alina Vitko a Artem Yatsenko, majú prácu v roku 2022. Zdroje: https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko, https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""status"": ""ok"", ""claims"": [{""person"": ""Alina Vitko"", ""year"": 2022}, {""person"": ""Artem Yatsenko"", ""year"": 2022}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""], ""count"": 2}"
|
||||
wide-224,candidate_set_aggregation,True,,7.357641800997953,True,True,True,True,True,True,"Z kandidátov Adrián Remiáš, Dávid Kostilník, Alina Vitko vyber osoby s prácou v roku 2024. Aký je ich počet?","{""answer"": ""Počet osôb s prácou v roku 2024 je 2. Sú to Adrián Remiáš a Dávid Kostilník. Zdroje: https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias, https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik"", ""status"": ""ok"", ""claims"": [{""person"": ""Adrián Remiáš"", ""year"": 2024}, {""person"": ""Dávid Kostilník"", ""year"": 2024}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2020/david_kostilnik""], ""count"": 2}"
|
||||
wide-225,candidate_set_aggregation,True,,10.645838413998717,True,True,True,True,True,True,"Z kandidátov Dárius Lindvai, Martin Wencel, Adrián Remiáš vyber osoby s prácou v roku 2020. Aký je ich počet?","{""answer"": ""Počet kandidátov s prácou v roku 2020 je 2. Sú to Dárius Lindvai a Martin Wencel. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai, https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""status"": ""ok"", ""claims"": [{""person"": ""Dárius Lindvai"", ""year"": 2020}, {""person"": ""Martin Wencel"", ""year"": 2020}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""], ""count"": 2}"
|
||||
wide-226,candidate_set_aggregation,True,,7.666217147998395,True,True,True,True,True,True,"Z kandidátov Dárius Lindvai, Ediz Morochovič, Adrián Remiáš vyber osoby s prácou v roku 2019. Koľko ich je?","{""answer"": ""Dárius Lindvai a Ediz Morochovič majú prácu v roku 2019, čo je spolu 2 osoby. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai, https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic"", ""status"": ""ok"", ""claims"": [{""person"": ""Dárius Lindvai"", ""year"": 2019}, {""person"": ""Ediz Morochovič"", ""year"": 2019}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic""], ""count"": 2}"
|
||||
wide-227,candidate_set_aggregation,True,,10.733524051000131,True,True,True,True,True,True,"Z kandidátov Adrián Remiáš, Matej Kobyľan, Alina Vitko vyber osoby s prácou v roku 2024. Aký je ich počet?","{""answer"": ""Počet osôb s prácou v roku 2024 je 2. Sú to Adrián Remiáš a Matej Kobyľan. Zdroje: https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias, https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan"", ""status"": ""ok"", ""claims"": [{""person"": ""Adrián Remiáš"", ""year"": 2024}, {""person"": ""Matej Kobyľan"", ""year"": 2024}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""], ""count"": 2}"
|
||||
wide-228,candidate_set_aggregation,True,,8.750566690003325,True,True,True,True,True,True,"Z kandidátov Artur Hyrenko, Ján Malinovský, Adrián Remiáš vyber osoby s prácou v roku 2026. Aký je ich počet?","{""answer"": ""Počet osôb s prácou v roku 2026 je 2. Sú to Artur Hyrenko a Ján Malinovský. Zdroje: https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko, https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky"", ""status"": ""ok"", ""claims"": [{""person"": ""Artur Hyrenko"", ""year"": 2026}, {""person"": ""Ján Malinovský"", ""year"": 2026}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2022/jan_malinovsky""], ""count"": 2}"
|
||||
wide-229,candidate_set_aggregation,True,,10.704826668006717,True,True,True,True,True,True,"Z kandidátov Dávid Iľaš, Martin Šarišský, Adrián Remiáš vyber osoby s prácou v roku 2023. Koľko ich je?","{""answer"": ""Dávid Iľaš a Martin Šarišský majú prácu v roku 2023, čo je spolu 2 osoby. Zdroje: https://zp.kemt.fei.tuke.sk/students/2018/david_ilas, https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""status"": ""ok"", ""claims"": [{""person"": ""Dávid Iľaš"", ""year"": 2023}, {""person"": ""Martin Šarišský"", ""year"": 2023}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/david_ilas"", ""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""], ""count"": 2}"
|
||||
wide-230,candidate_set_aggregation,True,,8.786429461004445,True,True,True,True,True,True,"Z kandidátov Adrián Remiáš, Matej Ščišľak, Alina Vitko vyber osoby s prácou v roku 2024. Aký je ich počet?","{""answer"": ""Počet osôb s prácou v roku 2024 je 2. Sú to Adrián Remiáš a Matej Ščišľak. Zdroje: https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias, https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""status"": ""ok"", ""claims"": [{""person"": ""Adrián Remiáš"", ""year"": 2024}, {""person"": ""Matej Ščišľak"", ""year"": 2024}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""], ""count"": 2}"
|
||||
wide-231,candidate_set_aggregation,True,,9.847875152001507,True,True,True,True,True,True,"Z kandidátov Artur Hyrenko, Oleksandr Dorybohov, Adrián Remiáš vyber osoby s prácou v roku 2026. Aký je ich počet?","{""answer"": ""Počet kandidátov s prácou v roku 2026 je 2. Sú to Artur Hyrenko a Oleksandr Dorybohov. Zdroje: https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko, https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov"", ""status"": ""ok"", ""claims"": [{""person"": ""Artur Hyrenko"", ""year"": 2026}, {""person"": ""Oleksandr Dorybohov"", ""year"": 2026}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/oleksandr_dorybohov""], ""count"": 2}"
|
||||
wide-232,candidate_set_aggregation,False,JSONDecodeError: Expecting value: line 1 column 1 (char 0),13.339628460002132,,,,,,,"Z kandidátov Dávid Omasta, Jakub Kristián Lukas, Adrián Remiáš vyber osoby s prácou v roku 2023. Koľko ich je?",null
|
||||
wide-233,candidate_set_aggregation,True,,8.772020734999387,True,True,True,True,True,True,"Z kandidátov Alina Vitko, Jakub Maruniak, Adrián Remiáš vyber osoby s prácou v roku 2021. Aký je ich počet?","{""answer"": ""Počet osôb s prácou v roku 2021 je 2. Sú to Alina Vitko a Jakub Maruniak. Zdroje: https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko, https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak"", ""status"": ""ok"", ""claims"": [{""person"": ""Alina Vitko"", ""year"": 2021}, {""person"": ""Jakub Maruniak"", ""year"": 2021}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""], ""count"": 2}"
|
||||
wide-234,candidate_set_aggregation,True,,11.249018417001935,True,True,True,True,True,True,"Z kandidátov Adrián Remiáš, Dávid Omasta, Alina Vitko vyber osoby s prácou v roku 2024. Aký je ich počet?","{""answer"": ""Počet osôb s prácou v roku 2024 je 2. Sú to Adrián Remiáš a Dávid Omasta. Zdroje: https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias, https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""status"": ""ok"", ""claims"": [{""person"": ""Adrián Remiáš"", ""year"": 2024}, {""person"": ""Dávid Omasta"", ""year"": 2024}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta""], ""count"": 2}"
|
||||
wide-235,candidate_set_aggregation,True,,8.039425630006008,True,True,True,True,True,True,"Z kandidátov Dominik Nagy, Lukáš Pokrývka, Adrián Remiáš vyber osoby s prácou v roku 2019. Koľko ich je?","{""answer"": ""Dvaja kandidáti, Dominik Nagy a Lukáš Pokrývka, majú prácu v roku 2019. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy, https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""status"": ""ok"", ""claims"": [{""person"": ""Dominik Nagy"", ""year"": 2019}, {""person"": ""Lukáš Pokrývka"", ""year"": 2019}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""], ""count"": 2}"
|
||||
wide-236,candidate_set_aggregation,False,JSONDecodeError: Expecting value: line 1 column 1 (char 0),15.70306140199682,,,,,,,"Z kandidátov Dávid Iľaš, Vladyslav Krupko, Adrián Remiáš vyber osoby s prácou v roku 2023. Aký je ich počet?",null
|
||||
wide-237,candidate_set_aggregation,True,,7.519558184001653,True,True,True,True,True,True,"Z kandidátov Andrii Pervashov, Matej Ščišľak, Adrián Remiáš vyber osoby s prácou v roku 2025. Aký je ich počet?","{""answer"": ""Počet osôb s prácou v roku 2025 je 2. Sú to Andrii Pervashov a Matej Ščišľak. Zdroje: https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov, https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak"", ""status"": ""ok"", ""claims"": [{""person"": ""Andrii Pervashov"", ""year"": 2025}, {""person"": ""Matej Ščišľak"", ""year"": 2025}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""], ""count"": 2}"
|
||||
wide-238,candidate_set_aggregation,True,,12.04440959099884,True,True,True,True,True,True,"Z kandidátov Andrii Pervashov, Patrik Pokrivčák, Adrián Remiáš vyber osoby s prácou v roku 2025. Koľko ich je?","{""answer"": ""Dvaja kandidáti, Andrii Pervashov a Patrik Pokrivčák, majú prácu v roku 2025. Zdroje: https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov, https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak"", ""status"": ""ok"", ""claims"": [{""person"": ""Andrii Pervashov"", ""year"": 2025}, {""person"": ""Patrik Pokrivčák"", ""year"": 2025}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/andrii_pervashov"", ""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak""], ""count"": 2}"
|
||||
wide-239,candidate_set_aggregation,False,JSONDecodeError: Expecting value: line 1 column 1 (char 0),15.513169307996577,,,,,,,"Z kandidátov Dárius Lindvai, Dmytro Ushatenko, Adrián Remiáš vyber osoby s prácou v roku 2020. Aký je ich počet?",null
|
||||
wide-240,candidate_set_aggregation,True,,7.4692764049977995,True,True,True,True,True,True,"Z kandidátov Alina Vitko, Michal Stromko, Adrián Remiáš vyber osoby s prácou v roku 2021. Aký je ich počet?","{""answer"": ""Počet osôb s prácou v roku 2021 je 2: Alina Vitko a Michal Stromko. Zdroje: https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko, https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""status"": ""ok"", ""claims"": [{""person"": ""Alina Vitko"", ""year"": 2021}, {""person"": ""Michal Stromko"", ""year"": 2021}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""], ""count"": 2}"
|
||||
wide-241,candidate_set_aggregation,True,,11.048038004999398,True,True,True,True,True,True,"Z kandidátov Adrián Remiáš, Pavol Hudák, Alina Vitko vyber osoby s prácou v roku 2024. Koľko ich je?","{""answer"": ""Dvaja kandidáti, Adrián Remiáš a Pavol Hudák, majú prácu v roku 2024. Zdroje: https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias, https://zp.kemt.fei.tuke.sk/students/2020/pavol_hudak"", ""status"": ""ok"", ""claims"": [{""person"": ""Adrián Remiáš"", ""year"": 2024}, {""person"": ""Pavol Hudák"", ""year"": 2024}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/adrian_remias"", ""https://zp.kemt.fei.tuke.sk/students/2020/pavol_hudak""], ""count"": 2}"
|
||||
wide-242,candidate_set_aggregation,True,,10.065853608997713,True,True,True,True,True,True,"Z kandidátov Alina Vitko, Dmytro Mural, Adrián Remiáš vyber osoby s prácou v roku 2022. Aký je ich počet?","{""answer"": ""Počet osôb s prácou v roku 2022 je 2: Alina Vitko a Dmytro Mural. Zdroje: https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko, https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural"", ""status"": ""ok"", ""claims"": [{""person"": ""Alina Vitko"", ""year"": 2022}, {""person"": ""Dmytro Mural"", ""year"": 2022}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/dmytro_mural""], ""count"": 2}"
|
||||
wide-243,candidate_set_aggregation,True,,8.257452006000676,True,True,True,True,True,True,"Z kandidátov Alina Vitko, Kristián Sopkovič, Adrián Remiáš vyber osoby s prácou v roku 2022. Aký je ich počet?","{""answer"": ""Počet osôb s prácou v roku 2022 je 2. Sú to Alina Vitko a Kristián Sopkovič. Zdroje: https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko, https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""status"": ""ok"", ""claims"": [{""person"": ""Alina Vitko"", ""year"": 2022}, {""person"": ""Kristián Sopkovič"", ""year"": 2022}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""], ""count"": 2}"
|
||||
wide-244,candidate_set_aggregation,True,,10.002914138000051,True,True,True,True,True,True,"Z kandidátov Dávid Omasta, Filip Tomáš, Adrián Remiáš vyber osoby s prácou v roku 2023. Koľko ich je?","{""answer"": ""Dávid Omasta a Filip Tomáš majú prácu v roku 2023, čo je spolu 2 osoby. Zdroje: https://zp.kemt.fei.tuke.sk/students/2018/david_omasta, https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""status"": ""ok"", ""claims"": [{""person"": ""Dávid Omasta"", ""year"": 2023}, {""person"": ""Filip Tomáš"", ""year"": 2023}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/david_omasta"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""], ""count"": 2}"
|
||||
wide-245,candidate_set_aggregation,True,,8.243047608004417,True,True,True,True,True,True,"Z kandidátov Dominik Nagy, Ján Holp, Adrián Remiáš vyber osoby s prácou v roku 2019. Aký je ich počet?","{""answer"": ""Počet osôb s prácou v roku 2019 je 2. Sú to Dominik Nagy a Ján Holp. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy, https://zp.kemt.fei.tuke.sk/students/2016/jan_holp"", ""status"": ""ok"", ""claims"": [{""person"": ""Dominik Nagy"", ""year"": 2019}, {""person"": ""Ján Holp"", ""year"": 2019}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/dominik_nagy"", ""https://zp.kemt.fei.tuke.sk/students/2016/jan_holp""], ""count"": 2}"
|
||||
wide-246,candidate_set_aggregation,True,,9.787830825000128,True,True,True,True,True,True,"Z kandidátov Alina Vitko, Filip Tomáš, Adrián Remiáš vyber osoby s prácou v roku 2021. Aký je ich počet?","{""answer"": ""Počet kandidátov s prácou v roku 2021 je 2. Sú to Alina Vitko a Filip Tomáš. Zdroje: https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko, https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas"", ""status"": ""ok"", ""claims"": [{""person"": ""Alina Vitko"", ""year"": 2021}, {""person"": ""Filip Tomáš"", ""year"": 2021}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""], ""count"": 2}"
|
||||
wide-247,candidate_set_aggregation,True,,9.740451630997995,True,True,True,True,True,True,"Z kandidátov Alina Vitko, Matúš Suchanič, Adrián Remiáš vyber osoby s prácou v roku 2022. Koľko ich je?","{""answer"": ""Z kandidátov Alina Vitko a Matúš Suchanič majú prácu v roku 2022, čo je spolu 2 osoby. Adrián Remiáš v roku 2022 prácu nemá. Zdroje: https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko, https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic"", ""status"": ""ok"", ""claims"": [{""person"": ""Alina Vitko"", ""year"": 2022}, {""person"": ""Matúš Suchanič"", ""year"": 2022}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/alina_vitko"", ""https://zp.kemt.fei.tuke.sk/students/2020/matus_suchanic""], ""count"": 2}"
|
||||
wide-248,candidate_set_aggregation,True,,9.86519188999955,True,True,True,True,True,True,"Z kandidátov Artur Hyrenko, Denis Le Thanh, Adrián Remiáš vyber osoby s prácou v roku 2026. Aký je ich počet?","{""answer"": ""Počet kandidátov s prácou v roku 2026 je 2, a to Artur Hyrenko a Denis Le Thanh. Zdroje: https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko, https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh"", ""status"": ""ok"", ""claims"": [{""person"": ""Artur Hyrenko"", ""year"": 2026}, {""person"": ""Denis Le Thanh"", ""year"": 2026}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/artur_hyrenko"", ""https://zp.kemt.fei.tuke.sk/students/2023/denis_le_thanh""], ""count"": 2}"
|
||||
wide-251,conjunctive_disambiguation,True,,8.290319315005036,True,True,True,True,True,True,Ktorá z osôb Matej Kobyľan a Adrián Remiáš spĺňa kľúčové slovo ir a rok práce 2024?,"{""answer"": ""Matej Kobyľan spĺňa kľúčové slovo ir a rok práce 2024 (zdroj: https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan)."", ""status"": ""ok"", ""claims"": [{""person"": ""Matej Kobyľan"", ""year"": 2024, ""keyword"": ""ir""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2020/matej_kobylan""], ""count"": 1}"
|
||||
wide-252,conjunctive_disambiguation,True,,7.219944579999719,True,True,True,True,True,True,Ktorá z osôb Patrik Pavlišin a Dárius Lindvai má kľúčové slovo translation a jej práca je z roku 2019?,"{""answer"": ""Patrik Pavlišin má kľúčové slovo translation a jeho práca je z roku 2019. Dárius Lindvai nemá v grafoch uvedené kľúčové slovo translation ani rok 2019. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin"", ""status"": ""ok"", ""claims"": [{""person"": ""Patrik Pavlišin"", ""year"": 2019, ""keyword"": ""translation""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/patrik_pavlisin""], ""count"": 1}"
|
||||
wide-253,conjunctive_disambiguation,True,,5.840062208997551,True,True,True,True,True,True,Ktorá z osôb Dárius Lindvai a Ediz Morochovič spĺňa kľúčové slovo nn a rok práce 2019?,"{""answer"": ""Dárius Lindvai spĺňa kľúčové slovo nn a rok práce 2019 (https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai)."", ""status"": ""ok"", ""claims"": [{""person"": ""Dárius Lindvai"", ""year"": 2019, ""keyword"": ""nn""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai""], ""count"": 1}"
|
||||
wide-254,conjunctive_disambiguation,True,,6.407496858999366,True,True,True,True,True,True,Ktorá z osôb Filip Tomáš a Dávid Omasta spĺňa kľúčové slovo testovanie a rok práce 2023?,"{""answer"": ""Osoba Filip Tomáš spĺňa kľúčové slovo testovanie a rok práce 2023 (zdroj: https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas)."", ""status"": ""ok"", ""claims"": [{""person"": ""Filip Tomáš"", ""year"": 2023, ""keyword"": ""testovanie""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""], ""count"": 1}"
|
||||
wide-255,conjunctive_disambiguation,True,,4.776170264995017,True,True,True,True,True,True,Ktorá z osôb Michal Stromko a Alina Vitko má kľúčové slovo cloud a jej práca je z roku 2022?,"{""answer"": ""Michal Stromko má kľúčové slovo cloud a jeho práca je z roku 2022. Zdroj: https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""status"": ""ok"", ""claims"": [{""person"": ""Michal Stromko"", ""year"": 2022, ""keyword"": ""cloud""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""], ""count"": 1}"
|
||||
wide-256,conjunctive_disambiguation,True,,6.568239268002799,True,True,True,True,True,True,Ktorá z osôb Oleh Bilykh a Dmytro Ushatenko spĺňa kľúčové slovo question-answer a rok práce 2020?,"{""answer"": ""Oleh Bilykh spĺňa kľúčové slovo question-answer a rok práce 2020 (zdroj: https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh)."", ""status"": ""ok"", ""claims"": [{""person"": ""Oleh Bilykh"", ""year"": 2020, ""keyword"": ""question-answer""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""], ""count"": 1}"
|
||||
wide-257,conjunctive_disambiguation,True,,4.94857262000005,True,True,True,True,True,True,Ktorá z osôb Matej Ščišľak a Eduard Matovka spĺňa kľúčové slovo dialog a rok práce 2026?,"{""answer"": ""Matej Ščišľak spĺňa kľúčové slovo \""dialog\"" a rok práce 2026 (zdroj: https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak)."", ""status"": ""ok"", ""claims"": [{""person"": ""Matej Ščišľak"", ""year"": 2026, ""keyword"": ""dialog""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""], ""count"": 1}"
|
||||
wide-258,conjunctive_disambiguation,True,,6.659346368003753,True,True,True,True,True,True,Ktorá z osôb Artem Yatsenko a Dávid Stromp má kľúčové slovo spacy a jej práca je z roku 2022?,"{""answer"": ""Artem Yatsenko má kľúčové slovo Spacy a jeho práca je z roku 2022 (zdroj: https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko)."", ""status"": ""ok"", ""claims"": [{""person"": ""Artem Yatsenko"", ""year"": 2022, ""keyword"": ""Spacy""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""], ""count"": 1}"
|
||||
wide-259,conjunctive_disambiguation,True,,5.258838747999107,True,True,True,True,True,True,Ktorá z osôb Michal Stromko a Alina Vitko spĺňa kľúčové slovo nlp a rok práce 2023?,"{""answer"": ""Michal Stromko spĺňa kľúčové slovo NLP a rok práce 2023. Alina Vitko nemá v grafoch uvedené tieto údaje. Zdroje: https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko"", ""status"": ""ok"", ""claims"": [{""person"": ""Michal Stromko"", ""year"": 2023, ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/michal_stromko""], ""count"": 1}"
|
||||
wide-260,conjunctive_disambiguation,True,,7.194393290999869,True,True,True,True,True,True,Ktorá z osôb Martin Šarišský a Alina Vitko spĺňa kľúčové slovo nlp a rok práce 2023?,"{""answer"": ""Martin Šarišský spĺňa kľúčové slovo NLP a rok práce 2023. Alina Vitko nemá v grafe zaznamenaný rok 2023 ani kľúčové slovo NLP. Zdroje: https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky"", ""status"": ""ok"", ""claims"": [{""person"": ""Martin Šarišský"", ""year"": 2023, ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/martin_sarissky""], ""count"": 1}"
|
||||
wide-261,conjunctive_disambiguation,True,,5.320920971003943,True,True,True,True,True,True,Ktorá z osôb Ondrej Megela a Dárius Lindvai má kľúčové slovo fairseq a jej práca je z roku 2020?,"{""answer"": ""Ondrej Megela má kľúčové slovo fairseq a jeho práca je z roku 2020 (zdroj: https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela)."", ""status"": ""ok"", ""claims"": [{""person"": ""Ondrej Megela"", ""year"": 2020, ""keyword"": ""fairseq""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""], ""count"": 1}"
|
||||
wide-262,conjunctive_disambiguation,True,,7.518260585995449,True,True,True,True,True,True,Ktorá z osôb Patrik Pokrivčák a Dávid Kostilník spĺňa kľúčové slovo hate a rok práce 2024?,"{""answer"": ""Patrik Pokrivčák spĺňa kľúčové slovo 'hate' a rok práce 2024, zatiaľ čo Dávid Kostilník tieto kritériá nespĺňa. Zdroj: https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak"", ""status"": ""ok"", ""claims"": [{""person"": ""Patrik Pokrivčák"", ""year"": 2024, ""keyword"": ""hate""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/patrik_pokrivcak""], ""count"": 1}"
|
||||
wide-263,conjunctive_disambiguation,True,,5.239184719997866,True,True,True,True,True,True,Ktorá z osôb Kristián Sopkovič a Adrián Remiáš spĺňa kľúčové slovo nlp a rok práce 2021?,"{""answer"": ""Kristián Sopkovič spĺňa kľúčové slovo NLP a rok práce 2021, zatiaľ čo Adrián Remiáš nemá v grafoch uvedené tieto údaje. Zdroje: https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic"", ""status"": ""ok"", ""claims"": [{""person"": ""Kristián Sopkovič"", ""year"": 2021, ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""], ""count"": 1}"
|
||||
wide-264,conjunctive_disambiguation,True,,7.584487269996316,True,True,True,True,True,True,Ktorá z osôb Dmytro Ushatenko a Alina Vitko má kľúčové slovo nlp a jej práca je z roku 2020?,"{""answer"": ""Dmytro Ushatenko má kľúčové slovo NLP a jeho práca je z roku 2020 (zdroj: https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko)."", ""status"": ""ok"", ""claims"": [{""person"": ""Dmytro Ushatenko"", ""year"": 2020, ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2017/dmytro_ushatenko""], ""count"": 1}"
|
||||
wide-265,conjunctive_disambiguation,True,,4.588180135993753,True,True,True,True,True,True,Ktorá z osôb Ondrej Megela a Alina Vitko spĺňa kľúčové slovo nlp a rok práce 2023?,"{""answer"": ""Ondrej Megela spĺňa kľúčové slovo NLP a rok práce 2023 (zdroj: https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela)."", ""status"": ""ok"", ""claims"": [{""person"": ""Ondrej Megela"", ""year"": 2023, ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""], ""count"": 1}"
|
||||
wide-266,conjunctive_disambiguation,True,,7.256377336001606,True,True,True,True,True,True,Ktorá z osôb Than Trung Thanh a Dmytro Ushatenko spĺňa kľúčové slovo anotation a rok práce 2020?,"{""answer"": ""Than Trung Thanh spĺňa kľúčové slovo anotation a rok práce 2020, zatiaľ čo Dmytro Ushatenko tieto kritériá nespĺňa. Zdroje: https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh"", ""status"": ""ok"", ""claims"": [{""person"": ""Than Trung Thanh"", ""year"": 2020, ""keyword"": ""anotation""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2017/than_trung_thanh""], ""count"": 1}"
|
||||
wide-267,conjunctive_disambiguation,True,,4.091823563001526,True,True,True,True,True,True,Ktorá z osôb Kristián Sopkovič a Alina Vitko má kľúčové slovo spacy a jej práca je z roku 2022?,"{""answer"": ""Kristián Sopkovič má kľúčové slovo Spacy a jeho práca je z roku 2022 (zdroj: https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic)."", ""status"": ""ok"", ""claims"": [{""person"": ""Kristián Sopkovič"", ""year"": 2022, ""keyword"": ""Spacy""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/kristian_sopkovic""], ""count"": 1}"
|
||||
wide-268,conjunctive_disambiguation,True,,7.003688570999657,True,True,True,True,True,True,Ktorá z osôb Artem Yatsenko a Cesar Abascal Gutierrez spĺňa kľúčové slovo ner a rok práce 2022?,"{""answer"": ""Osoba Artem Yatsenko spĺňa kľúčové slovo NER a rok práce 2022. Zdroj: https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko"", ""status"": ""ok"", ""claims"": [{""person"": ""Artem Yatsenko"", ""year"": 2022, ""keyword"": ""NER""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/artem_yatsenko""], ""count"": 1}"
|
||||
wide-269,conjunctive_disambiguation,True,,3.9448283739984618,True,True,True,True,True,True,Ktorá z osôb Oleh Bilykh a Artem Yatsenko spĺňa kľúčové slovo drqa a rok práce 2021?,"{""answer"": ""Oleh Bilykh spĺňa kľúčové slovo drqa a rok práce 2021. Zdroj: https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh"", ""status"": ""ok"", ""claims"": [{""person"": ""Oleh Bilykh"", ""year"": 2021, ""keyword"": ""drqa""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""], ""count"": 1}"
|
||||
wide-270,conjunctive_disambiguation,True,,7.2973852189970785,True,True,True,True,True,True,Ktorá z osôb Filip Tomáš a Daniil Huzenko má kľúčové slovo testovanie a jej práca je z roku 2025?,"{""answer"": ""Filip Tomáš má kľúčové slovo testovanie a jeho práca je z roku 2025 (zdroj: https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas)."", ""status"": ""ok"", ""claims"": [{""person"": ""Filip Tomáš"", ""year"": 2025, ""keyword"": ""testovanie""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2019/filip_tomas""], ""count"": 1}"
|
||||
wide-271,conjunctive_disambiguation,True,,4.728661907996866,True,True,True,True,True,True,Ktorá z osôb Maksym Zatirka a Artur Hyrenko spĺňa kľúčové slovo db a rok práce 2026?,"{""answer"": ""Maksym Zatirka spĺňa kľúčové slovo DB a rok práce 2026, zatiaľ čo Artur Hyrenko nemá v grafe uvedené tieto údaje. Zdroje: https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""status"": ""ok"", ""claims"": [{""person"": ""Maksym Zatirka"", ""year"": 2026, ""keyword"": ""DB""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""], ""count"": 1}"
|
||||
wide-272,conjunctive_disambiguation,True,,7.658525220002048,True,True,True,True,True,True,Ktorá z osôb Lukáš Pokrývka a Artem Yatsenko spĺňa kľúčové slovo cloud a rok práce 2021?,"{""answer"": ""Lukáš Pokrývka spĺňa kľúčové slovo cloud a rok práce 2021, zatiaľ čo Artem Yatsenko nemá v grafe uvedené tieto údaje. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka"", ""status"": ""ok"", ""claims"": [{""person"": ""Lukáš Pokrývka"", ""year"": 2021, ""keyword"": ""cloud""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""], ""count"": 1}"
|
||||
wide-273,conjunctive_disambiguation,True,,4.929320309005561,True,True,True,True,True,True,Ktorá z osôb Lukáš Pokrývka a Alina Vitko má kľúčové slovo cloud a jej práca je z roku 2021?,"{""answer"": ""Lukáš Pokrývka má kľúčové slovo cloud a jeho práca je z roku 2021 (zdroj: https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka)."", ""status"": ""ok"", ""claims"": [{""person"": ""Lukáš Pokrývka"", ""year"": 2021, ""keyword"": ""cloud""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/lukas_pokryvka""], ""count"": 1}"
|
||||
wide-274,conjunctive_disambiguation,True,,9.057492628002365,True,True,True,True,True,True,Ktorá z osôb Valerii Kutsenko a Adrián Remiáš spĺňa kľúčové slovo nlp a rok práce 2025?,"{""answer"": ""Osoba Valerii Kutsenko spĺňa kľúčové slovo NLP a rok práce 2025, zatiaľ čo pre Adriána Remiáša nie sú v grafe uvedené žiadne údaje o roku 2025 ani kľúčovom slove NLP. Zdroje: https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko"", ""status"": ""ok"", ""claims"": [{""person"": ""Valerii Kutsenko"", ""year"": 2025, ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/valerii_kutsenko""], ""count"": 1}"
|
||||
wide-275,conjunctive_disambiguation,True,,4.394214208004996,True,True,True,True,True,True,Ktorá z osôb Martin Jancura a Dmytro Ushatenko spĺňa kľúčové slovo opennmt a rok práce 2020?,"{""answer"": ""Martin Jancura spĺňa kľúčové slovo opennmt a rok práce 2020. Dmytro Ushatenko v poskytnutých grafoch nemá tieto údaje. Zdroje: https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura"", ""status"": ""ok"", ""claims"": [{""person"": ""Martin Jancura"", ""year"": 2020, ""keyword"": ""opennmt""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2017/martin_jancura""], ""count"": 1}"
|
||||
wide-276,conjunctive_disambiguation,True,,8.695488644996658,True,True,True,True,True,True,Ktorá z osôb Ondrej Megela a Dárius Lindvai má kľúčové slovo question-answer a jej práca je z roku 2020?,"{""answer"": ""Ondrej Megela má kľúčové slovo question-answer a jeho práca je z roku 2020. Dárius Lindvai nemá v grafoch uvedené kľúčové slovo question-answer ani prácu z roku 2020. Zdroje: https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""status"": ""ok"", ""claims"": [{""person"": ""Ondrej Megela"", ""year"": 2020, ""keyword"": ""question-answer""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""], ""count"": 1}"
|
||||
wide-277,conjunctive_disambiguation,True,,4.561247384001035,True,True,True,True,True,True,Ktorá z osôb Martin Wencel a Artem Yatsenko spĺňa kľúčové slovo spacy a rok práce 2020?,"{""answer"": ""Martin Wencel spĺňa kľúčové slovo Spacy a rok práce 2020 (zdroj: https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel)."", ""status"": ""ok"", ""claims"": [{""person"": ""Martin Wencel"", ""year"": 2020, ""keyword"": ""Spacy""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""], ""count"": 1}"
|
||||
wide-278,conjunctive_disambiguation,True,,7.106551545999537,True,True,True,True,True,True,Ktorá z osôb Jakub Maruniak a Artem Yatsenko spĺňa kľúčové slovo annotation a rok práce 2021?,"{""answer"": ""Osoba Jakub Maruniak spĺňa kľúčové slovo 'annotation' a rok práce 2021, čo je potvrdené v zdroji https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak."", ""status"": ""ok"", ""claims"": [{""person"": ""Jakub Maruniak"", ""year"": 2021, ""keyword"": ""annotation""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""], ""count"": 1}"
|
||||
wide-279,conjunctive_disambiguation,True,,3.8795665049983654,True,True,True,True,True,True,Ktorá z osôb Vladimír Ferko a Andrii Pervashov má kľúčové slovo nlp a jej práca je z roku 2024?,"{""answer"": ""Vladimír Ferko má kľúčové slovo NLP a jeho práca je z roku 2024 (zdroj: https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko)."", ""status"": ""ok"", ""claims"": [{""person"": ""Vladimír Ferko"", ""year"": 2024, ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/vladimir_ferko""], ""count"": 1}"
|
||||
wide-280,conjunctive_disambiguation,True,,8.457105479996244,True,True,True,True,True,True,Ktorá z osôb Maksym Zatirka a Denis Le Thanh spĺňa kľúčové slovo graph a rok práce 2026?,"{""answer"": ""Maksym Zatirka spĺňa kľúčové slovo graph a rok práce 2026, zatiaľ čo pre Denis Le Thanh nie sú v grafoch uvedené žiadne údaje o roku 2026 ani kľúčovom slove graph. Zdroje: https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka"", ""status"": ""ok"", ""claims"": [{""person"": ""Maksym Zatirka"", ""year"": 2026, ""keyword"": ""graph""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""], ""count"": 1}"
|
||||
wide-281,conjunctive_disambiguation,True,,4.085568874994351,True,True,True,True,True,True,Ktorá z osôb Martin Wencel a Dárius Lindvai spĺňa kľúčové slovo demo a rok práce 2020?,"{""answer"": ""Martin Wencel spĺňa kľúčové slovo demo a rok práce 2020, zatiaľ čo Dárius Lindvai v poskytnutých údajoch tieto kritériá nespĺňa. Zdroje: https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel"", ""status"": ""ok"", ""claims"": [{""person"": ""Martin Wencel"", ""year"": 2020, ""keyword"": ""demo""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/martin_wencel""], ""count"": 1}"
|
||||
wide-282,conjunctive_disambiguation,True,,7.9133985659937025,True,True,True,True,True,True,Ktorá z osôb Ondrej Megela a Artem Yatsenko má kľúčové slovo lm a jej práca je z roku 2022?,"{""answer"": ""Ondrej Megela má kľúčové slovo LM a jeho práca je z roku 2022. Zdroj: https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela"", ""status"": ""ok"", ""claims"": [{""person"": ""Ondrej Megela"", ""year"": 2022, ""keyword"": ""LM""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/ondrej_megela""], ""count"": 1}"
|
||||
wide-283,conjunctive_disambiguation,False,,9.018380888002866,False,True,True,True,True,True,Ktorá z osôb Dárius Lindvai a Alina Vitko spĺňa kľúčové slovo anaconda a rok práce 2021?,"{""answer"": ""Dárius Lindvai spĺňa kľúčové slovo anaconda a rok práce 2021, zatiaľ čo Alina Vitko nemá v grafoch zaznamenané žiadne údaje spĺňajúce tieto podmienky. Dárius Lindvai má rok 2021 v dokumente https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai a kľúčové slovo anaconda v dokumente https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial."", ""status"": ""ok"", ""claims"": [{""person"": ""Dárius Lindvai"", ""year"": 2021, ""document_path"": ""pages/students/2016/darius_lindvai/README.md""}, {""person"": ""Dárius Lindvai"", ""keyword"": ""anaconda"", ""document_path"": ""pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial""], ""count"": 1}"
|
||||
wide-284,conjunctive_disambiguation,True,,6.446719039995514,True,True,True,True,True,True,Ktorá z osôb Jakub Maruniak a Alina Vitko spĺňa kľúčové slovo nlp a rok práce 2020?,"{""answer"": ""Osoba Jakub Maruniak spĺňa kľúčové slovo NLP a rok práce 2020, čo je doložené v zdroji https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak."", ""status"": ""ok"", ""claims"": [{""person"": ""Jakub Maruniak"", ""year"": 2020, ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/jakub_maruniak""], ""count"": 1}"
|
||||
wide-285,conjunctive_disambiguation,True,,9.707872013001179,True,True,True,True,True,True,Ktorá z osôb Dárius Lindvai a Dominik Nagy má kľúčové slovo pytorch a jej práca je z roku 2019?,"{""answer"": ""Dárius Lindvai má kľúčové slovo pytorch a jeho práca je z roku 2019 (zdroje: https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai, https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial). Dominik Nagy nemá v grafe uvedené kľúčové slovo pytorch ani prácu z roku 2019."", ""status"": ""ok"", ""claims"": [{""person"": ""Dárius Lindvai"", ""year"": 2019, ""keyword"": ""pytorch""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"", ""https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial""], ""count"": 1}"
|
||||
wide-286,conjunctive_disambiguation,True,,7.281992283002182,True,True,True,True,True,True,Ktorá z osôb Ediz Morochovič a Cesar Abascal Gutierrez spĺňa kľúčové slovo ner a rok práce 2019?,"{""answer"": ""Osoba Ediz Morochovič spĺňa kľúčové slovo NER a rok práce 2019, čo je potvrdené v zdrojoch [1](https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic). Osoba Cesar Abascal Gutierrez nemá v dodaných faktoch uvedené kľúčové slovo NER ani rok 2019."", ""status"": ""ok"", ""claims"": [{""person"": ""Ediz Morochovič"", ""year"": 2019, ""keyword"": ""NER""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/ediz_morochovic""], ""count"": 1}"
|
||||
wide-287,conjunctive_disambiguation,True,,8.911685728999146,True,True,True,True,True,True,Ktorá z osôb Stanislav Matsunych a Adrián Remiáš spĺňa kľúčové slovo nlp a rok práce 2019?,"{""answer"": ""Stanislav Matsunych spĺňa kľúčové slovo NLP a rok práce 2019 (zdroj: https://zp.kemt.fei.tuke.sk/students/2017/stanislav_matsunych)."", ""status"": ""ok"", ""claims"": [{""person"": ""Stanislav Matsunych"", ""year"": 2019, ""keyword"": ""NLP""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2017/stanislav_matsunych""], ""count"": 1}"
|
||||
wide-288,conjunctive_disambiguation,True,,5.03515259300184,True,True,True,True,True,True,Ktorá z osôb Matej Ščišľak a Jakub Schwarc má kľúčové slovo rasa a jej práca je z roku 2026?,"{""answer"": ""Matej Ščišľak má kľúčové slovo 'rasa' a jeho práca je z roku 2026 (zdroj: https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak)."", ""status"": ""ok"", ""claims"": [{""person"": ""Matej Ščišľak"", ""year"": 2026, ""keyword"": ""rasa""}], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/matej_scislak""], ""count"": 1}"
|
||||
wide-291,negative_lookup,True,,5.53823840500263,True,True,True,True,True,True,Aký názov práce má osoba Dávid Iľaš s kľúčovým slovom cluster?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o osobe Dávid Iľaš s kľúčovým slovom cluster."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [], ""count"": 0}"
|
||||
wide-292,negative_lookup,True,,4.538664214000164,True,True,True,True,True,True,Aký názov práce má osoba Martin NaN1 s kľúčovým slovom opennmt?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o osobe Martin s kľúčovým slovom opennmt ani o názve jeho práce. Zdroj: https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday"", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/NaN1name_buday""], ""count"": 0}"
|
||||
wide-293,negative_lookup,True,,3.460392613997101,True,True,True,True,True,True,Aký názov práce má osoba Stanislav Matsunych s kľúčovým slovom cassandra?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o osobe Stanislav Matsunych s kľúčovým slovom cassandra."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [], ""count"": 0}"
|
||||
wide-294,negative_lookup,True,,4.047304077997978,True,True,True,True,True,True,Aký názov práce má osoba Rostyslav Rodzhuk s kľúčovým slovom translation?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o osobe Rostyslav Rodzhuk s kľúčovým slovom translation."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [], ""count"": 0}"
|
||||
wide-295,negative_lookup,True,,2.1742468329975964,True,True,True,True,True,True,Aký názov práce má osoba Adrián Remiáš s kľúčovým slovom agent?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o osobe Adrián Remiáš s kľúčovým slovom agent."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [], ""count"": 0}"
|
||||
wide-296,negative_lookup,True,,5.470801062001556,True,True,True,True,True,True,Aký názov práce má osoba Oleh Poiasnik v roku 2018?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o názve práce osoby Oleh Poiasnik v roku 2018. Dostupný zdroj (https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik) sa týka roku 2022."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/oleh_poiasnik""], ""count"": 0}"
|
||||
wide-297,negative_lookup,True,,4.190618332002487,True,True,True,True,True,True,Aký názov práce má osoba Cesar Abascal Gutierrez s kľúčovým slovom chatbot?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o osobe Cesar Abascal Gutierrez s kľúčovým slovom chatbot."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [], ""count"": 0}"
|
||||
wide-298,negative_lookup,True,,2.034728049999103,True,True,True,True,True,True,Aký názov práce má osoba Samuel Horáni s kľúčovým slovom agent?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o osobe Samuel Horáni s kľúčovým slovom agent."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [], ""count"": 0}"
|
||||
wide-299,negative_lookup,True,,5.025690648006275,True,True,True,True,True,True,Aký názov práce má osoba Samuel Širotník v roku 2018?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o názve práce osoby Samuel Širotník v roku 2018. Zdroj: https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik"", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/samuel_sirotnik""], ""count"": 0}"
|
||||
wide-300,negative_lookup,True,,3.9049685309946653,True,True,True,True,True,True,Aký názov práce má osoba Ján Pták v roku 2018?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o názve práce osoby Ján Pták v roku 2018. Dostupný zdroj (https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak) sa týka roku 2022."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/jan_ptak""], ""count"": 0}"
|
||||
wide-301,negative_lookup,True,,6.157832761993632,True,True,True,True,True,True,Aký názov práce má osoba Oleh Bilykh v roku 2018?,"{""answer"": ""Na základe dodaných grafových faktov nie je možné určiť názov práce osoby Oleh Bilykh v roku 2018, pretože neexistujú žiadne zodpovedajúce fakty."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/oleh_bilykh""], ""count"": 0}"
|
||||
wide-302,negative_lookup,True,,2.3194820119970245,True,True,True,True,True,True,Aký názov práce má osoba Sevval Bulburu s kľúčovým slovom annotation?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o osobe Sevval Bulburu s kľúčovým slovom annotation."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [], ""count"": null}"
|
||||
wide-303,negative_lookup,True,,3.9633937789985794,True,True,True,True,True,True,Aký názov práce má osoba Ediz Morochovič s kľúčovým slovom gpu?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o osobe Ediz Morochovič s kľúčovým slovom gpu."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [], ""count"": 0}"
|
||||
wide-304,negative_lookup,True,,4.055577051003638,True,True,True,True,True,True,Aký názov práce má osoba Daniil Huzenko v roku 2018?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o názve práce osoby Daniil Huzenko v roku 2018. Jediný dostupný zdroj sa týka roku 2022."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/daniil_huzenko""], ""count"": 0}"
|
||||
wide-305,negative_lookup,True,,4.846808893998968,True,True,True,True,True,True,Aký názov práce má osoba Jakub Schwarc v roku 2018?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o názve práce osoby Jakub Schwarc v roku 2018. Dostupný zdroj (https://zp.kemt.fei.tuke.sk/students/2022/jakub_schwarc) sa týka roku 2022."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/jakub_schwarc""], ""count"": 0}"
|
||||
wide-306,negative_lookup,True,,4.063987007997639,True,True,True,True,True,True,Aký názov práce má osoba Youssef Ressaissi v roku 2018?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o názve práce osoby Youssef Ressaissi v roku 2018."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [], ""count"": 0}"
|
||||
wide-307,negative_lookup,True,,5.840548838998075,True,True,True,True,True,True,Aký názov práce má osoba Maksym Zatirka v roku 2018?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o názve práce osoby Maksym Zatirka v roku 2018. Jediný dostupný zdroj sa týka roku 2023 (https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka)."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2023/maksym_zatirka""], ""count"": 0}"
|
||||
wide-308,negative_lookup,True,,2.309492806001799,True,True,True,True,True,True,Aký názov práce má osoba Patrik Pavlišin s kľúčovým slovom spacy?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o osobe Patrik Pavlišin s kľúčovým slovom spacy."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [], ""count"": 0}"
|
||||
wide-309,negative_lookup,True,,5.432989887995063,True,True,True,True,True,True,Aký názov práce má osoba Tomáš Kuchárik v roku 2018?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o názve práce osoby Tomáš Kuchárik v roku 2018. K dispozícii je len zdroj pre rok 2016: https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2016/tomas_kucharik""], ""count"": 0}"
|
||||
wide-310,negative_lookup,True,,3.9099001540016616,True,True,True,True,True,True,Aký názov práce má osoba Sevval Bulburu v roku 2018?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o názve práce osoby Sevval Bulburu v roku 2018."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [], ""count"": 0}"
|
||||
wide-311,negative_lookup,True,,5.625917255994864,True,True,True,True,True,True,Aký názov práce má osoba Eduard Matovka v roku 2018?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o názve práce osoby Eduard Matovka v roku 2018. K dispozícii je len zdroj pre rok 2021: https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2021/eduard_matovka""], ""count"": 0}"
|
||||
wide-312,negative_lookup,True,,1.646204315002251,True,True,True,True,True,True,Aký názov práce má osoba Lucia Chýbajúca Vzorová?,"{""answer"": ""Požadované údaje o osobe Lucia Chýbajúca Vzorová sa nenašli."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [], ""count"": null}"
|
||||
wide-313,negative_lookup,True,,5.2200822480008355,True,True,True,True,True,True,Aký názov práce má osoba Serhii Yemets v roku 2018?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o názve práce osoby Serhii Yemets v roku 2018. K dispozícii je len zdroj pre rok 2022: https://zp.kemt.fei.tuke.sk/students/2022/serhii_yemets."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/serhii_yemets""], ""count"": 0}"
|
||||
wide-314,negative_lookup,True,,3.4291655240012915,True,True,True,True,True,True,Aký názov práce má osoba Jozef Neznámy Overovací?,"{""answer"": ""Požadované údaje o osobe Jozef Neznámy Overovací sa nenašli."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [], ""count"": null}"
|
||||
wide-315,negative_lookup,True,,3.5061925330010126,True,True,True,True,True,True,Aký názov práce má osoba Vladimír Ferko s kľúčovým slovom cluster?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o osobe Vladimír Ferko s kľúčovým slovom cluster."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [], ""count"": null}"
|
||||
wide-316,negative_lookup,True,,2.7539666459997534,True,True,True,True,True,True,Aký názov práce má osoba Ján Malinovský s kľúčovým slovom ir?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o osobe Ján Malinovský s kľúčovým slovom 'ir'."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [], ""count"": null}"
|
||||
wide-317,negative_lookup,True,,4.164983741000469,True,True,True,True,True,True,Aký názov práce má osoba Ján Holp s kľúčovým slovom interpunction?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o osobe Ján Holp s kľúčovým slovom interpunction."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [], ""count"": 0}"
|
||||
wide-318,negative_lookup,True,,1.7391303290060023,True,True,True,True,True,True,Aký názov práce má osoba Petra Neznáma Overovacia?,"{""answer"": ""Požadované údaje o osobe Petra Neznáma Overovacia sa nenašli."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [], ""count"": null}"
|
||||
wide-319,negative_lookup,True,,4.787630693994288,True,True,True,True,True,True,Aký názov práce má osoba Vladyslav Yanchenko v roku 2018?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o názve práce osoby Vladyslav Yanchenko v roku 2018. Jediný dostupný zdroj sa týka roku 2022 (https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko)."", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2022/vladyslav_yanchenko""], ""count"": 0}"
|
||||
wide-320,negative_lookup,True,,3.4466839759988943,True,True,True,True,True,True,Aký názov práce má osoba Dávid Iľaš v roku 2018?,"{""answer"": ""Na základe dodaných grafových faktov sa nenašli žiadne údaje o názve práce osoby Dávid Iľaš v roku 2018. Zdroj: https://zp.kemt.fei.tuke.sk/students/2018/david_ilas"", ""status"": ""no_answer"", ""claims"": [], ""source_urls"": [""https://zp.kemt.fei.tuke.sk/students/2018/david_ilas""], ""count"": 0}"
|
||||
|
File diff suppressed because it is too large
Load Diff
File diff suppressed because it is too large
Load Diff
@ -0,0 +1,661 @@
|
||||
{
|
||||
"method": "Fresh LLM-generation holdout over previously measured, frozen graph queries.",
|
||||
"graph_freeze_sha256": "07867eb5300498b5862b1e4a607d9f5b050b9fdeab19b1fb6129810e28313a62",
|
||||
"audit_sha256": "220fd00ab08cceee6d5141ca5c1a02ec2877d1eee83b36ea707c6a076ba69e15",
|
||||
"generation_files": {
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/evaluate_graph_answers.py": "d34f324c0c490a02111eed31c45864c068b2b856040bea0201f731ab4ac527f5",
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/graph_answer_prompt.txt": "1900178f4ae805e258726a2df853ab2d0766033cf2ed956d28ea8e0caa7c653f",
|
||||
"tools/rag/evaluation/rag_runner.py": "a011b29e2b6aa47df9350e74fc358f05780a355170a819dbb1cfd16d2971493b"
|
||||
},
|
||||
"model": "model120-fast",
|
||||
"temperature": 0,
|
||||
"workers": 3,
|
||||
"dev_ids": [
|
||||
"wide-001",
|
||||
"wide-002",
|
||||
"wide-041",
|
||||
"wide-042",
|
||||
"wide-081",
|
||||
"wide-082",
|
||||
"wide-113",
|
||||
"wide-114",
|
||||
"wide-137",
|
||||
"wide-138",
|
||||
"wide-169",
|
||||
"wide-170",
|
||||
"wide-193",
|
||||
"wide-194",
|
||||
"wide-217",
|
||||
"wide-218",
|
||||
"wide-249",
|
||||
"wide-250",
|
||||
"wide-289",
|
||||
"wide-290"
|
||||
],
|
||||
"test_ids": [
|
||||
"wide-003",
|
||||
"wide-004",
|
||||
"wide-005",
|
||||
"wide-006",
|
||||
"wide-007",
|
||||
"wide-008",
|
||||
"wide-009",
|
||||
"wide-010",
|
||||
"wide-011",
|
||||
"wide-012",
|
||||
"wide-013",
|
||||
"wide-014",
|
||||
"wide-015",
|
||||
"wide-016",
|
||||
"wide-017",
|
||||
"wide-018",
|
||||
"wide-019",
|
||||
"wide-020",
|
||||
"wide-021",
|
||||
"wide-022",
|
||||
"wide-023",
|
||||
"wide-024",
|
||||
"wide-025",
|
||||
"wide-026",
|
||||
"wide-027",
|
||||
"wide-028",
|
||||
"wide-029",
|
||||
"wide-030",
|
||||
"wide-031",
|
||||
"wide-032",
|
||||
"wide-033",
|
||||
"wide-034",
|
||||
"wide-035",
|
||||
"wide-036",
|
||||
"wide-037",
|
||||
"wide-038",
|
||||
"wide-039",
|
||||
"wide-040",
|
||||
"wide-043",
|
||||
"wide-044",
|
||||
"wide-045",
|
||||
"wide-046",
|
||||
"wide-047",
|
||||
"wide-048",
|
||||
"wide-049",
|
||||
"wide-050",
|
||||
"wide-051",
|
||||
"wide-052",
|
||||
"wide-053",
|
||||
"wide-054",
|
||||
"wide-055",
|
||||
"wide-056",
|
||||
"wide-057",
|
||||
"wide-058",
|
||||
"wide-059",
|
||||
"wide-060",
|
||||
"wide-061",
|
||||
"wide-062",
|
||||
"wide-063",
|
||||
"wide-064",
|
||||
"wide-065",
|
||||
"wide-066",
|
||||
"wide-067",
|
||||
"wide-068",
|
||||
"wide-069",
|
||||
"wide-070",
|
||||
"wide-071",
|
||||
"wide-072",
|
||||
"wide-073",
|
||||
"wide-074",
|
||||
"wide-075",
|
||||
"wide-076",
|
||||
"wide-077",
|
||||
"wide-078",
|
||||
"wide-079",
|
||||
"wide-080",
|
||||
"wide-083",
|
||||
"wide-084",
|
||||
"wide-085",
|
||||
"wide-086",
|
||||
"wide-087",
|
||||
"wide-088",
|
||||
"wide-089",
|
||||
"wide-090",
|
||||
"wide-091",
|
||||
"wide-092",
|
||||
"wide-093",
|
||||
"wide-094",
|
||||
"wide-095",
|
||||
"wide-096",
|
||||
"wide-097",
|
||||
"wide-098",
|
||||
"wide-099",
|
||||
"wide-100",
|
||||
"wide-101",
|
||||
"wide-102",
|
||||
"wide-103",
|
||||
"wide-104",
|
||||
"wide-105",
|
||||
"wide-106",
|
||||
"wide-107",
|
||||
"wide-108",
|
||||
"wide-109",
|
||||
"wide-110",
|
||||
"wide-111",
|
||||
"wide-112",
|
||||
"wide-115",
|
||||
"wide-116",
|
||||
"wide-117",
|
||||
"wide-118",
|
||||
"wide-119",
|
||||
"wide-120",
|
||||
"wide-121",
|
||||
"wide-122",
|
||||
"wide-123",
|
||||
"wide-124",
|
||||
"wide-125",
|
||||
"wide-126",
|
||||
"wide-127",
|
||||
"wide-128",
|
||||
"wide-129",
|
||||
"wide-130",
|
||||
"wide-131",
|
||||
"wide-132",
|
||||
"wide-133",
|
||||
"wide-134",
|
||||
"wide-135",
|
||||
"wide-136",
|
||||
"wide-139",
|
||||
"wide-140",
|
||||
"wide-141",
|
||||
"wide-142",
|
||||
"wide-143",
|
||||
"wide-144",
|
||||
"wide-145",
|
||||
"wide-146",
|
||||
"wide-147",
|
||||
"wide-148",
|
||||
"wide-149",
|
||||
"wide-150",
|
||||
"wide-151",
|
||||
"wide-152",
|
||||
"wide-153",
|
||||
"wide-154",
|
||||
"wide-155",
|
||||
"wide-156",
|
||||
"wide-157",
|
||||
"wide-158",
|
||||
"wide-159",
|
||||
"wide-160",
|
||||
"wide-161",
|
||||
"wide-162",
|
||||
"wide-163",
|
||||
"wide-164",
|
||||
"wide-165",
|
||||
"wide-166",
|
||||
"wide-167",
|
||||
"wide-168",
|
||||
"wide-171",
|
||||
"wide-172",
|
||||
"wide-173",
|
||||
"wide-174",
|
||||
"wide-175",
|
||||
"wide-176",
|
||||
"wide-177",
|
||||
"wide-178",
|
||||
"wide-179",
|
||||
"wide-180",
|
||||
"wide-181",
|
||||
"wide-182",
|
||||
"wide-183",
|
||||
"wide-184",
|
||||
"wide-185",
|
||||
"wide-186",
|
||||
"wide-187",
|
||||
"wide-188",
|
||||
"wide-189",
|
||||
"wide-190",
|
||||
"wide-191",
|
||||
"wide-192",
|
||||
"wide-195",
|
||||
"wide-196",
|
||||
"wide-197",
|
||||
"wide-198",
|
||||
"wide-199",
|
||||
"wide-200",
|
||||
"wide-201",
|
||||
"wide-202",
|
||||
"wide-203",
|
||||
"wide-204",
|
||||
"wide-205",
|
||||
"wide-206",
|
||||
"wide-207",
|
||||
"wide-208",
|
||||
"wide-209",
|
||||
"wide-210",
|
||||
"wide-211",
|
||||
"wide-212",
|
||||
"wide-213",
|
||||
"wide-214",
|
||||
"wide-215",
|
||||
"wide-216",
|
||||
"wide-219",
|
||||
"wide-220",
|
||||
"wide-221",
|
||||
"wide-222",
|
||||
"wide-223",
|
||||
"wide-224",
|
||||
"wide-225",
|
||||
"wide-226",
|
||||
"wide-227",
|
||||
"wide-228",
|
||||
"wide-229",
|
||||
"wide-230",
|
||||
"wide-231",
|
||||
"wide-232",
|
||||
"wide-233",
|
||||
"wide-234",
|
||||
"wide-235",
|
||||
"wide-236",
|
||||
"wide-237",
|
||||
"wide-238",
|
||||
"wide-239",
|
||||
"wide-240",
|
||||
"wide-241",
|
||||
"wide-242",
|
||||
"wide-243",
|
||||
"wide-244",
|
||||
"wide-245",
|
||||
"wide-246",
|
||||
"wide-247",
|
||||
"wide-248",
|
||||
"wide-251",
|
||||
"wide-252",
|
||||
"wide-253",
|
||||
"wide-254",
|
||||
"wide-255",
|
||||
"wide-256",
|
||||
"wide-257",
|
||||
"wide-258",
|
||||
"wide-259",
|
||||
"wide-260",
|
||||
"wide-261",
|
||||
"wide-262",
|
||||
"wide-263",
|
||||
"wide-264",
|
||||
"wide-265",
|
||||
"wide-266",
|
||||
"wide-267",
|
||||
"wide-268",
|
||||
"wide-269",
|
||||
"wide-270",
|
||||
"wide-271",
|
||||
"wide-272",
|
||||
"wide-273",
|
||||
"wide-274",
|
||||
"wide-275",
|
||||
"wide-276",
|
||||
"wide-277",
|
||||
"wide-278",
|
||||
"wide-279",
|
||||
"wide-280",
|
||||
"wide-281",
|
||||
"wide-282",
|
||||
"wide-283",
|
||||
"wide-284",
|
||||
"wide-285",
|
||||
"wide-286",
|
||||
"wide-287",
|
||||
"wide-288",
|
||||
"wide-291",
|
||||
"wide-292",
|
||||
"wide-293",
|
||||
"wide-294",
|
||||
"wide-295",
|
||||
"wide-296",
|
||||
"wide-297",
|
||||
"wide-298",
|
||||
"wide-299",
|
||||
"wide-300",
|
||||
"wide-301",
|
||||
"wide-302",
|
||||
"wide-303",
|
||||
"wide-304",
|
||||
"wide-305",
|
||||
"wide-306",
|
||||
"wide-307",
|
||||
"wide-308",
|
||||
"wide-309",
|
||||
"wide-310",
|
||||
"wide-311",
|
||||
"wide-312",
|
||||
"wide-313",
|
||||
"wide-314",
|
||||
"wide-315",
|
||||
"wide-316",
|
||||
"wide-317",
|
||||
"wide-318",
|
||||
"wide-319",
|
||||
"wide-320"
|
||||
],
|
||||
"dev_count": 20,
|
||||
"test_count": 300,
|
||||
"target_accuracy": 0.92,
|
||||
"selected_split": "test",
|
||||
"selected_ids": [
|
||||
"wide-003",
|
||||
"wide-004",
|
||||
"wide-005",
|
||||
"wide-006",
|
||||
"wide-007",
|
||||
"wide-008",
|
||||
"wide-009",
|
||||
"wide-010",
|
||||
"wide-011",
|
||||
"wide-012",
|
||||
"wide-013",
|
||||
"wide-014",
|
||||
"wide-015",
|
||||
"wide-016",
|
||||
"wide-017",
|
||||
"wide-018",
|
||||
"wide-019",
|
||||
"wide-020",
|
||||
"wide-021",
|
||||
"wide-022",
|
||||
"wide-023",
|
||||
"wide-024",
|
||||
"wide-025",
|
||||
"wide-026",
|
||||
"wide-027",
|
||||
"wide-028",
|
||||
"wide-029",
|
||||
"wide-030",
|
||||
"wide-031",
|
||||
"wide-032",
|
||||
"wide-033",
|
||||
"wide-034",
|
||||
"wide-035",
|
||||
"wide-036",
|
||||
"wide-037",
|
||||
"wide-038",
|
||||
"wide-039",
|
||||
"wide-040",
|
||||
"wide-043",
|
||||
"wide-044",
|
||||
"wide-045",
|
||||
"wide-046",
|
||||
"wide-047",
|
||||
"wide-048",
|
||||
"wide-049",
|
||||
"wide-050",
|
||||
"wide-051",
|
||||
"wide-052",
|
||||
"wide-053",
|
||||
"wide-054",
|
||||
"wide-055",
|
||||
"wide-056",
|
||||
"wide-057",
|
||||
"wide-058",
|
||||
"wide-059",
|
||||
"wide-060",
|
||||
"wide-061",
|
||||
"wide-062",
|
||||
"wide-063",
|
||||
"wide-064",
|
||||
"wide-065",
|
||||
"wide-066",
|
||||
"wide-067",
|
||||
"wide-068",
|
||||
"wide-069",
|
||||
"wide-070",
|
||||
"wide-071",
|
||||
"wide-072",
|
||||
"wide-073",
|
||||
"wide-074",
|
||||
"wide-075",
|
||||
"wide-076",
|
||||
"wide-077",
|
||||
"wide-078",
|
||||
"wide-079",
|
||||
"wide-080",
|
||||
"wide-083",
|
||||
"wide-084",
|
||||
"wide-085",
|
||||
"wide-086",
|
||||
"wide-087",
|
||||
"wide-088",
|
||||
"wide-089",
|
||||
"wide-090",
|
||||
"wide-091",
|
||||
"wide-092",
|
||||
"wide-093",
|
||||
"wide-094",
|
||||
"wide-095",
|
||||
"wide-096",
|
||||
"wide-097",
|
||||
"wide-098",
|
||||
"wide-099",
|
||||
"wide-100",
|
||||
"wide-101",
|
||||
"wide-102",
|
||||
"wide-103",
|
||||
"wide-104",
|
||||
"wide-105",
|
||||
"wide-106",
|
||||
"wide-107",
|
||||
"wide-108",
|
||||
"wide-109",
|
||||
"wide-110",
|
||||
"wide-111",
|
||||
"wide-112",
|
||||
"wide-115",
|
||||
"wide-116",
|
||||
"wide-117",
|
||||
"wide-118",
|
||||
"wide-119",
|
||||
"wide-120",
|
||||
"wide-121",
|
||||
"wide-122",
|
||||
"wide-123",
|
||||
"wide-124",
|
||||
"wide-125",
|
||||
"wide-126",
|
||||
"wide-127",
|
||||
"wide-128",
|
||||
"wide-129",
|
||||
"wide-130",
|
||||
"wide-131",
|
||||
"wide-132",
|
||||
"wide-133",
|
||||
"wide-134",
|
||||
"wide-135",
|
||||
"wide-136",
|
||||
"wide-139",
|
||||
"wide-140",
|
||||
"wide-141",
|
||||
"wide-142",
|
||||
"wide-143",
|
||||
"wide-144",
|
||||
"wide-145",
|
||||
"wide-146",
|
||||
"wide-147",
|
||||
"wide-148",
|
||||
"wide-149",
|
||||
"wide-150",
|
||||
"wide-151",
|
||||
"wide-152",
|
||||
"wide-153",
|
||||
"wide-154",
|
||||
"wide-155",
|
||||
"wide-156",
|
||||
"wide-157",
|
||||
"wide-158",
|
||||
"wide-159",
|
||||
"wide-160",
|
||||
"wide-161",
|
||||
"wide-162",
|
||||
"wide-163",
|
||||
"wide-164",
|
||||
"wide-165",
|
||||
"wide-166",
|
||||
"wide-167",
|
||||
"wide-168",
|
||||
"wide-171",
|
||||
"wide-172",
|
||||
"wide-173",
|
||||
"wide-174",
|
||||
"wide-175",
|
||||
"wide-176",
|
||||
"wide-177",
|
||||
"wide-178",
|
||||
"wide-179",
|
||||
"wide-180",
|
||||
"wide-181",
|
||||
"wide-182",
|
||||
"wide-183",
|
||||
"wide-184",
|
||||
"wide-185",
|
||||
"wide-186",
|
||||
"wide-187",
|
||||
"wide-188",
|
||||
"wide-189",
|
||||
"wide-190",
|
||||
"wide-191",
|
||||
"wide-192",
|
||||
"wide-195",
|
||||
"wide-196",
|
||||
"wide-197",
|
||||
"wide-198",
|
||||
"wide-199",
|
||||
"wide-200",
|
||||
"wide-201",
|
||||
"wide-202",
|
||||
"wide-203",
|
||||
"wide-204",
|
||||
"wide-205",
|
||||
"wide-206",
|
||||
"wide-207",
|
||||
"wide-208",
|
||||
"wide-209",
|
||||
"wide-210",
|
||||
"wide-211",
|
||||
"wide-212",
|
||||
"wide-213",
|
||||
"wide-214",
|
||||
"wide-215",
|
||||
"wide-216",
|
||||
"wide-219",
|
||||
"wide-220",
|
||||
"wide-221",
|
||||
"wide-222",
|
||||
"wide-223",
|
||||
"wide-224",
|
||||
"wide-225",
|
||||
"wide-226",
|
||||
"wide-227",
|
||||
"wide-228",
|
||||
"wide-229",
|
||||
"wide-230",
|
||||
"wide-231",
|
||||
"wide-232",
|
||||
"wide-233",
|
||||
"wide-234",
|
||||
"wide-235",
|
||||
"wide-236",
|
||||
"wide-237",
|
||||
"wide-238",
|
||||
"wide-239",
|
||||
"wide-240",
|
||||
"wide-241",
|
||||
"wide-242",
|
||||
"wide-243",
|
||||
"wide-244",
|
||||
"wide-245",
|
||||
"wide-246",
|
||||
"wide-247",
|
||||
"wide-248",
|
||||
"wide-251",
|
||||
"wide-252",
|
||||
"wide-253",
|
||||
"wide-254",
|
||||
"wide-255",
|
||||
"wide-256",
|
||||
"wide-257",
|
||||
"wide-258",
|
||||
"wide-259",
|
||||
"wide-260",
|
||||
"wide-261",
|
||||
"wide-262",
|
||||
"wide-263",
|
||||
"wide-264",
|
||||
"wide-265",
|
||||
"wide-266",
|
||||
"wide-267",
|
||||
"wide-268",
|
||||
"wide-269",
|
||||
"wide-270",
|
||||
"wide-271",
|
||||
"wide-272",
|
||||
"wide-273",
|
||||
"wide-274",
|
||||
"wide-275",
|
||||
"wide-276",
|
||||
"wide-277",
|
||||
"wide-278",
|
||||
"wide-279",
|
||||
"wide-280",
|
||||
"wide-281",
|
||||
"wide-282",
|
||||
"wide-283",
|
||||
"wide-284",
|
||||
"wide-285",
|
||||
"wide-286",
|
||||
"wide-287",
|
||||
"wide-288",
|
||||
"wide-291",
|
||||
"wide-292",
|
||||
"wide-293",
|
||||
"wide-294",
|
||||
"wide-295",
|
||||
"wide-296",
|
||||
"wide-297",
|
||||
"wide-298",
|
||||
"wide-299",
|
||||
"wide-300",
|
||||
"wide-301",
|
||||
"wide-302",
|
||||
"wide-303",
|
||||
"wide-304",
|
||||
"wide-305",
|
||||
"wide-306",
|
||||
"wide-307",
|
||||
"wide-308",
|
||||
"wide-309",
|
||||
"wide-310",
|
||||
"wide-311",
|
||||
"wide-312",
|
||||
"wide-313",
|
||||
"wide-314",
|
||||
"wide-315",
|
||||
"wide-316",
|
||||
"wide-317",
|
||||
"wide-318",
|
||||
"wide-319",
|
||||
"wide-320"
|
||||
],
|
||||
"policy": "Evaluate all 300; retain every failure; do not tune on this TEST.",
|
||||
"test_categories": {
|
||||
"shared_keyword_pair": 38,
|
||||
"same_academic_year_pair": 38,
|
||||
"same_start_year_pair": 30,
|
||||
"person_title_year": 22,
|
||||
"person_keyword_title": 30,
|
||||
"document_author_category_multi_hop": 22,
|
||||
"person_multiple_categories": 22,
|
||||
"candidate_set_aggregation": 30,
|
||||
"conjunctive_disambiguation": 38,
|
||||
"negative_lookup": 30
|
||||
},
|
||||
"limitations": [
|
||||
"Known corpus/profiles and templates; model outputs for these 300 questions were not previously observed.",
|
||||
"Harness supplies graph context; native OpenWebUI tool choice and browser UI are outside this experiment.",
|
||||
"Checks structured factual claims, their source support/citations and required prose values; not a general semantic judge of arbitrary prose."
|
||||
]
|
||||
}
|
||||
@ -0,0 +1,40 @@
|
||||
id,category,strict,error,latency_seconds,attempts,first_pass_strict
|
||||
wide-001,shared_keyword_pair,True,,7.432791330997134,1,True
|
||||
wide-002,shared_keyword_pair,True,,9.3359067220008,1,True
|
||||
wide-041,same_academic_year_pair,True,,13.052469432994258,1,True
|
||||
wide-042,same_academic_year_pair,True,,7.94166571200185,1,True
|
||||
wide-080,same_academic_year_pair,True,,8.928297609003494,1,True
|
||||
wide-081,same_start_year_pair,True,,8.421164927000063,1,True
|
||||
wide-082,same_start_year_pair,True,,8.470174660003977,1,True
|
||||
wide-104,same_start_year_pair,True,,9.088728798000375,1,True
|
||||
wide-113,person_title_year,True,,7.292930210009217,1,True
|
||||
wide-114,person_title_year,True,,8.822794015999534,1,True
|
||||
wide-119,person_title_year,True,,5.405082925994066,1,True
|
||||
wide-137,person_keyword_title,True,,9.147465852001915,1,True
|
||||
wide-138,person_keyword_title,True,,6.318841665008222,1,True
|
||||
wide-139,person_keyword_title,True,,10.469266973988852,1,True
|
||||
wide-141,person_keyword_title,True,,6.316172414997709,1,True
|
||||
wide-142,person_keyword_title,False,,10.959449250003672,1,False
|
||||
wide-143,person_keyword_title,True,,8.508081905994914,1,True
|
||||
wide-145,person_keyword_title,True,,13.52746086299885,1,True
|
||||
wide-155,person_keyword_title,True,,6.8860766970028635,1,True
|
||||
wide-159,person_keyword_title,True,,10.890385270991828,1,True
|
||||
wide-161,person_keyword_title,True,,6.801796521991491,1,True
|
||||
wide-163,person_keyword_title,True,,10.777118418001919,1,True
|
||||
wide-169,document_author_category_multi_hop,True,,4.879302582994569,1,True
|
||||
wide-170,document_author_category_multi_hop,True,,8.241740879006102,1,True
|
||||
wide-178,document_author_category_multi_hop,True,,5.5909052140050335,1,True
|
||||
wide-181,document_author_category_multi_hop,True,,8.192060016008327,1,True
|
||||
wide-193,person_multiple_categories,True,,4.390313146999688,1,True
|
||||
wide-194,person_multiple_categories,True,,6.805427877989132,1,True
|
||||
wide-209,person_multiple_categories,True,,5.125700485994457,1,True
|
||||
wide-217,candidate_set_aggregation,True,,9.28586104400165,1,True
|
||||
wide-218,candidate_set_aggregation,True,,7.510667574999388,1,True
|
||||
wide-232,candidate_set_aggregation,True,,10.86943264301226,1,True
|
||||
wide-236,candidate_set_aggregation,True,,7.126413513993612,1,True
|
||||
wide-239,candidate_set_aggregation,True,,11.048067500989418,1,True
|
||||
wide-249,conjunctive_disambiguation,True,,4.892320775994449,1,True
|
||||
wide-250,conjunctive_disambiguation,True,,8.952342251010123,1,True
|
||||
wide-283,conjunctive_disambiguation,True,,7.288101250000182,1,True
|
||||
wide-289,negative_lookup,True,,5.516414188998169,1,True
|
||||
wide-290,negative_lookup,True,,4.058507394001936,1,True
|
||||
|
File diff suppressed because it is too large
Load Diff
@ -0,0 +1,425 @@
|
||||
{
|
||||
"method": "Previously exposed LLM questions; regression, not independent TEST.",
|
||||
"graph_freeze_sha256": "ca1d2d71f60a8e65b82d727ad14556aabf2e03f2acdce1755c3e2a7a9a3149d3",
|
||||
"audit_sha256": "81708ca63f8772673cd836fe7a1a1938fbe0e713588efcb07ed3fd4280f27829",
|
||||
"generation_files": {
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/evaluate_graph_answers.py": "3b58e210fcd934a5488575e1b0ebb46a2e94ce72ee12f1e1a666c726c66d68af",
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/graph_answer_prompt.txt": "64d2bd817657f390c306ea01bf2dad41f70cd6993e06b2e3b2f4713bae0d249c",
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/answer_format.py": "86a27b4aebc6a5077e13794b81957a1cf063a1f3e070c583120ba53c1788d2f8",
|
||||
"tools/rag/evaluation/rag_runner.py": "a011b29e2b6aa47df9350e74fc358f05780a355170a819dbb1cfd16d2971493b"
|
||||
},
|
||||
"model": "model120-fast",
|
||||
"temperature": 0,
|
||||
"workers": 3,
|
||||
"dev_ids": [
|
||||
"wide-001",
|
||||
"wide-002",
|
||||
"wide-041",
|
||||
"wide-042",
|
||||
"wide-080",
|
||||
"wide-081",
|
||||
"wide-082",
|
||||
"wide-104",
|
||||
"wide-113",
|
||||
"wide-114",
|
||||
"wide-119",
|
||||
"wide-137",
|
||||
"wide-138",
|
||||
"wide-139",
|
||||
"wide-141",
|
||||
"wide-142",
|
||||
"wide-143",
|
||||
"wide-145",
|
||||
"wide-155",
|
||||
"wide-159",
|
||||
"wide-161",
|
||||
"wide-163",
|
||||
"wide-169",
|
||||
"wide-170",
|
||||
"wide-178",
|
||||
"wide-181",
|
||||
"wide-193",
|
||||
"wide-194",
|
||||
"wide-209",
|
||||
"wide-217",
|
||||
"wide-218",
|
||||
"wide-232",
|
||||
"wide-236",
|
||||
"wide-239",
|
||||
"wide-249",
|
||||
"wide-250",
|
||||
"wide-283",
|
||||
"wide-289",
|
||||
"wide-290"
|
||||
],
|
||||
"test_ids": [
|
||||
"wide-003",
|
||||
"wide-004",
|
||||
"wide-005",
|
||||
"wide-006",
|
||||
"wide-007",
|
||||
"wide-008",
|
||||
"wide-009",
|
||||
"wide-010",
|
||||
"wide-011",
|
||||
"wide-012",
|
||||
"wide-013",
|
||||
"wide-014",
|
||||
"wide-015",
|
||||
"wide-016",
|
||||
"wide-017",
|
||||
"wide-018",
|
||||
"wide-019",
|
||||
"wide-020",
|
||||
"wide-021",
|
||||
"wide-022",
|
||||
"wide-023",
|
||||
"wide-024",
|
||||
"wide-025",
|
||||
"wide-026",
|
||||
"wide-027",
|
||||
"wide-028",
|
||||
"wide-029",
|
||||
"wide-030",
|
||||
"wide-031",
|
||||
"wide-032",
|
||||
"wide-033",
|
||||
"wide-034",
|
||||
"wide-035",
|
||||
"wide-036",
|
||||
"wide-037",
|
||||
"wide-038",
|
||||
"wide-039",
|
||||
"wide-040",
|
||||
"wide-043",
|
||||
"wide-044",
|
||||
"wide-045",
|
||||
"wide-046",
|
||||
"wide-047",
|
||||
"wide-048",
|
||||
"wide-049",
|
||||
"wide-050",
|
||||
"wide-051",
|
||||
"wide-052",
|
||||
"wide-053",
|
||||
"wide-054",
|
||||
"wide-055",
|
||||
"wide-056",
|
||||
"wide-057",
|
||||
"wide-058",
|
||||
"wide-059",
|
||||
"wide-060",
|
||||
"wide-061",
|
||||
"wide-062",
|
||||
"wide-063",
|
||||
"wide-064",
|
||||
"wide-065",
|
||||
"wide-066",
|
||||
"wide-067",
|
||||
"wide-068",
|
||||
"wide-069",
|
||||
"wide-070",
|
||||
"wide-071",
|
||||
"wide-072",
|
||||
"wide-073",
|
||||
"wide-074",
|
||||
"wide-075",
|
||||
"wide-076",
|
||||
"wide-077",
|
||||
"wide-078",
|
||||
"wide-079",
|
||||
"wide-080",
|
||||
"wide-083",
|
||||
"wide-084",
|
||||
"wide-085",
|
||||
"wide-086",
|
||||
"wide-087",
|
||||
"wide-088",
|
||||
"wide-089",
|
||||
"wide-090",
|
||||
"wide-091",
|
||||
"wide-092",
|
||||
"wide-093",
|
||||
"wide-094",
|
||||
"wide-095",
|
||||
"wide-096",
|
||||
"wide-097",
|
||||
"wide-098",
|
||||
"wide-099",
|
||||
"wide-100",
|
||||
"wide-101",
|
||||
"wide-102",
|
||||
"wide-103",
|
||||
"wide-104",
|
||||
"wide-105",
|
||||
"wide-106",
|
||||
"wide-107",
|
||||
"wide-108",
|
||||
"wide-109",
|
||||
"wide-110",
|
||||
"wide-111",
|
||||
"wide-112",
|
||||
"wide-115",
|
||||
"wide-116",
|
||||
"wide-117",
|
||||
"wide-118",
|
||||
"wide-119",
|
||||
"wide-120",
|
||||
"wide-121",
|
||||
"wide-122",
|
||||
"wide-123",
|
||||
"wide-124",
|
||||
"wide-125",
|
||||
"wide-126",
|
||||
"wide-127",
|
||||
"wide-128",
|
||||
"wide-129",
|
||||
"wide-130",
|
||||
"wide-131",
|
||||
"wide-132",
|
||||
"wide-133",
|
||||
"wide-134",
|
||||
"wide-135",
|
||||
"wide-136",
|
||||
"wide-139",
|
||||
"wide-140",
|
||||
"wide-141",
|
||||
"wide-142",
|
||||
"wide-143",
|
||||
"wide-144",
|
||||
"wide-145",
|
||||
"wide-146",
|
||||
"wide-147",
|
||||
"wide-148",
|
||||
"wide-149",
|
||||
"wide-150",
|
||||
"wide-151",
|
||||
"wide-152",
|
||||
"wide-153",
|
||||
"wide-154",
|
||||
"wide-155",
|
||||
"wide-156",
|
||||
"wide-157",
|
||||
"wide-158",
|
||||
"wide-159",
|
||||
"wide-160",
|
||||
"wide-161",
|
||||
"wide-162",
|
||||
"wide-163",
|
||||
"wide-164",
|
||||
"wide-165",
|
||||
"wide-166",
|
||||
"wide-167",
|
||||
"wide-168",
|
||||
"wide-171",
|
||||
"wide-172",
|
||||
"wide-173",
|
||||
"wide-174",
|
||||
"wide-175",
|
||||
"wide-176",
|
||||
"wide-177",
|
||||
"wide-178",
|
||||
"wide-179",
|
||||
"wide-180",
|
||||
"wide-181",
|
||||
"wide-182",
|
||||
"wide-183",
|
||||
"wide-184",
|
||||
"wide-185",
|
||||
"wide-186",
|
||||
"wide-187",
|
||||
"wide-188",
|
||||
"wide-189",
|
||||
"wide-190",
|
||||
"wide-191",
|
||||
"wide-192",
|
||||
"wide-195",
|
||||
"wide-196",
|
||||
"wide-197",
|
||||
"wide-198",
|
||||
"wide-199",
|
||||
"wide-200",
|
||||
"wide-201",
|
||||
"wide-202",
|
||||
"wide-203",
|
||||
"wide-204",
|
||||
"wide-205",
|
||||
"wide-206",
|
||||
"wide-207",
|
||||
"wide-208",
|
||||
"wide-209",
|
||||
"wide-210",
|
||||
"wide-211",
|
||||
"wide-212",
|
||||
"wide-213",
|
||||
"wide-214",
|
||||
"wide-215",
|
||||
"wide-216",
|
||||
"wide-219",
|
||||
"wide-220",
|
||||
"wide-221",
|
||||
"wide-222",
|
||||
"wide-223",
|
||||
"wide-224",
|
||||
"wide-225",
|
||||
"wide-226",
|
||||
"wide-227",
|
||||
"wide-228",
|
||||
"wide-229",
|
||||
"wide-230",
|
||||
"wide-231",
|
||||
"wide-232",
|
||||
"wide-233",
|
||||
"wide-234",
|
||||
"wide-235",
|
||||
"wide-236",
|
||||
"wide-237",
|
||||
"wide-238",
|
||||
"wide-239",
|
||||
"wide-240",
|
||||
"wide-241",
|
||||
"wide-242",
|
||||
"wide-243",
|
||||
"wide-244",
|
||||
"wide-245",
|
||||
"wide-246",
|
||||
"wide-247",
|
||||
"wide-248",
|
||||
"wide-251",
|
||||
"wide-252",
|
||||
"wide-253",
|
||||
"wide-254",
|
||||
"wide-255",
|
||||
"wide-256",
|
||||
"wide-257",
|
||||
"wide-258",
|
||||
"wide-259",
|
||||
"wide-260",
|
||||
"wide-261",
|
||||
"wide-262",
|
||||
"wide-263",
|
||||
"wide-264",
|
||||
"wide-265",
|
||||
"wide-266",
|
||||
"wide-267",
|
||||
"wide-268",
|
||||
"wide-269",
|
||||
"wide-270",
|
||||
"wide-271",
|
||||
"wide-272",
|
||||
"wide-273",
|
||||
"wide-274",
|
||||
"wide-275",
|
||||
"wide-276",
|
||||
"wide-277",
|
||||
"wide-278",
|
||||
"wide-279",
|
||||
"wide-280",
|
||||
"wide-281",
|
||||
"wide-282",
|
||||
"wide-283",
|
||||
"wide-284",
|
||||
"wide-285",
|
||||
"wide-286",
|
||||
"wide-287",
|
||||
"wide-288",
|
||||
"wide-291",
|
||||
"wide-292",
|
||||
"wide-293",
|
||||
"wide-294",
|
||||
"wide-295",
|
||||
"wide-296",
|
||||
"wide-297",
|
||||
"wide-298",
|
||||
"wide-299",
|
||||
"wide-300",
|
||||
"wide-301",
|
||||
"wide-302",
|
||||
"wide-303",
|
||||
"wide-304",
|
||||
"wide-305",
|
||||
"wide-306",
|
||||
"wide-307",
|
||||
"wide-308",
|
||||
"wide-309",
|
||||
"wide-310",
|
||||
"wide-311",
|
||||
"wide-312",
|
||||
"wide-313",
|
||||
"wide-314",
|
||||
"wide-315",
|
||||
"wide-316",
|
||||
"wide-317",
|
||||
"wide-318",
|
||||
"wide-319",
|
||||
"wide-320"
|
||||
],
|
||||
"dev_count": 39,
|
||||
"test_count": 300,
|
||||
"target_accuracy": 0.92,
|
||||
"selected_split": "dev",
|
||||
"selected_ids": [
|
||||
"wide-001",
|
||||
"wide-002",
|
||||
"wide-041",
|
||||
"wide-042",
|
||||
"wide-080",
|
||||
"wide-081",
|
||||
"wide-082",
|
||||
"wide-104",
|
||||
"wide-113",
|
||||
"wide-114",
|
||||
"wide-119",
|
||||
"wide-137",
|
||||
"wide-138",
|
||||
"wide-139",
|
||||
"wide-141",
|
||||
"wide-142",
|
||||
"wide-143",
|
||||
"wide-145",
|
||||
"wide-155",
|
||||
"wide-159",
|
||||
"wide-161",
|
||||
"wide-163",
|
||||
"wide-169",
|
||||
"wide-170",
|
||||
"wide-178",
|
||||
"wide-181",
|
||||
"wide-193",
|
||||
"wide-194",
|
||||
"wide-209",
|
||||
"wide-217",
|
||||
"wide-218",
|
||||
"wide-232",
|
||||
"wide-236",
|
||||
"wide-239",
|
||||
"wide-249",
|
||||
"wide-250",
|
||||
"wide-283",
|
||||
"wide-289",
|
||||
"wide-290"
|
||||
],
|
||||
"selected_count": 39,
|
||||
"selected_dev_overlap": 39,
|
||||
"format_repair_limit": 1,
|
||||
"repair_policy": "Only JSON/schema failures; same question/context, no gold; retain all attempts.",
|
||||
"dev_results_sha256": null,
|
||||
"policy": "Evaluate every declared regression case, including DEV overlap; retain all failures and stop tuning after this freeze.",
|
||||
"selected_categories": {
|
||||
"shared_keyword_pair": 2,
|
||||
"same_academic_year_pair": 3,
|
||||
"same_start_year_pair": 3,
|
||||
"person_title_year": 3,
|
||||
"person_keyword_title": 11,
|
||||
"document_author_category_multi_hop": 4,
|
||||
"person_multiple_categories": 3,
|
||||
"candidate_set_aggregation": 5,
|
||||
"conjunctive_disambiguation": 3,
|
||||
"negative_lookup": 2
|
||||
},
|
||||
"limitations": [
|
||||
"Known corpus/profiles and templates; model outputs for these 300 questions were not previously observed.",
|
||||
"Harness supplies graph context; native OpenWebUI tool choice and browser UI are outside this experiment.",
|
||||
"Checks structured factual claims, their source support/citations and required prose values; not a general semantic judge of arbitrary prose."
|
||||
]
|
||||
}
|
||||
@ -0,0 +1,321 @@
|
||||
id,category,strict,error,latency_seconds,attempts,first_pass_strict
|
||||
wide-001,shared_keyword_pair,True,,12.681157764003729,1,True
|
||||
wide-002,shared_keyword_pair,True,,7.440348913005437,1,True
|
||||
wide-003,shared_keyword_pair,True,,6.8628689809993375,1,True
|
||||
wide-004,shared_keyword_pair,True,,7.915003027010243,1,True
|
||||
wide-005,shared_keyword_pair,True,,11.64334254800633,1,True
|
||||
wide-006,shared_keyword_pair,True,,9.263334328003111,1,True
|
||||
wide-007,shared_keyword_pair,True,,10.080044332993566,1,True
|
||||
wide-008,shared_keyword_pair,True,,9.102414163004141,1,True
|
||||
wide-009,shared_keyword_pair,True,,8.990864911000244,1,True
|
||||
wide-010,shared_keyword_pair,True,,10.98848542298947,1,True
|
||||
wide-011,shared_keyword_pair,True,,9.469930938998004,1,True
|
||||
wide-012,shared_keyword_pair,True,,11.050285377990804,1,True
|
||||
wide-013,shared_keyword_pair,True,,8.279340490000322,1,True
|
||||
wide-014,shared_keyword_pair,True,,10.769162045005942,1,True
|
||||
wide-015,shared_keyword_pair,True,,10.199135344999377,1,True
|
||||
wide-016,shared_keyword_pair,True,,12.438964514003601,1,True
|
||||
wide-017,shared_keyword_pair,True,,10.442358953005169,1,True
|
||||
wide-018,shared_keyword_pair,True,,10.590256554991356,1,True
|
||||
wide-019,shared_keyword_pair,True,,9.393680679990212,1,True
|
||||
wide-020,shared_keyword_pair,True,,10.050156186000095,1,True
|
||||
wide-021,shared_keyword_pair,True,,10.283129505012766,1,True
|
||||
wide-022,shared_keyword_pair,True,,9.261356490998878,1,True
|
||||
wide-023,shared_keyword_pair,True,,11.352632169000572,1,True
|
||||
wide-024,shared_keyword_pair,True,,7.952293816997553,1,True
|
||||
wide-025,shared_keyword_pair,True,,11.707699684004183,1,True
|
||||
wide-026,shared_keyword_pair,True,,7.244572512994637,1,True
|
||||
wide-027,shared_keyword_pair,True,,11.86879978099023,1,True
|
||||
wide-028,shared_keyword_pair,True,,6.436980010010302,1,True
|
||||
wide-029,shared_keyword_pair,True,,13.4112125190004,1,True
|
||||
wide-030,shared_keyword_pair,True,,6.320292321004672,1,True
|
||||
wide-031,shared_keyword_pair,True,,13.030589675996453,1,True
|
||||
wide-032,shared_keyword_pair,True,,8.23478609599988,1,True
|
||||
wide-033,shared_keyword_pair,True,,11.427597190995584,1,True
|
||||
wide-034,shared_keyword_pair,True,,7.945492083003046,1,True
|
||||
wide-035,shared_keyword_pair,True,,10.91667144499661,1,True
|
||||
wide-036,shared_keyword_pair,True,,7.704312329005916,1,True
|
||||
wide-037,shared_keyword_pair,True,,9.866947228001663,1,True
|
||||
wide-038,shared_keyword_pair,True,,9.0944732450007,1,True
|
||||
wide-039,shared_keyword_pair,True,,9.955326469003921,1,True
|
||||
wide-040,shared_keyword_pair,True,,10.126550430999487,1,True
|
||||
wide-041,same_academic_year_pair,True,,8.00595778299612,1,True
|
||||
wide-042,same_academic_year_pair,True,,10.224936337006511,1,True
|
||||
wide-043,same_academic_year_pair,True,,7.973652732995106,1,True
|
||||
wide-044,same_academic_year_pair,True,,11.643997175007826,1,True
|
||||
wide-045,same_academic_year_pair,True,,7.812763041001745,1,True
|
||||
wide-046,same_academic_year_pair,True,,11.01834614200925,1,True
|
||||
wide-047,same_academic_year_pair,True,,9.787194718010142,1,True
|
||||
wide-048,same_academic_year_pair,True,,11.489561196009163,1,True
|
||||
wide-049,same_academic_year_pair,True,,10.164007376006339,1,True
|
||||
wide-050,same_academic_year_pair,True,,9.938125018001301,1,True
|
||||
wide-051,same_academic_year_pair,True,,9.78176777700719,1,True
|
||||
wide-052,same_academic_year_pair,True,,9.160806122003123,1,True
|
||||
wide-053,same_academic_year_pair,True,,9.269089786990662,1,True
|
||||
wide-054,same_academic_year_pair,True,,9.431611267005792,1,True
|
||||
wide-055,same_academic_year_pair,True,,9.327960707989405,1,True
|
||||
wide-056,same_academic_year_pair,True,,9.804446037000162,1,True
|
||||
wide-057,same_academic_year_pair,True,,8.234563728998182,1,True
|
||||
wide-058,same_academic_year_pair,True,,9.821240933990339,1,True
|
||||
wide-059,same_academic_year_pair,True,,6.477854401004151,1,True
|
||||
wide-060,same_academic_year_pair,True,,10.462991334003164,1,True
|
||||
wide-061,same_academic_year_pair,True,,6.2554830580047565,1,True
|
||||
wide-062,same_academic_year_pair,True,,10.774600299002486,1,True
|
||||
wide-063,same_academic_year_pair,True,,6.288768262995291,1,True
|
||||
wide-064,same_academic_year_pair,True,,11.15352754900232,1,True
|
||||
wide-065,same_academic_year_pair,True,,5.480506381005398,1,True
|
||||
wide-066,same_academic_year_pair,True,,10.729390800988767,1,True
|
||||
wide-067,same_academic_year_pair,True,,7.499470337992534,1,True
|
||||
wide-068,same_academic_year_pair,True,,11.094555151008535,1,True
|
||||
wide-069,same_academic_year_pair,True,,7.680634538002778,1,True
|
||||
wide-070,same_academic_year_pair,True,,10.041368676989805,1,True
|
||||
wide-071,same_academic_year_pair,True,,9.15008538699476,1,True
|
||||
wide-072,same_academic_year_pair,True,,9.846425030991668,1,True
|
||||
wide-073,same_academic_year_pair,True,,8.89766675599094,1,True
|
||||
wide-074,same_academic_year_pair,True,,8.42804765701294,1,True
|
||||
wide-075,same_academic_year_pair,True,,8.904354819998844,1,True
|
||||
wide-076,same_academic_year_pair,True,,8.653263764994335,1,True
|
||||
wide-077,same_academic_year_pair,True,,8.350220588996308,1,True
|
||||
wide-078,same_academic_year_pair,True,,9.132759956002701,1,True
|
||||
wide-079,same_academic_year_pair,True,,8.293541837992962,1,True
|
||||
wide-080,same_academic_year_pair,True,,10.156925554998452,1,True
|
||||
wide-081,same_start_year_pair,True,,7.918382621995988,1,True
|
||||
wide-082,same_start_year_pair,True,,10.321019872004399,1,True
|
||||
wide-083,same_start_year_pair,True,,7.002511290003895,1,True
|
||||
wide-084,same_start_year_pair,True,,10.437800674000755,1,True
|
||||
wide-085,same_start_year_pair,True,,6.816185226009111,1,True
|
||||
wide-086,same_start_year_pair,True,,10.71233119200042,1,True
|
||||
wide-087,same_start_year_pair,True,,6.4720146839972585,1,True
|
||||
wide-088,same_start_year_pair,True,,10.198497953009792,1,True
|
||||
wide-089,same_start_year_pair,True,,6.79203049800708,1,True
|
||||
wide-090,same_start_year_pair,True,,10.413568222007598,1,True
|
||||
wide-091,same_start_year_pair,True,,7.510395374993095,1,True
|
||||
wide-092,same_start_year_pair,True,,10.110175805006293,1,True
|
||||
wide-093,same_start_year_pair,True,,7.382416222986649,1,True
|
||||
wide-094,same_start_year_pair,True,,9.637755793010001,1,True
|
||||
wide-095,same_start_year_pair,True,,7.721356611000374,1,True
|
||||
wide-096,same_start_year_pair,True,,9.783646965996013,1,True
|
||||
wide-097,same_start_year_pair,True,,8.19954388300539,1,True
|
||||
wide-098,same_start_year_pair,True,,9.142149596998934,1,True
|
||||
wide-099,same_start_year_pair,True,,7.995075654995162,1,True
|
||||
wide-100,same_start_year_pair,True,,9.23304197700054,1,True
|
||||
wide-101,same_start_year_pair,True,,8.445941337995464,1,True
|
||||
wide-102,same_start_year_pair,True,,9.29434829299862,1,True
|
||||
wide-103,same_start_year_pair,True,,8.262059757005773,1,True
|
||||
wide-104,same_start_year_pair,True,,8.660338338988367,1,True
|
||||
wide-105,same_start_year_pair,True,,8.136423168994952,1,True
|
||||
wide-106,same_start_year_pair,True,,8.826232392006204,1,True
|
||||
wide-107,same_start_year_pair,True,,8.023831066006096,1,True
|
||||
wide-108,same_start_year_pair,True,,9.481848634008202,1,True
|
||||
wide-109,same_start_year_pair,True,,7.782530160999158,1,True
|
||||
wide-110,same_start_year_pair,True,,10.06139503599843,1,True
|
||||
wide-111,same_start_year_pair,True,,7.194188486013445,1,True
|
||||
wide-112,same_start_year_pair,True,,9.618882115988526,1,True
|
||||
wide-113,person_title_year,True,,6.316762108996045,1,True
|
||||
wide-114,person_title_year,True,,8.973571240989259,1,True
|
||||
wide-115,person_title_year,True,,5.77858125900093,1,True
|
||||
wide-116,person_title_year,True,,8.171107051006402,1,True
|
||||
wide-117,person_title_year,True,,5.923224907994154,1,True
|
||||
wide-118,person_title_year,True,,8.248448436992476,1,True
|
||||
wide-119,person_title_year,True,,6.6704190939926775,1,True
|
||||
wide-120,person_title_year,True,,7.390637057993445,1,True
|
||||
wide-121,person_title_year,True,,6.828236892994028,1,True
|
||||
wide-122,person_title_year,True,,7.436154732989962,1,True
|
||||
wide-123,person_title_year,True,,7.201046439004131,1,True
|
||||
wide-124,person_title_year,True,,7.452169609998236,1,True
|
||||
wide-125,person_title_year,True,,7.024459202992148,1,True
|
||||
wide-126,person_title_year,True,,7.134706636992632,1,True
|
||||
wide-127,person_title_year,True,,6.701897156002815,1,True
|
||||
wide-128,person_title_year,True,,7.7986834320036,1,True
|
||||
wide-129,person_title_year,False,,7.78502085400396,1,False
|
||||
wide-130,person_title_year,True,,7.579418053996051,1,True
|
||||
wide-131,person_title_year,True,,7.29737891399418,1,True
|
||||
wide-132,person_title_year,True,,6.5710127700003795,1,True
|
||||
wide-133,person_title_year,True,,7.670121143004508,1,True
|
||||
wide-134,person_title_year,True,,6.268109227006789,1,True
|
||||
wide-135,person_title_year,True,,7.80891695599712,1,True
|
||||
wide-136,person_title_year,True,,6.535969970005681,1,True
|
||||
wide-137,person_keyword_title,True,,8.499110547010787,1,True
|
||||
wide-138,person_keyword_title,True,,7.348516454003402,1,True
|
||||
wide-139,person_keyword_title,True,,8.490620700002182,1,True
|
||||
wide-140,person_keyword_title,True,,7.142724603007082,1,True
|
||||
wide-141,person_keyword_title,True,,7.750912368996069,1,True
|
||||
wide-142,person_keyword_title,False,,9.134571484988555,1,False
|
||||
wide-143,person_keyword_title,True,,9.924621155005298,1,True
|
||||
wide-144,person_keyword_title,True,,9.80673293399741,1,True
|
||||
wide-145,person_keyword_title,False,,9.125109145010356,1,False
|
||||
wide-146,person_keyword_title,True,,7.816306863998761,1,True
|
||||
wide-147,person_keyword_title,True,,9.222393247997388,1,True
|
||||
wide-148,person_keyword_title,True,,6.4315986309957225,1,True
|
||||
wide-149,person_keyword_title,True,,8.975530234994949,1,True
|
||||
wide-150,person_keyword_title,True,,6.5634262770036,1,True
|
||||
wide-151,person_keyword_title,True,,8.981235069994,1,True
|
||||
wide-152,person_keyword_title,True,,6.80172690100153,1,True
|
||||
wide-153,person_keyword_title,True,,8.104526370007079,1,True
|
||||
wide-154,person_keyword_title,True,,7.002095560004818,1,True
|
||||
wide-155,person_keyword_title,True,,8.536377580996486,1,True
|
||||
wide-156,person_keyword_title,True,,7.33249492100731,1,True
|
||||
wide-157,person_keyword_title,True,,8.53190982498927,1,True
|
||||
wide-158,person_keyword_title,True,,6.987181315998896,1,True
|
||||
wide-159,person_keyword_title,True,,9.206439533008961,1,True
|
||||
wide-160,person_keyword_title,True,,7.2076548890036065,1,True
|
||||
wide-161,person_keyword_title,True,,9.755865868995897,1,True
|
||||
wide-162,person_keyword_title,True,,6.598434728002758,1,True
|
||||
wide-163,person_keyword_title,True,,9.665300851003849,1,True
|
||||
wide-164,person_keyword_title,True,,6.409714323002845,1,True
|
||||
wide-165,person_keyword_title,True,,9.189696266010287,1,True
|
||||
wide-166,person_keyword_title,True,,6.362806601988268,1,True
|
||||
wide-167,person_keyword_title,True,,9.12334693899902,1,True
|
||||
wide-168,person_keyword_title,True,,6.939789495998411,1,True
|
||||
wide-169,document_author_category_multi_hop,True,,8.274773390003247,1,True
|
||||
wide-170,document_author_category_multi_hop,True,,5.761120869006845,1,True
|
||||
wide-171,document_author_category_multi_hop,True,,7.484641218994511,1,True
|
||||
wide-172,document_author_category_multi_hop,True,,5.7914811780065065,1,True
|
||||
wide-173,document_author_category_multi_hop,True,,7.744038484990597,1,True
|
||||
wide-174,document_author_category_multi_hop,True,,5.857030038998346,1,True
|
||||
wide-175,document_author_category_multi_hop,True,,8.176481470989529,1,True
|
||||
wide-176,document_author_category_multi_hop,True,,7.8557383849984035,1,True
|
||||
wide-177,document_author_category_multi_hop,True,,7.886023836006643,1,True
|
||||
wide-178,document_author_category_multi_hop,True,,7.453686430002563,1,True
|
||||
wide-179,document_author_category_multi_hop,True,,5.2365985850046854,1,True
|
||||
wide-180,document_author_category_multi_hop,True,,7.151028209991637,1,True
|
||||
wide-181,document_author_category_multi_hop,True,,5.116186750004999,1,True
|
||||
wide-182,document_author_category_multi_hop,True,,7.575539704004768,1,True
|
||||
wide-183,document_author_category_multi_hop,True,,5.5021829689940205,1,True
|
||||
wide-184,document_author_category_multi_hop,True,,7.557064304011874,1,True
|
||||
wide-185,document_author_category_multi_hop,True,,5.2788128620013595,1,True
|
||||
wide-186,document_author_category_multi_hop,True,,7.775028784992173,1,True
|
||||
wide-187,document_author_category_multi_hop,True,,5.468235724998522,1,True
|
||||
wide-188,document_author_category_multi_hop,True,,7.458582812003442,1,True
|
||||
wide-189,document_author_category_multi_hop,True,,5.423984528999426,1,True
|
||||
wide-190,document_author_category_multi_hop,True,,6.802945887990063,1,True
|
||||
wide-191,document_author_category_multi_hop,True,,5.720807204997982,1,True
|
||||
wide-192,document_author_category_multi_hop,True,,6.970476242990117,1,True
|
||||
wide-193,person_multiple_categories,True,,5.315446266002255,1,True
|
||||
wide-194,person_multiple_categories,True,,6.611033188004512,1,True
|
||||
wide-195,person_multiple_categories,True,,4.514709312992636,1,True
|
||||
wide-196,person_multiple_categories,True,,6.597614583995892,1,True
|
||||
wide-197,person_multiple_categories,True,,4.054451817995869,1,True
|
||||
wide-198,person_multiple_categories,True,,6.207983192012762,1,True
|
||||
wide-199,person_multiple_categories,True,,4.590510104011628,1,True
|
||||
wide-200,person_multiple_categories,True,,6.553350798989413,1,True
|
||||
wide-201,person_multiple_categories,True,,4.605876973000704,1,True
|
||||
wide-202,person_multiple_categories,True,,5.585335472002043,1,True
|
||||
wide-203,person_multiple_categories,True,,4.492845022992697,1,True
|
||||
wide-204,person_multiple_categories,True,,6.641766903994721,1,True
|
||||
wide-205,person_multiple_categories,True,,5.62207466000109,1,True
|
||||
wide-206,person_multiple_categories,True,,6.369739195986767,1,True
|
||||
wide-207,person_multiple_categories,True,,4.450628942999174,1,True
|
||||
wide-208,person_multiple_categories,True,,5.57498624100117,1,True
|
||||
wide-209,person_multiple_categories,True,,5.34890157400514,1,True
|
||||
wide-210,person_multiple_categories,True,,6.2012351820012555,1,True
|
||||
wide-211,person_multiple_categories,True,,5.767825509014074,1,True
|
||||
wide-212,person_multiple_categories,True,,5.083963163997396,1,True
|
||||
wide-213,person_multiple_categories,True,,5.3684891809971305,1,True
|
||||
wide-214,person_multiple_categories,True,,4.774883028992917,1,True
|
||||
wide-215,person_multiple_categories,True,,5.859735618010745,1,True
|
||||
wide-216,person_multiple_categories,True,,5.045369378000032,1,True
|
||||
wide-217,candidate_set_aggregation,True,,8.18277867299912,1,True
|
||||
wide-218,candidate_set_aggregation,True,,7.061751248998917,1,True
|
||||
wide-219,candidate_set_aggregation,True,,9.888737866000156,1,True
|
||||
wide-220,candidate_set_aggregation,True,,6.534448446996976,1,True
|
||||
wide-221,candidate_set_aggregation,True,,10.02607991900004,1,True
|
||||
wide-222,candidate_set_aggregation,True,,6.639642160007497,1,True
|
||||
wide-223,candidate_set_aggregation,True,,10.05624425499991,1,True
|
||||
wide-224,candidate_set_aggregation,True,,6.380346581994672,1,True
|
||||
wide-225,candidate_set_aggregation,True,,9.750748607999412,1,True
|
||||
wide-226,candidate_set_aggregation,True,,6.927533381007379,1,True
|
||||
wide-227,candidate_set_aggregation,True,,9.749435025994899,1,True
|
||||
wide-228,candidate_set_aggregation,True,,7.000018507009372,1,True
|
||||
wide-229,candidate_set_aggregation,True,,9.393544332007878,1,True
|
||||
wide-230,candidate_set_aggregation,True,,7.075158320993069,1,True
|
||||
wide-231,candidate_set_aggregation,True,,9.68925523001235,1,True
|
||||
wide-232,candidate_set_aggregation,True,,7.470996176998597,1,True
|
||||
wide-233,candidate_set_aggregation,True,,9.546211912995204,1,True
|
||||
wide-234,candidate_set_aggregation,True,,7.121646208994207,1,True
|
||||
wide-235,candidate_set_aggregation,True,,9.106454324006336,1,True
|
||||
wide-236,candidate_set_aggregation,True,,7.33974453000701,1,True
|
||||
wide-237,candidate_set_aggregation,True,,9.92777099799423,1,True
|
||||
wide-238,candidate_set_aggregation,True,,7.6532076459989185,1,True
|
||||
wide-239,candidate_set_aggregation,True,,9.878883134995704,1,True
|
||||
wide-240,candidate_set_aggregation,True,,6.794067700000596,1,True
|
||||
wide-241,candidate_set_aggregation,True,,9.484167262999108,1,True
|
||||
wide-242,candidate_set_aggregation,True,,6.586464612002601,1,True
|
||||
wide-243,candidate_set_aggregation,True,,9.679727968003135,1,True
|
||||
wide-244,candidate_set_aggregation,True,,6.853099594998639,1,True
|
||||
wide-245,candidate_set_aggregation,True,,9.588607818004675,1,True
|
||||
wide-246,candidate_set_aggregation,True,,6.615246096000192,1,True
|
||||
wide-247,candidate_set_aggregation,True,,9.338731531999656,1,True
|
||||
wide-248,candidate_set_aggregation,True,,6.656504976010183,1,True
|
||||
wide-249,conjunctive_disambiguation,True,,8.06964380700083,1,True
|
||||
wide-250,conjunctive_disambiguation,True,,5.727493058991968,1,True
|
||||
wide-251,conjunctive_disambiguation,True,,7.403562118997797,1,True
|
||||
wide-252,conjunctive_disambiguation,True,,6.389556170004653,1,True
|
||||
wide-253,conjunctive_disambiguation,True,,7.190451546994154,1,True
|
||||
wide-254,conjunctive_disambiguation,True,,5.571824425001978,1,True
|
||||
wide-255,conjunctive_disambiguation,True,,6.363713938990259,1,True
|
||||
wide-256,conjunctive_disambiguation,True,,5.9705328209965955,1,True
|
||||
wide-257,conjunctive_disambiguation,True,,6.814727099001175,1,True
|
||||
wide-258,conjunctive_disambiguation,True,,6.060012061992893,1,True
|
||||
wide-259,conjunctive_disambiguation,True,,6.477906736996374,1,True
|
||||
wide-260,conjunctive_disambiguation,True,,6.108023989989306,1,True
|
||||
wide-261,conjunctive_disambiguation,True,,6.89838379000139,1,True
|
||||
wide-262,conjunctive_disambiguation,True,,6.639250446998631,1,True
|
||||
wide-263,conjunctive_disambiguation,True,,7.647332847991493,1,True
|
||||
wide-264,conjunctive_disambiguation,True,,6.806039610994048,1,True
|
||||
wide-265,conjunctive_disambiguation,True,,7.480212347989436,1,True
|
||||
wide-266,conjunctive_disambiguation,True,,5.939997524998034,1,True
|
||||
wide-267,conjunctive_disambiguation,True,,7.483691226007068,1,True
|
||||
wide-268,conjunctive_disambiguation,True,,5.128309691994218,1,True
|
||||
wide-269,conjunctive_disambiguation,True,,7.950514240990742,1,True
|
||||
wide-270,conjunctive_disambiguation,True,,3.838128978997702,1,True
|
||||
wide-271,conjunctive_disambiguation,True,,7.203258510999149,1,True
|
||||
wide-272,conjunctive_disambiguation,True,,5.274275976000354,1,True
|
||||
wide-273,conjunctive_disambiguation,True,,7.145530178997433,1,True
|
||||
wide-274,conjunctive_disambiguation,True,,5.765552001001197,1,True
|
||||
wide-275,conjunctive_disambiguation,True,,7.404864780008211,1,True
|
||||
wide-276,conjunctive_disambiguation,True,,6.352571280993288,1,True
|
||||
wide-277,conjunctive_disambiguation,True,,7.504300720000174,1,True
|
||||
wide-278,conjunctive_disambiguation,True,,6.016011193001759,1,True
|
||||
wide-279,conjunctive_disambiguation,True,,7.295396494999295,1,True
|
||||
wide-280,conjunctive_disambiguation,True,,5.834808207000606,1,True
|
||||
wide-281,conjunctive_disambiguation,True,,7.8035292659915285,1,True
|
||||
wide-282,conjunctive_disambiguation,True,,6.399204970992287,1,True
|
||||
wide-283,conjunctive_disambiguation,True,,9.671940870990511,1,True
|
||||
wide-284,conjunctive_disambiguation,True,,5.51546201200108,1,True
|
||||
wide-285,conjunctive_disambiguation,True,,10.154824249999365,1,True
|
||||
wide-286,conjunctive_disambiguation,True,,4.581112927000504,1,True
|
||||
wide-287,conjunctive_disambiguation,True,,9.536005122994538,1,True
|
||||
wide-288,conjunctive_disambiguation,True,,5.152376526006265,1,True
|
||||
wide-289,negative_lookup,True,,5.77029365299677,1,True
|
||||
wide-290,negative_lookup,True,,4.0657596189994365,1,True
|
||||
wide-291,negative_lookup,True,,5.455527030004305,1,True
|
||||
wide-292,negative_lookup,True,,3.0121111600019503,1,True
|
||||
wide-293,negative_lookup,True,,2.800542648998089,1,True
|
||||
wide-294,negative_lookup,True,,2.3347310710087186,1,True
|
||||
wide-295,negative_lookup,True,,3.137155468997662,1,True
|
||||
wide-296,negative_lookup,True,,4.624817319010617,1,True
|
||||
wide-297,negative_lookup,True,,2.6547789269970963,1,True
|
||||
wide-298,negative_lookup,True,,3.314983567004674,1,True
|
||||
wide-299,negative_lookup,True,,4.695426902995678,1,True
|
||||
wide-300,negative_lookup,True,,4.431371640996076,1,True
|
||||
wide-301,negative_lookup,True,,6.186935618010466,1,True
|
||||
wide-302,negative_lookup,True,,2.142409003005014,1,True
|
||||
wide-303,negative_lookup,True,,3.43618969200179,1,True
|
||||
wide-304,negative_lookup,True,,5.18562207800278,1,True
|
||||
wide-305,negative_lookup,True,,4.38843695500691,1,True
|
||||
wide-306,negative_lookup,True,,5.134904260004987,1,True
|
||||
wide-307,negative_lookup,True,,2.6632863889972214,1,True
|
||||
wide-308,negative_lookup,True,,3.1229624890111154,1,True
|
||||
wide-309,negative_lookup,True,,4.524710755009437,1,True
|
||||
wide-310,negative_lookup,True,,3.0614984529966023,1,True
|
||||
wide-311,negative_lookup,True,,3.266464348009322,1,True
|
||||
wide-312,negative_lookup,True,,2.7247217559925048,1,True
|
||||
wide-313,negative_lookup,True,,4.237170866996166,1,True
|
||||
wide-314,negative_lookup,True,,2.5491485459933756,1,True
|
||||
wide-315,negative_lookup,True,,3.5208440470014466,1,True
|
||||
wide-316,negative_lookup,True,,4.705917885992676,1,True
|
||||
wide-317,negative_lookup,True,,4.300244467012817,1,True
|
||||
wide-318,negative_lookup,True,,4.2143690299999435,1,True
|
||||
wide-319,negative_lookup,True,,4.686885363000329,1,True
|
||||
wide-320,negative_lookup,True,,3.806223741004942,1,True
|
||||
|
File diff suppressed because it is too large
Load Diff
@ -0,0 +1,411 @@
|
||||
[
|
||||
{
|
||||
"id": "wide-129",
|
||||
"category": "person_title_year",
|
||||
"question": "Uveď názov diplomového projektu osoby Maroš Harahus a rok práce pre rok 2020.",
|
||||
"graph_context": {
|
||||
"status": "ok",
|
||||
"reason": null,
|
||||
"facts": [
|
||||
{
|
||||
"person": "Maroš Harahus",
|
||||
"title": "Doplnenie podpory morfologického značkovania slovenského jazyka do nlp frameworku (spacy alebo flair)",
|
||||
"year": 2020,
|
||||
"document_path": "pages/students/2016/maros_harahus/README.md",
|
||||
"source_url": "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"
|
||||
}
|
||||
],
|
||||
"sources": [
|
||||
{
|
||||
"document_path": "pages/students/2016/maros_harahus/README.md",
|
||||
"source_url": "https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"
|
||||
}
|
||||
],
|
||||
"aggregation": null
|
||||
},
|
||||
"strict": false,
|
||||
"attempts": [
|
||||
{
|
||||
"response": {
|
||||
"choices": [
|
||||
{
|
||||
"finish_reason": "stop",
|
||||
"index": 0,
|
||||
"message": {
|
||||
"role": "assistant",
|
||||
"content": "{\n\"answer\": \"Maroš Harahus v roku 2020 vypracoval diplomový projekt s názvom Doplnenie podpory morfologického značkovania slovenského jazyka do nlp frameworku (spacy alebo flair). Zdroj: https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus\",\n\"status\": \"ok\",\n\"claims\": [\n{\n\"person\": \"Maroš Harahus\",\n\"title\": \"Doplnenie podpory morfologického značkovania slovenského jazyka do nlp frameworku (spacy alebo flair)\",\n\"year\": 2020,\n\"keyword\": \"diplomový projekt\"\n}\n],\n\"source_urls\": [\n\"https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus\"\n],\n\"count\": 1\n}"
|
||||
}
|
||||
}
|
||||
],
|
||||
"created": 1792945390,
|
||||
"model": "Qwen3.5-122B-A10B-Q4_K_M",
|
||||
"system_fingerprint": "b8580-7c203670f",
|
||||
"object": "chat.completion",
|
||||
"usage": {
|
||||
"completion_tokens": 207,
|
||||
"prompt_tokens": 1060,
|
||||
"total_tokens": 1267,
|
||||
"prompt_tokens_details": {
|
||||
"cached_tokens": 741
|
||||
}
|
||||
},
|
||||
"id": "chatcmpl-g1NApedgMI4Zy7dBR2SrY5S62SKWblvZ",
|
||||
"timings": {
|
||||
"cache_n": 741,
|
||||
"prompt_n": 319,
|
||||
"prompt_ms": 526.979,
|
||||
"prompt_per_token_ms": 1.651971786833856,
|
||||
"prompt_per_second": 605.3372145759129,
|
||||
"predicted_n": 207,
|
||||
"predicted_ms": 4996.334,
|
||||
"predicted_per_token_ms": 24.13687922705314,
|
||||
"predicted_per_second": 41.430376752234736
|
||||
}
|
||||
},
|
||||
"format_normalized": false,
|
||||
"strict": false
|
||||
}
|
||||
],
|
||||
"response": {
|
||||
"choices": [
|
||||
{
|
||||
"finish_reason": "stop",
|
||||
"index": 0,
|
||||
"message": {
|
||||
"role": "assistant",
|
||||
"content": "{\n\"answer\": \"Maroš Harahus v roku 2020 vypracoval diplomový projekt s názvom Doplnenie podpory morfologického značkovania slovenského jazyka do nlp frameworku (spacy alebo flair). Zdroj: https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus\",\n\"status\": \"ok\",\n\"claims\": [\n{\n\"person\": \"Maroš Harahus\",\n\"title\": \"Doplnenie podpory morfologického značkovania slovenského jazyka do nlp frameworku (spacy alebo flair)\",\n\"year\": 2020,\n\"keyword\": \"diplomový projekt\"\n}\n],\n\"source_urls\": [\n\"https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus\"\n],\n\"count\": 1\n}"
|
||||
}
|
||||
}
|
||||
],
|
||||
"created": 1792945390,
|
||||
"model": "Qwen3.5-122B-A10B-Q4_K_M",
|
||||
"system_fingerprint": "b8580-7c203670f",
|
||||
"object": "chat.completion",
|
||||
"usage": {
|
||||
"completion_tokens": 207,
|
||||
"prompt_tokens": 1060,
|
||||
"total_tokens": 1267,
|
||||
"prompt_tokens_details": {
|
||||
"cached_tokens": 741
|
||||
}
|
||||
},
|
||||
"id": "chatcmpl-g1NApedgMI4Zy7dBR2SrY5S62SKWblvZ",
|
||||
"timings": {
|
||||
"cache_n": 741,
|
||||
"prompt_n": 319,
|
||||
"prompt_ms": 526.979,
|
||||
"prompt_per_token_ms": 1.651971786833856,
|
||||
"prompt_per_second": 605.3372145759129,
|
||||
"predicted_n": 207,
|
||||
"predicted_ms": 4996.334,
|
||||
"predicted_per_token_ms": 24.13687922705314,
|
||||
"predicted_per_second": 41.430376752234736
|
||||
}
|
||||
},
|
||||
"answer": {
|
||||
"answer": "Maroš Harahus v roku 2020 vypracoval diplomový projekt s názvom Doplnenie podpory morfologického značkovania slovenského jazyka do nlp frameworku (spacy alebo flair). Zdroj: https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus",
|
||||
"status": "ok",
|
||||
"claims": [
|
||||
{
|
||||
"person": "Maroš Harahus",
|
||||
"title": "Doplnenie podpory morfologického značkovania slovenského jazyka do nlp frameworku (spacy alebo flair)",
|
||||
"year": 2020,
|
||||
"keyword": "diplomový projekt"
|
||||
}
|
||||
],
|
||||
"source_urls": [
|
||||
"https://zp.kemt.fei.tuke.sk/students/2016/maros_harahus"
|
||||
],
|
||||
"count": 1
|
||||
},
|
||||
"bindings_ok": true,
|
||||
"unsupported_claims": [
|
||||
{
|
||||
"person": "Maroš Harahus",
|
||||
"title": "Doplnenie podpory morfologického značkovania slovenského jazyka do nlp frameworku (spacy alebo flair)",
|
||||
"year": 2020,
|
||||
"keyword": "diplomový projekt"
|
||||
}
|
||||
],
|
||||
"sources_ok": true,
|
||||
"status_ok": true,
|
||||
"count_ok": true,
|
||||
"set_ok": true,
|
||||
"text_values_ok": true,
|
||||
"missing_text_values": [],
|
||||
"contradictory_thesis_label": false,
|
||||
"latency_seconds": 7.78502085400396
|
||||
},
|
||||
{
|
||||
"id": "wide-142",
|
||||
"category": "person_keyword_title",
|
||||
"question": "Uveď názov práce osoby Dárius Lindvai v roku 2019 s kľúčovým slovom lstm.",
|
||||
"graph_context": {
|
||||
"status": "ok",
|
||||
"reason": null,
|
||||
"facts": [
|
||||
{
|
||||
"person": "Dárius Lindvai",
|
||||
"title": "rešerš",
|
||||
"year": 2019,
|
||||
"document_path": "pages/students/2016/darius_lindvai/README.md",
|
||||
"source_url": "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"
|
||||
},
|
||||
{
|
||||
"person": "Dárius Lindvai",
|
||||
"keyword": "lstm",
|
||||
"document_path": "pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md",
|
||||
"source_url": "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"
|
||||
}
|
||||
],
|
||||
"sources": [
|
||||
{
|
||||
"document_path": "pages/students/2016/darius_lindvai/README.md",
|
||||
"source_url": "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"
|
||||
},
|
||||
{
|
||||
"document_path": "pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md",
|
||||
"source_url": "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"
|
||||
}
|
||||
],
|
||||
"aggregation": null
|
||||
},
|
||||
"strict": false,
|
||||
"attempts": [
|
||||
{
|
||||
"response": {
|
||||
"choices": [
|
||||
{
|
||||
"finish_reason": "stop",
|
||||
"index": 0,
|
||||
"message": {
|
||||
"role": "assistant",
|
||||
"content": "{\"answer\": \"V roku 2019 má Dárius Lindvai prácu s názvom \\\"rešerš\\\", ale v dodaných grafových faktoch nie je pre túto prácu (dokument pages/students/2016/darius_lindvai/README.md) uvedený kľúčové slovo \\\"lstm\\\". Kľúčové slovo \\\"lstm\\\" je priradené k inému dokumentu (pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md), pre ktorý nie je v roku 2019 uvedený názov práce. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai, https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial\", \"status\": \"no_answer\", \"claims\": [], \"source_urls\": [\"https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai\", \"https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial\"], \"count\": 0}"
|
||||
}
|
||||
}
|
||||
],
|
||||
"created": 1792945424,
|
||||
"model": "Qwen3.5-122B-A10B-Q4_K_M",
|
||||
"system_fingerprint": "b8580-7c203670f",
|
||||
"object": "chat.completion",
|
||||
"usage": {
|
||||
"completion_tokens": 271,
|
||||
"prompt_tokens": 1179,
|
||||
"total_tokens": 1450,
|
||||
"prompt_tokens_details": {
|
||||
"cached_tokens": 757
|
||||
}
|
||||
},
|
||||
"id": "chatcmpl-GN6RM6r1ZLYbSY2fIyiP4vJ01UYBpkFB",
|
||||
"timings": {
|
||||
"cache_n": 757,
|
||||
"prompt_n": 422,
|
||||
"prompt_ms": 564.135,
|
||||
"prompt_per_token_ms": 1.3368127962085308,
|
||||
"prompt_per_second": 748.0478963368697,
|
||||
"predicted_n": 271,
|
||||
"predicted_ms": 6580.341,
|
||||
"predicted_per_token_ms": 24.28170110701107,
|
||||
"predicted_per_second": 41.18327606426475
|
||||
}
|
||||
},
|
||||
"format_normalized": false,
|
||||
"strict": false
|
||||
}
|
||||
],
|
||||
"response": {
|
||||
"choices": [
|
||||
{
|
||||
"finish_reason": "stop",
|
||||
"index": 0,
|
||||
"message": {
|
||||
"role": "assistant",
|
||||
"content": "{\"answer\": \"V roku 2019 má Dárius Lindvai prácu s názvom \\\"rešerš\\\", ale v dodaných grafových faktoch nie je pre túto prácu (dokument pages/students/2016/darius_lindvai/README.md) uvedený kľúčové slovo \\\"lstm\\\". Kľúčové slovo \\\"lstm\\\" je priradené k inému dokumentu (pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md), pre ktorý nie je v roku 2019 uvedený názov práce. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai, https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial\", \"status\": \"no_answer\", \"claims\": [], \"source_urls\": [\"https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai\", \"https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial\"], \"count\": 0}"
|
||||
}
|
||||
}
|
||||
],
|
||||
"created": 1792945424,
|
||||
"model": "Qwen3.5-122B-A10B-Q4_K_M",
|
||||
"system_fingerprint": "b8580-7c203670f",
|
||||
"object": "chat.completion",
|
||||
"usage": {
|
||||
"completion_tokens": 271,
|
||||
"prompt_tokens": 1179,
|
||||
"total_tokens": 1450,
|
||||
"prompt_tokens_details": {
|
||||
"cached_tokens": 757
|
||||
}
|
||||
},
|
||||
"id": "chatcmpl-GN6RM6r1ZLYbSY2fIyiP4vJ01UYBpkFB",
|
||||
"timings": {
|
||||
"cache_n": 757,
|
||||
"prompt_n": 422,
|
||||
"prompt_ms": 564.135,
|
||||
"prompt_per_token_ms": 1.3368127962085308,
|
||||
"prompt_per_second": 748.0478963368697,
|
||||
"predicted_n": 271,
|
||||
"predicted_ms": 6580.341,
|
||||
"predicted_per_token_ms": 24.28170110701107,
|
||||
"predicted_per_second": 41.18327606426475
|
||||
}
|
||||
},
|
||||
"answer": {
|
||||
"answer": "V roku 2019 má Dárius Lindvai prácu s názvom \"rešerš\", ale v dodaných grafových faktoch nie je pre túto prácu (dokument pages/students/2016/darius_lindvai/README.md) uvedený kľúčové slovo \"lstm\". Kľúčové slovo \"lstm\" je priradené k inému dokumentu (pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md), pre ktorý nie je v roku 2019 uvedený názov práce. Zdroje: https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai, https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial",
|
||||
"status": "no_answer",
|
||||
"claims": [],
|
||||
"source_urls": [
|
||||
"https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai",
|
||||
"https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"
|
||||
],
|
||||
"count": 0
|
||||
},
|
||||
"bindings_ok": false,
|
||||
"unsupported_claims": [],
|
||||
"sources_ok": true,
|
||||
"status_ok": false,
|
||||
"count_ok": true,
|
||||
"set_ok": true,
|
||||
"text_values_ok": true,
|
||||
"missing_text_values": [],
|
||||
"contradictory_thesis_label": false,
|
||||
"latency_seconds": 9.134571484988555
|
||||
},
|
||||
{
|
||||
"id": "wide-145",
|
||||
"category": "person_keyword_title",
|
||||
"question": "Uveď názov práce osoby Dárius Lindvai v roku 2019 s kľúčovým slovom python.",
|
||||
"graph_context": {
|
||||
"status": "ok",
|
||||
"reason": null,
|
||||
"facts": [
|
||||
{
|
||||
"person": "Dárius Lindvai",
|
||||
"title": "rešerš",
|
||||
"year": 2019,
|
||||
"document_path": "pages/students/2016/darius_lindvai/README.md",
|
||||
"source_url": "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"
|
||||
},
|
||||
{
|
||||
"person": "Dárius Lindvai",
|
||||
"keyword": "python",
|
||||
"document_path": "pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md",
|
||||
"source_url": "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"
|
||||
}
|
||||
],
|
||||
"sources": [
|
||||
{
|
||||
"document_path": "pages/students/2016/darius_lindvai/README.md",
|
||||
"source_url": "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai"
|
||||
},
|
||||
{
|
||||
"document_path": "pages/students/2016/darius_lindvai/timovy_projekt/tutorial/README.md",
|
||||
"source_url": "https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"
|
||||
},
|
||||
{
|
||||
"document_path": "pages/topics/python/README.md",
|
||||
"source_url": "https://zp.kemt.fei.tuke.sk/topics/python"
|
||||
}
|
||||
],
|
||||
"aggregation": null
|
||||
},
|
||||
"strict": false,
|
||||
"attempts": [
|
||||
{
|
||||
"response": {
|
||||
"choices": [
|
||||
{
|
||||
"finish_reason": "stop",
|
||||
"index": 0,
|
||||
"message": {
|
||||
"role": "assistant",
|
||||
"content": "{\n\"answer\": \"Nenašli sa žiadne fakty o práci Dárius Lindvai z roku 2019 s kľúčovým slovom python. Zdrojové údaje uvádzajú pre Dárius Lindvai v roku 2019 prácu s názvom \\\"rešerš\\\" (https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai), ale kľúčové slovo \\\"python\\\" je spojené s iným dokumentom bez uvedeného roku a názvu práce (https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial).\",\n\"status\": \"no_answer\",\n\"claims\": [],\n\"source_urls\": [\n\"https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai\",\n\"https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial\"\n],\n\"count\": 0\n}"
|
||||
}
|
||||
}
|
||||
],
|
||||
"created": 1792945433,
|
||||
"model": "Qwen3.5-122B-A10B-Q4_K_M",
|
||||
"system_fingerprint": "b8580-7c203670f",
|
||||
"object": "chat.completion",
|
||||
"usage": {
|
||||
"completion_tokens": 235,
|
||||
"prompt_tokens": 1208,
|
||||
"total_tokens": 1443,
|
||||
"prompt_tokens_details": {
|
||||
"cached_tokens": 741
|
||||
}
|
||||
},
|
||||
"id": "chatcmpl-wedgIgmgk8EORiFxPHOLuxXJnrOP8YqX",
|
||||
"timings": {
|
||||
"cache_n": 741,
|
||||
"prompt_n": 467,
|
||||
"prompt_ms": 621.672,
|
||||
"prompt_per_token_ms": 1.331203426124197,
|
||||
"prompt_per_second": 751.1999897051821,
|
||||
"predicted_n": 235,
|
||||
"predicted_ms": 5720.465,
|
||||
"predicted_per_token_ms": 24.34240425531915,
|
||||
"predicted_per_second": 41.080576491596396
|
||||
}
|
||||
},
|
||||
"format_normalized": false,
|
||||
"strict": false
|
||||
}
|
||||
],
|
||||
"response": {
|
||||
"choices": [
|
||||
{
|
||||
"finish_reason": "stop",
|
||||
"index": 0,
|
||||
"message": {
|
||||
"role": "assistant",
|
||||
"content": "{\n\"answer\": \"Nenašli sa žiadne fakty o práci Dárius Lindvai z roku 2019 s kľúčovým slovom python. Zdrojové údaje uvádzajú pre Dárius Lindvai v roku 2019 prácu s názvom \\\"rešerš\\\" (https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai), ale kľúčové slovo \\\"python\\\" je spojené s iným dokumentom bez uvedeného roku a názvu práce (https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial).\",\n\"status\": \"no_answer\",\n\"claims\": [],\n\"source_urls\": [\n\"https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai\",\n\"https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial\"\n],\n\"count\": 0\n}"
|
||||
}
|
||||
}
|
||||
],
|
||||
"created": 1792945433,
|
||||
"model": "Qwen3.5-122B-A10B-Q4_K_M",
|
||||
"system_fingerprint": "b8580-7c203670f",
|
||||
"object": "chat.completion",
|
||||
"usage": {
|
||||
"completion_tokens": 235,
|
||||
"prompt_tokens": 1208,
|
||||
"total_tokens": 1443,
|
||||
"prompt_tokens_details": {
|
||||
"cached_tokens": 741
|
||||
}
|
||||
},
|
||||
"id": "chatcmpl-wedgIgmgk8EORiFxPHOLuxXJnrOP8YqX",
|
||||
"timings": {
|
||||
"cache_n": 741,
|
||||
"prompt_n": 467,
|
||||
"prompt_ms": 621.672,
|
||||
"prompt_per_token_ms": 1.331203426124197,
|
||||
"prompt_per_second": 751.1999897051821,
|
||||
"predicted_n": 235,
|
||||
"predicted_ms": 5720.465,
|
||||
"predicted_per_token_ms": 24.34240425531915,
|
||||
"predicted_per_second": 41.080576491596396
|
||||
}
|
||||
},
|
||||
"answer": {
|
||||
"answer": "Nenašli sa žiadne fakty o práci Dárius Lindvai z roku 2019 s kľúčovým slovom python. Zdrojové údaje uvádzajú pre Dárius Lindvai v roku 2019 prácu s názvom \"rešerš\" (https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai), ale kľúčové slovo \"python\" je spojené s iným dokumentom bez uvedeného roku a názvu práce (https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial).",
|
||||
"status": "no_answer",
|
||||
"claims": [],
|
||||
"source_urls": [
|
||||
"https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai",
|
||||
"https://zp.kemt.fei.tuke.sk/students/2016/darius_lindvai/timovy_projekt/tutorial"
|
||||
],
|
||||
"count": 0
|
||||
},
|
||||
"bindings_ok": false,
|
||||
"unsupported_claims": [],
|
||||
"sources_ok": true,
|
||||
"status_ok": false,
|
||||
"count_ok": true,
|
||||
"set_ok": true,
|
||||
"text_values_ok": true,
|
||||
"missing_text_values": [],
|
||||
"contradictory_thesis_label": false,
|
||||
"latency_seconds": 9.125109145010356
|
||||
}
|
||||
]
|
||||
@ -0,0 +1,706 @@
|
||||
{
|
||||
"method": "Previously exposed LLM questions; regression, not independent TEST.",
|
||||
"graph_freeze_sha256": "ca1d2d71f60a8e65b82d727ad14556aabf2e03f2acdce1755c3e2a7a9a3149d3",
|
||||
"audit_sha256": "81708ca63f8772673cd836fe7a1a1938fbe0e713588efcb07ed3fd4280f27829",
|
||||
"generation_files": {
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/evaluate_graph_answers.py": "3b58e210fcd934a5488575e1b0ebb46a2e94ce72ee12f1e1a666c726c66d68af",
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/graph_answer_prompt.txt": "64d2bd817657f390c306ea01bf2dad41f70cd6993e06b2e3b2f4713bae0d249c",
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/answer_format.py": "86a27b4aebc6a5077e13794b81957a1cf063a1f3e070c583120ba53c1788d2f8",
|
||||
"tools/rag/evaluation/rag_runner.py": "a011b29e2b6aa47df9350e74fc358f05780a355170a819dbb1cfd16d2971493b"
|
||||
},
|
||||
"model": "model120-fast",
|
||||
"temperature": 0,
|
||||
"workers": 3,
|
||||
"dev_ids": [
|
||||
"wide-001",
|
||||
"wide-002",
|
||||
"wide-041",
|
||||
"wide-042",
|
||||
"wide-080",
|
||||
"wide-081",
|
||||
"wide-082",
|
||||
"wide-104",
|
||||
"wide-113",
|
||||
"wide-114",
|
||||
"wide-119",
|
||||
"wide-137",
|
||||
"wide-138",
|
||||
"wide-139",
|
||||
"wide-141",
|
||||
"wide-142",
|
||||
"wide-143",
|
||||
"wide-145",
|
||||
"wide-155",
|
||||
"wide-159",
|
||||
"wide-161",
|
||||
"wide-163",
|
||||
"wide-169",
|
||||
"wide-170",
|
||||
"wide-178",
|
||||
"wide-181",
|
||||
"wide-193",
|
||||
"wide-194",
|
||||
"wide-209",
|
||||
"wide-217",
|
||||
"wide-218",
|
||||
"wide-232",
|
||||
"wide-236",
|
||||
"wide-239",
|
||||
"wide-249",
|
||||
"wide-250",
|
||||
"wide-283",
|
||||
"wide-289",
|
||||
"wide-290"
|
||||
],
|
||||
"test_ids": [
|
||||
"wide-003",
|
||||
"wide-004",
|
||||
"wide-005",
|
||||
"wide-006",
|
||||
"wide-007",
|
||||
"wide-008",
|
||||
"wide-009",
|
||||
"wide-010",
|
||||
"wide-011",
|
||||
"wide-012",
|
||||
"wide-013",
|
||||
"wide-014",
|
||||
"wide-015",
|
||||
"wide-016",
|
||||
"wide-017",
|
||||
"wide-018",
|
||||
"wide-019",
|
||||
"wide-020",
|
||||
"wide-021",
|
||||
"wide-022",
|
||||
"wide-023",
|
||||
"wide-024",
|
||||
"wide-025",
|
||||
"wide-026",
|
||||
"wide-027",
|
||||
"wide-028",
|
||||
"wide-029",
|
||||
"wide-030",
|
||||
"wide-031",
|
||||
"wide-032",
|
||||
"wide-033",
|
||||
"wide-034",
|
||||
"wide-035",
|
||||
"wide-036",
|
||||
"wide-037",
|
||||
"wide-038",
|
||||
"wide-039",
|
||||
"wide-040",
|
||||
"wide-043",
|
||||
"wide-044",
|
||||
"wide-045",
|
||||
"wide-046",
|
||||
"wide-047",
|
||||
"wide-048",
|
||||
"wide-049",
|
||||
"wide-050",
|
||||
"wide-051",
|
||||
"wide-052",
|
||||
"wide-053",
|
||||
"wide-054",
|
||||
"wide-055",
|
||||
"wide-056",
|
||||
"wide-057",
|
||||
"wide-058",
|
||||
"wide-059",
|
||||
"wide-060",
|
||||
"wide-061",
|
||||
"wide-062",
|
||||
"wide-063",
|
||||
"wide-064",
|
||||
"wide-065",
|
||||
"wide-066",
|
||||
"wide-067",
|
||||
"wide-068",
|
||||
"wide-069",
|
||||
"wide-070",
|
||||
"wide-071",
|
||||
"wide-072",
|
||||
"wide-073",
|
||||
"wide-074",
|
||||
"wide-075",
|
||||
"wide-076",
|
||||
"wide-077",
|
||||
"wide-078",
|
||||
"wide-079",
|
||||
"wide-080",
|
||||
"wide-083",
|
||||
"wide-084",
|
||||
"wide-085",
|
||||
"wide-086",
|
||||
"wide-087",
|
||||
"wide-088",
|
||||
"wide-089",
|
||||
"wide-090",
|
||||
"wide-091",
|
||||
"wide-092",
|
||||
"wide-093",
|
||||
"wide-094",
|
||||
"wide-095",
|
||||
"wide-096",
|
||||
"wide-097",
|
||||
"wide-098",
|
||||
"wide-099",
|
||||
"wide-100",
|
||||
"wide-101",
|
||||
"wide-102",
|
||||
"wide-103",
|
||||
"wide-104",
|
||||
"wide-105",
|
||||
"wide-106",
|
||||
"wide-107",
|
||||
"wide-108",
|
||||
"wide-109",
|
||||
"wide-110",
|
||||
"wide-111",
|
||||
"wide-112",
|
||||
"wide-115",
|
||||
"wide-116",
|
||||
"wide-117",
|
||||
"wide-118",
|
||||
"wide-119",
|
||||
"wide-120",
|
||||
"wide-121",
|
||||
"wide-122",
|
||||
"wide-123",
|
||||
"wide-124",
|
||||
"wide-125",
|
||||
"wide-126",
|
||||
"wide-127",
|
||||
"wide-128",
|
||||
"wide-129",
|
||||
"wide-130",
|
||||
"wide-131",
|
||||
"wide-132",
|
||||
"wide-133",
|
||||
"wide-134",
|
||||
"wide-135",
|
||||
"wide-136",
|
||||
"wide-139",
|
||||
"wide-140",
|
||||
"wide-141",
|
||||
"wide-142",
|
||||
"wide-143",
|
||||
"wide-144",
|
||||
"wide-145",
|
||||
"wide-146",
|
||||
"wide-147",
|
||||
"wide-148",
|
||||
"wide-149",
|
||||
"wide-150",
|
||||
"wide-151",
|
||||
"wide-152",
|
||||
"wide-153",
|
||||
"wide-154",
|
||||
"wide-155",
|
||||
"wide-156",
|
||||
"wide-157",
|
||||
"wide-158",
|
||||
"wide-159",
|
||||
"wide-160",
|
||||
"wide-161",
|
||||
"wide-162",
|
||||
"wide-163",
|
||||
"wide-164",
|
||||
"wide-165",
|
||||
"wide-166",
|
||||
"wide-167",
|
||||
"wide-168",
|
||||
"wide-171",
|
||||
"wide-172",
|
||||
"wide-173",
|
||||
"wide-174",
|
||||
"wide-175",
|
||||
"wide-176",
|
||||
"wide-177",
|
||||
"wide-178",
|
||||
"wide-179",
|
||||
"wide-180",
|
||||
"wide-181",
|
||||
"wide-182",
|
||||
"wide-183",
|
||||
"wide-184",
|
||||
"wide-185",
|
||||
"wide-186",
|
||||
"wide-187",
|
||||
"wide-188",
|
||||
"wide-189",
|
||||
"wide-190",
|
||||
"wide-191",
|
||||
"wide-192",
|
||||
"wide-195",
|
||||
"wide-196",
|
||||
"wide-197",
|
||||
"wide-198",
|
||||
"wide-199",
|
||||
"wide-200",
|
||||
"wide-201",
|
||||
"wide-202",
|
||||
"wide-203",
|
||||
"wide-204",
|
||||
"wide-205",
|
||||
"wide-206",
|
||||
"wide-207",
|
||||
"wide-208",
|
||||
"wide-209",
|
||||
"wide-210",
|
||||
"wide-211",
|
||||
"wide-212",
|
||||
"wide-213",
|
||||
"wide-214",
|
||||
"wide-215",
|
||||
"wide-216",
|
||||
"wide-219",
|
||||
"wide-220",
|
||||
"wide-221",
|
||||
"wide-222",
|
||||
"wide-223",
|
||||
"wide-224",
|
||||
"wide-225",
|
||||
"wide-226",
|
||||
"wide-227",
|
||||
"wide-228",
|
||||
"wide-229",
|
||||
"wide-230",
|
||||
"wide-231",
|
||||
"wide-232",
|
||||
"wide-233",
|
||||
"wide-234",
|
||||
"wide-235",
|
||||
"wide-236",
|
||||
"wide-237",
|
||||
"wide-238",
|
||||
"wide-239",
|
||||
"wide-240",
|
||||
"wide-241",
|
||||
"wide-242",
|
||||
"wide-243",
|
||||
"wide-244",
|
||||
"wide-245",
|
||||
"wide-246",
|
||||
"wide-247",
|
||||
"wide-248",
|
||||
"wide-251",
|
||||
"wide-252",
|
||||
"wide-253",
|
||||
"wide-254",
|
||||
"wide-255",
|
||||
"wide-256",
|
||||
"wide-257",
|
||||
"wide-258",
|
||||
"wide-259",
|
||||
"wide-260",
|
||||
"wide-261",
|
||||
"wide-262",
|
||||
"wide-263",
|
||||
"wide-264",
|
||||
"wide-265",
|
||||
"wide-266",
|
||||
"wide-267",
|
||||
"wide-268",
|
||||
"wide-269",
|
||||
"wide-270",
|
||||
"wide-271",
|
||||
"wide-272",
|
||||
"wide-273",
|
||||
"wide-274",
|
||||
"wide-275",
|
||||
"wide-276",
|
||||
"wide-277",
|
||||
"wide-278",
|
||||
"wide-279",
|
||||
"wide-280",
|
||||
"wide-281",
|
||||
"wide-282",
|
||||
"wide-283",
|
||||
"wide-284",
|
||||
"wide-285",
|
||||
"wide-286",
|
||||
"wide-287",
|
||||
"wide-288",
|
||||
"wide-291",
|
||||
"wide-292",
|
||||
"wide-293",
|
||||
"wide-294",
|
||||
"wide-295",
|
||||
"wide-296",
|
||||
"wide-297",
|
||||
"wide-298",
|
||||
"wide-299",
|
||||
"wide-300",
|
||||
"wide-301",
|
||||
"wide-302",
|
||||
"wide-303",
|
||||
"wide-304",
|
||||
"wide-305",
|
||||
"wide-306",
|
||||
"wide-307",
|
||||
"wide-308",
|
||||
"wide-309",
|
||||
"wide-310",
|
||||
"wide-311",
|
||||
"wide-312",
|
||||
"wide-313",
|
||||
"wide-314",
|
||||
"wide-315",
|
||||
"wide-316",
|
||||
"wide-317",
|
||||
"wide-318",
|
||||
"wide-319",
|
||||
"wide-320"
|
||||
],
|
||||
"dev_count": 39,
|
||||
"test_count": 300,
|
||||
"target_accuracy": 0.92,
|
||||
"selected_split": "regression",
|
||||
"selected_ids": [
|
||||
"wide-001",
|
||||
"wide-002",
|
||||
"wide-003",
|
||||
"wide-004",
|
||||
"wide-005",
|
||||
"wide-006",
|
||||
"wide-007",
|
||||
"wide-008",
|
||||
"wide-009",
|
||||
"wide-010",
|
||||
"wide-011",
|
||||
"wide-012",
|
||||
"wide-013",
|
||||
"wide-014",
|
||||
"wide-015",
|
||||
"wide-016",
|
||||
"wide-017",
|
||||
"wide-018",
|
||||
"wide-019",
|
||||
"wide-020",
|
||||
"wide-021",
|
||||
"wide-022",
|
||||
"wide-023",
|
||||
"wide-024",
|
||||
"wide-025",
|
||||
"wide-026",
|
||||
"wide-027",
|
||||
"wide-028",
|
||||
"wide-029",
|
||||
"wide-030",
|
||||
"wide-031",
|
||||
"wide-032",
|
||||
"wide-033",
|
||||
"wide-034",
|
||||
"wide-035",
|
||||
"wide-036",
|
||||
"wide-037",
|
||||
"wide-038",
|
||||
"wide-039",
|
||||
"wide-040",
|
||||
"wide-041",
|
||||
"wide-042",
|
||||
"wide-043",
|
||||
"wide-044",
|
||||
"wide-045",
|
||||
"wide-046",
|
||||
"wide-047",
|
||||
"wide-048",
|
||||
"wide-049",
|
||||
"wide-050",
|
||||
"wide-051",
|
||||
"wide-052",
|
||||
"wide-053",
|
||||
"wide-054",
|
||||
"wide-055",
|
||||
"wide-056",
|
||||
"wide-057",
|
||||
"wide-058",
|
||||
"wide-059",
|
||||
"wide-060",
|
||||
"wide-061",
|
||||
"wide-062",
|
||||
"wide-063",
|
||||
"wide-064",
|
||||
"wide-065",
|
||||
"wide-066",
|
||||
"wide-067",
|
||||
"wide-068",
|
||||
"wide-069",
|
||||
"wide-070",
|
||||
"wide-071",
|
||||
"wide-072",
|
||||
"wide-073",
|
||||
"wide-074",
|
||||
"wide-075",
|
||||
"wide-076",
|
||||
"wide-077",
|
||||
"wide-078",
|
||||
"wide-079",
|
||||
"wide-080",
|
||||
"wide-081",
|
||||
"wide-082",
|
||||
"wide-083",
|
||||
"wide-084",
|
||||
"wide-085",
|
||||
"wide-086",
|
||||
"wide-087",
|
||||
"wide-088",
|
||||
"wide-089",
|
||||
"wide-090",
|
||||
"wide-091",
|
||||
"wide-092",
|
||||
"wide-093",
|
||||
"wide-094",
|
||||
"wide-095",
|
||||
"wide-096",
|
||||
"wide-097",
|
||||
"wide-098",
|
||||
"wide-099",
|
||||
"wide-100",
|
||||
"wide-101",
|
||||
"wide-102",
|
||||
"wide-103",
|
||||
"wide-104",
|
||||
"wide-105",
|
||||
"wide-106",
|
||||
"wide-107",
|
||||
"wide-108",
|
||||
"wide-109",
|
||||
"wide-110",
|
||||
"wide-111",
|
||||
"wide-112",
|
||||
"wide-113",
|
||||
"wide-114",
|
||||
"wide-115",
|
||||
"wide-116",
|
||||
"wide-117",
|
||||
"wide-118",
|
||||
"wide-119",
|
||||
"wide-120",
|
||||
"wide-121",
|
||||
"wide-122",
|
||||
"wide-123",
|
||||
"wide-124",
|
||||
"wide-125",
|
||||
"wide-126",
|
||||
"wide-127",
|
||||
"wide-128",
|
||||
"wide-129",
|
||||
"wide-130",
|
||||
"wide-131",
|
||||
"wide-132",
|
||||
"wide-133",
|
||||
"wide-134",
|
||||
"wide-135",
|
||||
"wide-136",
|
||||
"wide-137",
|
||||
"wide-138",
|
||||
"wide-139",
|
||||
"wide-140",
|
||||
"wide-141",
|
||||
"wide-142",
|
||||
"wide-143",
|
||||
"wide-144",
|
||||
"wide-145",
|
||||
"wide-146",
|
||||
"wide-147",
|
||||
"wide-148",
|
||||
"wide-149",
|
||||
"wide-150",
|
||||
"wide-151",
|
||||
"wide-152",
|
||||
"wide-153",
|
||||
"wide-154",
|
||||
"wide-155",
|
||||
"wide-156",
|
||||
"wide-157",
|
||||
"wide-158",
|
||||
"wide-159",
|
||||
"wide-160",
|
||||
"wide-161",
|
||||
"wide-162",
|
||||
"wide-163",
|
||||
"wide-164",
|
||||
"wide-165",
|
||||
"wide-166",
|
||||
"wide-167",
|
||||
"wide-168",
|
||||
"wide-169",
|
||||
"wide-170",
|
||||
"wide-171",
|
||||
"wide-172",
|
||||
"wide-173",
|
||||
"wide-174",
|
||||
"wide-175",
|
||||
"wide-176",
|
||||
"wide-177",
|
||||
"wide-178",
|
||||
"wide-179",
|
||||
"wide-180",
|
||||
"wide-181",
|
||||
"wide-182",
|
||||
"wide-183",
|
||||
"wide-184",
|
||||
"wide-185",
|
||||
"wide-186",
|
||||
"wide-187",
|
||||
"wide-188",
|
||||
"wide-189",
|
||||
"wide-190",
|
||||
"wide-191",
|
||||
"wide-192",
|
||||
"wide-193",
|
||||
"wide-194",
|
||||
"wide-195",
|
||||
"wide-196",
|
||||
"wide-197",
|
||||
"wide-198",
|
||||
"wide-199",
|
||||
"wide-200",
|
||||
"wide-201",
|
||||
"wide-202",
|
||||
"wide-203",
|
||||
"wide-204",
|
||||
"wide-205",
|
||||
"wide-206",
|
||||
"wide-207",
|
||||
"wide-208",
|
||||
"wide-209",
|
||||
"wide-210",
|
||||
"wide-211",
|
||||
"wide-212",
|
||||
"wide-213",
|
||||
"wide-214",
|
||||
"wide-215",
|
||||
"wide-216",
|
||||
"wide-217",
|
||||
"wide-218",
|
||||
"wide-219",
|
||||
"wide-220",
|
||||
"wide-221",
|
||||
"wide-222",
|
||||
"wide-223",
|
||||
"wide-224",
|
||||
"wide-225",
|
||||
"wide-226",
|
||||
"wide-227",
|
||||
"wide-228",
|
||||
"wide-229",
|
||||
"wide-230",
|
||||
"wide-231",
|
||||
"wide-232",
|
||||
"wide-233",
|
||||
"wide-234",
|
||||
"wide-235",
|
||||
"wide-236",
|
||||
"wide-237",
|
||||
"wide-238",
|
||||
"wide-239",
|
||||
"wide-240",
|
||||
"wide-241",
|
||||
"wide-242",
|
||||
"wide-243",
|
||||
"wide-244",
|
||||
"wide-245",
|
||||
"wide-246",
|
||||
"wide-247",
|
||||
"wide-248",
|
||||
"wide-249",
|
||||
"wide-250",
|
||||
"wide-251",
|
||||
"wide-252",
|
||||
"wide-253",
|
||||
"wide-254",
|
||||
"wide-255",
|
||||
"wide-256",
|
||||
"wide-257",
|
||||
"wide-258",
|
||||
"wide-259",
|
||||
"wide-260",
|
||||
"wide-261",
|
||||
"wide-262",
|
||||
"wide-263",
|
||||
"wide-264",
|
||||
"wide-265",
|
||||
"wide-266",
|
||||
"wide-267",
|
||||
"wide-268",
|
||||
"wide-269",
|
||||
"wide-270",
|
||||
"wide-271",
|
||||
"wide-272",
|
||||
"wide-273",
|
||||
"wide-274",
|
||||
"wide-275",
|
||||
"wide-276",
|
||||
"wide-277",
|
||||
"wide-278",
|
||||
"wide-279",
|
||||
"wide-280",
|
||||
"wide-281",
|
||||
"wide-282",
|
||||
"wide-283",
|
||||
"wide-284",
|
||||
"wide-285",
|
||||
"wide-286",
|
||||
"wide-287",
|
||||
"wide-288",
|
||||
"wide-289",
|
||||
"wide-290",
|
||||
"wide-291",
|
||||
"wide-292",
|
||||
"wide-293",
|
||||
"wide-294",
|
||||
"wide-295",
|
||||
"wide-296",
|
||||
"wide-297",
|
||||
"wide-298",
|
||||
"wide-299",
|
||||
"wide-300",
|
||||
"wide-301",
|
||||
"wide-302",
|
||||
"wide-303",
|
||||
"wide-304",
|
||||
"wide-305",
|
||||
"wide-306",
|
||||
"wide-307",
|
||||
"wide-308",
|
||||
"wide-309",
|
||||
"wide-310",
|
||||
"wide-311",
|
||||
"wide-312",
|
||||
"wide-313",
|
||||
"wide-314",
|
||||
"wide-315",
|
||||
"wide-316",
|
||||
"wide-317",
|
||||
"wide-318",
|
||||
"wide-319",
|
||||
"wide-320"
|
||||
],
|
||||
"selected_count": 320,
|
||||
"selected_dev_overlap": 39,
|
||||
"format_repair_limit": 1,
|
||||
"repair_policy": "Only JSON/schema failures; same question/context, no gold; retain all attempts.",
|
||||
"dev_results_sha256": "cd9b206a5a89602441e5d3b47c9de2febfd8f34ef4ec32cf20f567079761e619",
|
||||
"policy": "Evaluate every declared regression case, including DEV overlap; retain all failures and stop tuning after this freeze.",
|
||||
"selected_categories": {
|
||||
"shared_keyword_pair": 40,
|
||||
"same_academic_year_pair": 40,
|
||||
"same_start_year_pair": 32,
|
||||
"person_title_year": 24,
|
||||
"person_keyword_title": 32,
|
||||
"document_author_category_multi_hop": 24,
|
||||
"person_multiple_categories": 24,
|
||||
"candidate_set_aggregation": 32,
|
||||
"conjunctive_disambiguation": 40,
|
||||
"negative_lookup": 32
|
||||
},
|
||||
"limitations": [
|
||||
"Known corpus/profiles and templates; model outputs for these 300 questions were not previously observed.",
|
||||
"Harness supplies graph context; native OpenWebUI tool choice and browser UI are outside this experiment.",
|
||||
"Checks structured factual claims, their source support/citations and required prose values; not a general semantic judge of arbitrary prose."
|
||||
]
|
||||
}
|
||||
@ -0,0 +1,40 @@
|
||||
id,category,strict,error,latency_seconds,attempts,first_pass_strict
|
||||
wide-001,shared_keyword_pair,True,,13.102745643991511,1,True
|
||||
wide-002,shared_keyword_pair,True,,8.686387695997837,1,True
|
||||
wide-041,same_academic_year_pair,True,,7.175007558995276,1,True
|
||||
wide-042,same_academic_year_pair,True,,7.3540544569987105,1,True
|
||||
wide-080,same_academic_year_pair,True,,9.493409784001415,1,True
|
||||
wide-081,same_start_year_pair,True,,7.360842023990699,1,True
|
||||
wide-082,same_start_year_pair,True,,9.634056855007657,1,True
|
||||
wide-104,same_start_year_pair,True,,7.5196549139946,1,True
|
||||
wide-113,person_title_year,True,,8.4268134659942,1,True
|
||||
wide-114,person_title_year,True,,6.6590490480011795,1,True
|
||||
wide-119,person_title_year,True,,8.043334904010408,1,True
|
||||
wide-137,person_keyword_title,True,,7.18094556601136,1,True
|
||||
wide-138,person_keyword_title,True,,8.415209711994976,1,True
|
||||
wide-139,person_keyword_title,True,,7.5367714180029,1,True
|
||||
wide-141,person_keyword_title,True,,8.302764993000892,1,True
|
||||
wide-142,person_keyword_title,True,,9.15925429300114,1,True
|
||||
wide-143,person_keyword_title,True,,11.15336542800651,1,True
|
||||
wide-145,person_keyword_title,False,,10.935504723005579,1,False
|
||||
wide-155,person_keyword_title,True,,9.731682198005728,1,True
|
||||
wide-159,person_keyword_title,True,,8.722476019000169,1,True
|
||||
wide-161,person_keyword_title,True,,8.795275380005478,1,True
|
||||
wide-163,person_keyword_title,True,,8.375112182999146,1,True
|
||||
wide-169,document_author_category_multi_hop,True,,7.371920378995128,1,True
|
||||
wide-170,document_author_category_multi_hop,True,,6.7976903180097,1,True
|
||||
wide-178,document_author_category_multi_hop,True,,6.5963496360054705,1,True
|
||||
wide-181,document_author_category_multi_hop,True,,6.7874484959902475,1,True
|
||||
wide-193,person_multiple_categories,True,,5.843567528994754,1,True
|
||||
wide-194,person_multiple_categories,True,,5.834254229994258,1,True
|
||||
wide-209,person_multiple_categories,True,,6.06473808499868,1,True
|
||||
wide-217,candidate_set_aggregation,True,,8.168832301991642,1,True
|
||||
wide-218,candidate_set_aggregation,True,,8.408147340000141,1,True
|
||||
wide-232,candidate_set_aggregation,True,,9.107497649005381,1,True
|
||||
wide-236,candidate_set_aggregation,True,,8.041833495008177,1,True
|
||||
wide-239,candidate_set_aggregation,True,,8.753410860008444,1,True
|
||||
wide-249,conjunctive_disambiguation,True,,6.555928866990143,1,True
|
||||
wide-250,conjunctive_disambiguation,True,,7.249271184002282,1,True
|
||||
wide-283,conjunctive_disambiguation,True,,6.916102559000137,1,True
|
||||
wide-289,negative_lookup,True,,4.995769290995668,1,True
|
||||
wide-290,negative_lookup,True,,4.3209586270095315,1,True
|
||||
|
File diff suppressed because it is too large
Load Diff
@ -0,0 +1,425 @@
|
||||
{
|
||||
"method": "Previously exposed LLM questions; regression, not independent TEST.",
|
||||
"graph_freeze_sha256": "0dc97fdba37557d76392538eb122e2eafd5f58480fee7de347e1f5ca251823d4",
|
||||
"audit_sha256": "091e2ee00a88e9e6a459e91fb54efabd23eec5eb4dd70570aa313c3e51e93410",
|
||||
"generation_files": {
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/evaluate_graph_answers.py": "3b58e210fcd934a5488575e1b0ebb46a2e94ce72ee12f1e1a666c726c66d68af",
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/graph_answer_prompt.txt": "801dcd48be8014b65667ced52810b75b43f9b7c525fdbfcbd08fd8f668673016",
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/answer_format.py": "86a27b4aebc6a5077e13794b81957a1cf063a1f3e070c583120ba53c1788d2f8",
|
||||
"tools/rag/evaluation/rag_runner.py": "a011b29e2b6aa47df9350e74fc358f05780a355170a819dbb1cfd16d2971493b"
|
||||
},
|
||||
"model": "model120-fast",
|
||||
"temperature": 0,
|
||||
"workers": 3,
|
||||
"dev_ids": [
|
||||
"wide-001",
|
||||
"wide-002",
|
||||
"wide-041",
|
||||
"wide-042",
|
||||
"wide-080",
|
||||
"wide-081",
|
||||
"wide-082",
|
||||
"wide-104",
|
||||
"wide-113",
|
||||
"wide-114",
|
||||
"wide-119",
|
||||
"wide-137",
|
||||
"wide-138",
|
||||
"wide-139",
|
||||
"wide-141",
|
||||
"wide-142",
|
||||
"wide-143",
|
||||
"wide-145",
|
||||
"wide-155",
|
||||
"wide-159",
|
||||
"wide-161",
|
||||
"wide-163",
|
||||
"wide-169",
|
||||
"wide-170",
|
||||
"wide-178",
|
||||
"wide-181",
|
||||
"wide-193",
|
||||
"wide-194",
|
||||
"wide-209",
|
||||
"wide-217",
|
||||
"wide-218",
|
||||
"wide-232",
|
||||
"wide-236",
|
||||
"wide-239",
|
||||
"wide-249",
|
||||
"wide-250",
|
||||
"wide-283",
|
||||
"wide-289",
|
||||
"wide-290"
|
||||
],
|
||||
"test_ids": [
|
||||
"wide-003",
|
||||
"wide-004",
|
||||
"wide-005",
|
||||
"wide-006",
|
||||
"wide-007",
|
||||
"wide-008",
|
||||
"wide-009",
|
||||
"wide-010",
|
||||
"wide-011",
|
||||
"wide-012",
|
||||
"wide-013",
|
||||
"wide-014",
|
||||
"wide-015",
|
||||
"wide-016",
|
||||
"wide-017",
|
||||
"wide-018",
|
||||
"wide-019",
|
||||
"wide-020",
|
||||
"wide-021",
|
||||
"wide-022",
|
||||
"wide-023",
|
||||
"wide-024",
|
||||
"wide-025",
|
||||
"wide-026",
|
||||
"wide-027",
|
||||
"wide-028",
|
||||
"wide-029",
|
||||
"wide-030",
|
||||
"wide-031",
|
||||
"wide-032",
|
||||
"wide-033",
|
||||
"wide-034",
|
||||
"wide-035",
|
||||
"wide-036",
|
||||
"wide-037",
|
||||
"wide-038",
|
||||
"wide-039",
|
||||
"wide-040",
|
||||
"wide-043",
|
||||
"wide-044",
|
||||
"wide-045",
|
||||
"wide-046",
|
||||
"wide-047",
|
||||
"wide-048",
|
||||
"wide-049",
|
||||
"wide-050",
|
||||
"wide-051",
|
||||
"wide-052",
|
||||
"wide-053",
|
||||
"wide-054",
|
||||
"wide-055",
|
||||
"wide-056",
|
||||
"wide-057",
|
||||
"wide-058",
|
||||
"wide-059",
|
||||
"wide-060",
|
||||
"wide-061",
|
||||
"wide-062",
|
||||
"wide-063",
|
||||
"wide-064",
|
||||
"wide-065",
|
||||
"wide-066",
|
||||
"wide-067",
|
||||
"wide-068",
|
||||
"wide-069",
|
||||
"wide-070",
|
||||
"wide-071",
|
||||
"wide-072",
|
||||
"wide-073",
|
||||
"wide-074",
|
||||
"wide-075",
|
||||
"wide-076",
|
||||
"wide-077",
|
||||
"wide-078",
|
||||
"wide-079",
|
||||
"wide-080",
|
||||
"wide-083",
|
||||
"wide-084",
|
||||
"wide-085",
|
||||
"wide-086",
|
||||
"wide-087",
|
||||
"wide-088",
|
||||
"wide-089",
|
||||
"wide-090",
|
||||
"wide-091",
|
||||
"wide-092",
|
||||
"wide-093",
|
||||
"wide-094",
|
||||
"wide-095",
|
||||
"wide-096",
|
||||
"wide-097",
|
||||
"wide-098",
|
||||
"wide-099",
|
||||
"wide-100",
|
||||
"wide-101",
|
||||
"wide-102",
|
||||
"wide-103",
|
||||
"wide-104",
|
||||
"wide-105",
|
||||
"wide-106",
|
||||
"wide-107",
|
||||
"wide-108",
|
||||
"wide-109",
|
||||
"wide-110",
|
||||
"wide-111",
|
||||
"wide-112",
|
||||
"wide-115",
|
||||
"wide-116",
|
||||
"wide-117",
|
||||
"wide-118",
|
||||
"wide-119",
|
||||
"wide-120",
|
||||
"wide-121",
|
||||
"wide-122",
|
||||
"wide-123",
|
||||
"wide-124",
|
||||
"wide-125",
|
||||
"wide-126",
|
||||
"wide-127",
|
||||
"wide-128",
|
||||
"wide-129",
|
||||
"wide-130",
|
||||
"wide-131",
|
||||
"wide-132",
|
||||
"wide-133",
|
||||
"wide-134",
|
||||
"wide-135",
|
||||
"wide-136",
|
||||
"wide-139",
|
||||
"wide-140",
|
||||
"wide-141",
|
||||
"wide-142",
|
||||
"wide-143",
|
||||
"wide-144",
|
||||
"wide-145",
|
||||
"wide-146",
|
||||
"wide-147",
|
||||
"wide-148",
|
||||
"wide-149",
|
||||
"wide-150",
|
||||
"wide-151",
|
||||
"wide-152",
|
||||
"wide-153",
|
||||
"wide-154",
|
||||
"wide-155",
|
||||
"wide-156",
|
||||
"wide-157",
|
||||
"wide-158",
|
||||
"wide-159",
|
||||
"wide-160",
|
||||
"wide-161",
|
||||
"wide-162",
|
||||
"wide-163",
|
||||
"wide-164",
|
||||
"wide-165",
|
||||
"wide-166",
|
||||
"wide-167",
|
||||
"wide-168",
|
||||
"wide-171",
|
||||
"wide-172",
|
||||
"wide-173",
|
||||
"wide-174",
|
||||
"wide-175",
|
||||
"wide-176",
|
||||
"wide-177",
|
||||
"wide-178",
|
||||
"wide-179",
|
||||
"wide-180",
|
||||
"wide-181",
|
||||
"wide-182",
|
||||
"wide-183",
|
||||
"wide-184",
|
||||
"wide-185",
|
||||
"wide-186",
|
||||
"wide-187",
|
||||
"wide-188",
|
||||
"wide-189",
|
||||
"wide-190",
|
||||
"wide-191",
|
||||
"wide-192",
|
||||
"wide-195",
|
||||
"wide-196",
|
||||
"wide-197",
|
||||
"wide-198",
|
||||
"wide-199",
|
||||
"wide-200",
|
||||
"wide-201",
|
||||
"wide-202",
|
||||
"wide-203",
|
||||
"wide-204",
|
||||
"wide-205",
|
||||
"wide-206",
|
||||
"wide-207",
|
||||
"wide-208",
|
||||
"wide-209",
|
||||
"wide-210",
|
||||
"wide-211",
|
||||
"wide-212",
|
||||
"wide-213",
|
||||
"wide-214",
|
||||
"wide-215",
|
||||
"wide-216",
|
||||
"wide-219",
|
||||
"wide-220",
|
||||
"wide-221",
|
||||
"wide-222",
|
||||
"wide-223",
|
||||
"wide-224",
|
||||
"wide-225",
|
||||
"wide-226",
|
||||
"wide-227",
|
||||
"wide-228",
|
||||
"wide-229",
|
||||
"wide-230",
|
||||
"wide-231",
|
||||
"wide-232",
|
||||
"wide-233",
|
||||
"wide-234",
|
||||
"wide-235",
|
||||
"wide-236",
|
||||
"wide-237",
|
||||
"wide-238",
|
||||
"wide-239",
|
||||
"wide-240",
|
||||
"wide-241",
|
||||
"wide-242",
|
||||
"wide-243",
|
||||
"wide-244",
|
||||
"wide-245",
|
||||
"wide-246",
|
||||
"wide-247",
|
||||
"wide-248",
|
||||
"wide-251",
|
||||
"wide-252",
|
||||
"wide-253",
|
||||
"wide-254",
|
||||
"wide-255",
|
||||
"wide-256",
|
||||
"wide-257",
|
||||
"wide-258",
|
||||
"wide-259",
|
||||
"wide-260",
|
||||
"wide-261",
|
||||
"wide-262",
|
||||
"wide-263",
|
||||
"wide-264",
|
||||
"wide-265",
|
||||
"wide-266",
|
||||
"wide-267",
|
||||
"wide-268",
|
||||
"wide-269",
|
||||
"wide-270",
|
||||
"wide-271",
|
||||
"wide-272",
|
||||
"wide-273",
|
||||
"wide-274",
|
||||
"wide-275",
|
||||
"wide-276",
|
||||
"wide-277",
|
||||
"wide-278",
|
||||
"wide-279",
|
||||
"wide-280",
|
||||
"wide-281",
|
||||
"wide-282",
|
||||
"wide-283",
|
||||
"wide-284",
|
||||
"wide-285",
|
||||
"wide-286",
|
||||
"wide-287",
|
||||
"wide-288",
|
||||
"wide-291",
|
||||
"wide-292",
|
||||
"wide-293",
|
||||
"wide-294",
|
||||
"wide-295",
|
||||
"wide-296",
|
||||
"wide-297",
|
||||
"wide-298",
|
||||
"wide-299",
|
||||
"wide-300",
|
||||
"wide-301",
|
||||
"wide-302",
|
||||
"wide-303",
|
||||
"wide-304",
|
||||
"wide-305",
|
||||
"wide-306",
|
||||
"wide-307",
|
||||
"wide-308",
|
||||
"wide-309",
|
||||
"wide-310",
|
||||
"wide-311",
|
||||
"wide-312",
|
||||
"wide-313",
|
||||
"wide-314",
|
||||
"wide-315",
|
||||
"wide-316",
|
||||
"wide-317",
|
||||
"wide-318",
|
||||
"wide-319",
|
||||
"wide-320"
|
||||
],
|
||||
"dev_count": 39,
|
||||
"test_count": 300,
|
||||
"target_accuracy": 0.92,
|
||||
"selected_split": "dev",
|
||||
"selected_ids": [
|
||||
"wide-001",
|
||||
"wide-002",
|
||||
"wide-041",
|
||||
"wide-042",
|
||||
"wide-080",
|
||||
"wide-081",
|
||||
"wide-082",
|
||||
"wide-104",
|
||||
"wide-113",
|
||||
"wide-114",
|
||||
"wide-119",
|
||||
"wide-137",
|
||||
"wide-138",
|
||||
"wide-139",
|
||||
"wide-141",
|
||||
"wide-142",
|
||||
"wide-143",
|
||||
"wide-145",
|
||||
"wide-155",
|
||||
"wide-159",
|
||||
"wide-161",
|
||||
"wide-163",
|
||||
"wide-169",
|
||||
"wide-170",
|
||||
"wide-178",
|
||||
"wide-181",
|
||||
"wide-193",
|
||||
"wide-194",
|
||||
"wide-209",
|
||||
"wide-217",
|
||||
"wide-218",
|
||||
"wide-232",
|
||||
"wide-236",
|
||||
"wide-239",
|
||||
"wide-249",
|
||||
"wide-250",
|
||||
"wide-283",
|
||||
"wide-289",
|
||||
"wide-290"
|
||||
],
|
||||
"selected_count": 39,
|
||||
"selected_dev_overlap": 39,
|
||||
"format_repair_limit": 1,
|
||||
"repair_policy": "Only JSON/schema failures; same question/context, no gold; retain all attempts.",
|
||||
"dev_results_sha256": null,
|
||||
"policy": "Evaluate every declared regression case, including DEV overlap; retain all failures and stop tuning after this freeze.",
|
||||
"selected_categories": {
|
||||
"shared_keyword_pair": 2,
|
||||
"same_academic_year_pair": 3,
|
||||
"same_start_year_pair": 3,
|
||||
"person_title_year": 3,
|
||||
"person_keyword_title": 11,
|
||||
"document_author_category_multi_hop": 4,
|
||||
"person_multiple_categories": 3,
|
||||
"candidate_set_aggregation": 5,
|
||||
"conjunctive_disambiguation": 3,
|
||||
"negative_lookup": 2
|
||||
},
|
||||
"limitations": [
|
||||
"Known corpus/profiles and templates; model outputs for these 300 questions were not previously observed.",
|
||||
"Harness supplies graph context; native OpenWebUI tool choice and browser UI are outside this experiment.",
|
||||
"Checks structured factual claims, their source support/citations and required prose values; not a general semantic judge of arbitrary prose."
|
||||
]
|
||||
}
|
||||
@ -0,0 +1,43 @@
|
||||
id,category,strict,error,latency_seconds,attempts,first_pass_strict
|
||||
wide-001,shared_keyword_pair,True,,14.98031888899277,1,True
|
||||
wide-002,shared_keyword_pair,True,,8.397393244013074,1,True
|
||||
wide-041,same_academic_year_pair,True,,6.902643829002045,1,True
|
||||
wide-042,same_academic_year_pair,True,,6.882375492001302,1,True
|
||||
wide-080,same_academic_year_pair,True,,12.271757686001365,1,True
|
||||
wide-081,same_start_year_pair,True,,8.204727490010555,1,True
|
||||
wide-082,same_start_year_pair,True,,13.702611551998416,1,True
|
||||
wide-104,same_start_year_pair,True,,6.501820275996579,1,True
|
||||
wide-113,person_title_year,True,,10.964796315005515,1,True
|
||||
wide-114,person_title_year,True,,7.376625097997021,1,True
|
||||
wide-116,person_title_year,True,,7.847194762012805,1,True
|
||||
wide-119,person_title_year,True,,7.342980269997497,1,True
|
||||
wide-129,person_title_year,True,,8.418876146010007,1,True
|
||||
wide-137,person_keyword_title,True,,9.795194769991213,1,True
|
||||
wide-138,person_keyword_title,True,,8.844560971003375,1,True
|
||||
wide-139,person_keyword_title,True,,9.329334552996443,1,True
|
||||
wide-141,person_keyword_title,True,,9.592877750008483,1,True
|
||||
wide-142,person_keyword_title,True,,5.007802811000147,1,True
|
||||
wide-143,person_keyword_title,True,,11.664019524003379,1,True
|
||||
wide-145,person_keyword_title,True,,3.2914913540007547,1,True
|
||||
wide-155,person_keyword_title,True,,6.680825702002039,1,True
|
||||
wide-159,person_keyword_title,True,,13.560824561005575,1,True
|
||||
wide-161,person_keyword_title,True,,7.287550342996838,1,True
|
||||
wide-163,person_keyword_title,True,,12.33143888199993,1,True
|
||||
wide-165,person_keyword_title,True,,2.5120001080067595,1,True
|
||||
wide-169,document_author_category_multi_hop,True,,6.5130544929997995,1,True
|
||||
wide-170,document_author_category_multi_hop,True,,8.98161977599375,1,True
|
||||
wide-178,document_author_category_multi_hop,True,,6.077633890003199,1,True
|
||||
wide-181,document_author_category_multi_hop,True,,8.441153998006484,1,True
|
||||
wide-193,person_multiple_categories,True,,5.523557033011457,1,True
|
||||
wide-194,person_multiple_categories,True,,8.1642089090019,1,True
|
||||
wide-209,person_multiple_categories,True,,6.1462335319956765,1,True
|
||||
wide-217,candidate_set_aggregation,True,,10.333294509997359,1,True
|
||||
wide-218,candidate_set_aggregation,True,,8.658889918995555,1,True
|
||||
wide-232,candidate_set_aggregation,True,,14.336149934009882,1,True
|
||||
wide-236,candidate_set_aggregation,True,,7.896173950997763,1,True
|
||||
wide-239,candidate_set_aggregation,True,,13.960932583999238,1,True
|
||||
wide-249,conjunctive_disambiguation,True,,5.288597282997216,1,True
|
||||
wide-250,conjunctive_disambiguation,True,,10.146073770010844,1,True
|
||||
wide-283,conjunctive_disambiguation,False,,12.396372432995122,1,False
|
||||
wide-289,negative_lookup,True,,6.812868237000657,1,True
|
||||
wide-290,negative_lookup,True,,6.7916078380076215,1,True
|
||||
|
File diff suppressed because it is too large
Load Diff
@ -0,0 +1,434 @@
|
||||
{
|
||||
"method": "Previously exposed LLM questions; regression, not independent TEST.",
|
||||
"graph_freeze_sha256": "e5c6c01277478b49e10b0ea3daee991b8a20d895b5fb435506a01d8a941535ef",
|
||||
"audit_sha256": "d5922db25b6d40cb7e5dc7df7990e93a3caee263a6e747ae910ab340da340023",
|
||||
"generation_files": {
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/evaluate_graph_answers.py": "2553a0d17e164922b02046416fdf0d5df4496dc443466d8d9a1f4be86415b318",
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/graph_answer_prompt.txt": "c7104ffb08b5b384f38d48fbdad40ccd40de61beace984d8a118cf12bd229860",
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/answer_format.py": "86a27b4aebc6a5077e13794b81957a1cf063a1f3e070c583120ba53c1788d2f8",
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/context_policy.py": "ee3c423772800d3e7368fff9b48bcd464a98a741b87a0c79158398ed22a3dc00",
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/checked_generation.py": "e82b95314b8c0ae9ba82353b98876da7b2a4dce464eb21129ad904bf58b8ef5e",
|
||||
"tools/rag/evaluation/rag_runner.py": "031abf7d5b1a026eb199aa2a579bfb8baaa01175279d0018a364bfe50b76c3c1"
|
||||
},
|
||||
"model": "model120-fast",
|
||||
"temperature": 0,
|
||||
"workers": 3,
|
||||
"dev_ids": [
|
||||
"wide-001",
|
||||
"wide-002",
|
||||
"wide-041",
|
||||
"wide-042",
|
||||
"wide-080",
|
||||
"wide-081",
|
||||
"wide-082",
|
||||
"wide-104",
|
||||
"wide-113",
|
||||
"wide-114",
|
||||
"wide-116",
|
||||
"wide-119",
|
||||
"wide-129",
|
||||
"wide-137",
|
||||
"wide-138",
|
||||
"wide-139",
|
||||
"wide-141",
|
||||
"wide-142",
|
||||
"wide-143",
|
||||
"wide-145",
|
||||
"wide-155",
|
||||
"wide-159",
|
||||
"wide-161",
|
||||
"wide-163",
|
||||
"wide-165",
|
||||
"wide-169",
|
||||
"wide-170",
|
||||
"wide-178",
|
||||
"wide-181",
|
||||
"wide-193",
|
||||
"wide-194",
|
||||
"wide-209",
|
||||
"wide-217",
|
||||
"wide-218",
|
||||
"wide-232",
|
||||
"wide-236",
|
||||
"wide-239",
|
||||
"wide-249",
|
||||
"wide-250",
|
||||
"wide-283",
|
||||
"wide-289",
|
||||
"wide-290"
|
||||
],
|
||||
"test_ids": [
|
||||
"wide-003",
|
||||
"wide-004",
|
||||
"wide-005",
|
||||
"wide-006",
|
||||
"wide-007",
|
||||
"wide-008",
|
||||
"wide-009",
|
||||
"wide-010",
|
||||
"wide-011",
|
||||
"wide-012",
|
||||
"wide-013",
|
||||
"wide-014",
|
||||
"wide-015",
|
||||
"wide-016",
|
||||
"wide-017",
|
||||
"wide-018",
|
||||
"wide-019",
|
||||
"wide-020",
|
||||
"wide-021",
|
||||
"wide-022",
|
||||
"wide-023",
|
||||
"wide-024",
|
||||
"wide-025",
|
||||
"wide-026",
|
||||
"wide-027",
|
||||
"wide-028",
|
||||
"wide-029",
|
||||
"wide-030",
|
||||
"wide-031",
|
||||
"wide-032",
|
||||
"wide-033",
|
||||
"wide-034",
|
||||
"wide-035",
|
||||
"wide-036",
|
||||
"wide-037",
|
||||
"wide-038",
|
||||
"wide-039",
|
||||
"wide-040",
|
||||
"wide-043",
|
||||
"wide-044",
|
||||
"wide-045",
|
||||
"wide-046",
|
||||
"wide-047",
|
||||
"wide-048",
|
||||
"wide-049",
|
||||
"wide-050",
|
||||
"wide-051",
|
||||
"wide-052",
|
||||
"wide-053",
|
||||
"wide-054",
|
||||
"wide-055",
|
||||
"wide-056",
|
||||
"wide-057",
|
||||
"wide-058",
|
||||
"wide-059",
|
||||
"wide-060",
|
||||
"wide-061",
|
||||
"wide-062",
|
||||
"wide-063",
|
||||
"wide-064",
|
||||
"wide-065",
|
||||
"wide-066",
|
||||
"wide-067",
|
||||
"wide-068",
|
||||
"wide-069",
|
||||
"wide-070",
|
||||
"wide-071",
|
||||
"wide-072",
|
||||
"wide-073",
|
||||
"wide-074",
|
||||
"wide-075",
|
||||
"wide-076",
|
||||
"wide-077",
|
||||
"wide-078",
|
||||
"wide-079",
|
||||
"wide-080",
|
||||
"wide-083",
|
||||
"wide-084",
|
||||
"wide-085",
|
||||
"wide-086",
|
||||
"wide-087",
|
||||
"wide-088",
|
||||
"wide-089",
|
||||
"wide-090",
|
||||
"wide-091",
|
||||
"wide-092",
|
||||
"wide-093",
|
||||
"wide-094",
|
||||
"wide-095",
|
||||
"wide-096",
|
||||
"wide-097",
|
||||
"wide-098",
|
||||
"wide-099",
|
||||
"wide-100",
|
||||
"wide-101",
|
||||
"wide-102",
|
||||
"wide-103",
|
||||
"wide-104",
|
||||
"wide-105",
|
||||
"wide-106",
|
||||
"wide-107",
|
||||
"wide-108",
|
||||
"wide-109",
|
||||
"wide-110",
|
||||
"wide-111",
|
||||
"wide-112",
|
||||
"wide-115",
|
||||
"wide-116",
|
||||
"wide-117",
|
||||
"wide-118",
|
||||
"wide-119",
|
||||
"wide-120",
|
||||
"wide-121",
|
||||
"wide-122",
|
||||
"wide-123",
|
||||
"wide-124",
|
||||
"wide-125",
|
||||
"wide-126",
|
||||
"wide-127",
|
||||
"wide-128",
|
||||
"wide-129",
|
||||
"wide-130",
|
||||
"wide-131",
|
||||
"wide-132",
|
||||
"wide-133",
|
||||
"wide-134",
|
||||
"wide-135",
|
||||
"wide-136",
|
||||
"wide-139",
|
||||
"wide-140",
|
||||
"wide-141",
|
||||
"wide-142",
|
||||
"wide-143",
|
||||
"wide-144",
|
||||
"wide-145",
|
||||
"wide-146",
|
||||
"wide-147",
|
||||
"wide-148",
|
||||
"wide-149",
|
||||
"wide-150",
|
||||
"wide-151",
|
||||
"wide-152",
|
||||
"wide-153",
|
||||
"wide-154",
|
||||
"wide-155",
|
||||
"wide-156",
|
||||
"wide-157",
|
||||
"wide-158",
|
||||
"wide-159",
|
||||
"wide-160",
|
||||
"wide-161",
|
||||
"wide-162",
|
||||
"wide-163",
|
||||
"wide-164",
|
||||
"wide-165",
|
||||
"wide-166",
|
||||
"wide-167",
|
||||
"wide-168",
|
||||
"wide-171",
|
||||
"wide-172",
|
||||
"wide-173",
|
||||
"wide-174",
|
||||
"wide-175",
|
||||
"wide-176",
|
||||
"wide-177",
|
||||
"wide-178",
|
||||
"wide-179",
|
||||
"wide-180",
|
||||
"wide-181",
|
||||
"wide-182",
|
||||
"wide-183",
|
||||
"wide-184",
|
||||
"wide-185",
|
||||
"wide-186",
|
||||
"wide-187",
|
||||
"wide-188",
|
||||
"wide-189",
|
||||
"wide-190",
|
||||
"wide-191",
|
||||
"wide-192",
|
||||
"wide-195",
|
||||
"wide-196",
|
||||
"wide-197",
|
||||
"wide-198",
|
||||
"wide-199",
|
||||
"wide-200",
|
||||
"wide-201",
|
||||
"wide-202",
|
||||
"wide-203",
|
||||
"wide-204",
|
||||
"wide-205",
|
||||
"wide-206",
|
||||
"wide-207",
|
||||
"wide-208",
|
||||
"wide-209",
|
||||
"wide-210",
|
||||
"wide-211",
|
||||
"wide-212",
|
||||
"wide-213",
|
||||
"wide-214",
|
||||
"wide-215",
|
||||
"wide-216",
|
||||
"wide-219",
|
||||
"wide-220",
|
||||
"wide-221",
|
||||
"wide-222",
|
||||
"wide-223",
|
||||
"wide-224",
|
||||
"wide-225",
|
||||
"wide-226",
|
||||
"wide-227",
|
||||
"wide-228",
|
||||
"wide-229",
|
||||
"wide-230",
|
||||
"wide-231",
|
||||
"wide-232",
|
||||
"wide-233",
|
||||
"wide-234",
|
||||
"wide-235",
|
||||
"wide-236",
|
||||
"wide-237",
|
||||
"wide-238",
|
||||
"wide-239",
|
||||
"wide-240",
|
||||
"wide-241",
|
||||
"wide-242",
|
||||
"wide-243",
|
||||
"wide-244",
|
||||
"wide-245",
|
||||
"wide-246",
|
||||
"wide-247",
|
||||
"wide-248",
|
||||
"wide-251",
|
||||
"wide-252",
|
||||
"wide-253",
|
||||
"wide-254",
|
||||
"wide-255",
|
||||
"wide-256",
|
||||
"wide-257",
|
||||
"wide-258",
|
||||
"wide-259",
|
||||
"wide-260",
|
||||
"wide-261",
|
||||
"wide-262",
|
||||
"wide-263",
|
||||
"wide-264",
|
||||
"wide-265",
|
||||
"wide-266",
|
||||
"wide-267",
|
||||
"wide-268",
|
||||
"wide-269",
|
||||
"wide-270",
|
||||
"wide-271",
|
||||
"wide-272",
|
||||
"wide-273",
|
||||
"wide-274",
|
||||
"wide-275",
|
||||
"wide-276",
|
||||
"wide-277",
|
||||
"wide-278",
|
||||
"wide-279",
|
||||
"wide-280",
|
||||
"wide-281",
|
||||
"wide-282",
|
||||
"wide-283",
|
||||
"wide-284",
|
||||
"wide-285",
|
||||
"wide-286",
|
||||
"wide-287",
|
||||
"wide-288",
|
||||
"wide-291",
|
||||
"wide-292",
|
||||
"wide-293",
|
||||
"wide-294",
|
||||
"wide-295",
|
||||
"wide-296",
|
||||
"wide-297",
|
||||
"wide-298",
|
||||
"wide-299",
|
||||
"wide-300",
|
||||
"wide-301",
|
||||
"wide-302",
|
||||
"wide-303",
|
||||
"wide-304",
|
||||
"wide-305",
|
||||
"wide-306",
|
||||
"wide-307",
|
||||
"wide-308",
|
||||
"wide-309",
|
||||
"wide-310",
|
||||
"wide-311",
|
||||
"wide-312",
|
||||
"wide-313",
|
||||
"wide-314",
|
||||
"wide-315",
|
||||
"wide-316",
|
||||
"wide-317",
|
||||
"wide-318",
|
||||
"wide-319",
|
||||
"wide-320"
|
||||
],
|
||||
"dev_count": 42,
|
||||
"test_count": 300,
|
||||
"target_accuracy": 0.92,
|
||||
"selected_split": "dev",
|
||||
"selected_ids": [
|
||||
"wide-001",
|
||||
"wide-002",
|
||||
"wide-041",
|
||||
"wide-042",
|
||||
"wide-080",
|
||||
"wide-081",
|
||||
"wide-082",
|
||||
"wide-104",
|
||||
"wide-113",
|
||||
"wide-114",
|
||||
"wide-116",
|
||||
"wide-119",
|
||||
"wide-129",
|
||||
"wide-137",
|
||||
"wide-138",
|
||||
"wide-139",
|
||||
"wide-141",
|
||||
"wide-142",
|
||||
"wide-143",
|
||||
"wide-145",
|
||||
"wide-155",
|
||||
"wide-159",
|
||||
"wide-161",
|
||||
"wide-163",
|
||||
"wide-165",
|
||||
"wide-169",
|
||||
"wide-170",
|
||||
"wide-178",
|
||||
"wide-181",
|
||||
"wide-193",
|
||||
"wide-194",
|
||||
"wide-209",
|
||||
"wide-217",
|
||||
"wide-218",
|
||||
"wide-232",
|
||||
"wide-236",
|
||||
"wide-239",
|
||||
"wide-249",
|
||||
"wide-250",
|
||||
"wide-283",
|
||||
"wide-289",
|
||||
"wide-290"
|
||||
],
|
||||
"selected_count": 42,
|
||||
"selected_dev_overlap": 42,
|
||||
"corrective_request_limit": 1,
|
||||
"format_repair_limit": 1,
|
||||
"repair_policy": "At most one total corrective request for format, citations or retrieval-context violations. Same question/context, no gold; retain all attempts.",
|
||||
"dev_results_sha256": null,
|
||||
"policy": "Evaluate every declared regression case, including DEV overlap; retain all failures and stop tuning after this freeze.",
|
||||
"selected_categories": {
|
||||
"shared_keyword_pair": 2,
|
||||
"same_academic_year_pair": 3,
|
||||
"same_start_year_pair": 3,
|
||||
"person_title_year": 5,
|
||||
"person_keyword_title": 12,
|
||||
"document_author_category_multi_hop": 4,
|
||||
"person_multiple_categories": 3,
|
||||
"candidate_set_aggregation": 5,
|
||||
"conjunctive_disambiguation": 3,
|
||||
"negative_lookup": 2
|
||||
},
|
||||
"limitations": [
|
||||
"All questions and previous model outputs are known; this is historical regression.",
|
||||
"Harness supplies graph context; native OpenWebUI tool choice and browser UI are outside this experiment.",
|
||||
"Checks structured factual claims, their source support/citations and required prose values; not a general semantic judge of arbitrary prose."
|
||||
]
|
||||
}
|
||||
@ -0,0 +1,43 @@
|
||||
id,category,strict,error,latency_seconds,attempts,first_pass_strict
|
||||
wide-001,shared_keyword_pair,True,,9.046294871004648,1,True
|
||||
wide-002,shared_keyword_pair,True,,16.67808335200243,1,True
|
||||
wide-041,same_academic_year_pair,True,,12.044013594000717,1,True
|
||||
wide-042,same_academic_year_pair,True,,16.060333867004374,1,True
|
||||
wide-080,same_academic_year_pair,True,,14.174281418003375,1,True
|
||||
wide-081,same_start_year_pair,True,,16.653584496001713,1,True
|
||||
wide-082,same_start_year_pair,True,,15.326327786999173,1,True
|
||||
wide-104,same_start_year_pair,True,,17.865080415009288,1,True
|
||||
wide-113,person_title_year,True,,14.24573272500129,1,True
|
||||
wide-114,person_title_year,True,,9.858880985004362,1,True
|
||||
wide-116,person_title_year,True,,8.85577247099718,1,True
|
||||
wide-119,person_title_year,True,,8.421206099999836,1,True
|
||||
wide-129,person_title_year,True,,8.982687898998847,1,True
|
||||
wide-137,person_keyword_title,True,,8.925621253001736,1,True
|
||||
wide-138,person_keyword_title,False,InvalidAnswerFormat: two invalid JSON/schema responses,19.134980328992242,2,False
|
||||
wide-139,person_keyword_title,True,,8.484527300999616,1,True
|
||||
wide-141,person_keyword_title,True,,9.90471307298867,1,True
|
||||
wide-142,person_keyword_title,True,,5.409087655993062,1,True
|
||||
wide-143,person_keyword_title,False,InvalidAnswerFormat: two invalid JSON/schema responses,21.20253009199223,2,False
|
||||
wide-145,person_keyword_title,True,,4.431844910999644,1,True
|
||||
wide-155,person_keyword_title,True,,9.433868713997072,1,True
|
||||
wide-159,person_keyword_title,True,,12.901580277000903,1,True
|
||||
wide-161,person_keyword_title,True,,13.279490936998627,1,True
|
||||
wide-163,person_keyword_title,True,,10.156943395006238,1,True
|
||||
wide-165,person_keyword_title,True,,6.284939156001201,1,True
|
||||
wide-169,document_author_category_multi_hop,True,,6.316422595002223,1,True
|
||||
wide-170,document_author_category_multi_hop,True,,6.294689077010844,1,True
|
||||
wide-178,document_author_category_multi_hop,True,,8.572520501009421,1,True
|
||||
wide-181,document_author_category_multi_hop,True,,6.569023182004457,1,True
|
||||
wide-193,person_multiple_categories,True,,8.477885875996435,1,True
|
||||
wide-194,person_multiple_categories,True,,5.930385426996509,1,True
|
||||
wide-209,person_multiple_categories,True,,8.633006432995899,1,True
|
||||
wide-217,candidate_set_aggregation,True,,8.902099704995635,1,True
|
||||
wide-218,candidate_set_aggregation,True,,12.242024114006199,1,True
|
||||
wide-232,candidate_set_aggregation,True,,11.786965720995795,1,True
|
||||
wide-236,candidate_set_aggregation,True,,12.099168748012744,1,True
|
||||
wide-239,candidate_set_aggregation,True,,10.9651905639912,1,True
|
||||
wide-249,conjunctive_disambiguation,True,,9.097645240995917,1,True
|
||||
wide-250,conjunctive_disambiguation,True,,8.975287802997627,1,True
|
||||
wide-283,conjunctive_disambiguation,True,,8.098080616997322,1,True
|
||||
wide-289,negative_lookup,True,,8.07642724798643,1,True
|
||||
wide-290,negative_lookup,True,,5.626124244998209,1,True
|
||||
|
File diff suppressed because it is too large
Load Diff
@ -0,0 +1,434 @@
|
||||
{
|
||||
"method": "Previously exposed LLM questions; regression, not independent TEST.",
|
||||
"graph_freeze_sha256": "54946b476fd713f551414b00cf2b843627566f6a333e3b59ce3efbbdf2328629",
|
||||
"audit_sha256": "d5922db25b6d40cb7e5dc7df7990e93a3caee263a6e747ae910ab340da340023",
|
||||
"generation_files": {
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/evaluate_graph_answers.py": "2553a0d17e164922b02046416fdf0d5df4496dc443466d8d9a1f4be86415b318",
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/graph_answer_prompt.txt": "8c8274a22bf5b44364d8fc8226a8f659b31c232f5a2aba5916d693b559e9f341",
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/answer_format.py": "86a27b4aebc6a5077e13794b81957a1cf063a1f3e070c583120ba53c1788d2f8",
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/context_policy.py": "e7b7c511e5e9cafdef04969eb4007a6a61ac4b99bcc60e9e722945a15bec1f26",
|
||||
"/home/janko/DP/zp-agent/tools/answer_evaluation/checked_generation.py": "7e017471e6281db62b79f270210db3ab14c7e31a4623bbfa3d9a5fd8911b1c20",
|
||||
"tools/rag/evaluation/rag_runner.py": "031abf7d5b1a026eb199aa2a579bfb8baaa01175279d0018a364bfe50b76c3c1"
|
||||
},
|
||||
"model": "model120-fast",
|
||||
"temperature": 0,
|
||||
"workers": 3,
|
||||
"dev_ids": [
|
||||
"wide-001",
|
||||
"wide-002",
|
||||
"wide-041",
|
||||
"wide-042",
|
||||
"wide-080",
|
||||
"wide-081",
|
||||
"wide-082",
|
||||
"wide-104",
|
||||
"wide-113",
|
||||
"wide-114",
|
||||
"wide-116",
|
||||
"wide-119",
|
||||
"wide-129",
|
||||
"wide-137",
|
||||
"wide-138",
|
||||
"wide-139",
|
||||
"wide-141",
|
||||
"wide-142",
|
||||
"wide-143",
|
||||
"wide-145",
|
||||
"wide-155",
|
||||
"wide-159",
|
||||
"wide-161",
|
||||
"wide-163",
|
||||
"wide-165",
|
||||
"wide-169",
|
||||
"wide-170",
|
||||
"wide-178",
|
||||
"wide-181",
|
||||
"wide-193",
|
||||
"wide-194",
|
||||
"wide-209",
|
||||
"wide-217",
|
||||
"wide-218",
|
||||
"wide-232",
|
||||
"wide-236",
|
||||
"wide-239",
|
||||
"wide-249",
|
||||
"wide-250",
|
||||
"wide-283",
|
||||
"wide-289",
|
||||
"wide-290"
|
||||
],
|
||||
"test_ids": [
|
||||
"wide-003",
|
||||
"wide-004",
|
||||
"wide-005",
|
||||
"wide-006",
|
||||
"wide-007",
|
||||
"wide-008",
|
||||
"wide-009",
|
||||
"wide-010",
|
||||
"wide-011",
|
||||
"wide-012",
|
||||
"wide-013",
|
||||
"wide-014",
|
||||
"wide-015",
|
||||
"wide-016",
|
||||
"wide-017",
|
||||
"wide-018",
|
||||
"wide-019",
|
||||
"wide-020",
|
||||
"wide-021",
|
||||
"wide-022",
|
||||
"wide-023",
|
||||
"wide-024",
|
||||
"wide-025",
|
||||
"wide-026",
|
||||
"wide-027",
|
||||
"wide-028",
|
||||
"wide-029",
|
||||
"wide-030",
|
||||
"wide-031",
|
||||
"wide-032",
|
||||
"wide-033",
|
||||
"wide-034",
|
||||
"wide-035",
|
||||
"wide-036",
|
||||
"wide-037",
|
||||
"wide-038",
|
||||
"wide-039",
|
||||
"wide-040",
|
||||
"wide-043",
|
||||
"wide-044",
|
||||
"wide-045",
|
||||
"wide-046",
|
||||
"wide-047",
|
||||
"wide-048",
|
||||
"wide-049",
|
||||
"wide-050",
|
||||
"wide-051",
|
||||
"wide-052",
|
||||
"wide-053",
|
||||
"wide-054",
|
||||
"wide-055",
|
||||
"wide-056",
|
||||
"wide-057",
|
||||
"wide-058",
|
||||
"wide-059",
|
||||
"wide-060",
|
||||
"wide-061",
|
||||
"wide-062",
|
||||
"wide-063",
|
||||
"wide-064",
|
||||
"wide-065",
|
||||
"wide-066",
|
||||
"wide-067",
|
||||
"wide-068",
|
||||
"wide-069",
|
||||
"wide-070",
|
||||
"wide-071",
|
||||
"wide-072",
|
||||
"wide-073",
|
||||
"wide-074",
|
||||
"wide-075",
|
||||
"wide-076",
|
||||
"wide-077",
|
||||
"wide-078",
|
||||
"wide-079",
|
||||
"wide-080",
|
||||
"wide-083",
|
||||
"wide-084",
|
||||
"wide-085",
|
||||
"wide-086",
|
||||
"wide-087",
|
||||
"wide-088",
|
||||
"wide-089",
|
||||
"wide-090",
|
||||
"wide-091",
|
||||
"wide-092",
|
||||
"wide-093",
|
||||
"wide-094",
|
||||
"wide-095",
|
||||
"wide-096",
|
||||
"wide-097",
|
||||
"wide-098",
|
||||
"wide-099",
|
||||
"wide-100",
|
||||
"wide-101",
|
||||
"wide-102",
|
||||
"wide-103",
|
||||
"wide-104",
|
||||
"wide-105",
|
||||
"wide-106",
|
||||
"wide-107",
|
||||
"wide-108",
|
||||
"wide-109",
|
||||
"wide-110",
|
||||
"wide-111",
|
||||
"wide-112",
|
||||
"wide-115",
|
||||
"wide-116",
|
||||
"wide-117",
|
||||
"wide-118",
|
||||
"wide-119",
|
||||
"wide-120",
|
||||
"wide-121",
|
||||
"wide-122",
|
||||
"wide-123",
|
||||
"wide-124",
|
||||
"wide-125",
|
||||
"wide-126",
|
||||
"wide-127",
|
||||
"wide-128",
|
||||
"wide-129",
|
||||
"wide-130",
|
||||
"wide-131",
|
||||
"wide-132",
|
||||
"wide-133",
|
||||
"wide-134",
|
||||
"wide-135",
|
||||
"wide-136",
|
||||
"wide-139",
|
||||
"wide-140",
|
||||
"wide-141",
|
||||
"wide-142",
|
||||
"wide-143",
|
||||
"wide-144",
|
||||
"wide-145",
|
||||
"wide-146",
|
||||
"wide-147",
|
||||
"wide-148",
|
||||
"wide-149",
|
||||
"wide-150",
|
||||
"wide-151",
|
||||
"wide-152",
|
||||
"wide-153",
|
||||
"wide-154",
|
||||
"wide-155",
|
||||
"wide-156",
|
||||
"wide-157",
|
||||
"wide-158",
|
||||
"wide-159",
|
||||
"wide-160",
|
||||
"wide-161",
|
||||
"wide-162",
|
||||
"wide-163",
|
||||
"wide-164",
|
||||
"wide-165",
|
||||
"wide-166",
|
||||
"wide-167",
|
||||
"wide-168",
|
||||
"wide-171",
|
||||
"wide-172",
|
||||
"wide-173",
|
||||
"wide-174",
|
||||
"wide-175",
|
||||
"wide-176",
|
||||
"wide-177",
|
||||
"wide-178",
|
||||
"wide-179",
|
||||
"wide-180",
|
||||
"wide-181",
|
||||
"wide-182",
|
||||
"wide-183",
|
||||
"wide-184",
|
||||
"wide-185",
|
||||
"wide-186",
|
||||
"wide-187",
|
||||
"wide-188",
|
||||
"wide-189",
|
||||
"wide-190",
|
||||
"wide-191",
|
||||
"wide-192",
|
||||
"wide-195",
|
||||
"wide-196",
|
||||
"wide-197",
|
||||
"wide-198",
|
||||
"wide-199",
|
||||
"wide-200",
|
||||
"wide-201",
|
||||
"wide-202",
|
||||
"wide-203",
|
||||
"wide-204",
|
||||
"wide-205",
|
||||
"wide-206",
|
||||
"wide-207",
|
||||
"wide-208",
|
||||
"wide-209",
|
||||
"wide-210",
|
||||
"wide-211",
|
||||
"wide-212",
|
||||
"wide-213",
|
||||
"wide-214",
|
||||
"wide-215",
|
||||
"wide-216",
|
||||
"wide-219",
|
||||
"wide-220",
|
||||
"wide-221",
|
||||
"wide-222",
|
||||
"wide-223",
|
||||
"wide-224",
|
||||
"wide-225",
|
||||
"wide-226",
|
||||
"wide-227",
|
||||
"wide-228",
|
||||
"wide-229",
|
||||
"wide-230",
|
||||
"wide-231",
|
||||
"wide-232",
|
||||
"wide-233",
|
||||
"wide-234",
|
||||
"wide-235",
|
||||
"wide-236",
|
||||
"wide-237",
|
||||
"wide-238",
|
||||
"wide-239",
|
||||
"wide-240",
|
||||
"wide-241",
|
||||
"wide-242",
|
||||
"wide-243",
|
||||
"wide-244",
|
||||
"wide-245",
|
||||
"wide-246",
|
||||
"wide-247",
|
||||
"wide-248",
|
||||
"wide-251",
|
||||
"wide-252",
|
||||
"wide-253",
|
||||
"wide-254",
|
||||
"wide-255",
|
||||
"wide-256",
|
||||
"wide-257",
|
||||
"wide-258",
|
||||
"wide-259",
|
||||
"wide-260",
|
||||
"wide-261",
|
||||
"wide-262",
|
||||
"wide-263",
|
||||
"wide-264",
|
||||
"wide-265",
|
||||
"wide-266",
|
||||
"wide-267",
|
||||
"wide-268",
|
||||
"wide-269",
|
||||
"wide-270",
|
||||
"wide-271",
|
||||
"wide-272",
|
||||
"wide-273",
|
||||
"wide-274",
|
||||
"wide-275",
|
||||
"wide-276",
|
||||
"wide-277",
|
||||
"wide-278",
|
||||
"wide-279",
|
||||
"wide-280",
|
||||
"wide-281",
|
||||
"wide-282",
|
||||
"wide-283",
|
||||
"wide-284",
|
||||
"wide-285",
|
||||
"wide-286",
|
||||
"wide-287",
|
||||
"wide-288",
|
||||
"wide-291",
|
||||
"wide-292",
|
||||
"wide-293",
|
||||
"wide-294",
|
||||
"wide-295",
|
||||
"wide-296",
|
||||
"wide-297",
|
||||
"wide-298",
|
||||
"wide-299",
|
||||
"wide-300",
|
||||
"wide-301",
|
||||
"wide-302",
|
||||
"wide-303",
|
||||
"wide-304",
|
||||
"wide-305",
|
||||
"wide-306",
|
||||
"wide-307",
|
||||
"wide-308",
|
||||
"wide-309",
|
||||
"wide-310",
|
||||
"wide-311",
|
||||
"wide-312",
|
||||
"wide-313",
|
||||
"wide-314",
|
||||
"wide-315",
|
||||
"wide-316",
|
||||
"wide-317",
|
||||
"wide-318",
|
||||
"wide-319",
|
||||
"wide-320"
|
||||
],
|
||||
"dev_count": 42,
|
||||
"test_count": 300,
|
||||
"target_accuracy": 0.92,
|
||||
"selected_split": "dev",
|
||||
"selected_ids": [
|
||||
"wide-001",
|
||||
"wide-002",
|
||||
"wide-041",
|
||||
"wide-042",
|
||||
"wide-080",
|
||||
"wide-081",
|
||||
"wide-082",
|
||||
"wide-104",
|
||||
"wide-113",
|
||||
"wide-114",
|
||||
"wide-116",
|
||||
"wide-119",
|
||||
"wide-129",
|
||||
"wide-137",
|
||||
"wide-138",
|
||||
"wide-139",
|
||||
"wide-141",
|
||||
"wide-142",
|
||||
"wide-143",
|
||||
"wide-145",
|
||||
"wide-155",
|
||||
"wide-159",
|
||||
"wide-161",
|
||||
"wide-163",
|
||||
"wide-165",
|
||||
"wide-169",
|
||||
"wide-170",
|
||||
"wide-178",
|
||||
"wide-181",
|
||||
"wide-193",
|
||||
"wide-194",
|
||||
"wide-209",
|
||||
"wide-217",
|
||||
"wide-218",
|
||||
"wide-232",
|
||||
"wide-236",
|
||||
"wide-239",
|
||||
"wide-249",
|
||||
"wide-250",
|
||||
"wide-283",
|
||||
"wide-289",
|
||||
"wide-290"
|
||||
],
|
||||
"selected_count": 42,
|
||||
"selected_dev_overlap": 42,
|
||||
"corrective_request_limit": 1,
|
||||
"format_repair_limit": 1,
|
||||
"repair_policy": "At most one total corrective request for format, citations or retrieval-context violations. Same question/context, no gold; retain all attempts.",
|
||||
"dev_results_sha256": null,
|
||||
"policy": "Evaluate every declared regression case, including DEV overlap; retain all failures and stop tuning after this freeze.",
|
||||
"selected_categories": {
|
||||
"shared_keyword_pair": 2,
|
||||
"same_academic_year_pair": 3,
|
||||
"same_start_year_pair": 3,
|
||||
"person_title_year": 5,
|
||||
"person_keyword_title": 12,
|
||||
"document_author_category_multi_hop": 4,
|
||||
"person_multiple_categories": 3,
|
||||
"candidate_set_aggregation": 5,
|
||||
"conjunctive_disambiguation": 3,
|
||||
"negative_lookup": 2
|
||||
},
|
||||
"limitations": [
|
||||
"All questions and previous model outputs are known; this is historical regression.",
|
||||
"Harness supplies graph context; native OpenWebUI tool choice and browser UI are outside this experiment.",
|
||||
"Checks structured factual claims, their source support/citations and required prose values; not a general semantic judge of arbitrary prose."
|
||||
]
|
||||
}
|
||||
@ -0,0 +1,321 @@
|
||||
id,category,strict,error,latency_seconds,attempts,first_pass_strict
|
||||
wide-001,shared_keyword_pair,True,,46.673222578989225,1,True
|
||||
wide-002,shared_keyword_pair,True,,8.559933836993878,1,True
|
||||
wide-003,shared_keyword_pair,True,,7.599364289999357,1,True
|
||||
wide-004,shared_keyword_pair,True,,43.05431627100916,1,True
|
||||
wide-005,shared_keyword_pair,True,,46.60277532499458,1,True
|
||||
wide-006,shared_keyword_pair,True,,17.02198196199606,1,True
|
||||
wide-007,shared_keyword_pair,True,,37.58451674701064,1,True
|
||||
wide-008,shared_keyword_pair,True,,162.56305770600738,1,True
|
||||
wide-009,shared_keyword_pair,True,,96.59099388300092,1,True
|
||||
wide-010,shared_keyword_pair,True,,98.12694204699073,1,True
|
||||
wide-011,shared_keyword_pair,True,,5.023704371007625,1,True
|
||||
wide-012,shared_keyword_pair,True,,4.511661280004773,1,True
|
||||
wide-013,shared_keyword_pair,True,,4.7268635670043295,1,True
|
||||
wide-014,shared_keyword_pair,True,,4.411614174008719,1,True
|
||||
wide-015,shared_keyword_pair,True,,7.357604845994501,1,True
|
||||
wide-016,shared_keyword_pair,True,,8.766350423000404,1,True
|
||||
wide-017,shared_keyword_pair,True,,7.075148112009629,1,True
|
||||
wide-018,shared_keyword_pair,True,,7.273996427989914,1,True
|
||||
wide-019,shared_keyword_pair,True,,7.305565910995938,1,True
|
||||
wide-020,shared_keyword_pair,True,,6.627847782001481,1,True
|
||||
wide-021,shared_keyword_pair,True,,8.089955857009045,1,True
|
||||
wide-022,shared_keyword_pair,True,,7.479066304003936,1,True
|
||||
wide-023,shared_keyword_pair,True,,12.767835026999819,1,True
|
||||
wide-024,shared_keyword_pair,True,,12.18826178299787,1,True
|
||||
wide-025,shared_keyword_pair,True,,24.296105483997962,1,True
|
||||
wide-026,shared_keyword_pair,True,,26.256827491000877,1,True
|
||||
wide-027,shared_keyword_pair,True,,21.511969452010817,1,True
|
||||
wide-028,shared_keyword_pair,True,,13.690101789004984,1,True
|
||||
wide-029,shared_keyword_pair,True,,8.394414648006205,1,True
|
||||
wide-030,shared_keyword_pair,True,,13.538730853993911,1,True
|
||||
wide-031,shared_keyword_pair,True,,8.447307058013394,1,True
|
||||
wide-032,shared_keyword_pair,True,,13.313853904008283,1,True
|
||||
wide-033,shared_keyword_pair,True,,8.748317188990768,1,True
|
||||
wide-034,shared_keyword_pair,True,,15.075756493999506,1,True
|
||||
wide-035,shared_keyword_pair,True,,7.7471648280043155,1,True
|
||||
wide-036,shared_keyword_pair,True,,12.841984746992239,1,True
|
||||
wide-037,shared_keyword_pair,True,,8.577543838997371,1,True
|
||||
wide-038,shared_keyword_pair,True,,12.718846365998616,1,True
|
||||
wide-039,shared_keyword_pair,True,,9.08833715999208,1,True
|
||||
wide-040,shared_keyword_pair,True,,13.980110079006408,1,True
|
||||
wide-041,same_academic_year_pair,True,,7.145661453992943,1,True
|
||||
wide-042,same_academic_year_pair,True,,11.684578247994068,1,True
|
||||
wide-043,same_academic_year_pair,True,,10.049950553991948,1,True
|
||||
wide-044,same_academic_year_pair,True,,12.46243585999764,1,True
|
||||
wide-045,same_academic_year_pair,True,,9.949639684011345,1,True
|
||||
wide-046,same_academic_year_pair,True,,10.84967578999931,1,True
|
||||
wide-047,same_academic_year_pair,True,,11.929021324991481,1,True
|
||||
wide-048,same_academic_year_pair,True,,12.54277628500131,1,True
|
||||
wide-049,same_academic_year_pair,True,,12.512920577995828,1,True
|
||||
wide-050,same_academic_year_pair,True,,10.943723205011338,1,True
|
||||
wide-051,same_academic_year_pair,True,,11.361078971996903,1,True
|
||||
wide-052,same_academic_year_pair,True,,10.127026930989814,1,True
|
||||
wide-053,same_academic_year_pair,True,,9.671026055992115,1,True
|
||||
wide-054,same_academic_year_pair,True,,10.90942802200152,1,True
|
||||
wide-055,same_academic_year_pair,True,,9.650152500995318,1,True
|
||||
wide-056,same_academic_year_pair,True,,13.77639084700786,1,True
|
||||
wide-057,same_academic_year_pair,True,,7.519770080005401,1,True
|
||||
wide-058,same_academic_year_pair,True,,12.226794489004533,1,True
|
||||
wide-059,same_academic_year_pair,True,,9.18516255299619,1,True
|
||||
wide-060,same_academic_year_pair,True,,11.267676324001513,1,True
|
||||
wide-061,same_academic_year_pair,True,,8.971232945012162,1,True
|
||||
wide-062,same_academic_year_pair,True,,10.002240323010483,1,True
|
||||
wide-063,same_academic_year_pair,True,,9.58987016500032,1,True
|
||||
wide-064,same_academic_year_pair,True,,9.889049531993805,1,True
|
||||
wide-065,same_academic_year_pair,True,,10.5299181730079,1,True
|
||||
wide-066,same_academic_year_pair,True,,9.414292849003687,1,True
|
||||
wide-067,same_academic_year_pair,True,,12.795267630004673,1,True
|
||||
wide-068,same_academic_year_pair,True,,7.465757275000215,1,True
|
||||
wide-069,same_academic_year_pair,True,,13.18860708399734,1,True
|
||||
wide-070,same_academic_year_pair,True,,6.870617680004216,1,True
|
||||
wide-071,same_academic_year_pair,True,,13.928496929991525,1,True
|
||||
wide-072,same_academic_year_pair,True,,6.418771339012892,1,True
|
||||
wide-073,same_academic_year_pair,True,,11.917343320004875,1,True
|
||||
wide-074,same_academic_year_pair,True,,8.277425395994214,1,True
|
||||
wide-075,same_academic_year_pair,True,,10.830195090005873,1,True
|
||||
wide-076,same_academic_year_pair,True,,8.49058225400222,1,True
|
||||
wide-077,same_academic_year_pair,True,,10.718131281013484,1,True
|
||||
wide-078,same_academic_year_pair,True,,8.951186734004295,1,True
|
||||
wide-079,same_academic_year_pair,True,,10.618172678994597,1,True
|
||||
wide-080,same_academic_year_pair,True,,9.463216475996887,1,True
|
||||
wide-081,same_start_year_pair,True,,10.834732246003114,1,True
|
||||
wide-082,same_start_year_pair,True,,9.731701743992744,1,True
|
||||
wide-083,same_start_year_pair,True,,10.492485894006677,1,True
|
||||
wide-084,same_start_year_pair,True,,9.800166964996606,1,True
|
||||
wide-085,same_start_year_pair,True,,10.272105573007138,1,True
|
||||
wide-086,same_start_year_pair,True,,9.51915932400152,1,True
|
||||
wide-087,same_start_year_pair,True,,9.921699527010787,1,True
|
||||
wide-088,same_start_year_pair,True,,9.524695414002053,1,True
|
||||
wide-089,same_start_year_pair,True,,10.797489714997937,1,True
|
||||
wide-090,same_start_year_pair,True,,9.793365620993427,1,True
|
||||
wide-091,same_start_year_pair,True,,10.977525908994721,1,True
|
||||
wide-092,same_start_year_pair,True,,8.956933887006016,1,True
|
||||
wide-093,same_start_year_pair,True,,10.82372733700322,1,True
|
||||
wide-094,same_start_year_pair,True,,8.492465975010418,1,True
|
||||
wide-095,same_start_year_pair,True,,11.66025954700308,1,True
|
||||
wide-096,same_start_year_pair,True,,8.606951418012613,1,True
|
||||
wide-097,same_start_year_pair,True,,12.164914641994983,1,True
|
||||
wide-098,same_start_year_pair,True,,8.51734155100712,1,True
|
||||
wide-099,same_start_year_pair,True,,12.007975722997799,1,True
|
||||
wide-100,same_start_year_pair,True,,8.085574763012119,1,True
|
||||
wide-101,same_start_year_pair,True,,11.381393574003596,1,True
|
||||
wide-102,same_start_year_pair,True,,8.105480084996088,1,True
|
||||
wide-103,same_start_year_pair,True,,11.178495122003369,1,True
|
||||
wide-104,same_start_year_pair,False,,8.045926626000437,1,False
|
||||
wide-105,same_start_year_pair,True,,11.05217344200355,1,True
|
||||
wide-106,same_start_year_pair,True,,8.158618310000747,1,True
|
||||
wide-107,same_start_year_pair,True,,10.908150404997286,1,True
|
||||
wide-108,same_start_year_pair,True,,8.880417915992439,1,True
|
||||
wide-109,same_start_year_pair,True,,11.187253098003566,1,True
|
||||
wide-110,same_start_year_pair,True,,9.394831576995784,1,True
|
||||
wide-111,same_start_year_pair,True,,10.523962463004864,1,True
|
||||
wide-112,same_start_year_pair,True,,8.898946485001943,1,True
|
||||
wide-113,person_title_year,True,,9.418683277006494,1,True
|
||||
wide-114,person_title_year,True,,8.167781379001099,1,True
|
||||
wide-115,person_title_year,True,,8.713697127008345,1,True
|
||||
wide-116,person_title_year,True,,7.5155074930080445,1,True
|
||||
wide-117,person_title_year,True,,8.792661272003897,1,True
|
||||
wide-118,person_title_year,True,,7.729041151003912,1,True
|
||||
wide-119,person_title_year,False,InvalidAnswerFormat: two invalid JSON/schema responses,17.042694887000835,2,False
|
||||
wide-120,person_title_year,True,,7.293894077010918,1,True
|
||||
wide-121,person_title_year,True,,9.912295032001566,1,True
|
||||
wide-122,person_title_year,True,,10.336526605999097,1,True
|
||||
wide-123,person_title_year,True,,7.557256949992734,1,True
|
||||
wide-124,person_title_year,True,,9.972375639990787,1,True
|
||||
wide-125,person_title_year,True,,6.4579289499961305,1,True
|
||||
wide-126,person_title_year,True,,8.706965881996439,1,True
|
||||
wide-127,person_title_year,True,,6.528363082994474,1,True
|
||||
wide-128,person_title_year,True,,9.74250477401074,1,True
|
||||
wide-129,person_title_year,True,,7.816760465997504,1,True
|
||||
wide-130,person_title_year,True,,9.037185494991718,1,True
|
||||
wide-131,person_title_year,True,,6.980635786996572,1,True
|
||||
wide-132,person_title_year,True,,8.133284494004329,1,True
|
||||
wide-133,person_title_year,True,,7.697097384996596,1,True
|
||||
wide-134,person_title_year,True,,7.980329867990804,1,True
|
||||
wide-135,person_title_year,True,,7.890191981001408,1,True
|
||||
wide-136,person_title_year,True,,8.521550403995207,1,True
|
||||
wide-137,person_keyword_title,True,,8.654003389994614,1,True
|
||||
wide-138,person_keyword_title,True,,9.317925055991509,1,True
|
||||
wide-139,person_keyword_title,True,,8.443255108009907,1,True
|
||||
wide-140,person_keyword_title,True,,9.268355077001615,1,True
|
||||
wide-141,person_keyword_title,True,,8.619561607993091,1,True
|
||||
wide-142,person_keyword_title,True,,4.842823801009217,1,True
|
||||
wide-143,person_keyword_title,False,InvalidAnswerFormat: two invalid JSON/schema responses,25.41826143900107,2,False
|
||||
wide-144,person_keyword_title,True,,6.520040678005898,1,True
|
||||
wide-145,person_keyword_title,True,,6.482367881006212,1,True
|
||||
wide-146,person_keyword_title,True,,7.926933477006969,1,True
|
||||
wide-147,person_keyword_title,True,,9.258605299008195,1,True
|
||||
wide-148,person_keyword_title,True,,7.477349338005297,1,True
|
||||
wide-149,person_keyword_title,True,,11.021910049996222,1,True
|
||||
wide-150,person_keyword_title,True,,9.106626356995548,1,True
|
||||
wide-151,person_keyword_title,True,,9.87995294299617,1,True
|
||||
wide-152,person_keyword_title,True,,8.400023505993886,1,True
|
||||
wide-153,person_keyword_title,True,,8.574925572000211,1,True
|
||||
wide-154,person_keyword_title,True,,8.580053354002303,1,True
|
||||
wide-155,person_keyword_title,True,,9.083858401005273,1,True
|
||||
wide-156,person_keyword_title,True,,8.619125420998898,1,True
|
||||
wide-157,person_keyword_title,True,,9.071385319999536,1,True
|
||||
wide-158,person_keyword_title,True,,8.34309680199658,1,True
|
||||
wide-159,person_keyword_title,True,,9.822020093008177,1,True
|
||||
wide-160,person_keyword_title,True,,9.166224397995393,1,True
|
||||
wide-161,person_keyword_title,True,,10.358729845989728,1,True
|
||||
wide-162,person_keyword_title,True,,8.444243013000232,1,True
|
||||
wide-163,person_keyword_title,True,,9.713410705997376,1,True
|
||||
wide-164,person_keyword_title,True,,8.84475968699553,1,True
|
||||
wide-165,person_keyword_title,True,,5.332855019994895,1,True
|
||||
wide-166,person_keyword_title,True,,7.285008748003747,1,True
|
||||
wide-167,person_keyword_title,True,,7.721775719997822,1,True
|
||||
wide-168,person_keyword_title,True,,10.334125888999552,1,True
|
||||
wide-169,document_author_category_multi_hop,True,,5.7036590370116755,1,True
|
||||
wide-170,document_author_category_multi_hop,True,,9.754529660000117,1,True
|
||||
wide-171,document_author_category_multi_hop,True,,4.6746241329965414,1,True
|
||||
wide-172,document_author_category_multi_hop,True,,9.619921479999903,1,True
|
||||
wide-173,document_author_category_multi_hop,True,,6.214922799001215,1,True
|
||||
wide-174,document_author_category_multi_hop,True,,8.83508723799605,1,True
|
||||
wide-175,document_author_category_multi_hop,True,,6.034610215006978,1,True
|
||||
wide-176,document_author_category_multi_hop,False,InvalidAnswerFormat: two invalid JSON/schema responses,30.148610364005435,2,False
|
||||
wide-177,document_author_category_multi_hop,True,,5.49371292599244,1,True
|
||||
wide-178,document_author_category_multi_hop,True,,8.342899441995542,1,True
|
||||
wide-179,document_author_category_multi_hop,True,,9.640073613001732,1,True
|
||||
wide-180,document_author_category_multi_hop,True,,7.465760963008506,1,True
|
||||
wide-181,document_author_category_multi_hop,True,,5.794508402002975,1,True
|
||||
wide-182,document_author_category_multi_hop,True,,8.31849720000173,1,True
|
||||
wide-183,document_author_category_multi_hop,True,,9.857232266003848,1,True
|
||||
wide-184,document_author_category_multi_hop,True,,6.444520987992291,1,True
|
||||
wide-185,document_author_category_multi_hop,True,,9.522022441000445,1,True
|
||||
wide-186,document_author_category_multi_hop,True,,6.413496649009176,1,True
|
||||
wide-187,document_author_category_multi_hop,True,,10.410627094010124,1,True
|
||||
wide-188,document_author_category_multi_hop,True,,5.231139651994454,1,True
|
||||
wide-189,document_author_category_multi_hop,True,,8.794849190002424,1,True
|
||||
wide-190,document_author_category_multi_hop,True,,4.944473762996495,1,True
|
||||
wide-191,document_author_category_multi_hop,True,,10.042116317999898,1,True
|
||||
wide-192,document_author_category_multi_hop,True,,10.5407217900065,1,True
|
||||
wide-193,person_multiple_categories,True,,4.792528019999736,1,True
|
||||
wide-194,person_multiple_categories,True,,4.782916190000833,1,True
|
||||
wide-195,person_multiple_categories,True,,8.615475654994952,1,True
|
||||
wide-196,person_multiple_categories,True,,4.323636931003421,1,True
|
||||
wide-197,person_multiple_categories,True,,7.403106719997595,1,True
|
||||
wide-198,person_multiple_categories,True,,5.580519854003796,1,True
|
||||
wide-199,person_multiple_categories,True,,7.428712174994871,1,True
|
||||
wide-200,person_multiple_categories,True,,5.628509769987431,1,True
|
||||
wide-201,person_multiple_categories,True,,7.0406875039916486,1,True
|
||||
wide-202,person_multiple_categories,True,,5.428648525994504,1,True
|
||||
wide-203,person_multiple_categories,True,,7.3671833719999995,1,True
|
||||
wide-204,person_multiple_categories,True,,6.062737486005062,1,True
|
||||
wide-205,person_multiple_categories,True,,7.703495145004126,1,True
|
||||
wide-206,person_multiple_categories,True,,6.037194566000835,1,True
|
||||
wide-207,person_multiple_categories,True,,6.8626932660117745,1,True
|
||||
wide-208,person_multiple_categories,True,,5.614748537002015,1,True
|
||||
wide-209,person_multiple_categories,True,,7.410357187996851,1,True
|
||||
wide-210,person_multiple_categories,True,,5.773788381004124,1,True
|
||||
wide-211,person_multiple_categories,True,,8.462341753009241,1,True
|
||||
wide-212,person_multiple_categories,True,,3.9356538349966286,1,True
|
||||
wide-213,person_multiple_categories,True,,7.3488670679944335,1,True
|
||||
wide-214,person_multiple_categories,True,,5.440327513992088,1,True
|
||||
wide-215,person_multiple_categories,True,,7.479325737003819,1,True
|
||||
wide-216,person_multiple_categories,True,,5.488911034000921,1,True
|
||||
wide-217,candidate_set_aggregation,True,,12.322915113996714,1,True
|
||||
wide-218,candidate_set_aggregation,True,,7.939687445003074,1,True
|
||||
wide-219,candidate_set_aggregation,True,,15.70125729299616,1,True
|
||||
wide-220,candidate_set_aggregation,True,,7.490574616007507,1,True
|
||||
wide-221,candidate_set_aggregation,True,,14.266550314001506,1,True
|
||||
wide-222,candidate_set_aggregation,True,,9.285332848012331,1,True
|
||||
wide-223,candidate_set_aggregation,True,,15.166198047008947,1,True
|
||||
wide-224,candidate_set_aggregation,True,,7.299934319002205,1,True
|
||||
wide-225,candidate_set_aggregation,True,,12.34221489400079,1,True
|
||||
wide-226,candidate_set_aggregation,True,,9.4215394359926,1,True
|
||||
wide-227,candidate_set_aggregation,True,,11.556736822007224,1,True
|
||||
wide-228,candidate_set_aggregation,True,,9.91855254600523,1,True
|
||||
wide-229,candidate_set_aggregation,True,,10.58573554699251,1,True
|
||||
wide-230,candidate_set_aggregation,True,,10.693445764001808,1,True
|
||||
wide-231,candidate_set_aggregation,True,,11.349713716001133,1,True
|
||||
wide-232,candidate_set_aggregation,True,,11.74791878099495,1,True
|
||||
wide-233,candidate_set_aggregation,True,,11.048946268012514,1,True
|
||||
wide-234,candidate_set_aggregation,True,,11.014590331993531,1,True
|
||||
wide-235,candidate_set_aggregation,True,,10.42495377000887,1,True
|
||||
wide-236,candidate_set_aggregation,True,,11.615297402007855,1,True
|
||||
wide-237,candidate_set_aggregation,True,,11.304762533996836,1,True
|
||||
wide-238,candidate_set_aggregation,True,,12.494652763998602,1,True
|
||||
wide-239,candidate_set_aggregation,True,,10.859883589990204,1,True
|
||||
wide-240,candidate_set_aggregation,True,,11.546406508990913,1,True
|
||||
wide-241,candidate_set_aggregation,True,,9.245278398011578,1,True
|
||||
wide-242,candidate_set_aggregation,True,,12.081533781005419,1,True
|
||||
wide-243,candidate_set_aggregation,True,,9.45886921499914,1,True
|
||||
wide-244,candidate_set_aggregation,True,,12.694161742008873,1,True
|
||||
wide-245,candidate_set_aggregation,True,,8.572539522006991,1,True
|
||||
wide-246,candidate_set_aggregation,True,,12.862463094992563,1,True
|
||||
wide-247,candidate_set_aggregation,True,,8.681235329000629,1,True
|
||||
wide-248,candidate_set_aggregation,True,,14.288417944990215,1,True
|
||||
wide-249,conjunctive_disambiguation,True,,5.564151740996749,1,True
|
||||
wide-250,conjunctive_disambiguation,True,,9.57288877099927,1,True
|
||||
wide-251,conjunctive_disambiguation,True,,7.981897253994248,1,True
|
||||
wide-252,conjunctive_disambiguation,True,,8.615102830008254,1,True
|
||||
wide-253,conjunctive_disambiguation,True,,7.343791733001126,1,True
|
||||
wide-254,conjunctive_disambiguation,True,,8.36678491201019,1,True
|
||||
wide-255,conjunctive_disambiguation,True,,6.50943264500529,1,True
|
||||
wide-256,conjunctive_disambiguation,True,,8.855455351003911,1,True
|
||||
wide-257,conjunctive_disambiguation,True,,6.625423559002229,1,True
|
||||
wide-258,conjunctive_disambiguation,True,,10.785042872012127,1,True
|
||||
wide-259,conjunctive_disambiguation,True,,5.227306733999285,1,True
|
||||
wide-260,conjunctive_disambiguation,True,,9.602625528001226,1,True
|
||||
wide-261,conjunctive_disambiguation,True,,7.348476777013275,1,True
|
||||
wide-262,conjunctive_disambiguation,True,,9.600847927998984,1,True
|
||||
wide-263,conjunctive_disambiguation,True,,7.57662963400071,1,True
|
||||
wide-264,conjunctive_disambiguation,True,,9.053563342007692,1,True
|
||||
wide-265,conjunctive_disambiguation,True,,7.701207513004192,1,True
|
||||
wide-266,conjunctive_disambiguation,True,,8.352936759009026,1,True
|
||||
wide-267,conjunctive_disambiguation,True,,7.6647831270092865,1,True
|
||||
wide-268,conjunctive_disambiguation,True,,7.513196407002397,1,True
|
||||
wide-269,conjunctive_disambiguation,True,,7.314271451992681,1,True
|
||||
wide-270,conjunctive_disambiguation,True,,7.282059941004263,1,True
|
||||
wide-271,conjunctive_disambiguation,True,,7.553321383005823,1,True
|
||||
wide-272,conjunctive_disambiguation,True,,8.163246180993156,1,True
|
||||
wide-273,conjunctive_disambiguation,True,,7.806915986991953,1,True
|
||||
wide-274,conjunctive_disambiguation,True,,8.457703224004945,1,True
|
||||
wide-275,conjunctive_disambiguation,True,,7.778582415005076,1,True
|
||||
wide-276,conjunctive_disambiguation,True,,9.062161419002223,1,True
|
||||
wide-277,conjunctive_disambiguation,True,,7.960439574002521,1,True
|
||||
wide-278,conjunctive_disambiguation,True,,8.366461051002261,1,True
|
||||
wide-279,conjunctive_disambiguation,True,,7.2900457229989115,1,True
|
||||
wide-280,conjunctive_disambiguation,True,,7.8031022979994304,1,True
|
||||
wide-281,conjunctive_disambiguation,True,,7.834450206995825,1,True
|
||||
wide-282,conjunctive_disambiguation,True,,8.4359122379974,1,True
|
||||
wide-283,conjunctive_disambiguation,True,,9.275576508007362,1,True
|
||||
wide-284,conjunctive_disambiguation,True,,8.009781319007743,1,True
|
||||
wide-285,conjunctive_disambiguation,True,,10.937106861994835,1,True
|
||||
wide-286,conjunctive_disambiguation,True,,5.5999535669980105,1,True
|
||||
wide-287,conjunctive_disambiguation,True,,10.864354767996701,1,True
|
||||
wide-288,conjunctive_disambiguation,True,,5.759624956001062,1,True
|
||||
wide-289,negative_lookup,True,,7.9427883150056005,1,True
|
||||
wide-290,negative_lookup,True,,5.373547496012179,1,True
|
||||
wide-291,negative_lookup,True,,7.423920717992587,1,True
|
||||
wide-292,negative_lookup,True,,2.929652819002513,1,True
|
||||
wide-293,negative_lookup,True,,5.856424662997597,1,True
|
||||
wide-294,negative_lookup,True,,7.053081437989022,1,True
|
||||
wide-295,negative_lookup,True,,6.665841868001735,1,True
|
||||
wide-296,negative_lookup,True,,7.309867624993785,1,True
|
||||
wide-297,negative_lookup,True,,6.265542463006568,1,True
|
||||
wide-298,negative_lookup,True,,7.0743426569970325,1,True
|
||||
wide-299,negative_lookup,True,,5.507314685994061,1,True
|
||||
wide-300,negative_lookup,True,,5.693418583992752,1,True
|
||||
wide-301,negative_lookup,True,,5.491494399990188,1,True
|
||||
wide-302,negative_lookup,True,,4.511676192007144,1,True
|
||||
wide-303,negative_lookup,True,,5.679598642003839,1,True
|
||||
wide-304,negative_lookup,True,,5.175881937990198,1,True
|
||||
wide-305,negative_lookup,True,,7.612728366002557,1,True
|
||||
wide-306,negative_lookup,True,,5.382500367995817,1,True
|
||||
wide-307,negative_lookup,True,,7.818900088008377,1,True
|
||||
wide-308,negative_lookup,True,,5.674700601011864,1,True
|
||||
wide-309,negative_lookup,True,,8.50653202299145,1,True
|
||||
wide-310,negative_lookup,True,,3.142994189009187,1,True
|
||||
wide-311,negative_lookup,True,,7.0121463510004105,1,True
|
||||
wide-312,negative_lookup,True,,2.9377342259977013,1,True
|
||||
wide-313,negative_lookup,True,,6.331644553996739,1,True
|
||||
wide-314,negative_lookup,True,,3.377158279006835,1,True
|
||||
wide-315,negative_lookup,True,,5.142885044988361,1,True
|
||||
wide-316,negative_lookup,True,,5.371270889008883,1,True
|
||||
wide-317,negative_lookup,True,,6.465425841000979,1,True
|
||||
wide-318,negative_lookup,True,,2.8997244839993073,1,True
|
||||
wide-319,negative_lookup,True,,5.762461207006709,1,True
|
||||
wide-320,negative_lookup,True,,5.02917427700595,1,True
|
||||
|
Some files were not shown because too many files have changed in this diff Show More
Loading…
Reference in New Issue
Block a user